2024-05-21T13:22:06.673 INFO:root:teuthology version: 0.0.1.dev276+g4fbe5e8 2024-05-21T13:22:06.673 DEBUG:teuthology.run:Teuthology command: teuthology --name leonidus-2024-05-21_13:01:15-fs-wip-lusov-quiesce-overdrive-export-distro-default-smithi --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/with-quiesce 2-workunit/suites/iozone}} --archive /home/teuthworker/archive/leonidus-2024-05-21_13:01:15-fs-wip-lusov-quiesce-overdrive-export-distro-default-smithi/7718504 --owner scheduled_leonidus@teuthology --verbose -- /home/teuthworker/archive/leonidus-2024-05-21_13:01:15-fs-wip-lusov-quiesce-overdrive-export-distro-default-smithi/7718504/orig.config.yaml 2024-05-21T13:22:06.721 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-21T13:22:06.811 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/leonidus-2024-05-21_13:01:15-fs-wip-lusov-quiesce-overdrive-export-distro-default-smithi/7718504 branch: wip-lusov-quiesce-overdrive-export description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/with-quiesce 2-workunit/suites/iozone}} email: null first_in_suite: false job_id: '7718504' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: leonidus-2024-05-21_13:01:15-fs-wip-lusov-quiesce-overdrive-export-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-lusov-quiesce-overdrive-export ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 3 session_timeout: 300 conf: client: client mount timeout: 600 client_shutdown_timeout: 120 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds oft prefetch dirfrags: true mds op complaint time: 180 mds verify scatter: true mds_dir_prefetch: true mds_sleep_rank_change: 5000000.0 mon client directed command retry: 5 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: client mds osd ms inject socket failures: 2500 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore compression mode: aggressive bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon client directed command retry: 5 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: client mds ms inject socket failures: 2500 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum sha1: 7956b5e965f6ee5669688b5643c11d881b72442c ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} check-counter: counters: mds: - mds.exported - mds.imported install: ceph: flavor: default sha1: 7956b5e965f6ee5669688b5643c11d881b72442c thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-lusov-quiesce-overdrive-export sha1: 7956b5e965f6ee5669688b5643c11d881b72442c owner: scheduled_leonidus@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 5442 sha1: 7956b5e965f6ee5669688b5643c11d881b72442c sleep_before_teardown: 0 subset: 941/111111 suite: fs suite_branch: wip-lusov-quiesce-overdrive-export suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_7956b5e965f6ee5669688b5643c11d881b72442c/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 7956b5e965f6ee5669688b5643c11d881b72442c syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi022.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHJqrrsETYNb+VzHcB6nvWtPiszHYKly9hXL0CJJSHqGK1WBhk5LQWtrYNCc7n2FVHhfvGhp/HTpLWIWx/ZnMWs= smithi115.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM7NYN4uE55xoFgGohPtMRi+uQV95aBIvaSJHKV4zXyU+bQot8U5vhZH1uh86SVQVoXKiBt2VC/xwBIEk6ED9hU= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - ceph-fuse: null - quiescer: null - workunit: clients: all: - suites/iozone.sh teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: install-fix teuthology_sha1: 4fbe5e8dc899215f216853b8569a107d8be8861d timestamp: 2024-05-21_13:01:15 tube: smithi user: leonidus verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2698841 2024-05-21T13:22:06.811 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_7956b5e965f6ee5669688b5643c11d881b72442c/qa; will attempt to use it 2024-05-21T13:22:06.812 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_7956b5e965f6ee5669688b5643c11d881b72442c/qa/tasks 2024-05-21T13:22:06.812 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-21T13:22:06.814 INFO:teuthology.task.internal:Checking packages... 2024-05-21T13:22:06.834 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '7956b5e965f6ee5669688b5643c11d881b72442c' 2024-05-21T13:22:06.834 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-21T13:22:06.834 INFO:teuthology.packaging:ref: None 2024-05-21T13:22:06.835 INFO:teuthology.packaging:tag: None 2024-05-21T13:22:06.835 INFO:teuthology.packaging:branch: wip-lusov-quiesce-overdrive-export 2024-05-21T13:22:06.835 INFO:teuthology.packaging:sha1: 7956b5e965f6ee5669688b5643c11d881b72442c 2024-05-21T13:22:06.835 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-lusov-quiesce-overdrive-export 2024-05-21T13:22:06.977 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3857-g7956b5e9-1jammy 2024-05-21T13:22:06.979 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-21T13:22:06.986 INFO:teuthology.task.internal:no buildpackages task found 2024-05-21T13:22:06.986 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-21T13:22:07.099 INFO:teuthology.task.internal:Saving configuration 2024-05-21T13:22:07.117 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-21T13:22:07.197 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-21T13:22:07.219 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi022.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-05-21_13:01:15-fs-wip-lusov-quiesce-overdrive-export-distro-default-smithi/7718504', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-21 13:16:35.077521', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIHFfger2npateqXreYZiIGs/R4Jm+MkMjSgcJMZx4qRb'} 2024-05-21T13:22:07.244 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi115.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-05-21_13:01:15-fs-wip-lusov-quiesce-overdrive-export-distro-default-smithi/7718504', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-21 13:16:35.079268', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOTKEUdgy4/pIAJfIbTnn8C7Sv6eFDi8yeaA8npuIKfd'} 2024-05-21T13:22:07.245 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-21T13:22:07.263 INFO:teuthology.task.internal:roles: ubuntu@smithi022.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-05-21T13:22:07.263 INFO:teuthology.task.internal:roles: ubuntu@smithi115.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-05-21T13:22:07.263 INFO:teuthology.run_tasks:Running task console_log... 2024-05-21T13:22:07.390 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f98c270eb90>, signals=[15]) 2024-05-21T13:22:07.390 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-21T13:22:07.395 INFO:teuthology.task.internal:Opening connections... 2024-05-21T13:22:07.395 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi022.front.sepia.ceph.com 2024-05-21T13:22:07.396 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-21T13:22:07.478 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi115.front.sepia.ceph.com 2024-05-21T13:22:07.479 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-21T13:22:07.557 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-21T13:22:07.564 DEBUG:teuthology.orchestra.run.smithi022:> uname -m 2024-05-21T13:22:07.569 INFO:teuthology.orchestra.run.smithi022.stdout:x86_64 2024-05-21T13:22:07.569 DEBUG:teuthology.orchestra.run.smithi022:> cat /etc/os-release 2024-05-21T13:22:07.614 INFO:teuthology.orchestra.run.smithi022.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-05-21T13:22:07.614 INFO:teuthology.orchestra.run.smithi022.stdout:NAME="Ubuntu" 2024-05-21T13:22:07.614 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION_ID="22.04" 2024-05-21T13:22:07.615 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-05-21T13:22:07.615 INFO:teuthology.orchestra.run.smithi022.stdout:VERSION_CODENAME=jammy 2024-05-21T13:22:07.615 INFO:teuthology.orchestra.run.smithi022.stdout:ID=ubuntu 2024-05-21T13:22:07.615 INFO:teuthology.orchestra.run.smithi022.stdout:ID_LIKE=debian 2024-05-21T13:22:07.615 INFO:teuthology.orchestra.run.smithi022.stdout:HOME_URL="https://www.ubuntu.com/" 2024-05-21T13:22:07.615 INFO:teuthology.orchestra.run.smithi022.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-05-21T13:22:07.615 INFO:teuthology.orchestra.run.smithi022.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-05-21T13:22:07.615 INFO:teuthology.orchestra.run.smithi022.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-05-21T13:22:07.615 INFO:teuthology.orchestra.run.smithi022.stdout:UBUNTU_CODENAME=jammy 2024-05-21T13:22:07.616 INFO:teuthology.lock.ops:Updating smithi022.front.sepia.ceph.com on lock server 2024-05-21T13:22:07.640 DEBUG:teuthology.orchestra.run.smithi115:> uname -m 2024-05-21T13:22:07.644 INFO:teuthology.orchestra.run.smithi115.stdout:x86_64 2024-05-21T13:22:07.645 DEBUG:teuthology.orchestra.run.smithi115:> cat /etc/os-release 2024-05-21T13:22:07.690 INFO:teuthology.orchestra.run.smithi115.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-05-21T13:22:07.690 INFO:teuthology.orchestra.run.smithi115.stdout:NAME="Ubuntu" 2024-05-21T13:22:07.690 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION_ID="22.04" 2024-05-21T13:22:07.690 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-05-21T13:22:07.690 INFO:teuthology.orchestra.run.smithi115.stdout:VERSION_CODENAME=jammy 2024-05-21T13:22:07.690 INFO:teuthology.orchestra.run.smithi115.stdout:ID=ubuntu 2024-05-21T13:22:07.691 INFO:teuthology.orchestra.run.smithi115.stdout:ID_LIKE=debian 2024-05-21T13:22:07.691 INFO:teuthology.orchestra.run.smithi115.stdout:HOME_URL="https://www.ubuntu.com/" 2024-05-21T13:22:07.691 INFO:teuthology.orchestra.run.smithi115.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-05-21T13:22:07.691 INFO:teuthology.orchestra.run.smithi115.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-05-21T13:22:07.691 INFO:teuthology.orchestra.run.smithi115.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-05-21T13:22:07.691 INFO:teuthology.orchestra.run.smithi115.stdout:UBUNTU_CODENAME=jammy 2024-05-21T13:22:07.691 INFO:teuthology.lock.ops:Updating smithi115.front.sepia.ceph.com on lock server 2024-05-21T13:22:07.715 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-21T13:22:07.725 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-21T13:22:07.897 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-21T13:22:07.897 DEBUG:teuthology.orchestra.run.smithi022:> test '!' -e /home/ubuntu/cephtest 2024-05-21T13:22:07.900 DEBUG:teuthology.orchestra.run.smithi115:> test '!' -e /home/ubuntu/cephtest 2024-05-21T13:22:07.904 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-21T13:22:08.037 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-21T13:22:08.037 DEBUG:teuthology.orchestra.run.smithi022:> test -z $(ls -A /var/lib/ceph) 2024-05-21T13:22:08.039 DEBUG:teuthology.orchestra.run.smithi115:> test -z $(ls -A /var/lib/ceph) 2024-05-21T13:22:08.047 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-21T13:22:08.183 INFO:teuthology.run_tasks:Running task kernel... 2024-05-21T13:22:08.236 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-05-21T13:22:08.237 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-05-21T13:22:08.237 DEBUG:teuthology.orchestra.run.smithi022:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-21T13:22:08.238 DEBUG:teuthology.orchestra.run.smithi115:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-21T13:22:08.242 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-21T13:22:08.242 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-21T13:22:08.243 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-05-21T13:22:08.243 DEBUG:teuthology.orchestra.run.smithi022:> uname -r 2024-05-21T13:22:08.291 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-56-generic 2024-05-21T13:22:08.291 INFO:teuthology.task.kernel:Running kernel on smithi115: 5.15.0-56-generic 2024-05-21T13:22:08.291 DEBUG:teuthology.orchestra.run.smithi115:> sudo apt-get clean 2024-05-21T13:22:08.292 INFO:teuthology.orchestra.run.smithi022.stdout:5.15.0-56-generic 2024-05-21T13:22:08.292 INFO:teuthology.task.kernel:Running kernel on smithi022: 5.15.0-56-generic 2024-05-21T13:22:08.292 DEBUG:teuthology.orchestra.run.smithi022:> sudo apt-get clean 2024-05-21T13:22:08.412 DEBUG:teuthology.orchestra.run.smithi022:> sudo apt-get update 2024-05-21T13:22:08.428 DEBUG:teuthology.orchestra.run.smithi115:> sudo apt-get update 2024-05-21T13:22:08.605 INFO:teuthology.orchestra.run.smithi022.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-21T13:22:08.605 INFO:teuthology.orchestra.run.smithi022.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-05-21T13:22:08.627 INFO:teuthology.orchestra.run.smithi022.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-05-21T13:22:08.697 INFO:teuthology.orchestra.run.smithi115.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-21T13:22:08.697 INFO:teuthology.orchestra.run.smithi115.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-05-21T13:22:08.755 INFO:teuthology.orchestra.run.smithi115.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-05-21T13:22:08.793 INFO:teuthology.orchestra.run.smithi022.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-05-21T13:22:08.856 INFO:teuthology.orchestra.run.smithi022.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [470 kB] 2024-05-21T13:22:08.941 INFO:teuthology.orchestra.run.smithi022.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,681 kB] 2024-05-21T13:22:09.002 INFO:teuthology.orchestra.run.smithi022.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,470 kB] 2024-05-21T13:22:09.107 INFO:teuthology.orchestra.run.smithi115.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,470 kB] 2024-05-21T13:22:09.110 INFO:teuthology.orchestra.run.smithi022.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [253 kB] 2024-05-21T13:22:09.119 INFO:teuthology.orchestra.run.smithi022.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-05-21T13:22:09.120 INFO:teuthology.orchestra.run.smithi022.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,871 kB] 2024-05-21T13:22:09.120 INFO:teuthology.orchestra.run.smithi115.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-05-21T13:22:09.209 INFO:teuthology.orchestra.run.smithi022.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-05-21T13:22:09.210 INFO:teuthology.orchestra.run.smithi022.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [317 kB] 2024-05-21T13:22:09.217 INFO:teuthology.orchestra.run.smithi022.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-05-21T13:22:09.217 INFO:teuthology.orchestra.run.smithi022.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [603 kB] 2024-05-21T13:22:09.227 INFO:teuthology.orchestra.run.smithi022.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [852 kB] 2024-05-21T13:22:09.234 INFO:teuthology.orchestra.run.smithi022.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [631 kB] 2024-05-21T13:22:09.239 INFO:teuthology.orchestra.run.smithi022.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [164 kB] 2024-05-21T13:22:09.241 INFO:teuthology.orchestra.run.smithi022.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-05-21T13:22:09.242 INFO:teuthology.orchestra.run.smithi022.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-05-21T13:22:09.258 INFO:teuthology.orchestra.run.smithi115.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [631 kB] 2024-05-21T13:22:09.261 INFO:teuthology.orchestra.run.smithi022.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [311 kB] 2024-05-21T13:22:09.261 INFO:teuthology.orchestra.run.smithi022.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-05-21T13:22:09.268 INFO:teuthology.orchestra.run.smithi022.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-05-21T13:22:09.269 INFO:teuthology.orchestra.run.smithi022.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-05-21T13:22:09.271 INFO:teuthology.orchestra.run.smithi022.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,928 kB] 2024-05-21T13:22:09.330 INFO:teuthology.orchestra.run.smithi022.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [327 kB] 2024-05-21T13:22:09.337 INFO:teuthology.orchestra.run.smithi022.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-05-21T13:22:09.337 INFO:teuthology.orchestra.run.smithi022.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,074 kB] 2024-05-21T13:22:09.341 INFO:teuthology.orchestra.run.smithi022.stdout:Get:28 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-05-21T13:22:09.342 INFO:teuthology.orchestra.run.smithi022.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-05-21T13:22:09.361 INFO:teuthology.orchestra.run.smithi022.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [702 kB] 2024-05-21T13:22:09.375 INFO:teuthology.orchestra.run.smithi022.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [246 kB] 2024-05-21T13:22:09.380 INFO:teuthology.orchestra.run.smithi022.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-05-21T13:22:09.380 INFO:teuthology.orchestra.run.smithi022.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-05-21T13:22:09.381 INFO:teuthology.orchestra.run.smithi022.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-05-21T13:22:09.381 INFO:teuthology.orchestra.run.smithi022.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-05-21T13:22:09.405 INFO:teuthology.orchestra.run.smithi022.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-05-21T13:22:09.405 INFO:teuthology.orchestra.run.smithi022.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-05-21T13:22:09.407 INFO:teuthology.orchestra.run.smithi022.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.3 kB] 2024-05-21T13:22:09.421 INFO:teuthology.orchestra.run.smithi022.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-05-21T13:22:09.421 INFO:teuthology.orchestra.run.smithi022.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-05-21T13:22:09.422 INFO:teuthology.orchestra.run.smithi022.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.2 kB] 2024-05-21T13:22:09.422 INFO:teuthology.orchestra.run.smithi022.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [16.0 kB] 2024-05-21T13:22:09.422 INFO:teuthology.orchestra.run.smithi022.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-05-21T13:22:09.438 INFO:teuthology.orchestra.run.smithi022.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-05-21T13:22:09.460 INFO:teuthology.orchestra.run.smithi115.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,681 kB] 2024-05-21T13:22:09.536 INFO:teuthology.orchestra.run.smithi115.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [470 kB] 2024-05-21T13:22:09.554 INFO:teuthology.orchestra.run.smithi115.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [253 kB] 2024-05-21T13:22:09.563 INFO:teuthology.orchestra.run.smithi115.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-05-21T13:22:09.563 INFO:teuthology.orchestra.run.smithi115.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,871 kB] 2024-05-21T13:22:09.613 INFO:teuthology.orchestra.run.smithi115.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [311 kB] 2024-05-21T13:22:09.628 INFO:teuthology.orchestra.run.smithi115.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-05-21T13:22:09.629 INFO:teuthology.orchestra.run.smithi115.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-05-21T13:22:09.630 INFO:teuthology.orchestra.run.smithi115.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,928 kB] 2024-05-21T13:22:09.657 INFO:teuthology.orchestra.run.smithi115.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-05-21T13:22:09.658 INFO:teuthology.orchestra.run.smithi115.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [317 kB] 2024-05-21T13:22:09.669 INFO:teuthology.orchestra.run.smithi115.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-05-21T13:22:09.670 INFO:teuthology.orchestra.run.smithi115.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [603 kB] 2024-05-21T13:22:09.717 INFO:teuthology.orchestra.run.smithi115.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [327 kB] 2024-05-21T13:22:09.717 INFO:teuthology.orchestra.run.smithi115.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [852 kB] 2024-05-21T13:22:09.723 INFO:teuthology.orchestra.run.smithi115.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-05-21T13:22:09.888 INFO:teuthology.orchestra.run.smithi115.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,074 kB] 2024-05-21T13:22:09.888 INFO:teuthology.orchestra.run.smithi115.stdout:Get:24 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [164 kB] 2024-05-21T13:22:10.294 INFO:teuthology.orchestra.run.smithi115.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-05-21T13:22:10.300 INFO:teuthology.orchestra.run.smithi115.stdout:Get:26 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-05-21T13:22:10.301 INFO:teuthology.orchestra.run.smithi115.stdout:Get:27 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-05-21T13:22:10.314 INFO:teuthology.orchestra.run.smithi115.stdout:Get:28 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-05-21T13:22:10.317 INFO:teuthology.orchestra.run.smithi115.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-05-21T13:22:10.520 INFO:teuthology.orchestra.run.smithi115.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [702 kB] 2024-05-21T13:22:10.557 INFO:teuthology.orchestra.run.smithi115.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [246 kB] 2024-05-21T13:22:10.570 INFO:teuthology.orchestra.run.smithi115.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-05-21T13:22:10.571 INFO:teuthology.orchestra.run.smithi115.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-05-21T13:22:10.573 INFO:teuthology.orchestra.run.smithi115.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-05-21T13:22:10.573 INFO:teuthology.orchestra.run.smithi115.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-05-21T13:22:10.574 INFO:teuthology.orchestra.run.smithi115.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-05-21T13:22:10.575 INFO:teuthology.orchestra.run.smithi115.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.3 kB] 2024-05-21T13:22:10.601 INFO:teuthology.orchestra.run.smithi115.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-05-21T13:22:10.604 INFO:teuthology.orchestra.run.smithi115.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-05-21T13:22:10.769 INFO:teuthology.orchestra.run.smithi115.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-05-21T13:22:10.851 INFO:teuthology.orchestra.run.smithi115.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [16.0 kB] 2024-05-21T13:22:10.933 INFO:teuthology.orchestra.run.smithi115.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.2 kB] 2024-05-21T13:22:11.014 INFO:teuthology.orchestra.run.smithi115.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-05-21T13:22:11.043 INFO:teuthology.orchestra.run.smithi115.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-05-21T13:22:15.050 INFO:teuthology.orchestra.run.smithi022.stdout:Fetched 13.7 MB in 2s (6,337 kB/s) 2024-05-21T13:22:15.325 INFO:teuthology.orchestra.run.smithi115.stdout:Fetched 13.7 MB in 3s (5,360 kB/s) 2024-05-21T13:22:16.460 INFO:teuthology.orchestra.run.smithi022.stdout:Reading package lists... 2024-05-21T13:22:16.478 DEBUG:teuthology.orchestra.run.smithi022:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-05-21T13:22:16.544 INFO:teuthology.orchestra.run.smithi022.stdout:Reading package lists... 2024-05-21T13:22:16.738 INFO:teuthology.orchestra.run.smithi115.stdout:Reading package lists... 2024-05-21T13:22:16.750 INFO:teuthology.orchestra.run.smithi022.stdout:Building dependency tree... 2024-05-21T13:22:16.750 INFO:teuthology.orchestra.run.smithi022.stdout:Reading state information... 2024-05-21T13:22:16.755 DEBUG:teuthology.orchestra.run.smithi115:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-05-21T13:22:16.807 INFO:teuthology.orchestra.run.smithi115.stdout:Reading package lists... 2024-05-21T13:22:16.924 INFO:teuthology.orchestra.run.smithi022.stdout:The following packages were automatically installed and are no longer required: 2024-05-21T13:22:16.924 INFO:teuthology.orchestra.run.smithi022.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-21T13:22:16.924 INFO:teuthology.orchestra.run.smithi022.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-21T13:22:16.924 INFO:teuthology.orchestra.run.smithi022.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-21T13:22:16.925 INFO:teuthology.orchestra.run.smithi022.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-05-21T13:22:16.925 INFO:teuthology.orchestra.run.smithi022.stdout: python2.7-minimal 2024-05-21T13:22:16.925 INFO:teuthology.orchestra.run.smithi022.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-21T13:22:16.926 INFO:teuthology.orchestra.run.smithi022.stdout:The following additional packages will be installed: 2024-05-21T13:22:16.926 INFO:teuthology.orchestra.run.smithi022.stdout: linux-generic linux-headers-5.15.0-107 linux-headers-5.15.0-107-generic 2024-05-21T13:22:16.926 INFO:teuthology.orchestra.run.smithi022.stdout: linux-headers-generic linux-image-5.15.0-107-generic 2024-05-21T13:22:16.926 INFO:teuthology.orchestra.run.smithi022.stdout: linux-modules-5.15.0-107-generic linux-modules-extra-5.15.0-107-generic 2024-05-21T13:22:16.927 INFO:teuthology.orchestra.run.smithi022.stdout:Suggested packages: 2024-05-21T13:22:16.927 INFO:teuthology.orchestra.run.smithi022.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-05-21T13:22:16.927 INFO:teuthology.orchestra.run.smithi022.stdout:Recommended packages: 2024-05-21T13:22:16.928 INFO:teuthology.orchestra.run.smithi022.stdout: thermald 2024-05-21T13:22:16.970 INFO:teuthology.orchestra.run.smithi022.stdout:The following NEW packages will be installed: 2024-05-21T13:22:16.970 INFO:teuthology.orchestra.run.smithi022.stdout: linux-headers-5.15.0-107 linux-headers-5.15.0-107-generic 2024-05-21T13:22:16.970 INFO:teuthology.orchestra.run.smithi022.stdout: linux-image-5.15.0-107-generic linux-modules-5.15.0-107-generic 2024-05-21T13:22:16.970 INFO:teuthology.orchestra.run.smithi022.stdout: linux-modules-extra-5.15.0-107-generic 2024-05-21T13:22:16.970 INFO:teuthology.orchestra.run.smithi022.stdout:The following packages will be upgraded: 2024-05-21T13:22:16.971 INFO:teuthology.orchestra.run.smithi022.stdout: linux-generic linux-headers-generic linux-image-generic 2024-05-21T13:22:16.986 INFO:teuthology.orchestra.run.smithi115.stdout:Building dependency tree... 2024-05-21T13:22:16.986 INFO:teuthology.orchestra.run.smithi115.stdout:Reading state information... 2024-05-21T13:22:17.028 INFO:teuthology.orchestra.run.smithi022.stdout:3 upgraded, 5 newly installed, 0 to remove and 320 not upgraded. 2024-05-21T13:22:17.028 INFO:teuthology.orchestra.run.smithi022.stdout:Need to get 113 MB of archives. 2024-05-21T13:22:17.028 INFO:teuthology.orchestra.run.smithi022.stdout:After this operation, 583 MB of additional disk space will be used. 2024-05-21T13:22:17.029 INFO:teuthology.orchestra.run.smithi022.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-107-generic amd64 5.15.0-107.117 [22.7 MB] 2024-05-21T13:22:17.143 INFO:teuthology.orchestra.run.smithi115.stdout:The following packages were automatically installed and are no longer required: 2024-05-21T13:22:17.143 INFO:teuthology.orchestra.run.smithi115.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-21T13:22:17.143 INFO:teuthology.orchestra.run.smithi115.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-21T13:22:17.144 INFO:teuthology.orchestra.run.smithi115.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-21T13:22:17.144 INFO:teuthology.orchestra.run.smithi115.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-05-21T13:22:17.144 INFO:teuthology.orchestra.run.smithi115.stdout: python2.7-minimal 2024-05-21T13:22:17.144 INFO:teuthology.orchestra.run.smithi115.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-21T13:22:17.146 INFO:teuthology.orchestra.run.smithi115.stdout:The following additional packages will be installed: 2024-05-21T13:22:17.146 INFO:teuthology.orchestra.run.smithi115.stdout: linux-generic linux-headers-5.15.0-107 linux-headers-5.15.0-107-generic 2024-05-21T13:22:17.146 INFO:teuthology.orchestra.run.smithi115.stdout: linux-headers-generic linux-image-5.15.0-107-generic 2024-05-21T13:22:17.147 INFO:teuthology.orchestra.run.smithi115.stdout: linux-modules-5.15.0-107-generic linux-modules-extra-5.15.0-107-generic 2024-05-21T13:22:17.147 INFO:teuthology.orchestra.run.smithi115.stdout:Suggested packages: 2024-05-21T13:22:17.147 INFO:teuthology.orchestra.run.smithi115.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-05-21T13:22:17.148 INFO:teuthology.orchestra.run.smithi115.stdout:Recommended packages: 2024-05-21T13:22:17.148 INFO:teuthology.orchestra.run.smithi115.stdout: thermald 2024-05-21T13:22:17.193 INFO:teuthology.orchestra.run.smithi115.stdout:The following NEW packages will be installed: 2024-05-21T13:22:17.193 INFO:teuthology.orchestra.run.smithi115.stdout: linux-headers-5.15.0-107 linux-headers-5.15.0-107-generic 2024-05-21T13:22:17.193 INFO:teuthology.orchestra.run.smithi115.stdout: linux-image-5.15.0-107-generic linux-modules-5.15.0-107-generic 2024-05-21T13:22:17.193 INFO:teuthology.orchestra.run.smithi115.stdout: linux-modules-extra-5.15.0-107-generic 2024-05-21T13:22:17.194 INFO:teuthology.orchestra.run.smithi115.stdout:The following packages will be upgraded: 2024-05-21T13:22:17.194 INFO:teuthology.orchestra.run.smithi115.stdout: linux-generic linux-headers-generic linux-image-generic 2024-05-21T13:22:17.373 INFO:teuthology.orchestra.run.smithi115.stdout:3 upgraded, 5 newly installed, 0 to remove and 320 not upgraded. 2024-05-21T13:22:17.374 INFO:teuthology.orchestra.run.smithi115.stdout:Need to get 113 MB of archives. 2024-05-21T13:22:17.374 INFO:teuthology.orchestra.run.smithi115.stdout:After this operation, 583 MB of additional disk space will be used. 2024-05-21T13:22:17.374 INFO:teuthology.orchestra.run.smithi115.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-107-generic amd64 5.15.0-107.117 [22.7 MB] 2024-05-21T13:22:17.697 INFO:teuthology.orchestra.run.smithi022.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-107-generic amd64 5.15.0-107.117 [11.5 MB] 2024-05-21T13:22:17.845 INFO:teuthology.orchestra.run.smithi022.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-107-generic amd64 5.15.0-107.117 [63.9 MB] 2024-05-21T13:22:18.788 INFO:teuthology.orchestra.run.smithi115.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-107-generic amd64 5.15.0-107.117 [11.5 MB] 2024-05-21T13:22:19.001 INFO:teuthology.orchestra.run.smithi022.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.107.107 [1,694 B] 2024-05-21T13:22:19.001 INFO:teuthology.orchestra.run.smithi022.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.107.107 [2,496 B] 2024-05-21T13:22:19.001 INFO:teuthology.orchestra.run.smithi022.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-107 all 5.15.0-107.117 [12.3 MB] 2024-05-21T13:22:19.139 INFO:teuthology.orchestra.run.smithi115.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-107-generic amd64 5.15.0-107.117 [63.9 MB] 2024-05-21T13:22:19.191 INFO:teuthology.orchestra.run.smithi022.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-107-generic amd64 5.15.0-107.117 [2,887 kB] 2024-05-21T13:22:19.231 INFO:teuthology.orchestra.run.smithi022.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.107.107 [2,354 B] 2024-05-21T13:22:19.651 INFO:teuthology.orchestra.run.smithi022.stdout:Fetched 113 MB in 2s (50.3 MB/s) 2024-05-21T13:22:19.834 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package linux-modules-5.15.0-107-generic. 2024-05-21T13:22:21.430 INFO:teuthology.orchestra.run.smithi115.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.107.107 [1,694 B] 2024-05-21T13:22:21.430 INFO:teuthology.orchestra.run.smithi115.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.107.107 [2,496 B] 2024-05-21T13:22:21.431 INFO:teuthology.orchestra.run.smithi115.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-107 all 5.15.0-107.117 [12.3 MB] 2024-05-21T13:22:21.877 INFO:teuthology.orchestra.run.smithi022.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-05-21T13:22:21.882 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../0-linux-modules-5.15.0-107-generic_5.15.0-107.117_amd64.deb ... 2024-05-21T13:22:21.966 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking linux-modules-5.15.0-107-generic (5.15.0-107.117) ... 2024-05-21T13:22:22.193 INFO:teuthology.orchestra.run.smithi115.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-107-generic amd64 5.15.0-107.117 [2,887 kB] 2024-05-21T13:22:22.252 INFO:teuthology.orchestra.run.smithi115.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.107.107 [2,354 B] 2024-05-21T13:22:22.627 INFO:teuthology.orchestra.run.smithi115.stdout:Fetched 113 MB in 5s (22.4 MB/s) 2024-05-21T13:22:22.822 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package linux-modules-5.15.0-107-generic. 2024-05-21T13:22:23.935 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package linux-image-5.15.0-107-generic. 2024-05-21T13:22:23.957 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../1-linux-image-5.15.0-107-generic_5.15.0-107.117_amd64.deb ... 2024-05-21T13:22:24.046 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking linux-image-5.15.0-107-generic (5.15.0-107.117) ... 2024-05-21T13:22:24.504 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-107-generic. 2024-05-21T13:22:24.526 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-107-generic_5.15.0-107.117_amd64.deb ... 2024-05-21T13:22:24.563 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking linux-modules-extra-5.15.0-107-generic (5.15.0-107.117) ... 2024-05-21T13:22:24.860 INFO:teuthology.orchestra.run.smithi115.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-05-21T13:22:24.864 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../0-linux-modules-5.15.0-107-generic_5.15.0-107.117_amd64.deb ... 2024-05-21T13:22:24.960 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking linux-modules-5.15.0-107-generic (5.15.0-107.117) ... 2024-05-21T13:22:27.270 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package linux-image-5.15.0-107-generic. 2024-05-21T13:22:27.291 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../1-linux-image-5.15.0-107-generic_5.15.0-107.117_amd64.deb ... 2024-05-21T13:22:27.383 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking linux-image-5.15.0-107-generic (5.15.0-107.117) ... 2024-05-21T13:22:27.865 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-107-generic. 2024-05-21T13:22:27.885 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-107-generic_5.15.0-107.117_amd64.deb ... 2024-05-21T13:22:27.923 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking linux-modules-extra-5.15.0-107-generic (5.15.0-107.117) ... 2024-05-21T13:22:31.196 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../3-linux-generic_5.15.0.107.107_amd64.deb ... 2024-05-21T13:22:31.312 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking linux-generic (5.15.0.107.107) over (5.15.0.56.54) ... 2024-05-21T13:22:31.654 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.107.107_amd64.deb ... 2024-05-21T13:22:31.782 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking linux-image-generic (5.15.0.107.107) over (5.15.0.56.54) ... 2024-05-21T13:22:32.101 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package linux-headers-5.15.0-107. 2024-05-21T13:22:32.125 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../5-linux-headers-5.15.0-107_5.15.0-107.117_all.deb ... 2024-05-21T13:22:32.159 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking linux-headers-5.15.0-107 (5.15.0-107.117) ... 2024-05-21T13:22:34.781 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../3-linux-generic_5.15.0.107.107_amd64.deb ... 2024-05-21T13:22:34.908 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking linux-generic (5.15.0.107.107) over (5.15.0.56.54) ... 2024-05-21T13:22:35.225 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.107.107_amd64.deb ... 2024-05-21T13:22:35.328 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking linux-image-generic (5.15.0.107.107) over (5.15.0.56.54) ... 2024-05-21T13:22:35.639 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package linux-headers-5.15.0-107. 2024-05-21T13:22:35.662 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../5-linux-headers-5.15.0-107_5.15.0-107.117_all.deb ... 2024-05-21T13:22:35.706 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking linux-headers-5.15.0-107 (5.15.0-107.117) ... 2024-05-21T13:22:37.579 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package linux-headers-5.15.0-107-generic. 2024-05-21T13:22:37.616 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../6-linux-headers-5.15.0-107-generic_5.15.0-107.117_amd64.deb ... 2024-05-21T13:22:37.654 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking linux-headers-5.15.0-107-generic (5.15.0-107.117) ... 2024-05-21T13:22:40.709 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.107.107_amd64.deb ... 2024-05-21T13:22:40.832 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking linux-headers-generic (5.15.0.107.107) over (5.15.0.56.54) ... 2024-05-21T13:22:41.173 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up linux-headers-5.15.0-107 (5.15.0-107.117) ... 2024-05-21T13:22:41.302 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up linux-headers-5.15.0-107-generic (5.15.0-107.117) ... 2024-05-21T13:22:41.428 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up linux-headers-generic (5.15.0.107.107) ... 2024-05-21T13:22:41.558 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up linux-image-5.15.0-107-generic (5.15.0-107.117) ... 2024-05-21T13:22:41.784 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package linux-headers-5.15.0-107-generic. 2024-05-21T13:22:41.820 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../6-linux-headers-5.15.0-107-generic_5.15.0-107.117_amd64.deb ... 2024-05-21T13:22:41.858 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking linux-headers-5.15.0-107-generic (5.15.0-107.117) ... 2024-05-21T13:22:42.928 INFO:teuthology.orchestra.run.smithi022.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-05-21T13:22:42.928 INFO:teuthology.orchestra.run.smithi022.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-05-21T13:22:42.928 INFO:teuthology.orchestra.run.smithi022.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-107-generic 2024-05-21T13:22:42.928 INFO:teuthology.orchestra.run.smithi022.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-107-generic 2024-05-21T13:22:43.093 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up linux-modules-extra-5.15.0-107-generic (5.15.0-107.117) ... 2024-05-21T13:22:44.918 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up linux-modules-5.15.0-107-generic (5.15.0-107.117) ... 2024-05-21T13:22:45.364 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.107.107_amd64.deb ... 2024-05-21T13:22:45.493 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking linux-headers-generic (5.15.0.107.107) over (5.15.0.56.54) ... 2024-05-21T13:22:45.851 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up linux-headers-5.15.0-107 (5.15.0-107.117) ... 2024-05-21T13:22:45.973 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up linux-headers-5.15.0-107-generic (5.15.0-107.117) ... 2024-05-21T13:22:46.099 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up linux-headers-generic (5.15.0.107.107) ... 2024-05-21T13:22:46.228 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up linux-image-5.15.0-107-generic (5.15.0-107.117) ... 2024-05-21T13:22:46.345 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up linux-image-generic (5.15.0.107.107) ... 2024-05-21T13:22:46.479 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up linux-generic (5.15.0.107.107) ... 2024-05-21T13:22:46.605 INFO:teuthology.orchestra.run.smithi022.stdout:Processing triggers for linux-image-5.15.0-107-generic (5.15.0-107.117) ... 2024-05-21T13:22:46.679 INFO:teuthology.orchestra.run.smithi022.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-05-21T13:22:46.679 INFO:teuthology.orchestra.run.smithi022.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-107-generic 2024-05-21T13:22:47.553 INFO:teuthology.orchestra.run.smithi115.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-05-21T13:22:47.553 INFO:teuthology.orchestra.run.smithi115.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-05-21T13:22:47.553 INFO:teuthology.orchestra.run.smithi115.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-107-generic 2024-05-21T13:22:47.553 INFO:teuthology.orchestra.run.smithi115.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-107-generic 2024-05-21T13:22:47.738 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up linux-modules-extra-5.15.0-107-generic (5.15.0-107.117) ... 2024-05-21T13:22:49.163 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up linux-modules-5.15.0-107-generic (5.15.0-107.117) ... 2024-05-21T13:22:50.906 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up linux-image-generic (5.15.0.107.107) ... 2024-05-21T13:22:51.007 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up linux-generic (5.15.0.107.107) ... 2024-05-21T13:22:51.133 INFO:teuthology.orchestra.run.smithi115.stdout:Processing triggers for linux-image-5.15.0-107-generic (5.15.0-107.117) ... 2024-05-21T13:22:51.183 INFO:teuthology.orchestra.run.smithi115.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-05-21T13:22:51.183 INFO:teuthology.orchestra.run.smithi115.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-107-generic 2024-05-21T13:23:01.431 INFO:teuthology.orchestra.run.smithi022.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-05-21T13:23:01.431 INFO:teuthology.orchestra.run.smithi022.stdout:Sourcing file `/etc/default/grub' 2024-05-21T13:23:01.441 INFO:teuthology.orchestra.run.smithi022.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-21T13:23:01.483 INFO:teuthology.orchestra.run.smithi022.stdout:Generating grub configuration file ... 2024-05-21T13:23:01.752 INFO:teuthology.orchestra.run.smithi022.stdout:Found linux image: /boot/vmlinuz-5.15.0-107-generic 2024-05-21T13:23:01.771 INFO:teuthology.orchestra.run.smithi022.stdout:Found initrd image: /boot/initrd.img-5.15.0-107-generic 2024-05-21T13:23:02.081 INFO:teuthology.orchestra.run.smithi022.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-05-21T13:23:02.087 INFO:teuthology.orchestra.run.smithi022.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-05-21T13:23:02.160 INFO:teuthology.orchestra.run.smithi022.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-05-21T13:23:02.166 INFO:teuthology.orchestra.run.smithi022.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-05-21T13:23:02.345 INFO:teuthology.orchestra.run.smithi022.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-05-21T13:23:02.346 INFO:teuthology.orchestra.run.smithi022.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-05-21T13:23:02.346 INFO:teuthology.orchestra.run.smithi022.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-05-21T13:23:02.379 INFO:teuthology.orchestra.run.smithi022.stdout:done 2024-05-21T13:23:02.838 DEBUG:teuthology.orchestra.run.smithi022:> dpkg -s linux-image-generic 2024-05-21T13:23:02.862 INFO:teuthology.orchestra.run.smithi022.stdout:Package: linux-image-generic 2024-05-21T13:23:02.862 INFO:teuthology.orchestra.run.smithi022.stdout:Status: install ok installed 2024-05-21T13:23:02.863 INFO:teuthology.orchestra.run.smithi022.stdout:Priority: optional 2024-05-21T13:23:02.863 INFO:teuthology.orchestra.run.smithi022.stdout:Section: kernel 2024-05-21T13:23:02.863 INFO:teuthology.orchestra.run.smithi022.stdout:Installed-Size: 21 2024-05-21T13:23:02.863 INFO:teuthology.orchestra.run.smithi022.stdout:Maintainer: Ubuntu Kernel Team 2024-05-21T13:23:02.863 INFO:teuthology.orchestra.run.smithi022.stdout:Architecture: amd64 2024-05-21T13:23:02.863 INFO:teuthology.orchestra.run.smithi022.stdout:Source: linux-meta 2024-05-21T13:23:02.863 INFO:teuthology.orchestra.run.smithi022.stdout:Version: 5.15.0.107.107 2024-05-21T13:23:02.863 INFO:teuthology.orchestra.run.smithi022.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-107), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-05-21T13:23:02.863 INFO:teuthology.orchestra.run.smithi022.stdout:Depends: linux-image-5.15.0-107-generic, linux-modules-extra-5.15.0-107-generic, linux-firmware, intel-microcode, amd64-microcode 2024-05-21T13:23:02.863 INFO:teuthology.orchestra.run.smithi022.stdout:Recommends: thermald 2024-05-21T13:23:02.863 INFO:teuthology.orchestra.run.smithi022.stdout:Description: Generic Linux kernel image 2024-05-21T13:23:02.863 INFO:teuthology.orchestra.run.smithi022.stdout: This package will always depend on the latest generic kernel image 2024-05-21T13:23:02.864 INFO:teuthology.orchestra.run.smithi022.stdout: available. 2024-05-21T13:23:02.864 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-107-generic 2024-05-21T13:23:02.865 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-21T13:23:02.865 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-21T13:23:02.865 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-05-21T13:23:02.865 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi022.front.sepia.ceph.com, path=None, version=distro) 2024-05-21T13:23:02.865 DEBUG:teuthology.orchestra.run.smithi022:> sudo apt-get clean 2024-05-21T13:23:03.048 DEBUG:teuthology.orchestra.run.smithi022:> sudo apt-get update 2024-05-21T13:23:03.264 INFO:teuthology.orchestra.run.smithi022.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-05-21T13:23:03.264 INFO:teuthology.orchestra.run.smithi022.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-21T13:23:03.275 INFO:teuthology.orchestra.run.smithi022.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-05-21T13:23:03.296 INFO:teuthology.orchestra.run.smithi022.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-05-21T13:23:04.714 INFO:teuthology.orchestra.run.smithi022.stdout:Reading package lists... 2024-05-21T13:23:04.733 DEBUG:teuthology.orchestra.run.smithi022:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-05-21T13:23:04.791 INFO:teuthology.orchestra.run.smithi022.stdout:Reading package lists... 2024-05-21T13:23:04.972 INFO:teuthology.orchestra.run.smithi022.stdout:Building dependency tree... 2024-05-21T13:23:04.973 INFO:teuthology.orchestra.run.smithi022.stdout:Reading state information... 2024-05-21T13:23:05.136 INFO:teuthology.orchestra.run.smithi022.stdout:linux-image-generic is already the newest version (5.15.0.107.107). 2024-05-21T13:23:05.136 INFO:teuthology.orchestra.run.smithi022.stdout:The following packages were automatically installed and are no longer required: 2024-05-21T13:23:05.136 INFO:teuthology.orchestra.run.smithi022.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-21T13:23:05.136 INFO:teuthology.orchestra.run.smithi022.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-21T13:23:05.137 INFO:teuthology.orchestra.run.smithi022.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-21T13:23:05.137 INFO:teuthology.orchestra.run.smithi022.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-21T13:23:05.137 INFO:teuthology.orchestra.run.smithi022.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-21T13:23:05.137 INFO:teuthology.orchestra.run.smithi022.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-21T13:23:05.178 INFO:teuthology.orchestra.run.smithi022.stdout:0 upgraded, 0 newly installed, 0 to remove and 320 not upgraded. 2024-05-21T13:23:05.180 DEBUG:teuthology.orchestra.run.smithi022:> dpkg -s linux-image-generic 2024-05-21T13:23:05.238 INFO:teuthology.orchestra.run.smithi022.stdout:Package: linux-image-generic 2024-05-21T13:23:05.238 INFO:teuthology.orchestra.run.smithi022.stdout:Status: install ok installed 2024-05-21T13:23:05.238 INFO:teuthology.orchestra.run.smithi022.stdout:Priority: optional 2024-05-21T13:23:05.238 INFO:teuthology.orchestra.run.smithi022.stdout:Section: kernel 2024-05-21T13:23:05.238 INFO:teuthology.orchestra.run.smithi022.stdout:Installed-Size: 21 2024-05-21T13:23:05.238 INFO:teuthology.orchestra.run.smithi022.stdout:Maintainer: Ubuntu Kernel Team 2024-05-21T13:23:05.238 INFO:teuthology.orchestra.run.smithi022.stdout:Architecture: amd64 2024-05-21T13:23:05.238 INFO:teuthology.orchestra.run.smithi022.stdout:Source: linux-meta 2024-05-21T13:23:05.239 INFO:teuthology.orchestra.run.smithi022.stdout:Version: 5.15.0.107.107 2024-05-21T13:23:05.239 INFO:teuthology.orchestra.run.smithi022.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-107), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-05-21T13:23:05.239 INFO:teuthology.orchestra.run.smithi022.stdout:Depends: linux-image-5.15.0-107-generic, linux-modules-extra-5.15.0-107-generic, linux-firmware, intel-microcode, amd64-microcode 2024-05-21T13:23:05.239 INFO:teuthology.orchestra.run.smithi022.stdout:Recommends: thermald 2024-05-21T13:23:05.239 INFO:teuthology.orchestra.run.smithi022.stdout:Description: Generic Linux kernel image 2024-05-21T13:23:05.239 INFO:teuthology.orchestra.run.smithi022.stdout: This package will always depend on the latest generic kernel image 2024-05-21T13:23:05.239 INFO:teuthology.orchestra.run.smithi022.stdout: available. 2024-05-21T13:23:05.239 DEBUG:teuthology.orchestra.run.smithi022:> mktemp 2024-05-21T13:23:05.290 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/tmp.7P9FG5K92h 2024-05-21T13:23:05.290 DEBUG:teuthology.orchestra.run.smithi022:> sudo cp /boot/grub/grub.cfg /tmp/tmp.7P9FG5K92h 2024-05-21T13:23:05.346 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 0666 /tmp/tmp.7P9FG5K92h 2024-05-21T13:23:05.459 DEBUG:teuthology.orchestra.remote:smithi022:/tmp/tmp.7P9FG5K92h is 10KB 2024-05-21T13:23:05.468 INFO:teuthology.orchestra.run.smithi115.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-05-21T13:23:05.468 INFO:teuthology.orchestra.run.smithi115.stdout:Sourcing file `/etc/default/grub' 2024-05-21T13:23:05.472 DEBUG:teuthology.orchestra.run.smithi022:> rm -fr /tmp/tmp.7P9FG5K92h 2024-05-21T13:23:05.477 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-05-21T13:23:05.486 INFO:teuthology.orchestra.run.smithi115.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-21T13:23:05.500 INFO:teuthology.orchestra.run.smithi115.stdout:Generating grub configuration file ... 2024-05-21T13:23:05.530 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-05-21T13:23:05.530 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-05-21T13:23:05.530 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-05-21T13:23:05.611 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-107-generic 2024-05-21T13:23:05.611 DEBUG:teuthology.orchestra.run.smithi022:> sudo update-grub 2024-05-21T13:23:05.778 INFO:teuthology.orchestra.run.smithi115.stdout:Found linux image: /boot/vmlinuz-5.15.0-107-generic 2024-05-21T13:23:05.799 INFO:teuthology.orchestra.run.smithi115.stdout:Found initrd image: /boot/initrd.img-5.15.0-107-generic 2024-05-21T13:23:06.077 INFO:teuthology.orchestra.run.smithi115.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-05-21T13:23:06.082 INFO:teuthology.orchestra.run.smithi115.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-05-21T13:23:06.151 INFO:teuthology.orchestra.run.smithi115.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-05-21T13:23:06.157 INFO:teuthology.orchestra.run.smithi115.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-05-21T13:23:06.320 INFO:teuthology.orchestra.run.smithi115.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-05-21T13:23:06.320 INFO:teuthology.orchestra.run.smithi115.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-05-21T13:23:06.320 INFO:teuthology.orchestra.run.smithi115.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-05-21T13:23:06.353 INFO:teuthology.orchestra.run.smithi115.stdout:done 2024-05-21T13:23:06.796 INFO:teuthology.orchestra.run.smithi022.stderr:Sourcing file `/etc/default/grub' 2024-05-21T13:23:06.798 INFO:teuthology.orchestra.run.smithi022.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-21T13:23:06.800 INFO:teuthology.orchestra.run.smithi022.stderr:Generating grub configuration file ... 2024-05-21T13:23:06.825 DEBUG:teuthology.orchestra.run.smithi115:> dpkg -s linux-image-generic 2024-05-21T13:23:06.841 INFO:teuthology.orchestra.run.smithi115.stdout:Package: linux-image-generic 2024-05-21T13:23:06.841 INFO:teuthology.orchestra.run.smithi115.stdout:Status: install ok installed 2024-05-21T13:23:06.841 INFO:teuthology.orchestra.run.smithi115.stdout:Priority: optional 2024-05-21T13:23:06.841 INFO:teuthology.orchestra.run.smithi115.stdout:Section: kernel 2024-05-21T13:23:06.841 INFO:teuthology.orchestra.run.smithi115.stdout:Installed-Size: 21 2024-05-21T13:23:06.841 INFO:teuthology.orchestra.run.smithi115.stdout:Maintainer: Ubuntu Kernel Team 2024-05-21T13:23:06.841 INFO:teuthology.orchestra.run.smithi115.stdout:Architecture: amd64 2024-05-21T13:23:06.841 INFO:teuthology.orchestra.run.smithi115.stdout:Source: linux-meta 2024-05-21T13:23:06.841 INFO:teuthology.orchestra.run.smithi115.stdout:Version: 5.15.0.107.107 2024-05-21T13:23:06.842 INFO:teuthology.orchestra.run.smithi115.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-107), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-05-21T13:23:06.842 INFO:teuthology.orchestra.run.smithi115.stdout:Depends: linux-image-5.15.0-107-generic, linux-modules-extra-5.15.0-107-generic, linux-firmware, intel-microcode, amd64-microcode 2024-05-21T13:23:06.842 INFO:teuthology.orchestra.run.smithi115.stdout:Recommends: thermald 2024-05-21T13:23:06.842 INFO:teuthology.orchestra.run.smithi115.stdout:Description: Generic Linux kernel image 2024-05-21T13:23:06.842 INFO:teuthology.orchestra.run.smithi115.stdout: This package will always depend on the latest generic kernel image 2024-05-21T13:23:06.842 INFO:teuthology.orchestra.run.smithi115.stdout: available. 2024-05-21T13:23:06.843 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-107-generic 2024-05-21T13:23:06.843 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-21T13:23:06.843 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-21T13:23:06.843 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-05-21T13:23:06.843 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi115.front.sepia.ceph.com, path=None, version=distro) 2024-05-21T13:23:06.843 DEBUG:teuthology.orchestra.run.smithi115:> sudo apt-get clean 2024-05-21T13:23:06.975 INFO:teuthology.orchestra.run.smithi022.stderr:Found linux image: /boot/vmlinuz-5.15.0-107-generic 2024-05-21T13:23:06.983 INFO:teuthology.orchestra.run.smithi022.stderr:Found initrd image: /boot/initrd.img-5.15.0-107-generic 2024-05-21T13:23:07.033 DEBUG:teuthology.orchestra.run.smithi115:> sudo apt-get update 2024-05-21T13:23:07.158 INFO:teuthology.orchestra.run.smithi115.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-05-21T13:23:07.217 INFO:teuthology.orchestra.run.smithi022.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-05-21T13:23:07.222 INFO:teuthology.orchestra.run.smithi022.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-05-21T13:23:07.264 INFO:teuthology.orchestra.run.smithi022.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-05-21T13:23:07.266 INFO:teuthology.orchestra.run.smithi115.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-21T13:23:07.270 INFO:teuthology.orchestra.run.smithi022.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-05-21T13:23:07.361 INFO:teuthology.orchestra.run.smithi115.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-05-21T13:23:07.397 INFO:teuthology.orchestra.run.smithi022.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-05-21T13:23:07.397 INFO:teuthology.orchestra.run.smithi022.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-05-21T13:23:07.397 INFO:teuthology.orchestra.run.smithi022.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-05-21T13:23:07.409 INFO:teuthology.orchestra.run.smithi022.stderr:done 2024-05-21T13:23:07.421 DEBUG:teuthology.orchestra.run.smithi022:> sudo shutdown -r now 2024-05-21T13:23:07.429 INFO:teuthology.orchestra.run.smithi115.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-05-21T13:23:08.526 INFO:teuthology.orchestra.run.smithi115.stdout:Reading package lists... 2024-05-21T13:23:08.544 DEBUG:teuthology.orchestra.run.smithi115:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-05-21T13:23:08.595 INFO:teuthology.orchestra.run.smithi115.stdout:Reading package lists... 2024-05-21T13:23:08.778 INFO:teuthology.orchestra.run.smithi115.stdout:Building dependency tree... 2024-05-21T13:23:08.779 INFO:teuthology.orchestra.run.smithi115.stdout:Reading state information... 2024-05-21T13:23:08.935 INFO:teuthology.orchestra.run.smithi115.stdout:linux-image-generic is already the newest version (5.15.0.107.107). 2024-05-21T13:23:08.936 INFO:teuthology.orchestra.run.smithi115.stdout:The following packages were automatically installed and are no longer required: 2024-05-21T13:23:08.936 INFO:teuthology.orchestra.run.smithi115.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-21T13:23:08.936 INFO:teuthology.orchestra.run.smithi115.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-21T13:23:08.936 INFO:teuthology.orchestra.run.smithi115.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-21T13:23:08.936 INFO:teuthology.orchestra.run.smithi115.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-21T13:23:08.936 INFO:teuthology.orchestra.run.smithi115.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-21T13:23:08.936 INFO:teuthology.orchestra.run.smithi115.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-21T13:23:08.974 INFO:teuthology.orchestra.run.smithi115.stdout:0 upgraded, 0 newly installed, 0 to remove and 320 not upgraded. 2024-05-21T13:23:08.976 DEBUG:teuthology.orchestra.run.smithi115:> dpkg -s linux-image-generic 2024-05-21T13:23:09.035 INFO:teuthology.orchestra.run.smithi115.stdout:Package: linux-image-generic 2024-05-21T13:23:09.035 INFO:teuthology.orchestra.run.smithi115.stdout:Status: install ok installed 2024-05-21T13:23:09.035 INFO:teuthology.orchestra.run.smithi115.stdout:Priority: optional 2024-05-21T13:23:09.035 INFO:teuthology.orchestra.run.smithi115.stdout:Section: kernel 2024-05-21T13:23:09.035 INFO:teuthology.orchestra.run.smithi115.stdout:Installed-Size: 21 2024-05-21T13:23:09.036 INFO:teuthology.orchestra.run.smithi115.stdout:Maintainer: Ubuntu Kernel Team 2024-05-21T13:23:09.036 INFO:teuthology.orchestra.run.smithi115.stdout:Architecture: amd64 2024-05-21T13:23:09.036 INFO:teuthology.orchestra.run.smithi115.stdout:Source: linux-meta 2024-05-21T13:23:09.036 INFO:teuthology.orchestra.run.smithi115.stdout:Version: 5.15.0.107.107 2024-05-21T13:23:09.036 INFO:teuthology.orchestra.run.smithi115.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-107), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-05-21T13:23:09.036 INFO:teuthology.orchestra.run.smithi115.stdout:Depends: linux-image-5.15.0-107-generic, linux-modules-extra-5.15.0-107-generic, linux-firmware, intel-microcode, amd64-microcode 2024-05-21T13:23:09.036 INFO:teuthology.orchestra.run.smithi115.stdout:Recommends: thermald 2024-05-21T13:23:09.036 INFO:teuthology.orchestra.run.smithi115.stdout:Description: Generic Linux kernel image 2024-05-21T13:23:09.036 INFO:teuthology.orchestra.run.smithi115.stdout: This package will always depend on the latest generic kernel image 2024-05-21T13:23:09.036 INFO:teuthology.orchestra.run.smithi115.stdout: available. 2024-05-21T13:23:09.037 DEBUG:teuthology.orchestra.run.smithi115:> mktemp 2024-05-21T13:23:09.085 INFO:teuthology.orchestra.run.smithi115.stdout:/tmp/tmp.5TVFnW2jq8 2024-05-21T13:23:09.086 DEBUG:teuthology.orchestra.run.smithi115:> sudo cp /boot/grub/grub.cfg /tmp/tmp.5TVFnW2jq8 2024-05-21T13:23:09.140 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 0666 /tmp/tmp.5TVFnW2jq8 2024-05-21T13:23:09.273 DEBUG:teuthology.orchestra.remote:smithi115:/tmp/tmp.5TVFnW2jq8 is 10KB 2024-05-21T13:23:09.288 DEBUG:teuthology.orchestra.run.smithi115:> rm -fr /tmp/tmp.5TVFnW2jq8 2024-05-21T13:23:09.294 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-05-21T13:23:09.349 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-21T13:23:09.349 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-05-21T13:23:09.349 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-05-21T13:23:09.431 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-107-generic 2024-05-21T13:23:09.431 DEBUG:teuthology.orchestra.run.smithi115:> sudo update-grub 2024-05-21T13:23:10.650 INFO:teuthology.orchestra.run.smithi115.stderr:Sourcing file `/etc/default/grub' 2024-05-21T13:23:10.651 INFO:teuthology.orchestra.run.smithi115.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-05-21T13:23:10.653 INFO:teuthology.orchestra.run.smithi115.stderr:Generating grub configuration file ... 2024-05-21T13:23:10.827 INFO:teuthology.orchestra.run.smithi115.stderr:Found linux image: /boot/vmlinuz-5.15.0-107-generic 2024-05-21T13:23:10.833 INFO:teuthology.orchestra.run.smithi115.stderr:Found initrd image: /boot/initrd.img-5.15.0-107-generic 2024-05-21T13:23:11.115 INFO:teuthology.orchestra.run.smithi115.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-05-21T13:23:11.120 INFO:teuthology.orchestra.run.smithi115.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-05-21T13:23:11.164 INFO:teuthology.orchestra.run.smithi115.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-05-21T13:23:11.170 INFO:teuthology.orchestra.run.smithi115.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-05-21T13:23:11.317 INFO:teuthology.orchestra.run.smithi115.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-05-21T13:23:11.317 INFO:teuthology.orchestra.run.smithi115.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-05-21T13:23:11.317 INFO:teuthology.orchestra.run.smithi115.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-05-21T13:23:11.336 INFO:teuthology.orchestra.run.smithi115.stderr:done 2024-05-21T13:23:11.338 DEBUG:teuthology.orchestra.run.smithi115:> sudo shutdown -r now 2024-05-21T13:23:37.446 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-05-21T13:23:37.447 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi022.front.sepia.ceph.com' 2024-05-21T13:23:37.449 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-21T13:23:41.342 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-05-21T13:23:41.342 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-05-21T13:23:41.343 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-21T13:23:55.807 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.22 2024-05-21T13:23:59.902 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-05-21T13:24:04.813 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi022.front.sepia.ceph.com' 2024-05-21T13:24:04.813 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-21T13:24:07.870 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.22 2024-05-21T13:24:08.904 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-05-21T13:24:08.904 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-21T13:24:11.970 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-05-21T13:24:19.882 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi022.front.sepia.ceph.com' 2024-05-21T13:24:19.883 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-21T13:24:23.974 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-05-21T13:24:23.975 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-21T13:24:42.399 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.115 2024-05-21T13:24:51.996 DEBUG:teuthology.orchestra.run.smithi022:> true 2024-05-21T13:24:52.924 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi022.front.sepia.ceph.com' 2024-05-21T13:24:52.924 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-107-generic"... 2024-05-21T13:24:52.924 DEBUG:teuthology.orchestra.run.smithi022:> uname -r 2024-05-21T13:24:52.972 INFO:teuthology.orchestra.run.smithi022.stdout:5.15.0-107-generic 2024-05-21T13:24:52.972 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-107-generic vs 5.15.0-107-generic 2024-05-21T13:24:52.973 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-21T13:24:52.973 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-05-21T13:24:53.973 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-05-21T13:24:53.974 DEBUG:teuthology.orchestra.run.smithi022:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-21T13:24:54.112 INFO:teuthology.orchestra.run.smithi022.stdout:ttyS1 2024-05-21T13:24:54.143 DEBUG:teuthology.parallel:result is None 2024-05-21T13:24:57.400 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-05-21T13:24:57.401 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-21T13:24:57.767 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-05-21T13:24:58.480 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-05-21T13:24:58.481 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-107-generic"... 2024-05-21T13:24:58.481 DEBUG:teuthology.orchestra.run.smithi115:> uname -r 2024-05-21T13:24:58.533 INFO:teuthology.orchestra.run.smithi115.stdout:5.15.0-107-generic 2024-05-21T13:24:58.533 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-107-generic vs 5.15.0-107-generic 2024-05-21T13:24:58.533 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-21T13:24:58.533 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-05-21T13:24:59.534 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-05-21T13:24:59.534 DEBUG:teuthology.orchestra.run.smithi115:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-21T13:24:59.615 INFO:teuthology.orchestra.run.smithi115.stdout:ttyS1 2024-05-21T13:24:59.642 DEBUG:teuthology.parallel:result is None 2024-05-21T13:24:59.643 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-21T13:24:59.652 INFO:teuthology.task.internal:Creating test directory... 2024-05-21T13:24:59.652 DEBUG:teuthology.orchestra.run.smithi022:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-21T13:24:59.654 DEBUG:teuthology.orchestra.run.smithi115:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-21T13:24:59.660 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-21T13:24:59.716 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-21T13:24:59.809 INFO:teuthology.task.internal:Creating archive directory... 2024-05-21T13:24:59.810 DEBUG:teuthology.orchestra.run.smithi022:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-21T13:24:59.813 DEBUG:teuthology.orchestra.run.smithi115:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-21T13:24:59.834 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-21T13:24:59.892 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-21T13:24:59.892 DEBUG:teuthology.orchestra.run.smithi022:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-21T13:24:59.895 DEBUG:teuthology.orchestra.run.smithi115:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-21T13:24:59.912 INFO:teuthology.orchestra.run.smithi022.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-21T13:24:59.917 INFO:teuthology.orchestra.run.smithi115.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-21T13:24:59.921 INFO:teuthology.orchestra.run.smithi022.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-21T13:24:59.925 INFO:teuthology.orchestra.run.smithi115.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-21T13:24:59.927 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-21T13:24:59.985 INFO:teuthology.task.internal:Configuring sudo... 2024-05-21T13:24:59.985 DEBUG:teuthology.orchestra.run.smithi022:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-21T13:24:59.988 DEBUG:teuthology.orchestra.run.smithi115:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-21T13:25:00.002 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-21T13:25:00.013 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-21T13:25:00.013 DEBUG:teuthology.orchestra.run.smithi022:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-21T13:25:00.046 DEBUG:teuthology.orchestra.run.smithi115:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-21T13:25:00.051 DEBUG:teuthology.orchestra.run.smithi022:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-21T13:25:00.097 DEBUG:teuthology.orchestra.run.smithi022:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-21T13:25:00.145 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-05-21T13:25:00.145 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-21T13:25:00.208 DEBUG:teuthology.orchestra.run.smithi115:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-21T13:25:00.214 DEBUG:teuthology.orchestra.run.smithi115:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-21T13:25:00.261 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-21T13:25:00.261 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-21T13:25:00.333 DEBUG:teuthology.orchestra.run.smithi022:> sudo service rsyslog restart 2024-05-21T13:25:00.335 DEBUG:teuthology.orchestra.run.smithi115:> sudo service rsyslog restart 2024-05-21T13:25:00.411 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-21T13:25:00.419 INFO:teuthology.task.internal:Starting timer... 2024-05-21T13:25:00.419 INFO:teuthology.run_tasks:Running task pcp... 2024-05-21T13:25:00.498 INFO:teuthology.run_tasks:Running task selinux... 2024-05-21T13:25:00.569 DEBUG:teuthology.task.selinux:Excluding smithi022: OS 'ubuntu' does not support SELinux 2024-05-21T13:25:00.569 DEBUG:teuthology.task.selinux:Excluding smithi115: OS 'ubuntu' does not support SELinux 2024-05-21T13:25:00.570 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-21T13:25:00.570 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-05-21T13:25:00.570 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-21T13:25:00.570 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-21T13:25:00.666 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-05-21T13:25:00.670 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-05-21T13:25:00.793 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-21T13:25:00.804 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-21T13:25:00.805 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi022.front.sepia.ceph.com,smithi115.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-21T13:32:05.701 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi022.front.sepia.ceph.com'), Remote(name='ubuntu@smithi115.front.sepia.ceph.com')] 2024-05-21T13:32:05.703 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi022.front.sepia.ceph.com' 2024-05-21T13:32:05.704 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi022.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-21T13:32:05.791 DEBUG:teuthology.orchestra.run.smithi022:> true 2024-05-21T13:32:05.870 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi022.front.sepia.ceph.com' 2024-05-21T13:32:05.871 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-05-21T13:32:05.871 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi115.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-21T13:32:05.953 DEBUG:teuthology.orchestra.run.smithi115:> true 2024-05-21T13:32:06.034 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi115.front.sepia.ceph.com' 2024-05-21T13:32:06.035 INFO:teuthology.run_tasks:Running task clock... 2024-05-21T13:32:06.045 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-21T13:32:06.045 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-21T13:32:06.046 DEBUG:teuthology.orchestra.run.smithi022:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-21T13:32:06.048 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-21T13:32:06.048 DEBUG:teuthology.orchestra.run.smithi115:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-21T13:32:06.075 INFO:teuthology.orchestra.run.smithi022.stdout:21 May 13:32:06 ntpd[17199]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-05-21T13:32:06.075 INFO:teuthology.orchestra.run.smithi022.stdout:21 May 13:32:06 ntpd[17199]: Command line: ntpd -gq 2024-05-21T13:32:06.075 INFO:teuthology.orchestra.run.smithi022.stdout:21 May 13:32:06 ntpd[17199]: ---------------------------------------------------- 2024-05-21T13:32:06.075 INFO:teuthology.orchestra.run.smithi022.stdout:21 May 13:32:06 ntpd[17199]: ntp-4 is maintained by Network Time Foundation, 2024-05-21T13:32:06.075 INFO:teuthology.orchestra.run.smithi022.stdout:21 May 13:32:06 ntpd[17199]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-05-21T13:32:06.075 INFO:teuthology.orchestra.run.smithi022.stdout:21 May 13:32:06 ntpd[17199]: corporation. Support and training for ntp-4 are 2024-05-21T13:32:06.075 INFO:teuthology.orchestra.run.smithi022.stdout:21 May 13:32:06 ntpd[17199]: available at https://www.nwtime.org/support 2024-05-21T13:32:06.075 INFO:teuthology.orchestra.run.smithi022.stdout:21 May 13:32:06 ntpd[17199]: ---------------------------------------------------- 2024-05-21T13:32:06.076 INFO:teuthology.orchestra.run.smithi022.stdout:21 May 13:32:06 ntpd[17199]: proto: precision = 0.045 usec (-24) 2024-05-21T13:32:06.076 INFO:teuthology.orchestra.run.smithi022.stdout:21 May 13:32:06 ntpd[17199]: basedate set to 2022-02-04 2024-05-21T13:32:06.076 INFO:teuthology.orchestra.run.smithi022.stdout:21 May 13:32:06 ntpd[17199]: gps base set to 2022-02-06 (week 2196) 2024-05-21T13:32:06.076 INFO:teuthology.orchestra.run.smithi022.stdout:21 May 13:32:06 ntpd[17199]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-21T13:32:06.077 INFO:teuthology.orchestra.run.smithi022.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-21T13:32:06.077 INFO:teuthology.orchestra.run.smithi022.stderr:restrict ::: KOD does nothing without LIMITED. 2024-05-21T13:32:06.078 INFO:teuthology.orchestra.run.smithi022.stdout:21 May 13:32:06 ntpd[17199]: restrict ::: KOD does nothing without LIMITED. 2024-05-21T13:32:06.078 INFO:teuthology.orchestra.run.smithi022.stdout:21 May 13:32:06 ntpd[17199]: Listen and drop on 0 v6wildcard [::]:123 2024-05-21T13:32:06.078 INFO:teuthology.orchestra.run.smithi022.stdout:21 May 13:32:06 ntpd[17199]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-05-21T13:32:06.078 INFO:teuthology.orchestra.run.smithi022.stdout:21 May 13:32:06 ntpd[17199]: Listen normally on 2 lo 127.0.0.1:123 2024-05-21T13:32:06.078 INFO:teuthology.orchestra.run.smithi022.stdout:21 May 13:32:06 ntpd[17199]: Listen normally on 3 ens1f0 172.21.15.22:123 2024-05-21T13:32:06.078 INFO:teuthology.orchestra.run.smithi022.stdout:21 May 13:32:06 ntpd[17199]: Listen normally on 4 lo [::1]:123 2024-05-21T13:32:06.078 INFO:teuthology.orchestra.run.smithi022.stdout:21 May 13:32:06 ntpd[17199]: Listen normally on 5 ens1f0 [fe80::ec4:7aff:fe59:5de4%4]:123 2024-05-21T13:32:06.079 INFO:teuthology.orchestra.run.smithi022.stdout:21 May 13:32:06 ntpd[17199]: Listening on routing socket on fd #22 for interface updates 2024-05-21T13:32:06.106 INFO:teuthology.orchestra.run.smithi115.stdout:21 May 13:32:06 ntpd[17296]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-05-21T13:32:06.106 INFO:teuthology.orchestra.run.smithi115.stdout:21 May 13:32:06 ntpd[17296]: Command line: ntpd -gq 2024-05-21T13:32:06.106 INFO:teuthology.orchestra.run.smithi115.stdout:21 May 13:32:06 ntpd[17296]: ---------------------------------------------------- 2024-05-21T13:32:06.106 INFO:teuthology.orchestra.run.smithi115.stdout:21 May 13:32:06 ntpd[17296]: ntp-4 is maintained by Network Time Foundation, 2024-05-21T13:32:06.107 INFO:teuthology.orchestra.run.smithi115.stdout:21 May 13:32:06 ntpd[17296]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-05-21T13:32:06.107 INFO:teuthology.orchestra.run.smithi115.stdout:21 May 13:32:06 ntpd[17296]: corporation. Support and training for ntp-4 are 2024-05-21T13:32:06.107 INFO:teuthology.orchestra.run.smithi115.stdout:21 May 13:32:06 ntpd[17296]: available at https://www.nwtime.org/support 2024-05-21T13:32:06.107 INFO:teuthology.orchestra.run.smithi115.stdout:21 May 13:32:06 ntpd[17296]: ---------------------------------------------------- 2024-05-21T13:32:06.107 INFO:teuthology.orchestra.run.smithi115.stdout:21 May 13:32:06 ntpd[17296]: proto: precision = 0.048 usec (-24) 2024-05-21T13:32:06.107 INFO:teuthology.orchestra.run.smithi115.stdout:21 May 13:32:06 ntpd[17296]: basedate set to 2022-02-04 2024-05-21T13:32:06.107 INFO:teuthology.orchestra.run.smithi115.stdout:21 May 13:32:06 ntpd[17296]: gps base set to 2022-02-06 (week 2196) 2024-05-21T13:32:06.107 INFO:teuthology.orchestra.run.smithi115.stdout:21 May 13:32:06 ntpd[17296]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-21T13:32:06.107 INFO:teuthology.orchestra.run.smithi115.stdout:21 May 13:32:06 ntpd[17296]: restrict ::: KOD does nothing without LIMITED. 2024-05-21T13:32:06.107 INFO:teuthology.orchestra.run.smithi115.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-05-21T13:32:06.108 INFO:teuthology.orchestra.run.smithi115.stderr:restrict ::: KOD does nothing without LIMITED. 2024-05-21T13:32:06.108 INFO:teuthology.orchestra.run.smithi115.stdout:21 May 13:32:06 ntpd[17296]: Listen and drop on 0 v6wildcard [::]:123 2024-05-21T13:32:06.108 INFO:teuthology.orchestra.run.smithi115.stdout:21 May 13:32:06 ntpd[17296]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-05-21T13:32:06.108 INFO:teuthology.orchestra.run.smithi115.stdout:21 May 13:32:06 ntpd[17296]: Listen normally on 2 lo 127.0.0.1:123 2024-05-21T13:32:06.109 INFO:teuthology.orchestra.run.smithi115.stdout:21 May 13:32:06 ntpd[17296]: Listen normally on 3 enp3s0f1 172.21.15.115:123 2024-05-21T13:32:06.109 INFO:teuthology.orchestra.run.smithi115.stdout:21 May 13:32:06 ntpd[17296]: Listen normally on 4 lo [::1]:123 2024-05-21T13:32:06.109 INFO:teuthology.orchestra.run.smithi115.stdout:21 May 13:32:06 ntpd[17296]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:ce8f%5]:123 2024-05-21T13:32:06.109 INFO:teuthology.orchestra.run.smithi115.stdout:21 May 13:32:06 ntpd[17296]: Listening on routing socket on fd #22 for interface updates 2024-05-21T13:32:07.076 INFO:teuthology.orchestra.run.smithi022.stderr:21 May 13:32:07 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T13:32:07.076 INFO:teuthology.orchestra.run.smithi022.stderr:21 May 13:32:07 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T13:32:07.076 INFO:teuthology.orchestra.run.smithi022.stderr:21 May 13:32:07 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T13:32:07.076 INFO:teuthology.orchestra.run.smithi022.stderr:21 May 13:32:07 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T13:32:07.076 INFO:teuthology.orchestra.run.smithi022.stderr:21 May 13:32:07 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T13:32:07.076 INFO:teuthology.orchestra.run.smithi022.stderr:21 May 13:32:07 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T13:32:07.076 INFO:teuthology.orchestra.run.smithi022.stderr:21 May 13:32:07 ntpd[17199]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-21T13:32:07.077 INFO:teuthology.orchestra.run.smithi022.stderr:21 May 13:32:07 ntpd[17199]: can't open /var/log/ntpstats/peerstats.20240521: Permission denied 2024-05-21T13:32:07.077 INFO:teuthology.orchestra.run.smithi022.stderr:21 May 13:32:07 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T13:32:07.077 INFO:teuthology.orchestra.run.smithi022.stderr:21 May 13:32:07 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T13:32:07.077 INFO:teuthology.orchestra.run.smithi022.stderr:21 May 13:32:07 ntpd[17199]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-21T13:32:07.077 INFO:teuthology.orchestra.run.smithi022.stderr:21 May 13:32:07 ntpd[17199]: can't open /var/log/ntpstats/peerstats.20240521: Permission denied 2024-05-21T13:32:07.106 INFO:teuthology.orchestra.run.smithi115.stderr:21 May 13:32:07 ntpd[17296]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T13:32:07.106 INFO:teuthology.orchestra.run.smithi115.stderr:21 May 13:32:07 ntpd[17296]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T13:32:08.075 INFO:teuthology.orchestra.run.smithi022.stderr:21 May 13:32:08 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T13:32:08.075 INFO:teuthology.orchestra.run.smithi022.stderr:21 May 13:32:08 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T13:32:09.077 INFO:teuthology.orchestra.run.smithi022.stderr:21 May 13:32:09 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T13:32:09.077 INFO:teuthology.orchestra.run.smithi022.stderr:21 May 13:32:09 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T13:32:09.077 INFO:teuthology.orchestra.run.smithi022.stderr:21 May 13:32:09 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T13:32:09.077 INFO:teuthology.orchestra.run.smithi022.stderr:21 May 13:32:09 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T13:32:09.077 INFO:teuthology.orchestra.run.smithi022.stderr:21 May 13:32:09 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T13:32:09.077 INFO:teuthology.orchestra.run.smithi022.stderr:21 May 13:32:09 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T13:32:09.077 INFO:teuthology.orchestra.run.smithi022.stderr:21 May 13:32:09 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T13:32:09.078 INFO:teuthology.orchestra.run.smithi022.stderr:21 May 13:32:09 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T13:32:09.078 INFO:teuthology.orchestra.run.smithi022.stderr:21 May 13:32:09 ntpd[17199]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-21T13:32:09.078 INFO:teuthology.orchestra.run.smithi022.stderr:21 May 13:32:09 ntpd[17199]: can't open /var/log/ntpstats/peerstats.20240521: Permission denied 2024-05-21T13:32:09.078 INFO:teuthology.orchestra.run.smithi022.stderr:21 May 13:32:09 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T13:32:09.078 INFO:teuthology.orchestra.run.smithi022.stderr:21 May 13:32:09 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T13:32:09.078 INFO:teuthology.orchestra.run.smithi022.stderr:21 May 13:32:09 ntpd[17199]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-21T13:32:09.078 INFO:teuthology.orchestra.run.smithi022.stderr:21 May 13:32:09 ntpd[17199]: can't open /var/log/ntpstats/peerstats.20240521: Permission denied 2024-05-21T13:32:09.078 INFO:teuthology.orchestra.run.smithi022.stderr:21 May 13:32:09 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T13:32:09.078 INFO:teuthology.orchestra.run.smithi022.stderr:21 May 13:32:09 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T13:32:09.078 INFO:teuthology.orchestra.run.smithi022.stderr:21 May 13:32:09 ntpd[17199]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-21T13:32:09.078 INFO:teuthology.orchestra.run.smithi022.stderr:21 May 13:32:09 ntpd[17199]: can't open /var/log/ntpstats/peerstats.20240521: Permission denied 2024-05-21T13:32:10.108 INFO:teuthology.orchestra.run.smithi115.stderr:21 May 13:32:10 ntpd[17296]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T13:32:10.108 INFO:teuthology.orchestra.run.smithi115.stderr:21 May 13:32:10 ntpd[17296]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T13:32:10.108 INFO:teuthology.orchestra.run.smithi115.stderr:21 May 13:32:10 ntpd[17296]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T13:32:10.108 INFO:teuthology.orchestra.run.smithi115.stderr:21 May 13:32:10 ntpd[17296]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T13:32:10.108 INFO:teuthology.orchestra.run.smithi115.stderr:21 May 13:32:10 ntpd[17296]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T13:32:10.108 INFO:teuthology.orchestra.run.smithi115.stderr:21 May 13:32:10 ntpd[17296]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T13:32:10.108 INFO:teuthology.orchestra.run.smithi115.stderr:21 May 13:32:10 ntpd[17296]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T13:32:10.108 INFO:teuthology.orchestra.run.smithi115.stderr:21 May 13:32:10 ntpd[17296]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T13:32:10.108 INFO:teuthology.orchestra.run.smithi115.stderr:21 May 13:32:10 ntpd[17296]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-21T13:32:10.108 INFO:teuthology.orchestra.run.smithi115.stderr:21 May 13:32:10 ntpd[17296]: can't open /var/log/ntpstats/peerstats.20240521: Permission denied 2024-05-21T13:32:10.108 INFO:teuthology.orchestra.run.smithi115.stderr:21 May 13:32:10 ntpd[17296]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T13:32:10.108 INFO:teuthology.orchestra.run.smithi115.stderr:21 May 13:32:10 ntpd[17296]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T13:32:10.109 INFO:teuthology.orchestra.run.smithi115.stderr:21 May 13:32:10 ntpd[17296]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-21T13:32:10.109 INFO:teuthology.orchestra.run.smithi115.stderr:21 May 13:32:10 ntpd[17296]: can't open /var/log/ntpstats/peerstats.20240521: Permission denied 2024-05-21T13:32:10.109 INFO:teuthology.orchestra.run.smithi115.stderr:21 May 13:32:10 ntpd[17296]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T13:32:10.109 INFO:teuthology.orchestra.run.smithi115.stderr:21 May 13:32:10 ntpd[17296]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T13:32:10.109 INFO:teuthology.orchestra.run.smithi115.stderr:21 May 13:32:10 ntpd[17296]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-21T13:32:10.109 INFO:teuthology.orchestra.run.smithi115.stderr:21 May 13:32:10 ntpd[17296]: can't open /var/log/ntpstats/peerstats.20240521: Permission denied 2024-05-21T13:32:11.076 INFO:teuthology.orchestra.run.smithi022.stderr:21 May 13:32:11 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T13:32:11.077 INFO:teuthology.orchestra.run.smithi022.stderr:21 May 13:32:11 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T13:32:11.077 INFO:teuthology.orchestra.run.smithi022.stderr:21 May 13:32:11 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T13:32:11.077 INFO:teuthology.orchestra.run.smithi022.stderr:21 May 13:32:11 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T13:32:11.077 INFO:teuthology.orchestra.run.smithi022.stderr:21 May 13:32:11 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T13:32:11.077 INFO:teuthology.orchestra.run.smithi022.stderr:21 May 13:32:11 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T13:32:11.077 INFO:teuthology.orchestra.run.smithi022.stderr:21 May 13:32:11 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T13:32:11.077 INFO:teuthology.orchestra.run.smithi022.stderr:21 May 13:32:11 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T13:32:11.077 INFO:teuthology.orchestra.run.smithi022.stderr:21 May 13:32:11 ntpd[17199]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-21T13:32:11.077 INFO:teuthology.orchestra.run.smithi022.stderr:21 May 13:32:11 ntpd[17199]: can't open /var/log/ntpstats/peerstats.20240521: Permission denied 2024-05-21T13:32:11.077 INFO:teuthology.orchestra.run.smithi022.stderr:21 May 13:32:11 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T13:32:11.077 INFO:teuthology.orchestra.run.smithi022.stderr:21 May 13:32:11 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T13:32:11.077 INFO:teuthology.orchestra.run.smithi022.stderr:21 May 13:32:11 ntpd[17199]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-21T13:32:11.077 INFO:teuthology.orchestra.run.smithi022.stderr:21 May 13:32:11 ntpd[17199]: can't open /var/log/ntpstats/peerstats.20240521: Permission denied 2024-05-21T13:32:11.078 INFO:teuthology.orchestra.run.smithi022.stderr:21 May 13:32:11 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T13:32:11.078 INFO:teuthology.orchestra.run.smithi022.stderr:21 May 13:32:11 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T13:32:11.078 INFO:teuthology.orchestra.run.smithi022.stderr:21 May 13:32:11 ntpd[17199]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-21T13:32:11.078 INFO:teuthology.orchestra.run.smithi022.stderr:21 May 13:32:11 ntpd[17199]: can't open /var/log/ntpstats/peerstats.20240521: Permission denied 2024-05-21T13:32:12.107 INFO:teuthology.orchestra.run.smithi115.stderr:21 May 13:32:12 ntpd[17296]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T13:32:12.107 INFO:teuthology.orchestra.run.smithi115.stderr:21 May 13:32:12 ntpd[17296]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T13:32:12.108 INFO:teuthology.orchestra.run.smithi115.stderr:21 May 13:32:12 ntpd[17296]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T13:32:12.108 INFO:teuthology.orchestra.run.smithi115.stderr:21 May 13:32:12 ntpd[17296]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T13:32:12.108 INFO:teuthology.orchestra.run.smithi115.stderr:21 May 13:32:12 ntpd[17296]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T13:32:12.108 INFO:teuthology.orchestra.run.smithi115.stderr:21 May 13:32:12 ntpd[17296]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T13:32:12.108 INFO:teuthology.orchestra.run.smithi115.stderr:21 May 13:32:12 ntpd[17296]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T13:32:12.108 INFO:teuthology.orchestra.run.smithi115.stderr:21 May 13:32:12 ntpd[17296]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T13:32:12.108 INFO:teuthology.orchestra.run.smithi115.stderr:21 May 13:32:12 ntpd[17296]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-21T13:32:12.108 INFO:teuthology.orchestra.run.smithi115.stderr:21 May 13:32:12 ntpd[17296]: can't open /var/log/ntpstats/peerstats.20240521: Permission denied 2024-05-21T13:32:12.108 INFO:teuthology.orchestra.run.smithi115.stderr:21 May 13:32:12 ntpd[17296]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T13:32:12.108 INFO:teuthology.orchestra.run.smithi115.stderr:21 May 13:32:12 ntpd[17296]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T13:32:12.108 INFO:teuthology.orchestra.run.smithi115.stderr:21 May 13:32:12 ntpd[17296]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-21T13:32:12.108 INFO:teuthology.orchestra.run.smithi115.stderr:21 May 13:32:12 ntpd[17296]: can't open /var/log/ntpstats/peerstats.20240521: Permission denied 2024-05-21T13:32:12.108 INFO:teuthology.orchestra.run.smithi115.stderr:21 May 13:32:12 ntpd[17296]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T13:32:12.108 INFO:teuthology.orchestra.run.smithi115.stderr:21 May 13:32:12 ntpd[17296]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T13:32:12.109 INFO:teuthology.orchestra.run.smithi115.stderr:21 May 13:32:12 ntpd[17296]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-21T13:32:12.109 INFO:teuthology.orchestra.run.smithi115.stderr:21 May 13:32:12 ntpd[17296]: can't open /var/log/ntpstats/peerstats.20240521: Permission denied 2024-05-21T13:32:13.076 INFO:teuthology.orchestra.run.smithi022.stderr:21 May 13:32:13 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T13:32:13.076 INFO:teuthology.orchestra.run.smithi022.stderr:21 May 13:32:13 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T13:32:13.076 INFO:teuthology.orchestra.run.smithi022.stderr:21 May 13:32:13 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T13:32:13.076 INFO:teuthology.orchestra.run.smithi022.stderr:21 May 13:32:13 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T13:32:13.076 INFO:teuthology.orchestra.run.smithi022.stderr:21 May 13:32:13 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T13:32:13.076 INFO:teuthology.orchestra.run.smithi022.stderr:21 May 13:32:13 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T13:32:13.077 INFO:teuthology.orchestra.run.smithi022.stderr:21 May 13:32:13 ntpd[17199]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T13:32:13.077 INFO:teuthology.orchestra.run.smithi022.stderr:21 May 13:32:13 ntpd[17199]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T13:32:13.077 INFO:teuthology.orchestra.run.smithi022.stderr:21 May 13:32:13 ntpd[17199]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-21T13:32:13.077 INFO:teuthology.orchestra.run.smithi022.stderr:21 May 13:32:13 ntpd[17199]: can't open /var/log/ntpstats/peerstats.20240521: Permission denied 2024-05-21T13:32:13.077 INFO:teuthology.orchestra.run.smithi022.stdout:21 May 13:32:13 ntpd[17199]: ntpd: time slew +0.000354 s 2024-05-21T13:32:13.077 INFO:teuthology.orchestra.run.smithi022.stdout:ntpd: time slew +0.000354s 2024-05-21T13:32:13.077 INFO:teuthology.orchestra.run.smithi022.stderr:21 May 13:32:13 ntpd[17199]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-05-21T13:32:13.078 INFO:teuthology.orchestra.run.smithi022.stderr:21 May 13:32:13 ntpd[17199]: can't open /var/log/ntpstats/loopstats.20240521: Permission denied 2024-05-21T13:32:13.125 INFO:teuthology.orchestra.run.smithi022.stdout: remote refid st t when poll reach delay offset jitter 2024-05-21T13:32:13.126 INFO:teuthology.orchestra.run.smithi022.stdout:============================================================================== 2024-05-21T13:32:13.126 INFO:teuthology.orchestra.run.smithi022.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-21T13:32:13.126 INFO:teuthology.orchestra.run.smithi022.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-21T13:32:13.126 INFO:teuthology.orchestra.run.smithi022.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-21T13:32:13.126 INFO:teuthology.orchestra.run.smithi022.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-21T13:32:14.107 INFO:teuthology.orchestra.run.smithi115.stderr:21 May 13:32:14 ntpd[17296]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T13:32:14.107 INFO:teuthology.orchestra.run.smithi115.stderr:21 May 13:32:14 ntpd[17296]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T13:32:14.107 INFO:teuthology.orchestra.run.smithi115.stderr:21 May 13:32:14 ntpd[17296]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T13:32:14.108 INFO:teuthology.orchestra.run.smithi115.stderr:21 May 13:32:14 ntpd[17296]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T13:32:14.108 INFO:teuthology.orchestra.run.smithi115.stderr:21 May 13:32:14 ntpd[17296]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T13:32:14.108 INFO:teuthology.orchestra.run.smithi115.stderr:21 May 13:32:14 ntpd[17296]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T13:32:14.108 INFO:teuthology.orchestra.run.smithi115.stderr:21 May 13:32:14 ntpd[17296]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T13:32:14.108 INFO:teuthology.orchestra.run.smithi115.stderr:21 May 13:32:14 ntpd[17296]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T13:32:14.108 INFO:teuthology.orchestra.run.smithi115.stderr:21 May 13:32:14 ntpd[17296]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-21T13:32:14.108 INFO:teuthology.orchestra.run.smithi115.stderr:21 May 13:32:14 ntpd[17296]: can't open /var/log/ntpstats/peerstats.20240521: Permission denied 2024-05-21T13:32:14.108 INFO:teuthology.orchestra.run.smithi115.stderr:21 May 13:32:14 ntpd[17296]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T13:32:14.108 INFO:teuthology.orchestra.run.smithi115.stderr:21 May 13:32:14 ntpd[17296]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T13:32:14.108 INFO:teuthology.orchestra.run.smithi115.stderr:21 May 13:32:14 ntpd[17296]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-21T13:32:14.108 INFO:teuthology.orchestra.run.smithi115.stderr:21 May 13:32:14 ntpd[17296]: can't open /var/log/ntpstats/peerstats.20240521: Permission denied 2024-05-21T13:32:14.108 INFO:teuthology.orchestra.run.smithi115.stderr:21 May 13:32:14 ntpd[17296]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T13:32:14.108 INFO:teuthology.orchestra.run.smithi115.stderr:21 May 13:32:14 ntpd[17296]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T13:32:14.108 INFO:teuthology.orchestra.run.smithi115.stderr:21 May 13:32:14 ntpd[17296]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-21T13:32:14.109 INFO:teuthology.orchestra.run.smithi115.stderr:21 May 13:32:14 ntpd[17296]: can't open /var/log/ntpstats/peerstats.20240521: Permission denied 2024-05-21T13:32:16.107 INFO:teuthology.orchestra.run.smithi115.stderr:21 May 13:32:16 ntpd[17296]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T13:32:16.107 INFO:teuthology.orchestra.run.smithi115.stderr:21 May 13:32:16 ntpd[17296]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T13:32:16.107 INFO:teuthology.orchestra.run.smithi115.stderr:21 May 13:32:16 ntpd[17296]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T13:32:16.107 INFO:teuthology.orchestra.run.smithi115.stderr:21 May 13:32:16 ntpd[17296]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T13:32:16.107 INFO:teuthology.orchestra.run.smithi115.stderr:21 May 13:32:16 ntpd[17296]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T13:32:16.107 INFO:teuthology.orchestra.run.smithi115.stderr:21 May 13:32:16 ntpd[17296]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T13:32:16.107 INFO:teuthology.orchestra.run.smithi115.stderr:21 May 13:32:16 ntpd[17296]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-05-21T13:32:16.107 INFO:teuthology.orchestra.run.smithi115.stderr:21 May 13:32:16 ntpd[17296]: can't open /var/log/ntpstats/rawstats.20240521: Permission denied 2024-05-21T13:32:16.107 INFO:teuthology.orchestra.run.smithi115.stderr:21 May 13:32:16 ntpd[17296]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-05-21T13:32:16.108 INFO:teuthology.orchestra.run.smithi115.stderr:21 May 13:32:16 ntpd[17296]: can't open /var/log/ntpstats/peerstats.20240521: Permission denied 2024-05-21T13:32:16.108 INFO:teuthology.orchestra.run.smithi115.stdout:21 May 13:32:16 ntpd[17296]: ntpd: time slew +0.001682 s 2024-05-21T13:32:16.108 INFO:teuthology.orchestra.run.smithi115.stdout:ntpd: time slew +0.001682s 2024-05-21T13:32:16.108 INFO:teuthology.orchestra.run.smithi115.stderr:21 May 13:32:16 ntpd[17296]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-05-21T13:32:16.108 INFO:teuthology.orchestra.run.smithi115.stderr:21 May 13:32:16 ntpd[17296]: can't open /var/log/ntpstats/loopstats.20240521: Permission denied 2024-05-21T13:32:16.164 INFO:teuthology.orchestra.run.smithi115.stdout: remote refid st t when poll reach delay offset jitter 2024-05-21T13:32:16.164 INFO:teuthology.orchestra.run.smithi115.stdout:============================================================================== 2024-05-21T13:32:16.164 INFO:teuthology.orchestra.run.smithi115.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-21T13:32:16.165 INFO:teuthology.orchestra.run.smithi115.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-21T13:32:16.165 INFO:teuthology.orchestra.run.smithi115.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-21T13:32:16.165 INFO:teuthology.orchestra.run.smithi115.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-05-21T13:32:16.165 INFO:teuthology.run_tasks:Running task install... 2024-05-21T13:32:16.174 DEBUG:teuthology.task.install:project ceph 2024-05-21T13:32:16.175 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '7956b5e965f6ee5669688b5643c11d881b72442c'}} 2024-05-21T13:32:16.175 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '7956b5e965f6ee5669688b5643c11d881b72442c'} 2024-05-21T13:32:16.175 INFO:teuthology.task.install:Using flavor: default 2024-05-21T13:32:16.181 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-05-21T13:32:16.181 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-05-21T13:32:16.181 DEBUG:teuthology.orchestra.run.smithi022:> sudo apt-key list | grep Ceph 2024-05-21T13:32:16.182 DEBUG:teuthology.orchestra.run.smithi115:> sudo apt-key list | grep Ceph 2024-05-21T13:32:16.250 INFO:teuthology.orchestra.run.smithi022.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-05-21T13:32:16.258 INFO:teuthology.orchestra.run.smithi115.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-05-21T13:32:16.280 INFO:teuthology.orchestra.run.smithi022.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-05-21T13:32:16.281 INFO:teuthology.orchestra.run.smithi022.stdout:uid [ unknown] Ceph.com (release key) 2024-05-21T13:32:16.281 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-05-21T13:32:16.281 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-05-21T13:32:16.282 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=7956b5e965f6ee5669688b5643c11d881b72442c 2024-05-21T13:32:16.287 INFO:teuthology.orchestra.run.smithi115.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-05-21T13:32:16.287 INFO:teuthology.orchestra.run.smithi115.stdout:uid [ unknown] Ceph.com (release key) 2024-05-21T13:32:16.288 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-05-21T13:32:16.288 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-05-21T13:32:16.288 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=7956b5e965f6ee5669688b5643c11d881b72442c 2024-05-21T13:32:16.438 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-overdrive-export/7956b5e965f6ee5669688b5643c11d881b72442c/ubuntu/jammy/flavors/default/ 2024-05-21T13:32:16.438 INFO:teuthology.task.install.deb:Package version is 19.0.0-3857-g7956b5e9-1jammy 2024-05-21T13:32:16.501 INFO:teuthology.task.install.deb:Pulling from https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-overdrive-export/7956b5e965f6ee5669688b5643c11d881b72442c/ubuntu/jammy/flavors/default/ 2024-05-21T13:32:16.501 INFO:teuthology.task.install.deb:Package version is 19.0.0-3857-g7956b5e9-1jammy 2024-05-21T13:32:16.617 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-05-21T13:32:16.617 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-05-21T13:32:16.618 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-21T13:32:16.618 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-05-21T13:32:16.631 DEBUG:teuthology.orchestra.run.smithi115:> sudo apt-get update 2024-05-21T13:32:16.632 DEBUG:teuthology.orchestra.run.smithi022:> sudo apt-get update 2024-05-21T13:32:16.802 INFO:teuthology.orchestra.run.smithi115.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-21T13:32:16.815 INFO:teuthology.orchestra.run.smithi115.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-05-21T13:32:16.827 INFO:teuthology.orchestra.run.smithi022.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-05-21T13:32:16.836 INFO:teuthology.orchestra.run.smithi115.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-05-21T13:32:16.850 INFO:teuthology.orchestra.run.smithi115.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-overdrive-export/7956b5e965f6ee5669688b5643c11d881b72442c/ubuntu/jammy/flavors/default jammy InRelease 2024-05-21T13:32:16.857 INFO:teuthology.orchestra.run.smithi022.stdout:Ign:2 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-overdrive-export/7956b5e965f6ee5669688b5643c11d881b72442c/ubuntu/jammy/flavors/default jammy InRelease 2024-05-21T13:32:16.871 INFO:teuthology.orchestra.run.smithi115.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-overdrive-export/7956b5e965f6ee5669688b5643c11d881b72442c/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-05-21T13:32:16.878 INFO:teuthology.orchestra.run.smithi022.stdout:Get:3 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-overdrive-export/7956b5e965f6ee5669688b5643c11d881b72442c/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-05-21T13:32:16.893 INFO:teuthology.orchestra.run.smithi115.stdout:Ign:6 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-overdrive-export/7956b5e965f6ee5669688b5643c11d881b72442c/ubuntu/jammy/flavors/default jammy Release.gpg 2024-05-21T13:32:16.901 INFO:teuthology.orchestra.run.smithi022.stdout:Ign:4 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-overdrive-export/7956b5e965f6ee5669688b5643c11d881b72442c/ubuntu/jammy/flavors/default jammy Release.gpg 2024-05-21T13:32:16.914 INFO:teuthology.orchestra.run.smithi115.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-overdrive-export/7956b5e965f6ee5669688b5643c11d881b72442c/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-05-21T13:32:16.921 INFO:teuthology.orchestra.run.smithi022.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-overdrive-export/7956b5e965f6ee5669688b5643c11d881b72442c/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-05-21T13:32:16.928 INFO:teuthology.orchestra.run.smithi022.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-05-21T13:32:16.940 INFO:teuthology.orchestra.run.smithi115.stdout:Hit:8 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-05-21T13:32:16.941 INFO:teuthology.orchestra.run.smithi115.stdout:Get:9 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-overdrive-export/7956b5e965f6ee5669688b5643c11d881b72442c/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,421 B] 2024-05-21T13:32:16.949 INFO:teuthology.orchestra.run.smithi022.stdout:Get:7 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-overdrive-export/7956b5e965f6ee5669688b5643c11d881b72442c/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,421 B] 2024-05-21T13:32:17.008 INFO:teuthology.orchestra.run.smithi022.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-05-21T13:32:17.087 INFO:teuthology.orchestra.run.smithi022.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-05-21T13:32:17.166 INFO:teuthology.orchestra.run.smithi115.stdout:Fetched 29.2 kB in 0s (81.6 kB/s) 2024-05-21T13:32:17.242 INFO:teuthology.orchestra.run.smithi022.stdout:Fetched 29.2 kB in 0s (69.9 kB/s) 2024-05-21T13:32:18.159 INFO:teuthology.orchestra.run.smithi115.stdout:Reading package lists... 2024-05-21T13:32:18.175 DEBUG:teuthology.orchestra.run.smithi115:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3857-g7956b5e9-1jammy cephadm=19.0.0-3857-g7956b5e9-1jammy ceph-mds=19.0.0-3857-g7956b5e9-1jammy ceph-mgr=19.0.0-3857-g7956b5e9-1jammy ceph-common=19.0.0-3857-g7956b5e9-1jammy ceph-fuse=19.0.0-3857-g7956b5e9-1jammy ceph-test=19.0.0-3857-g7956b5e9-1jammy ceph-volume=19.0.0-3857-g7956b5e9-1jammy radosgw=19.0.0-3857-g7956b5e9-1jammy python3-rados=19.0.0-3857-g7956b5e9-1jammy python3-rgw=19.0.0-3857-g7956b5e9-1jammy python3-cephfs=19.0.0-3857-g7956b5e9-1jammy python3-rbd=19.0.0-3857-g7956b5e9-1jammy libcephfs2=19.0.0-3857-g7956b5e9-1jammy libcephfs-dev=19.0.0-3857-g7956b5e9-1jammy librados2=19.0.0-3857-g7956b5e9-1jammy librbd1=19.0.0-3857-g7956b5e9-1jammy rbd-fuse=19.0.0-3857-g7956b5e9-1jammy python3-cephfs=19.0.0-3857-g7956b5e9-1jammy cephfs-shell=19.0.0-3857-g7956b5e9-1jammy cephfs-top=19.0.0-3857-g7956b5e9-1jammy cephfs-mirror=19.0.0-3857-g7956b5e9-1jammy 2024-05-21T13:32:18.226 INFO:teuthology.orchestra.run.smithi115.stdout:Reading package lists... 2024-05-21T13:32:18.239 INFO:teuthology.orchestra.run.smithi022.stdout:Reading package lists... 2024-05-21T13:32:18.256 DEBUG:teuthology.orchestra.run.smithi022:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3857-g7956b5e9-1jammy cephadm=19.0.0-3857-g7956b5e9-1jammy ceph-mds=19.0.0-3857-g7956b5e9-1jammy ceph-mgr=19.0.0-3857-g7956b5e9-1jammy ceph-common=19.0.0-3857-g7956b5e9-1jammy ceph-fuse=19.0.0-3857-g7956b5e9-1jammy ceph-test=19.0.0-3857-g7956b5e9-1jammy ceph-volume=19.0.0-3857-g7956b5e9-1jammy radosgw=19.0.0-3857-g7956b5e9-1jammy python3-rados=19.0.0-3857-g7956b5e9-1jammy python3-rgw=19.0.0-3857-g7956b5e9-1jammy python3-cephfs=19.0.0-3857-g7956b5e9-1jammy python3-rbd=19.0.0-3857-g7956b5e9-1jammy libcephfs2=19.0.0-3857-g7956b5e9-1jammy libcephfs-dev=19.0.0-3857-g7956b5e9-1jammy librados2=19.0.0-3857-g7956b5e9-1jammy librbd1=19.0.0-3857-g7956b5e9-1jammy rbd-fuse=19.0.0-3857-g7956b5e9-1jammy python3-cephfs=19.0.0-3857-g7956b5e9-1jammy cephfs-shell=19.0.0-3857-g7956b5e9-1jammy cephfs-top=19.0.0-3857-g7956b5e9-1jammy cephfs-mirror=19.0.0-3857-g7956b5e9-1jammy 2024-05-21T13:32:18.317 INFO:teuthology.orchestra.run.smithi022.stdout:Reading package lists... 2024-05-21T13:32:18.405 INFO:teuthology.orchestra.run.smithi115.stdout:Building dependency tree... 2024-05-21T13:32:18.405 INFO:teuthology.orchestra.run.smithi115.stdout:Reading state information... 2024-05-21T13:32:18.523 INFO:teuthology.orchestra.run.smithi022.stdout:Building dependency tree... 2024-05-21T13:32:18.524 INFO:teuthology.orchestra.run.smithi022.stdout:Reading state information... 2024-05-21T13:32:18.581 INFO:teuthology.orchestra.run.smithi115.stdout:The following packages were automatically installed and are no longer required: 2024-05-21T13:32:18.581 INFO:teuthology.orchestra.run.smithi115.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-21T13:32:18.581 INFO:teuthology.orchestra.run.smithi115.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-21T13:32:18.582 INFO:teuthology.orchestra.run.smithi115.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-21T13:32:18.582 INFO:teuthology.orchestra.run.smithi115.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-21T13:32:18.582 INFO:teuthology.orchestra.run.smithi115.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-21T13:32:18.582 INFO:teuthology.orchestra.run.smithi115.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-21T13:32:18.583 INFO:teuthology.orchestra.run.smithi115.stdout:The following additional packages will be installed: 2024-05-21T13:32:18.583 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-05-21T13:32:18.583 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-05-21T13:32:18.583 INFO:teuthology.orchestra.run.smithi115.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-05-21T13:32:18.584 INFO:teuthology.orchestra.run.smithi115.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-05-21T13:32:18.584 INFO:teuthology.orchestra.run.smithi115.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-05-21T13:32:18.584 INFO:teuthology.orchestra.run.smithi115.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-05-21T13:32:18.584 INFO:teuthology.orchestra.run.smithi115.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-05-21T13:32:18.584 INFO:teuthology.orchestra.run.smithi115.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-05-21T13:32:18.584 INFO:teuthology.orchestra.run.smithi115.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-05-21T13:32:18.584 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-05-21T13:32:18.584 INFO:teuthology.orchestra.run.smithi115.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-05-21T13:32:18.584 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-05-21T13:32:18.584 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-05-21T13:32:18.584 INFO:teuthology.orchestra.run.smithi115.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-05-21T13:32:18.584 INFO:teuthology.orchestra.run.smithi115.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-05-21T13:32:18.584 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-05-21T13:32:18.584 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-05-21T13:32:18.584 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-05-21T13:32:18.585 INFO:teuthology.orchestra.run.smithi115.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-05-21T13:32:18.585 INFO:teuthology.orchestra.run.smithi115.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-05-21T13:32:18.585 INFO:teuthology.orchestra.run.smithi115.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-05-21T13:32:18.585 INFO:teuthology.orchestra.run.smithi115.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-05-21T13:32:18.585 INFO:teuthology.orchestra.run.smithi115.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-05-21T13:32:18.585 INFO:teuthology.orchestra.run.smithi115.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-05-21T13:32:18.585 INFO:teuthology.orchestra.run.smithi115.stdout:Suggested packages: 2024-05-21T13:32:18.585 INFO:teuthology.orchestra.run.smithi115.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-05-21T13:32:18.585 INFO:teuthology.orchestra.run.smithi115.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-05-21T13:32:18.585 INFO:teuthology.orchestra.run.smithi115.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-05-21T13:32:18.586 INFO:teuthology.orchestra.run.smithi115.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-05-21T13:32:18.586 INFO:teuthology.orchestra.run.smithi115.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-05-21T13:32:18.586 INFO:teuthology.orchestra.run.smithi115.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-05-21T13:32:18.586 INFO:teuthology.orchestra.run.smithi115.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-05-21T13:32:18.586 INFO:teuthology.orchestra.run.smithi115.stdout:Recommended packages: 2024-05-21T13:32:18.586 INFO:teuthology.orchestra.run.smithi115.stdout: btrfs-tools 2024-05-21T13:32:18.691 INFO:teuthology.orchestra.run.smithi115.stdout:The following NEW packages will be installed: 2024-05-21T13:32:18.691 INFO:teuthology.orchestra.run.smithi115.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-05-21T13:32:18.691 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-05-21T13:32:18.691 INFO:teuthology.orchestra.run.smithi115.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-05-21T13:32:18.691 INFO:teuthology.orchestra.run.smithi115.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-05-21T13:32:18.691 INFO:teuthology.orchestra.run.smithi115.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-05-21T13:32:18.691 INFO:teuthology.orchestra.run.smithi115.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-05-21T13:32:18.691 INFO:teuthology.orchestra.run.smithi115.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-05-21T13:32:18.691 INFO:teuthology.orchestra.run.smithi115.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-05-21T13:32:18.692 INFO:teuthology.orchestra.run.smithi115.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-05-21T13:32:18.692 INFO:teuthology.orchestra.run.smithi115.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-05-21T13:32:18.693 INFO:teuthology.orchestra.run.smithi115.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-05-21T13:32:18.693 INFO:teuthology.orchestra.run.smithi115.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-05-21T13:32:18.693 INFO:teuthology.orchestra.run.smithi115.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-05-21T13:32:18.693 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-05-21T13:32:18.693 INFO:teuthology.orchestra.run.smithi115.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-05-21T13:32:18.693 INFO:teuthology.orchestra.run.smithi115.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-05-21T13:32:18.693 INFO:teuthology.orchestra.run.smithi115.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-05-21T13:32:18.693 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-05-21T13:32:18.693 INFO:teuthology.orchestra.run.smithi115.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-05-21T13:32:18.693 INFO:teuthology.orchestra.run.smithi115.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-05-21T13:32:18.693 INFO:teuthology.orchestra.run.smithi115.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-05-21T13:32:18.693 INFO:teuthology.orchestra.run.smithi115.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-05-21T13:32:18.693 INFO:teuthology.orchestra.run.smithi115.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-05-21T13:32:18.694 INFO:teuthology.orchestra.run.smithi115.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-05-21T13:32:18.694 INFO:teuthology.orchestra.run.smithi115.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-05-21T13:32:18.694 INFO:teuthology.orchestra.run.smithi115.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-05-21T13:32:18.694 INFO:teuthology.orchestra.run.smithi115.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-05-21T13:32:18.694 INFO:teuthology.orchestra.run.smithi115.stdout: socat unzip xmlstarlet zip 2024-05-21T13:32:18.728 INFO:teuthology.orchestra.run.smithi022.stdout:The following packages were automatically installed and are no longer required: 2024-05-21T13:32:18.729 INFO:teuthology.orchestra.run.smithi022.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-21T13:32:18.729 INFO:teuthology.orchestra.run.smithi022.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-21T13:32:18.729 INFO:teuthology.orchestra.run.smithi022.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-21T13:32:18.729 INFO:teuthology.orchestra.run.smithi022.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-21T13:32:18.729 INFO:teuthology.orchestra.run.smithi022.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-21T13:32:18.729 INFO:teuthology.orchestra.run.smithi022.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-21T13:32:18.730 INFO:teuthology.orchestra.run.smithi022.stdout:The following additional packages will be installed: 2024-05-21T13:32:18.730 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-05-21T13:32:18.730 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-05-21T13:32:18.732 INFO:teuthology.orchestra.run.smithi022.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-05-21T13:32:18.732 INFO:teuthology.orchestra.run.smithi022.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-05-21T13:32:18.732 INFO:teuthology.orchestra.run.smithi022.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-05-21T13:32:18.732 INFO:teuthology.orchestra.run.smithi022.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-05-21T13:32:18.732 INFO:teuthology.orchestra.run.smithi022.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-05-21T13:32:18.732 INFO:teuthology.orchestra.run.smithi022.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-05-21T13:32:18.732 INFO:teuthology.orchestra.run.smithi022.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-05-21T13:32:18.732 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-05-21T13:32:18.732 INFO:teuthology.orchestra.run.smithi022.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-05-21T13:32:18.732 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-05-21T13:32:18.732 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-05-21T13:32:18.732 INFO:teuthology.orchestra.run.smithi022.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-05-21T13:32:18.732 INFO:teuthology.orchestra.run.smithi022.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-05-21T13:32:18.733 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-05-21T13:32:18.733 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-05-21T13:32:18.733 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-05-21T13:32:18.733 INFO:teuthology.orchestra.run.smithi022.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-05-21T13:32:18.733 INFO:teuthology.orchestra.run.smithi022.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-05-21T13:32:18.733 INFO:teuthology.orchestra.run.smithi022.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-05-21T13:32:18.733 INFO:teuthology.orchestra.run.smithi022.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-05-21T13:32:18.733 INFO:teuthology.orchestra.run.smithi022.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-05-21T13:32:18.733 INFO:teuthology.orchestra.run.smithi022.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-05-21T13:32:18.733 INFO:teuthology.orchestra.run.smithi022.stdout:Suggested packages: 2024-05-21T13:32:18.734 INFO:teuthology.orchestra.run.smithi022.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-05-21T13:32:18.734 INFO:teuthology.orchestra.run.smithi022.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-05-21T13:32:18.734 INFO:teuthology.orchestra.run.smithi022.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-05-21T13:32:18.734 INFO:teuthology.orchestra.run.smithi022.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-05-21T13:32:18.734 INFO:teuthology.orchestra.run.smithi022.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-05-21T13:32:18.734 INFO:teuthology.orchestra.run.smithi022.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-05-21T13:32:18.734 INFO:teuthology.orchestra.run.smithi022.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-05-21T13:32:18.734 INFO:teuthology.orchestra.run.smithi022.stdout:Recommended packages: 2024-05-21T13:32:18.734 INFO:teuthology.orchestra.run.smithi022.stdout: btrfs-tools 2024-05-21T13:32:18.756 INFO:teuthology.orchestra.run.smithi115.stdout:0 upgraded, 124 newly installed, 0 to remove and 307 not upgraded. 2024-05-21T13:32:18.756 INFO:teuthology.orchestra.run.smithi115.stdout:Need to get 190 MB of archives. 2024-05-21T13:32:18.756 INFO:teuthology.orchestra.run.smithi115.stdout:After this operation, 864 MB of additional disk space will be used. 2024-05-21T13:32:18.756 INFO:teuthology.orchestra.run.smithi115.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-05-21T13:32:18.776 INFO:teuthology.orchestra.run.smithi115.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-05-21T13:32:18.788 INFO:teuthology.orchestra.run.smithi115.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-05-21T13:32:18.835 INFO:teuthology.orchestra.run.smithi115.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-05-21T13:32:18.835 INFO:teuthology.orchestra.run.smithi115.stdout:Get:5 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-overdrive-export/7956b5e965f6ee5669688b5643c11d881b72442c/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3857-g7956b5e9-1jammy [3,558 kB] 2024-05-21T13:32:18.847 INFO:teuthology.orchestra.run.smithi022.stdout:The following NEW packages will be installed: 2024-05-21T13:32:18.847 INFO:teuthology.orchestra.run.smithi022.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-05-21T13:32:18.847 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-05-21T13:32:18.847 INFO:teuthology.orchestra.run.smithi022.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-05-21T13:32:18.847 INFO:teuthology.orchestra.run.smithi022.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-05-21T13:32:18.849 INFO:teuthology.orchestra.run.smithi022.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-05-21T13:32:18.849 INFO:teuthology.orchestra.run.smithi022.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-05-21T13:32:18.849 INFO:teuthology.orchestra.run.smithi022.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-05-21T13:32:18.849 INFO:teuthology.orchestra.run.smithi022.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-05-21T13:32:18.849 INFO:teuthology.orchestra.run.smithi022.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-05-21T13:32:18.849 INFO:teuthology.orchestra.run.smithi022.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-05-21T13:32:18.849 INFO:teuthology.orchestra.run.smithi022.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-05-21T13:32:18.849 INFO:teuthology.orchestra.run.smithi022.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-05-21T13:32:18.850 INFO:teuthology.orchestra.run.smithi022.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-05-21T13:32:18.850 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-05-21T13:32:18.850 INFO:teuthology.orchestra.run.smithi022.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-05-21T13:32:18.850 INFO:teuthology.orchestra.run.smithi022.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-05-21T13:32:18.850 INFO:teuthology.orchestra.run.smithi022.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-05-21T13:32:18.850 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-05-21T13:32:18.850 INFO:teuthology.orchestra.run.smithi022.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-05-21T13:32:18.850 INFO:teuthology.orchestra.run.smithi022.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-05-21T13:32:18.850 INFO:teuthology.orchestra.run.smithi022.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-05-21T13:32:18.850 INFO:teuthology.orchestra.run.smithi022.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-05-21T13:32:18.850 INFO:teuthology.orchestra.run.smithi022.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-05-21T13:32:18.851 INFO:teuthology.orchestra.run.smithi022.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-05-21T13:32:18.851 INFO:teuthology.orchestra.run.smithi022.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-05-21T13:32:18.851 INFO:teuthology.orchestra.run.smithi022.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-05-21T13:32:18.851 INFO:teuthology.orchestra.run.smithi022.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-05-21T13:32:18.851 INFO:teuthology.orchestra.run.smithi022.stdout: socat unzip xmlstarlet zip 2024-05-21T13:32:18.859 INFO:teuthology.orchestra.run.smithi115.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-05-21T13:32:18.862 INFO:teuthology.orchestra.run.smithi115.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-05-21T13:32:18.875 INFO:teuthology.orchestra.run.smithi115.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-05-21T13:32:18.913 INFO:teuthology.orchestra.run.smithi022.stdout:0 upgraded, 124 newly installed, 0 to remove and 307 not upgraded. 2024-05-21T13:32:18.913 INFO:teuthology.orchestra.run.smithi022.stdout:Need to get 190 MB of archives. 2024-05-21T13:32:18.913 INFO:teuthology.orchestra.run.smithi022.stdout:After this operation, 864 MB of additional disk space will be used. 2024-05-21T13:32:18.913 INFO:teuthology.orchestra.run.smithi022.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-05-21T13:32:18.926 INFO:teuthology.orchestra.run.smithi115.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-05-21T13:32:18.930 INFO:teuthology.orchestra.run.smithi115.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-05-21T13:32:18.935 INFO:teuthology.orchestra.run.smithi022.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-05-21T13:32:18.942 INFO:teuthology.orchestra.run.smithi115.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-05-21T13:32:18.944 INFO:teuthology.orchestra.run.smithi022.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-05-21T13:32:18.946 INFO:teuthology.orchestra.run.smithi115.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-05-21T13:32:18.946 INFO:teuthology.orchestra.run.smithi115.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-05-21T13:32:18.955 INFO:teuthology.orchestra.run.smithi115.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-05-21T13:32:18.957 INFO:teuthology.orchestra.run.smithi115.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-05-21T13:32:18.959 INFO:teuthology.orchestra.run.smithi115.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-05-21T13:32:18.960 INFO:teuthology.orchestra.run.smithi115.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-05-21T13:32:18.961 INFO:teuthology.orchestra.run.smithi115.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-05-21T13:32:18.970 INFO:teuthology.orchestra.run.smithi115.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-05-21T13:32:18.971 INFO:teuthology.orchestra.run.smithi115.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-05-21T13:32:18.973 INFO:teuthology.orchestra.run.smithi115.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-05-21T13:32:18.989 INFO:teuthology.orchestra.run.smithi115.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-05-21T13:32:18.991 INFO:teuthology.orchestra.run.smithi022.stdout:Get:4 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-overdrive-export/7956b5e965f6ee5669688b5643c11d881b72442c/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3857-g7956b5e9-1jammy [3,558 kB] 2024-05-21T13:32:18.994 INFO:teuthology.orchestra.run.smithi022.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-05-21T13:32:19.019 INFO:teuthology.orchestra.run.smithi022.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-05-21T13:32:19.022 INFO:teuthology.orchestra.run.smithi022.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-05-21T13:32:19.029 INFO:teuthology.orchestra.run.smithi115.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-05-21T13:32:19.035 INFO:teuthology.orchestra.run.smithi022.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-05-21T13:32:19.089 INFO:teuthology.orchestra.run.smithi022.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-05-21T13:32:19.094 INFO:teuthology.orchestra.run.smithi022.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-05-21T13:32:19.104 INFO:teuthology.orchestra.run.smithi115.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-05-21T13:32:19.106 INFO:teuthology.orchestra.run.smithi115.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-05-21T13:32:19.107 INFO:teuthology.orchestra.run.smithi022.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-05-21T13:32:19.107 INFO:teuthology.orchestra.run.smithi115.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-05-21T13:32:19.110 INFO:teuthology.orchestra.run.smithi115.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-05-21T13:32:19.111 INFO:teuthology.orchestra.run.smithi022.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-05-21T13:32:19.112 INFO:teuthology.orchestra.run.smithi022.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-05-21T13:32:19.114 INFO:teuthology.orchestra.run.smithi115.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-05-21T13:32:19.116 INFO:teuthology.orchestra.run.smithi115.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-05-21T13:32:19.118 INFO:teuthology.orchestra.run.smithi115.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-05-21T13:32:19.121 INFO:teuthology.orchestra.run.smithi022.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-05-21T13:32:19.123 INFO:teuthology.orchestra.run.smithi022.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-05-21T13:32:19.126 INFO:teuthology.orchestra.run.smithi022.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-05-21T13:32:19.127 INFO:teuthology.orchestra.run.smithi022.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-05-21T13:32:19.127 INFO:teuthology.orchestra.run.smithi022.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-05-21T13:32:19.134 INFO:teuthology.orchestra.run.smithi022.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-05-21T13:32:19.136 INFO:teuthology.orchestra.run.smithi022.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-05-21T13:32:19.150 INFO:teuthology.orchestra.run.smithi022.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-05-21T13:32:19.151 INFO:teuthology.orchestra.run.smithi022.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-05-21T13:32:19.152 INFO:teuthology.orchestra.run.smithi022.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-05-21T13:32:19.153 INFO:teuthology.orchestra.run.smithi022.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-05-21T13:32:19.153 INFO:teuthology.orchestra.run.smithi022.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-05-21T13:32:19.154 INFO:teuthology.orchestra.run.smithi115.stdout:Get:31 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-overdrive-export/7956b5e965f6ee5669688b5643c11d881b72442c/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3857-g7956b5e9-1jammy [3,225 kB] 2024-05-21T13:32:19.154 INFO:teuthology.orchestra.run.smithi115.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-05-21T13:32:19.154 INFO:teuthology.orchestra.run.smithi022.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-05-21T13:32:19.154 INFO:teuthology.orchestra.run.smithi022.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-05-21T13:32:19.155 INFO:teuthology.orchestra.run.smithi022.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-05-21T13:32:19.156 INFO:teuthology.orchestra.run.smithi115.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-05-21T13:32:19.158 INFO:teuthology.orchestra.run.smithi115.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-05-21T13:32:19.159 INFO:teuthology.orchestra.run.smithi115.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-05-21T13:32:19.165 INFO:teuthology.orchestra.run.smithi115.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-05-21T13:32:19.166 INFO:teuthology.orchestra.run.smithi115.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-05-21T13:32:19.166 INFO:teuthology.orchestra.run.smithi115.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-05-21T13:32:19.172 INFO:teuthology.orchestra.run.smithi115.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-05-21T13:32:19.174 INFO:teuthology.orchestra.run.smithi022.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-05-21T13:32:19.174 INFO:teuthology.orchestra.run.smithi022.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-05-21T13:32:19.176 INFO:teuthology.orchestra.run.smithi115.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-05-21T13:32:19.177 INFO:teuthology.orchestra.run.smithi115.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-05-21T13:32:19.178 INFO:teuthology.orchestra.run.smithi022.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-05-21T13:32:19.178 INFO:teuthology.orchestra.run.smithi022.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-05-21T13:32:19.179 INFO:teuthology.orchestra.run.smithi022.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-05-21T13:32:19.179 INFO:teuthology.orchestra.run.smithi022.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-05-21T13:32:19.194 INFO:teuthology.orchestra.run.smithi022.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-05-21T13:32:19.194 INFO:teuthology.orchestra.run.smithi022.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-05-21T13:32:19.195 INFO:teuthology.orchestra.run.smithi022.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-05-21T13:32:19.196 INFO:teuthology.orchestra.run.smithi022.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-05-21T13:32:19.197 INFO:teuthology.orchestra.run.smithi115.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-05-21T13:32:19.197 INFO:teuthology.orchestra.run.smithi115.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-05-21T13:32:19.198 INFO:teuthology.orchestra.run.smithi115.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-05-21T13:32:19.199 INFO:teuthology.orchestra.run.smithi115.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-05-21T13:32:19.202 INFO:teuthology.orchestra.run.smithi115.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-05-21T13:32:19.206 INFO:teuthology.orchestra.run.smithi115.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-05-21T13:32:19.207 INFO:teuthology.orchestra.run.smithi115.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-05-21T13:32:19.211 INFO:teuthology.orchestra.run.smithi115.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-05-21T13:32:19.214 INFO:teuthology.orchestra.run.smithi022.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-05-21T13:32:19.215 INFO:teuthology.orchestra.run.smithi022.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-05-21T13:32:19.220 INFO:teuthology.orchestra.run.smithi115.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-05-21T13:32:19.221 INFO:teuthology.orchestra.run.smithi022.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-05-21T13:32:19.221 INFO:teuthology.orchestra.run.smithi022.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-05-21T13:32:19.222 INFO:teuthology.orchestra.run.smithi022.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-05-21T13:32:19.223 INFO:teuthology.orchestra.run.smithi022.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-05-21T13:32:19.224 INFO:teuthology.orchestra.run.smithi115.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-05-21T13:32:19.234 INFO:teuthology.orchestra.run.smithi022.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-05-21T13:32:19.237 INFO:teuthology.orchestra.run.smithi022.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-05-21T13:32:19.238 INFO:teuthology.orchestra.run.smithi022.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-05-21T13:32:19.239 INFO:teuthology.orchestra.run.smithi022.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-05-21T13:32:19.240 INFO:teuthology.orchestra.run.smithi115.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-05-21T13:32:19.241 INFO:teuthology.orchestra.run.smithi115.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-05-21T13:32:19.246 INFO:teuthology.orchestra.run.smithi115.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-05-21T13:32:19.254 INFO:teuthology.orchestra.run.smithi022.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-05-21T13:32:19.257 INFO:teuthology.orchestra.run.smithi022.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-05-21T13:32:19.258 INFO:teuthology.orchestra.run.smithi022.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-05-21T13:32:19.259 INFO:teuthology.orchestra.run.smithi022.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-05-21T13:32:19.262 INFO:teuthology.orchestra.run.smithi022.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-05-21T13:32:19.322 INFO:teuthology.orchestra.run.smithi115.stdout:Get:55 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-overdrive-export/7956b5e965f6ee5669688b5643c11d881b72442c/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3857-g7956b5e9-1jammy [712 kB] 2024-05-21T13:32:19.337 INFO:teuthology.orchestra.run.smithi022.stdout:Get:54 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-overdrive-export/7956b5e965f6ee5669688b5643c11d881b72442c/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3857-g7956b5e9-1jammy [3,225 kB] 2024-05-21T13:32:19.338 INFO:teuthology.orchestra.run.smithi022.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-05-21T13:32:19.340 INFO:teuthology.orchestra.run.smithi022.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-05-21T13:32:19.342 INFO:teuthology.orchestra.run.smithi022.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-05-21T13:32:19.343 INFO:teuthology.orchestra.run.smithi022.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-05-21T13:32:19.344 INFO:teuthology.orchestra.run.smithi022.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-05-21T13:32:19.352 INFO:teuthology.orchestra.run.smithi115.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-05-21T13:32:19.353 INFO:teuthology.orchestra.run.smithi115.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-05-21T13:32:19.356 INFO:teuthology.orchestra.run.smithi115.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-05-21T13:32:19.356 INFO:teuthology.orchestra.run.smithi115.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-05-21T13:32:19.357 INFO:teuthology.orchestra.run.smithi115.stdout:Get:60 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-overdrive-export/7956b5e965f6ee5669688b5643c11d881b72442c/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3857-g7956b5e9-1jammy [356 kB] 2024-05-21T13:32:19.358 INFO:teuthology.orchestra.run.smithi115.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-05-21T13:32:19.382 INFO:teuthology.orchestra.run.smithi115.stdout:Get:62 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-overdrive-export/7956b5e965f6ee5669688b5643c11d881b72442c/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3857-g7956b5e9-1jammy [32.8 kB] 2024-05-21T13:32:19.384 INFO:teuthology.orchestra.run.smithi115.stdout:Get:63 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-overdrive-export/7956b5e965f6ee5669688b5643c11d881b72442c/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3857-g7956b5e9-1jammy [180 kB] 2024-05-21T13:32:19.385 INFO:teuthology.orchestra.run.smithi022.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-05-21T13:32:19.389 INFO:teuthology.orchestra.run.smithi022.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-05-21T13:32:19.389 INFO:teuthology.orchestra.run.smithi022.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-05-21T13:32:19.389 INFO:teuthology.orchestra.run.smithi115.stdout:Get:64 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-overdrive-export/7956b5e965f6ee5669688b5643c11d881b72442c/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3857-g7956b5e9-1jammy [67.4 kB] 2024-05-21T13:32:19.391 INFO:teuthology.orchestra.run.smithi115.stdout:Get:65 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-overdrive-export/7956b5e965f6ee5669688b5643c11d881b72442c/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3857-g7956b5e9-1jammy [334 kB] 2024-05-21T13:32:19.393 INFO:teuthology.orchestra.run.smithi115.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-05-21T13:32:19.399 INFO:teuthology.orchestra.run.smithi115.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-05-21T13:32:19.400 INFO:teuthology.orchestra.run.smithi115.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-05-21T13:32:19.417 INFO:teuthology.orchestra.run.smithi115.stdout:Get:69 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-overdrive-export/7956b5e965f6ee5669688b5643c11d881b72442c/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3857-g7956b5e9-1jammy [7,881 kB] 2024-05-21T13:32:19.428 INFO:teuthology.orchestra.run.smithi115.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-05-21T13:32:19.428 INFO:teuthology.orchestra.run.smithi115.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-05-21T13:32:19.431 INFO:teuthology.orchestra.run.smithi022.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-05-21T13:32:19.431 INFO:teuthology.orchestra.run.smithi022.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-05-21T13:32:19.433 INFO:teuthology.orchestra.run.smithi022.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-05-21T13:32:19.434 INFO:teuthology.orchestra.run.smithi022.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-05-21T13:32:19.434 INFO:teuthology.orchestra.run.smithi022.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-05-21T13:32:19.435 INFO:teuthology.orchestra.run.smithi022.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-05-21T13:32:19.436 INFO:teuthology.orchestra.run.smithi022.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-05-21T13:32:19.437 INFO:teuthology.orchestra.run.smithi022.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-05-21T13:32:19.441 INFO:teuthology.orchestra.run.smithi115.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-05-21T13:32:19.442 INFO:teuthology.orchestra.run.smithi115.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-05-21T13:32:19.443 INFO:teuthology.orchestra.run.smithi022.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-05-21T13:32:19.443 INFO:teuthology.orchestra.run.smithi115.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-05-21T13:32:19.444 INFO:teuthology.orchestra.run.smithi115.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-05-21T13:32:19.444 INFO:teuthology.orchestra.run.smithi115.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-05-21T13:32:19.444 INFO:teuthology.orchestra.run.smithi115.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-05-21T13:32:19.449 INFO:teuthology.orchestra.run.smithi115.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-05-21T13:32:19.458 INFO:teuthology.orchestra.run.smithi022.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-05-21T13:32:19.459 INFO:teuthology.orchestra.run.smithi022.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-05-21T13:32:19.461 INFO:teuthology.orchestra.run.smithi022.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-05-21T13:32:19.465 INFO:teuthology.orchestra.run.smithi115.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-05-21T13:32:19.466 INFO:teuthology.orchestra.run.smithi022.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-05-21T13:32:19.467 INFO:teuthology.orchestra.run.smithi115.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-05-21T13:32:19.468 INFO:teuthology.orchestra.run.smithi115.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-05-21T13:32:19.469 INFO:teuthology.orchestra.run.smithi022.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-05-21T13:32:19.470 INFO:teuthology.orchestra.run.smithi022.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-05-21T13:32:19.477 INFO:teuthology.orchestra.run.smithi022.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-05-21T13:32:19.478 INFO:teuthology.orchestra.run.smithi022.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-05-21T13:32:19.484 INFO:teuthology.orchestra.run.smithi022.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-05-21T13:32:19.485 INFO:teuthology.orchestra.run.smithi022.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-05-21T13:32:19.486 INFO:teuthology.orchestra.run.smithi115.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-05-21T13:32:19.489 INFO:teuthology.orchestra.run.smithi115.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-05-21T13:32:19.490 INFO:teuthology.orchestra.run.smithi115.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-05-21T13:32:19.491 INFO:teuthology.orchestra.run.smithi115.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-05-21T13:32:19.492 INFO:teuthology.orchestra.run.smithi115.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-05-21T13:32:19.497 INFO:teuthology.orchestra.run.smithi022.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-05-21T13:32:19.497 INFO:teuthology.orchestra.run.smithi022.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-05-21T13:32:19.498 INFO:teuthology.orchestra.run.smithi115.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-05-21T13:32:19.498 INFO:teuthology.orchestra.run.smithi115.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-05-21T13:32:19.499 INFO:teuthology.orchestra.run.smithi022.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-05-21T13:32:19.499 INFO:teuthology.orchestra.run.smithi022.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-05-21T13:32:19.502 INFO:teuthology.orchestra.run.smithi022.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-05-21T13:32:19.506 INFO:teuthology.orchestra.run.smithi022.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-05-21T13:32:19.507 INFO:teuthology.orchestra.run.smithi115.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-05-21T13:32:19.507 INFO:teuthology.orchestra.run.smithi115.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-05-21T13:32:19.508 INFO:teuthology.orchestra.run.smithi115.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-05-21T13:32:19.517 INFO:teuthology.orchestra.run.smithi022.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-05-21T13:32:19.518 INFO:teuthology.orchestra.run.smithi022.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-05-21T13:32:19.518 INFO:teuthology.orchestra.run.smithi022.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-05-21T13:32:19.521 INFO:teuthology.orchestra.run.smithi022.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-05-21T13:32:19.526 INFO:teuthology.orchestra.run.smithi115.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-05-21T13:32:19.528 INFO:teuthology.orchestra.run.smithi115.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-05-21T13:32:19.529 INFO:teuthology.orchestra.run.smithi115.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-05-21T13:32:19.539 INFO:teuthology.orchestra.run.smithi115.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-05-21T13:32:19.539 INFO:teuthology.orchestra.run.smithi115.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-05-21T13:32:19.539 INFO:teuthology.orchestra.run.smithi115.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-05-21T13:32:19.541 INFO:teuthology.orchestra.run.smithi022.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-05-21T13:32:19.542 INFO:teuthology.orchestra.run.smithi115.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-05-21T13:32:19.558 INFO:teuthology.orchestra.run.smithi115.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-05-21T13:32:19.587 INFO:teuthology.orchestra.run.smithi022.stdout:Get:93 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-overdrive-export/7956b5e965f6ee5669688b5643c11d881b72442c/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3857-g7956b5e9-1jammy [712 kB] 2024-05-21T13:32:19.635 INFO:teuthology.orchestra.run.smithi022.stdout:Get:94 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-overdrive-export/7956b5e965f6ee5669688b5643c11d881b72442c/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3857-g7956b5e9-1jammy [356 kB] 2024-05-21T13:32:19.671 INFO:teuthology.orchestra.run.smithi022.stdout:Get:95 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-overdrive-export/7956b5e965f6ee5669688b5643c11d881b72442c/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3857-g7956b5e9-1jammy [32.8 kB] 2024-05-21T13:32:19.674 INFO:teuthology.orchestra.run.smithi022.stdout:Get:96 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-overdrive-export/7956b5e965f6ee5669688b5643c11d881b72442c/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3857-g7956b5e9-1jammy [180 kB] 2024-05-21T13:32:19.679 INFO:teuthology.orchestra.run.smithi022.stdout:Get:97 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-overdrive-export/7956b5e965f6ee5669688b5643c11d881b72442c/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3857-g7956b5e9-1jammy [67.4 kB] 2024-05-21T13:32:19.682 INFO:teuthology.orchestra.run.smithi022.stdout:Get:98 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-overdrive-export/7956b5e965f6ee5669688b5643c11d881b72442c/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3857-g7956b5e9-1jammy [334 kB] 2024-05-21T13:32:19.720 INFO:teuthology.orchestra.run.smithi022.stdout:Get:99 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-overdrive-export/7956b5e965f6ee5669688b5643c11d881b72442c/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3857-g7956b5e9-1jammy [7,881 kB] 2024-05-21T13:32:19.864 INFO:teuthology.orchestra.run.smithi115.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-overdrive-export/7956b5e965f6ee5669688b5643c11d881b72442c/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3857-g7956b5e9-1jammy [112 kB] 2024-05-21T13:32:19.867 INFO:teuthology.orchestra.run.smithi115.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-overdrive-export/7956b5e965f6ee5669688b5643c11d881b72442c/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3857-g7956b5e9-1jammy [467 kB] 2024-05-21T13:32:19.905 INFO:teuthology.orchestra.run.smithi115.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-overdrive-export/7956b5e965f6ee5669688b5643c11d881b72442c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3857-g7956b5e9-1jammy [27.8 MB] 2024-05-21T13:32:20.306 INFO:teuthology.orchestra.run.smithi022.stdout:Get:100 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-overdrive-export/7956b5e965f6ee5669688b5643c11d881b72442c/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3857-g7956b5e9-1jammy [112 kB] 2024-05-21T13:32:20.308 INFO:teuthology.orchestra.run.smithi022.stdout:Get:101 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-overdrive-export/7956b5e965f6ee5669688b5643c11d881b72442c/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3857-g7956b5e9-1jammy [467 kB] 2024-05-21T13:32:20.365 INFO:teuthology.orchestra.run.smithi022.stdout:Get:102 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-overdrive-export/7956b5e965f6ee5669688b5643c11d881b72442c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3857-g7956b5e9-1jammy [27.8 MB] 2024-05-21T13:32:21.591 INFO:teuthology.orchestra.run.smithi115.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-overdrive-export/7956b5e965f6ee5669688b5643c11d881b72442c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3857-g7956b5e9-1jammy [5,094 kB] 2024-05-21T13:32:21.805 INFO:teuthology.orchestra.run.smithi115.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-overdrive-export/7956b5e965f6ee5669688b5643c11d881b72442c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3857-g7956b5e9-1jammy [245 kB] 2024-05-21T13:32:21.812 INFO:teuthology.orchestra.run.smithi115.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-overdrive-export/7956b5e965f6ee5669688b5643c11d881b72442c/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3857-g7956b5e9-1jammy [124 kB] 2024-05-21T13:32:21.816 INFO:teuthology.orchestra.run.smithi115.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-overdrive-export/7956b5e965f6ee5669688b5643c11d881b72442c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3857-g7956b5e9-1jammy [1,546 kB] 2024-05-21T13:32:21.915 INFO:teuthology.orchestra.run.smithi115.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-overdrive-export/7956b5e965f6ee5669688b5643c11d881b72442c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3857-g7956b5e9-1jammy [6,260 kB] 2024-05-21T13:32:22.270 INFO:teuthology.orchestra.run.smithi115.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-overdrive-export/7956b5e965f6ee5669688b5643c11d881b72442c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3857-g7956b5e9-1jammy [22.8 MB] 2024-05-21T13:32:22.572 INFO:teuthology.orchestra.run.smithi022.stdout:Get:103 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-overdrive-export/7956b5e965f6ee5669688b5643c11d881b72442c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3857-g7956b5e9-1jammy [5,094 kB] 2024-05-21T13:32:22.859 INFO:teuthology.orchestra.run.smithi022.stdout:Get:104 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-overdrive-export/7956b5e965f6ee5669688b5643c11d881b72442c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3857-g7956b5e9-1jammy [245 kB] 2024-05-21T13:32:22.904 INFO:teuthology.orchestra.run.smithi022.stdout:Get:105 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-overdrive-export/7956b5e965f6ee5669688b5643c11d881b72442c/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3857-g7956b5e9-1jammy [124 kB] 2024-05-21T13:32:22.908 INFO:teuthology.orchestra.run.smithi022.stdout:Get:106 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-overdrive-export/7956b5e965f6ee5669688b5643c11d881b72442c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3857-g7956b5e9-1jammy [1,546 kB] 2024-05-21T13:32:23.005 INFO:teuthology.orchestra.run.smithi022.stdout:Get:107 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-overdrive-export/7956b5e965f6ee5669688b5643c11d881b72442c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3857-g7956b5e9-1jammy [6,260 kB] 2024-05-21T13:32:23.509 INFO:teuthology.orchestra.run.smithi022.stdout:Get:108 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-overdrive-export/7956b5e965f6ee5669688b5643c11d881b72442c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3857-g7956b5e9-1jammy [22.8 MB] 2024-05-21T13:32:23.645 INFO:teuthology.orchestra.run.smithi115.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-overdrive-export/7956b5e965f6ee5669688b5643c11d881b72442c/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3857-g7956b5e9-1jammy [14.1 kB] 2024-05-21T13:32:23.645 INFO:teuthology.orchestra.run.smithi115.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-overdrive-export/7956b5e965f6ee5669688b5643c11d881b72442c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3857-g7956b5e9-1jammy [870 kB] 2024-05-21T13:32:23.663 INFO:teuthology.orchestra.run.smithi115.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-overdrive-export/7956b5e965f6ee5669688b5643c11d881b72442c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3857-g7956b5e9-1jammy [2,445 kB] 2024-05-21T13:32:23.775 INFO:teuthology.orchestra.run.smithi115.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-overdrive-export/7956b5e965f6ee5669688b5643c11d881b72442c/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3857-g7956b5e9-1jammy [793 kB] 2024-05-21T13:32:23.819 INFO:teuthology.orchestra.run.smithi115.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-overdrive-export/7956b5e965f6ee5669688b5643c11d881b72442c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3857-g7956b5e9-1jammy [149 kB] 2024-05-21T13:32:23.824 INFO:teuthology.orchestra.run.smithi115.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-overdrive-export/7956b5e965f6ee5669688b5643c11d881b72442c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3857-g7956b5e9-1jammy [2,222 kB] 2024-05-21T13:32:23.947 INFO:teuthology.orchestra.run.smithi115.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-overdrive-export/7956b5e965f6ee5669688b5643c11d881b72442c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3857-g7956b5e9-1jammy [8,625 kB] 2024-05-21T13:32:24.452 INFO:teuthology.orchestra.run.smithi115.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-overdrive-export/7956b5e965f6ee5669688b5643c11d881b72442c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3857-g7956b5e9-1jammy [14.2 kB] 2024-05-21T13:32:24.452 INFO:teuthology.orchestra.run.smithi115.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-overdrive-export/7956b5e965f6ee5669688b5643c11d881b72442c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3857-g7956b5e9-1jammy [54.7 MB] 2024-05-21T13:32:25.223 INFO:teuthology.orchestra.run.smithi022.stdout:Get:109 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-overdrive-export/7956b5e965f6ee5669688b5643c11d881b72442c/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3857-g7956b5e9-1jammy [14.1 kB] 2024-05-21T13:32:25.224 INFO:teuthology.orchestra.run.smithi022.stdout:Get:110 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-overdrive-export/7956b5e965f6ee5669688b5643c11d881b72442c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3857-g7956b5e9-1jammy [870 kB] 2024-05-21T13:32:25.242 INFO:teuthology.orchestra.run.smithi022.stdout:Get:111 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-overdrive-export/7956b5e965f6ee5669688b5643c11d881b72442c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3857-g7956b5e9-1jammy [2,445 kB] 2024-05-21T13:32:25.360 INFO:teuthology.orchestra.run.smithi022.stdout:Get:112 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-overdrive-export/7956b5e965f6ee5669688b5643c11d881b72442c/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3857-g7956b5e9-1jammy [793 kB] 2024-05-21T13:32:25.419 INFO:teuthology.orchestra.run.smithi022.stdout:Get:113 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-overdrive-export/7956b5e965f6ee5669688b5643c11d881b72442c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3857-g7956b5e9-1jammy [149 kB] 2024-05-21T13:32:25.423 INFO:teuthology.orchestra.run.smithi022.stdout:Get:114 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-overdrive-export/7956b5e965f6ee5669688b5643c11d881b72442c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3857-g7956b5e9-1jammy [2,222 kB] 2024-05-21T13:32:25.564 INFO:teuthology.orchestra.run.smithi022.stdout:Get:115 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-overdrive-export/7956b5e965f6ee5669688b5643c11d881b72442c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3857-g7956b5e9-1jammy [8,625 kB] 2024-05-21T13:32:26.124 INFO:teuthology.orchestra.run.smithi022.stdout:Get:116 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-overdrive-export/7956b5e965f6ee5669688b5643c11d881b72442c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3857-g7956b5e9-1jammy [14.2 kB] 2024-05-21T13:32:26.124 INFO:teuthology.orchestra.run.smithi022.stdout:Get:117 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-overdrive-export/7956b5e965f6ee5669688b5643c11d881b72442c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3857-g7956b5e9-1jammy [54.7 MB] 2024-05-21T13:32:28.268 INFO:teuthology.orchestra.run.smithi115.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-overdrive-export/7956b5e965f6ee5669688b5643c11d881b72442c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3857-g7956b5e9-1jammy [124 kB] 2024-05-21T13:32:28.271 INFO:teuthology.orchestra.run.smithi115.stdout:Get:119 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-overdrive-export/7956b5e965f6ee5669688b5643c11d881b72442c/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-3857-g7956b5e9-1jammy [232 kB] 2024-05-21T13:32:28.275 INFO:teuthology.orchestra.run.smithi115.stdout:Get:120 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-overdrive-export/7956b5e965f6ee5669688b5643c11d881b72442c/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-3857-g7956b5e9-1jammy [33.9 kB] 2024-05-21T13:32:28.276 INFO:teuthology.orchestra.run.smithi115.stdout:Get:121 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-overdrive-export/7956b5e965f6ee5669688b5643c11d881b72442c/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-3857-g7956b5e9-1jammy [23.4 kB] 2024-05-21T13:32:28.277 INFO:teuthology.orchestra.run.smithi115.stdout:Get:122 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-overdrive-export/7956b5e965f6ee5669688b5643c11d881b72442c/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3857-g7956b5e9-1jammy [38.9 kB] 2024-05-21T13:32:28.278 INFO:teuthology.orchestra.run.smithi115.stdout:Get:123 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-overdrive-export/7956b5e965f6ee5669688b5643c11d881b72442c/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3857-g7956b5e9-1jammy [15.7 MB] 2024-05-21T13:32:29.132 INFO:teuthology.orchestra.run.smithi115.stdout:Get:124 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-overdrive-export/7956b5e965f6ee5669688b5643c11d881b72442c/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3857-g7956b5e9-1jammy [91.5 kB] 2024-05-21T13:32:29.613 INFO:teuthology.orchestra.run.smithi022.stdout:Get:118 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-overdrive-export/7956b5e965f6ee5669688b5643c11d881b72442c/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3857-g7956b5e9-1jammy [124 kB] 2024-05-21T13:32:29.616 INFO:teuthology.orchestra.run.smithi022.stdout:Get:119 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-overdrive-export/7956b5e965f6ee5669688b5643c11d881b72442c/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-3857-g7956b5e9-1jammy [232 kB] 2024-05-21T13:32:29.620 INFO:teuthology.orchestra.run.smithi022.stdout:Get:120 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-overdrive-export/7956b5e965f6ee5669688b5643c11d881b72442c/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-3857-g7956b5e9-1jammy [33.9 kB] 2024-05-21T13:32:29.621 INFO:teuthology.orchestra.run.smithi022.stdout:Get:121 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-overdrive-export/7956b5e965f6ee5669688b5643c11d881b72442c/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-3857-g7956b5e9-1jammy [23.4 kB] 2024-05-21T13:32:29.673 INFO:teuthology.orchestra.run.smithi022.stdout:Get:122 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-overdrive-export/7956b5e965f6ee5669688b5643c11d881b72442c/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3857-g7956b5e9-1jammy [38.9 kB] 2024-05-21T13:32:29.674 INFO:teuthology.orchestra.run.smithi022.stdout:Get:123 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-overdrive-export/7956b5e965f6ee5669688b5643c11d881b72442c/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3857-g7956b5e9-1jammy [15.7 MB] 2024-05-21T13:32:29.746 INFO:teuthology.orchestra.run.smithi115.stdout:Fetched 190 MB in 10s (18.2 MB/s) 2024-05-21T13:32:29.878 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-pyperclip. 2024-05-21T13:32:29.971 INFO:teuthology.orchestra.run.smithi115.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-05-21T13:32:29.976 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-05-21T13:32:30.027 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-05-21T13:32:30.116 INFO:teuthology.orchestra.run.smithi022.stdout:Get:124 https://1.chacra.ceph.com/r/ceph/wip-lusov-quiesce-overdrive-export/7956b5e965f6ee5669688b5643c11d881b72442c/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3857-g7956b5e9-1jammy [91.5 kB] 2024-05-21T13:32:30.304 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-wcwidth. 2024-05-21T13:32:30.331 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-05-21T13:32:30.374 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-21T13:32:30.682 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-cmd2. 2024-05-21T13:32:30.709 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-05-21T13:32:30.737 INFO:teuthology.orchestra.run.smithi022.stdout:Fetched 190 MB in 11s (16.8 MB/s) 2024-05-21T13:32:30.749 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-05-21T13:32:30.874 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-pyperclip. 2024-05-21T13:32:30.974 INFO:teuthology.orchestra.run.smithi022.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165990 files and directories currently installed.) 2024-05-21T13:32:30.980 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-05-21T13:32:31.023 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-05-21T13:32:31.102 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-05-21T13:32:31.128 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-05-21T13:32:31.210 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-21T13:32:31.317 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-wcwidth. 2024-05-21T13:32:31.345 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-05-21T13:32:31.384 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-21T13:32:31.547 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-05-21T13:32:31.574 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-05-21T13:32:31.614 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-21T13:32:31.695 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-cmd2. 2024-05-21T13:32:31.722 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-05-21T13:32:31.762 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-05-21T13:32:31.925 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-05-21T13:32:31.952 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-05-21T13:32:31.992 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-21T13:32:32.073 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-05-21T13:32:32.100 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-05-21T13:32:32.173 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-21T13:32:32.437 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-05-21T13:32:32.463 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-21T13:32:32.485 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-05-21T13:32:32.512 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-21T13:32:32.512 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-05-21T13:32:32.551 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-21T13:32:32.896 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-05-21T13:32:32.924 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-05-21T13:32:32.971 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-21T13:32:33.073 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-05-21T13:32:33.100 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-21T13:32:33.132 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-21T13:32:33.391 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-05-21T13:32:33.410 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-05-21T13:32:33.419 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-21T13:32:33.438 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-21T13:32:33.466 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-21T13:32:33.468 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-21T13:32:33.836 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-05-21T13:32:33.846 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-05-21T13:32:33.863 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-21T13:32:33.873 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-05-21T13:32:33.902 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-21T13:32:33.913 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-21T13:32:34.232 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package librados2. 2024-05-21T13:32:34.238 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-05-21T13:32:34.259 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../010-librados2_19.0.0-3857-g7956b5e9-1jammy_amd64.deb ... 2024-05-21T13:32:34.266 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-05-21T13:32:34.299 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking librados2 (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:32:34.305 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-21T13:32:34.619 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-05-21T13:32:34.635 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-05-21T13:32:34.677 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-21T13:32:34.719 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package librbd1. 2024-05-21T13:32:34.745 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../011-librbd1_19.0.0-3857-g7956b5e9-1jammy_amd64.deb ... 2024-05-21T13:32:34.777 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking librbd1 (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:32:34.996 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package librados2. 2024-05-21T13:32:35.024 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../010-librados2_19.0.0-3857-g7956b5e9-1jammy_amd64.deb ... 2024-05-21T13:32:35.063 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking librados2 (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:32:35.196 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libcephfs2. 2024-05-21T13:32:35.223 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-3857-g7956b5e9-1jammy_amd64.deb ... 2024-05-21T13:32:35.263 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libcephfs2 (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:32:35.515 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package librbd1. 2024-05-21T13:32:35.532 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-rados. 2024-05-21T13:32:35.543 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../011-librbd1_19.0.0-3857-g7956b5e9-1jammy_amd64.deb ... 2024-05-21T13:32:35.547 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../013-python3-rados_19.0.0-3857-g7956b5e9-1jammy_amd64.deb ... 2024-05-21T13:32:35.582 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking librbd1 (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:32:35.590 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-rados (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:32:35.910 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-05-21T13:32:35.937 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-3857-g7956b5e9-1jammy_all.deb ... 2024-05-21T13:32:35.976 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-ceph-argparse (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:32:35.993 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package libcephfs2. 2024-05-21T13:32:36.021 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-3857-g7956b5e9-1jammy_amd64.deb ... 2024-05-21T13:32:36.060 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking libcephfs2 (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:32:36.179 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-cephfs. 2024-05-21T13:32:36.195 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-3857-g7956b5e9-1jammy_amd64.deb ... 2024-05-21T13:32:36.229 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-cephfs (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:32:36.312 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-rados. 2024-05-21T13:32:36.340 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../013-python3-rados_19.0.0-3857-g7956b5e9-1jammy_amd64.deb ... 2024-05-21T13:32:36.379 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-rados (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:32:36.523 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-ceph-common. 2024-05-21T13:32:36.550 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-3857-g7956b5e9-1jammy_all.deb ... 2024-05-21T13:32:36.590 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-ceph-common (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:32:36.698 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-05-21T13:32:36.726 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-3857-g7956b5e9-1jammy_all.deb ... 2024-05-21T13:32:36.764 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-ceph-argparse (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:32:36.926 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-prettytable. 2024-05-21T13:32:36.953 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-05-21T13:32:36.993 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-05-21T13:32:37.050 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-cephfs. 2024-05-21T13:32:37.078 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-3857-g7956b5e9-1jammy_amd64.deb ... 2024-05-21T13:32:37.117 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-cephfs (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:32:37.254 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-rbd. 2024-05-21T13:32:37.269 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-3857-g7956b5e9-1jammy_amd64.deb ... 2024-05-21T13:32:37.312 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-rbd (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:32:37.419 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-ceph-common. 2024-05-21T13:32:37.447 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-3857-g7956b5e9-1jammy_all.deb ... 2024-05-21T13:32:37.486 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-ceph-common (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:32:37.607 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-05-21T13:32:37.634 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-05-21T13:32:37.665 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-21T13:32:37.756 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-prettytable. 2024-05-21T13:32:37.783 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-05-21T13:32:37.814 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-05-21T13:32:37.943 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-05-21T13:32:37.958 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-05-21T13:32:38.001 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-05-21T13:32:38.050 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-rbd. 2024-05-21T13:32:38.066 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-3857-g7956b5e9-1jammy_amd64.deb ... 2024-05-21T13:32:38.109 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-rbd (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:32:38.469 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-05-21T13:32:38.495 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-05-21T13:32:38.497 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-05-21T13:32:38.511 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-05-21T13:32:38.536 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-21T13:32:38.554 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-05-21T13:32:38.788 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-05-21T13:32:38.805 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-05-21T13:32:38.838 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-05-21T13:32:38.874 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package lua5.1. 2024-05-21T13:32:38.900 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-05-21T13:32:38.949 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-05-21T13:32:39.124 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-05-21T13:32:39.152 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-05-21T13:32:39.190 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-05-21T13:32:39.235 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package lua-any. 2024-05-21T13:32:39.251 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-05-21T13:32:39.293 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking lua-any (27ubuntu1) ... 2024-05-21T13:32:39.511 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package lua5.1. 2024-05-21T13:32:39.538 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package zip. 2024-05-21T13:32:39.538 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-05-21T13:32:39.554 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-05-21T13:32:39.577 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-05-21T13:32:39.596 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking zip (3.0-12build2) ... 2024-05-21T13:32:39.888 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package lua-any. 2024-05-21T13:32:39.908 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package unzip. 2024-05-21T13:32:39.916 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-05-21T13:32:39.935 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-05-21T13:32:39.955 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking lua-any (27ubuntu1) ... 2024-05-21T13:32:39.991 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-05-21T13:32:40.174 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package zip. 2024-05-21T13:32:40.190 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-05-21T13:32:40.224 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking zip (3.0-12build2) ... 2024-05-21T13:32:40.378 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package luarocks. 2024-05-21T13:32:40.405 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-05-21T13:32:40.445 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-05-21T13:32:40.527 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package unzip. 2024-05-21T13:32:40.557 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-05-21T13:32:40.594 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-05-21T13:32:40.778 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package librgw2. 2024-05-21T13:32:40.805 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../027-librgw2_19.0.0-3857-g7956b5e9-1jammy_amd64.deb ... 2024-05-21T13:32:40.836 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking librgw2 (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:32:40.980 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package luarocks. 2024-05-21T13:32:41.008 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-05-21T13:32:41.047 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-05-21T13:32:41.413 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-rgw. 2024-05-21T13:32:41.438 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package librgw2. 2024-05-21T13:32:41.440 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-3857-g7956b5e9-1jammy_amd64.deb ... 2024-05-21T13:32:41.466 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../027-librgw2_19.0.0-3857-g7956b5e9-1jammy_amd64.deb ... 2024-05-21T13:32:41.480 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-rgw (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:32:41.504 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking librgw2 (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:32:41.808 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package liboath0:amd64. 2024-05-21T13:32:41.839 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-05-21T13:32:41.874 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-05-21T13:32:42.106 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-rgw. 2024-05-21T13:32:42.123 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-3857-g7956b5e9-1jammy_amd64.deb ... 2024-05-21T13:32:42.161 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libradosstriper1. 2024-05-21T13:32:42.164 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-rgw (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:32:42.188 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-3857-g7956b5e9-1jammy_amd64.deb ... 2024-05-21T13:32:42.219 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libradosstriper1 (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:32:42.509 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package liboath0:amd64. 2024-05-21T13:32:42.537 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-05-21T13:32:42.576 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-05-21T13:32:42.614 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package ceph-common. 2024-05-21T13:32:42.641 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../031-ceph-common_19.0.0-3857-g7956b5e9-1jammy_amd64.deb ... 2024-05-21T13:32:42.680 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking ceph-common (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:32:42.879 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package libradosstriper1. 2024-05-21T13:32:42.907 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-3857-g7956b5e9-1jammy_amd64.deb ... 2024-05-21T13:32:42.945 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking libradosstriper1 (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:32:43.299 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package ceph-common. 2024-05-21T13:32:43.326 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../031-ceph-common_19.0.0-3857-g7956b5e9-1jammy_amd64.deb ... 2024-05-21T13:32:43.356 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking ceph-common (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:32:44.169 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package ceph-base. 2024-05-21T13:32:44.196 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../032-ceph-base_19.0.0-3857-g7956b5e9-1jammy_amd64.deb ... 2024-05-21T13:32:44.246 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking ceph-base (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:32:44.832 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-05-21T13:32:44.853 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package ceph-base. 2024-05-21T13:32:44.858 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-05-21T13:32:44.881 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../032-ceph-base_19.0.0-3857-g7956b5e9-1jammy_amd64.deb ... 2024-05-21T13:32:44.898 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-05-21T13:32:44.928 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking ceph-base (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:32:45.178 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-cheroot. 2024-05-21T13:32:45.204 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-05-21T13:32:45.244 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-21T13:32:45.507 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-05-21T13:32:45.535 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-05-21T13:32:45.539 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-05-21T13:32:45.566 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-05-21T13:32:45.573 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-05-21T13:32:45.597 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-05-21T13:32:45.885 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-cheroot. 2024-05-21T13:32:45.891 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-jaraco.text. 2024-05-21T13:32:45.913 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-05-21T13:32:45.919 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-05-21T13:32:45.951 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-21T13:32:45.958 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-05-21T13:32:46.271 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-05-21T13:32:46.294 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-05-21T13:32:46.299 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-05-21T13:32:46.321 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-05-21T13:32:46.337 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-05-21T13:32:46.361 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-05-21T13:32:46.632 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-jaraco.text. 2024-05-21T13:32:46.649 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-05-21T13:32:46.663 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-tempora. 2024-05-21T13:32:46.682 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-05-21T13:32:46.690 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-05-21T13:32:46.730 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-05-21T13:32:46.968 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-05-21T13:32:46.991 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-portend. 2024-05-21T13:32:46.996 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-05-21T13:32:47.017 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-05-21T13:32:47.049 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-05-21T13:32:47.084 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-05-21T13:32:47.361 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-05-21T13:32:47.387 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-05-21T13:32:47.395 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-tempora. 2024-05-21T13:32:47.424 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-05-21T13:32:47.427 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-05-21T13:32:47.462 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-05-21T13:32:47.730 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-cherrypy3. 2024-05-21T13:32:47.757 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-05-21T13:32:47.765 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-portend. 2024-05-21T13:32:47.793 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-05-21T13:32:47.796 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-05-21T13:32:47.831 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-05-21T13:32:48.101 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-05-21T13:32:48.129 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-05-21T13:32:48.141 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-natsort. 2024-05-21T13:32:48.160 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-05-21T13:32:48.168 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-05-21T13:32:48.208 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-05-21T13:32:48.445 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-cherrypy3. 2024-05-21T13:32:48.473 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-05-21T13:32:48.512 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-05-21T13:32:48.519 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-logutils. 2024-05-21T13:32:48.546 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-05-21T13:32:48.586 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-05-21T13:32:48.823 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-natsort. 2024-05-21T13:32:48.851 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-05-21T13:32:48.880 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-markupsafe. 2024-05-21T13:32:48.881 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-05-21T13:32:48.907 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-05-21T13:32:48.947 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-05-21T13:32:49.168 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-logutils. 2024-05-21T13:32:49.196 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-05-21T13:32:49.200 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-mako. 2024-05-21T13:32:49.226 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-05-21T13:32:49.234 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-05-21T13:32:49.266 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-21T13:32:49.562 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-markupsafe. 2024-05-21T13:32:49.586 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-simplegeneric. 2024-05-21T13:32:49.590 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-05-21T13:32:49.612 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-05-21T13:32:49.629 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-05-21T13:32:49.653 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-05-21T13:32:49.932 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-mako. 2024-05-21T13:32:49.955 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-singledispatch. 2024-05-21T13:32:49.959 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-05-21T13:32:49.981 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-05-21T13:32:49.998 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-21T13:32:50.022 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-05-21T13:32:50.285 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-simplegeneric. 2024-05-21T13:32:50.308 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-webob. 2024-05-21T13:32:50.313 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-05-21T13:32:50.334 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-05-21T13:32:50.343 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-05-21T13:32:50.374 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-05-21T13:32:50.621 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-singledispatch. 2024-05-21T13:32:50.649 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-05-21T13:32:50.687 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-05-21T13:32:50.694 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-waitress. 2024-05-21T13:32:50.721 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-05-21T13:32:50.756 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-21T13:32:50.980 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-tempita. 2024-05-21T13:32:50.990 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-webob. 2024-05-21T13:32:50.995 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-05-21T13:32:51.018 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-05-21T13:32:51.038 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-05-21T13:32:51.056 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-05-21T13:32:51.341 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-paste. 2024-05-21T13:32:51.367 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-05-21T13:32:51.407 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-05-21T13:32:51.417 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-waitress. 2024-05-21T13:32:51.445 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-05-21T13:32:51.487 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-21T13:32:51.710 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-05-21T13:32:51.726 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-05-21T13:32:51.760 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-05-21T13:32:51.804 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-tempita. 2024-05-21T13:32:51.831 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-05-21T13:32:51.870 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-05-21T13:32:52.139 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-paste. 2024-05-21T13:32:52.156 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-05-21T13:32:52.198 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-05-21T13:32:52.501 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-05-21T13:32:52.529 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-05-21T13:32:52.567 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-05-21T13:32:52.831 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-pastedeploy. 2024-05-21T13:32:52.845 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-pastedeploy. 2024-05-21T13:32:52.857 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-05-21T13:32:52.873 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-05-21T13:32:52.897 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-05-21T13:32:52.911 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-05-21T13:32:53.200 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-webtest. 2024-05-21T13:32:53.214 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-webtest. 2024-05-21T13:32:53.226 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-05-21T13:32:53.242 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-05-21T13:32:53.266 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-05-21T13:32:53.281 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-05-21T13:32:53.586 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-pecan. 2024-05-21T13:32:53.612 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-05-21T13:32:53.617 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-pecan. 2024-05-21T13:32:53.645 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-05-21T13:32:53.652 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-05-21T13:32:53.684 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-05-21T13:32:54.015 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-certifi. 2024-05-21T13:32:54.038 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-certifi. 2024-05-21T13:32:54.042 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-05-21T13:32:54.066 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-05-21T13:32:54.081 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-05-21T13:32:54.105 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-05-21T13:32:54.385 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-idna. 2024-05-21T13:32:54.399 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-idna. 2024-05-21T13:32:54.411 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-05-21T13:32:54.427 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-05-21T13:32:54.443 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-idna (3.3-1) ... 2024-05-21T13:32:54.457 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-idna (3.3-1) ... 2024-05-21T13:32:54.744 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-urllib3. 2024-05-21T13:32:54.745 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-urllib3. 2024-05-21T13:32:54.772 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-05-21T13:32:54.772 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-05-21T13:32:54.810 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-21T13:32:54.812 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-21T13:32:55.097 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-requests. 2024-05-21T13:32:55.125 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-05-21T13:32:55.132 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-requests. 2024-05-21T13:32:55.158 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-05-21T13:32:55.163 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-21T13:32:55.198 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-21T13:32:55.474 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-werkzeug. 2024-05-21T13:32:55.502 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-05-21T13:32:55.518 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-werkzeug. 2024-05-21T13:32:55.541 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-05-21T13:32:55.544 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-05-21T13:32:55.584 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-05-21T13:32:55.802 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-05-21T13:32:55.830 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-3857-g7956b5e9-1jammy_all.deb ... 2024-05-21T13:32:55.869 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:32:55.870 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-05-21T13:32:55.897 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-3857-g7956b5e9-1jammy_all.deb ... 2024-05-21T13:32:55.937 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:32:56.265 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-05-21T13:32:56.293 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-3857-g7956b5e9-1jammy_amd64.deb ... 2024-05-21T13:32:56.308 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-05-21T13:32:56.331 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:32:56.335 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-3857-g7956b5e9-1jammy_amd64.deb ... 2024-05-21T13:32:56.375 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:32:56.567 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-bcrypt. 2024-05-21T13:32:56.595 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-05-21T13:32:56.625 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-05-21T13:32:56.636 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-bcrypt. 2024-05-21T13:32:56.651 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-05-21T13:32:56.711 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-05-21T13:32:56.920 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-openssl. 2024-05-21T13:32:56.948 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-05-21T13:32:56.986 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-05-21T13:32:57.013 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-openssl. 2024-05-21T13:32:57.040 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-05-21T13:32:57.080 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-05-21T13:32:57.298 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package ceph-mgr. 2024-05-21T13:32:57.326 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-3857-g7956b5e9-1jammy_amd64.deb ... 2024-05-21T13:32:57.364 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking ceph-mgr (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:32:57.424 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package ceph-mgr. 2024-05-21T13:32:57.451 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-3857-g7956b5e9-1jammy_amd64.deb ... 2024-05-21T13:32:57.491 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking ceph-mgr (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:32:57.775 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package ceph-mon. 2024-05-21T13:32:57.804 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-3857-g7956b5e9-1jammy_amd64.deb ... 2024-05-21T13:32:57.842 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking ceph-mon (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:32:57.844 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package ceph-mon. 2024-05-21T13:32:57.871 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-3857-g7956b5e9-1jammy_amd64.deb ... 2024-05-21T13:32:57.902 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking ceph-mon (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:32:58.379 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package ceph-osd. 2024-05-21T13:32:58.407 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-3857-g7956b5e9-1jammy_amd64.deb ... 2024-05-21T13:32:58.437 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking ceph-osd (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:32:58.489 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package ceph-osd. 2024-05-21T13:32:58.516 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-3857-g7956b5e9-1jammy_amd64.deb ... 2024-05-21T13:32:58.556 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking ceph-osd (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:32:59.498 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package ceph. 2024-05-21T13:32:59.514 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../068-ceph_19.0.0-3857-g7956b5e9-1jammy_amd64.deb ... 2024-05-21T13:32:59.556 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking ceph (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:32:59.567 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package ceph. 2024-05-21T13:32:59.583 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../068-ceph_19.0.0-3857-g7956b5e9-1jammy_amd64.deb ... 2024-05-21T13:32:59.625 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking ceph (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:32:59.944 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package ceph-fuse. 2024-05-21T13:32:59.972 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-3857-g7956b5e9-1jammy_amd64.deb ... 2024-05-21T13:33:00.011 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking ceph-fuse (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:33:00.201 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package ceph-fuse. 2024-05-21T13:33:00.229 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-3857-g7956b5e9-1jammy_amd64.deb ... 2024-05-21T13:33:00.267 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking ceph-fuse (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:33:00.380 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package ceph-mds. 2024-05-21T13:33:00.407 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-3857-g7956b5e9-1jammy_amd64.deb ... 2024-05-21T13:33:00.447 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking ceph-mds (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:33:00.654 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package ceph-mds. 2024-05-21T13:33:00.681 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-3857-g7956b5e9-1jammy_amd64.deb ... 2024-05-21T13:33:00.720 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking ceph-mds (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:33:00.849 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package cephadm. 2024-05-21T13:33:00.876 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../071-cephadm_19.0.0-3857-g7956b5e9-1jammy_amd64.deb ... 2024-05-21T13:33:00.916 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking cephadm (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:33:01.073 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package cephadm. 2024-05-21T13:33:01.100 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../071-cephadm_19.0.0-3857-g7956b5e9-1jammy_amd64.deb ... 2024-05-21T13:33:01.131 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking cephadm (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:33:01.236 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-asyncssh. 2024-05-21T13:33:01.262 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-05-21T13:33:01.302 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-05-21T13:33:01.450 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-asyncssh. 2024-05-21T13:33:01.478 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-05-21T13:33:01.516 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-05-21T13:33:01.613 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python-babel-localedata. 2024-05-21T13:33:01.637 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-05-21T13:33:01.679 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-21T13:33:01.853 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python-babel-localedata. 2024-05-21T13:33:01.881 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-05-21T13:33:01.911 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-21T13:33:02.759 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-babel. 2024-05-21T13:33:02.786 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-05-21T13:33:02.826 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-05-21T13:33:02.916 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-babel. 2024-05-21T13:33:02.944 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-05-21T13:33:02.982 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-05-21T13:33:03.129 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-jinja2. 2024-05-21T13:33:03.155 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-05-21T13:33:03.195 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-05-21T13:33:03.310 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-jinja2. 2024-05-21T13:33:03.338 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-05-21T13:33:03.376 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-05-21T13:33:03.515 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-05-21T13:33:03.542 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-3857-g7956b5e9-1jammy_all.deb ... 2024-05-21T13:33:03.581 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:33:03.713 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-05-21T13:33:03.741 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-3857-g7956b5e9-1jammy_all.deb ... 2024-05-21T13:33:03.779 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:33:04.115 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-repoze.lru. 2024-05-21T13:33:04.144 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-05-21T13:33:04.182 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-05-21T13:33:04.201 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-repoze.lru. 2024-05-21T13:33:04.228 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-05-21T13:33:04.267 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-05-21T13:33:04.468 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-routes. 2024-05-21T13:33:04.496 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-05-21T13:33:04.520 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-routes. 2024-05-21T13:33:04.535 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-05-21T13:33:04.547 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-05-21T13:33:04.578 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-05-21T13:33:04.871 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-05-21T13:33:04.889 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-05-21T13:33:04.899 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-3857-g7956b5e9-1jammy_all.deb ... 2024-05-21T13:33:04.916 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-3857-g7956b5e9-1jammy_all.deb ... 2024-05-21T13:33:04.954 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:33:04.956 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:33:06.261 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-05-21T13:33:06.288 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-05-21T13:33:06.317 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-05-21T13:33:06.327 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-21T13:33:06.346 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-05-21T13:33:06.384 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-21T13:33:06.839 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-joblib. 2024-05-21T13:33:06.862 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-joblib. 2024-05-21T13:33:06.866 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-05-21T13:33:06.891 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-05-21T13:33:06.897 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-05-21T13:33:06.929 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-05-21T13:33:07.226 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-05-21T13:33:07.253 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-05-21T13:33:07.307 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-05-21T13:33:07.336 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-05-21T13:33:07.377 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-05-21T13:33:07.459 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-05-21T13:33:07.663 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-sklearn. 2024-05-21T13:33:07.691 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-05-21T13:33:07.730 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-21T13:33:07.745 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-sklearn. 2024-05-21T13:33:07.774 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-05-21T13:33:07.812 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-21T13:33:08.431 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-05-21T13:33:08.458 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-3857-g7956b5e9-1jammy_all.deb ... 2024-05-21T13:33:08.487 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-05-21T13:33:08.497 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:33:08.516 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-3857-g7956b5e9-1jammy_all.deb ... 2024-05-21T13:33:08.553 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:33:09.482 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-cachetools. 2024-05-21T13:33:09.510 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-05-21T13:33:09.539 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-05-21T13:33:09.625 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-cachetools. 2024-05-21T13:33:09.652 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-05-21T13:33:09.691 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-05-21T13:33:09.851 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-pyasn1. 2024-05-21T13:33:09.879 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-05-21T13:33:09.917 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-05-21T13:33:09.953 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-pyasn1. 2024-05-21T13:33:09.980 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-05-21T13:33:10.011 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-05-21T13:33:10.271 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-05-21T13:33:10.280 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-05-21T13:33:10.296 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-05-21T13:33:10.300 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-05-21T13:33:10.339 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-05-21T13:33:10.429 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-05-21T13:33:10.740 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-rsa. 2024-05-21T13:33:10.768 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-05-21T13:33:10.806 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-rsa (4.8-1) ... 2024-05-21T13:33:10.833 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-rsa. 2024-05-21T13:33:10.861 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-05-21T13:33:10.900 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-rsa (4.8-1) ... 2024-05-21T13:33:11.122 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-google-auth. 2024-05-21T13:33:11.147 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-05-21T13:33:11.162 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-google-auth. 2024-05-21T13:33:11.178 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-05-21T13:33:11.185 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-05-21T13:33:11.212 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-05-21T13:33:11.513 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-05-21T13:33:11.540 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-05-21T13:33:11.541 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-05-21T13:33:11.567 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-05-21T13:33:11.579 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-21T13:33:11.606 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-21T13:33:11.908 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-websocket. 2024-05-21T13:33:11.918 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-websocket. 2024-05-21T13:33:11.936 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-05-21T13:33:11.946 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-05-21T13:33:11.974 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-05-21T13:33:11.984 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-05-21T13:33:12.271 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-kubernetes. 2024-05-21T13:33:12.288 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-kubernetes. 2024-05-21T13:33:12.298 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-05-21T13:33:12.316 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-05-21T13:33:12.337 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-21T13:33:12.354 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-21T13:33:12.970 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-05-21T13:33:12.984 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-3857-g7956b5e9-1jammy_all.deb ... 2024-05-21T13:33:12.985 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-05-21T13:33:13.014 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-3857-g7956b5e9-1jammy_all.deb ... 2024-05-21T13:33:13.025 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:33:13.043 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:33:13.345 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libonig5:amd64. 2024-05-21T13:33:13.354 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package libonig5:amd64. 2024-05-21T13:33:13.373 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-05-21T13:33:13.383 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-05-21T13:33:13.411 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-21T13:33:13.421 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-21T13:33:13.748 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libjq1:amd64. 2024-05-21T13:33:13.757 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package libjq1:amd64. 2024-05-21T13:33:13.775 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-05-21T13:33:13.786 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-05-21T13:33:13.814 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-21T13:33:13.823 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-21T13:33:14.050 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package jq. 2024-05-21T13:33:14.066 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-05-21T13:33:14.068 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package jq. 2024-05-21T13:33:14.085 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-05-21T13:33:14.099 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-05-21T13:33:14.143 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-05-21T13:33:14.344 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package socat. 2024-05-21T13:33:14.372 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-05-21T13:33:14.379 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package socat. 2024-05-21T13:33:14.406 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-05-21T13:33:14.410 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-05-21T13:33:14.446 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-05-21T13:33:14.705 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package xmlstarlet. 2024-05-21T13:33:14.721 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-05-21T13:33:14.741 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package xmlstarlet. 2024-05-21T13:33:14.757 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-05-21T13:33:14.788 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-05-21T13:33:14.798 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-05-21T13:33:15.126 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package ceph-test. 2024-05-21T13:33:15.142 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../099-ceph-test_19.0.0-3857-g7956b5e9-1jammy_amd64.deb ... 2024-05-21T13:33:15.153 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package ceph-test. 2024-05-21T13:33:15.182 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../099-ceph-test_19.0.0-3857-g7956b5e9-1jammy_amd64.deb ... 2024-05-21T13:33:15.184 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking ceph-test (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:33:15.211 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking ceph-test (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:33:17.530 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package ceph-volume. 2024-05-21T13:33:17.558 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-3857-g7956b5e9-1jammy_all.deb ... 2024-05-21T13:33:17.591 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package ceph-volume. 2024-05-21T13:33:17.595 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking ceph-volume (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:33:17.620 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-3857-g7956b5e9-1jammy_all.deb ... 2024-05-21T13:33:17.657 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking ceph-volume (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:33:17.950 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package cephfs-mirror. 2024-05-21T13:33:17.977 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-3857-g7956b5e9-1jammy_amd64.deb ... 2024-05-21T13:33:18.025 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking cephfs-mirror (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:33:18.037 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package cephfs-mirror. 2024-05-21T13:33:18.065 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-3857-g7956b5e9-1jammy_amd64.deb ... 2024-05-21T13:33:18.103 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking cephfs-mirror (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:33:18.286 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-colorama. 2024-05-21T13:33:18.313 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-05-21T13:33:18.352 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-05-21T13:33:18.415 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-colorama. 2024-05-21T13:33:18.444 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-05-21T13:33:18.481 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-05-21T13:33:18.613 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package cephfs-shell. 2024-05-21T13:33:18.629 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-3857-g7956b5e9-1jammy_all.deb ... 2024-05-21T13:33:18.671 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking cephfs-shell (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:33:18.742 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package cephfs-shell. 2024-05-21T13:33:18.759 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-3857-g7956b5e9-1jammy_all.deb ... 2024-05-21T13:33:18.800 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking cephfs-shell (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:33:18.949 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package cephfs-top. 2024-05-21T13:33:18.976 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-3857-g7956b5e9-1jammy_all.deb ... 2024-05-21T13:33:19.015 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking cephfs-top (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:33:19.061 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package cephfs-top. 2024-05-21T13:33:19.090 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-3857-g7956b5e9-1jammy_all.deb ... 2024-05-21T13:33:19.128 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking cephfs-top (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:33:19.276 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libcephfs-dev. 2024-05-21T13:33:19.304 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-3857-g7956b5e9-1jammy_amd64.deb ... 2024-05-21T13:33:19.343 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libcephfs-dev (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:33:19.372 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package libcephfs-dev. 2024-05-21T13:33:19.389 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-3857-g7956b5e9-1jammy_amd64.deb ... 2024-05-21T13:33:19.422 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking libcephfs-dev (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:33:19.629 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package lua-socket:amd64. 2024-05-21T13:33:19.656 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-05-21T13:33:19.675 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package lua-socket:amd64. 2024-05-21T13:33:19.687 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-05-21T13:33:19.704 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-05-21T13:33:19.733 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-05-21T13:33:19.991 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package lua-sec:amd64. 2024-05-21T13:33:20.019 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-05-21T13:33:20.058 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-05-21T13:33:20.063 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package lua-sec:amd64. 2024-05-21T13:33:20.092 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-05-21T13:33:20.129 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-05-21T13:33:20.437 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package nvme-cli. 2024-05-21T13:33:20.464 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-05-21T13:33:20.475 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package nvme-cli. 2024-05-21T13:33:20.503 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-05-21T13:33:20.504 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-05-21T13:33:20.691 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-05-21T13:33:20.925 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package pkg-config. 2024-05-21T13:33:20.952 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-05-21T13:33:20.991 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-05-21T13:33:21.172 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package pkg-config. 2024-05-21T13:33:21.201 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-05-21T13:33:21.235 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-05-21T13:33:21.238 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-05-21T13:33:21.251 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-05-21T13:33:21.285 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-05-21T13:33:21.500 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-05-21T13:33:21.517 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-05-21T13:33:21.575 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-05-21T13:33:21.664 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-iniconfig. 2024-05-21T13:33:21.691 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-05-21T13:33:21.730 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-05-21T13:33:21.995 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-iniconfig. 2024-05-21T13:33:21.999 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-pastescript. 2024-05-21T13:33:22.024 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-05-21T13:33:22.026 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-05-21T13:33:22.061 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-05-21T13:33:22.065 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-05-21T13:33:22.377 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-pluggy. 2024-05-21T13:33:22.403 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-pastescript. 2024-05-21T13:33:22.405 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-05-21T13:33:22.426 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-05-21T13:33:22.444 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-05-21T13:33:22.464 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-05-21T13:33:22.755 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-psutil. 2024-05-21T13:33:22.783 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-05-21T13:33:22.792 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-pluggy. 2024-05-21T13:33:22.822 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-05-21T13:33:22.822 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-05-21T13:33:22.859 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-05-21T13:33:23.129 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-psutil. 2024-05-21T13:33:23.157 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-py. 2024-05-21T13:33:23.158 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-05-21T13:33:23.185 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-05-21T13:33:23.186 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-05-21T13:33:23.224 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-py (1.10.0-1) ... 2024-05-21T13:33:23.506 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-py. 2024-05-21T13:33:23.523 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-05-21T13:33:23.554 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-pygments. 2024-05-21T13:33:23.564 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-py (1.10.0-1) ... 2024-05-21T13:33:23.582 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-05-21T13:33:23.620 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-05-21T13:33:23.835 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-pygments. 2024-05-21T13:33:23.852 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-05-21T13:33:23.885 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-05-21T13:33:24.083 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-pyinotify. 2024-05-21T13:33:24.111 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-05-21T13:33:24.149 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-05-21T13:33:24.314 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-pyinotify. 2024-05-21T13:33:24.343 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-05-21T13:33:24.380 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-05-21T13:33:24.436 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-toml. 2024-05-21T13:33:24.464 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-05-21T13:33:24.502 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-05-21T13:33:24.667 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-toml. 2024-05-21T13:33:24.696 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-05-21T13:33:24.725 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-05-21T13:33:24.805 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-pytest. 2024-05-21T13:33:24.833 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-05-21T13:33:24.871 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-05-21T13:33:24.986 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-pytest. 2024-05-21T13:33:25.015 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-05-21T13:33:25.052 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-05-21T13:33:25.158 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package python3-simplejson. 2024-05-21T13:33:25.186 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-05-21T13:33:25.225 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-05-21T13:33:25.373 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package python3-simplejson. 2024-05-21T13:33:25.402 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-05-21T13:33:25.431 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-05-21T13:33:25.478 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-05-21T13:33:25.505 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-05-21T13:33:25.544 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-05-21T13:33:25.709 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-05-21T13:33:25.726 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-05-21T13:33:25.767 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-05-21T13:33:26.231 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package radosgw. 2024-05-21T13:33:26.259 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../122-radosgw_19.0.0-3857-g7956b5e9-1jammy_amd64.deb ... 2024-05-21T13:33:26.298 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking radosgw (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:33:26.454 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package radosgw. 2024-05-21T13:33:26.483 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../122-radosgw_19.0.0-3857-g7956b5e9-1jammy_amd64.deb ... 2024-05-21T13:33:26.521 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking radosgw (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:33:27.193 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package rbd-fuse. 2024-05-21T13:33:27.220 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-3857-g7956b5e9-1jammy_amd64.deb ... 2024-05-21T13:33:27.259 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking rbd-fuse (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:33:27.440 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package rbd-fuse. 2024-05-21T13:33:27.458 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-3857-g7956b5e9-1jammy_amd64.deb ... 2024-05-21T13:33:27.499 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking rbd-fuse (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:33:27.563 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-05-21T13:33:27.796 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-05-21T13:33:27.814 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-21T13:33:27.940 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-05-21T13:33:28.054 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-05-21T13:33:28.180 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-05-21T13:33:28.203 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-05-21T13:33:28.438 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-05-21T13:33:28.502 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-05-21T13:33:28.763 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-05-21T13:33:28.903 INFO:teuthology.orchestra.run.smithi115.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-05-21T13:33:28.974 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up cephadm (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:33:29.173 INFO:teuthology.orchestra.run.smithi022.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-05-21T13:33:29.232 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up cephadm (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:33:29.458 INFO:teuthology.orchestra.run.smithi115.stdout:Adding system user cephadm....done 2024-05-21T13:33:29.614 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-21T13:33:29.732 INFO:teuthology.orchestra.run.smithi022.stdout:Adding system user cephadm....done 2024-05-21T13:33:29.882 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-05-21T13:33:29.888 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-05-21T13:33:30.133 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-05-21T13:33:30.181 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-05-21T13:33:30.234 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-05-21T13:33:30.433 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-05-21T13:33:30.494 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-05-21T13:33:30.550 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-05-21T13:33:30.737 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-05-21T13:33:30.801 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-05-21T13:33:30.863 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-py (1.10.0-1) ... 2024-05-21T13:33:31.044 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-05-21T13:33:31.165 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-05-21T13:33:31.170 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-py (1.10.0-1) ... 2024-05-21T13:33:31.489 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-05-21T13:33:31.533 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-05-21T13:33:31.767 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-05-21T13:33:31.849 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-05-21T13:33:32.035 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-05-21T13:33:32.100 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-05-21T13:33:32.295 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-05-21T13:33:32.351 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-05-21T13:33:32.546 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-05-21T13:33:32.611 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-05-21T13:33:32.814 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-05-21T13:33:32.871 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-05-21T13:33:33.073 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-05-21T13:33:33.130 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-05-21T13:33:33.316 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-ceph-argparse (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:33:33.390 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-05-21T13:33:33.551 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-21T13:33:33.685 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-05-21T13:33:33.749 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-ceph-argparse (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:33:33.811 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-05-21T13:33:33.992 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-05-21T13:33:34.079 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-05-21T13:33:34.101 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-05-21T13:33:34.205 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-05-21T13:33:34.227 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-05-21T13:33:34.456 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-05-21T13:33:34.487 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-05-21T13:33:34.646 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-05-21T13:33:34.839 INFO:teuthology.orchestra.run.smithi115.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-05-21T13:33:34.869 INFO:teuthology.orchestra.run.smithi115.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-05-21T13:33:34.906 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-05-21T13:33:34.926 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-21T13:33:35.052 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-05-21T13:33:35.267 INFO:teuthology.orchestra.run.smithi022.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-05-21T13:33:35.304 INFO:teuthology.orchestra.run.smithi022.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-05-21T13:33:35.367 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-05-21T13:33:35.420 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-21T13:33:35.493 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-05-21T13:33:35.546 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-05-21T13:33:35.830 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-05-21T13:33:35.861 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-05-21T13:33:36.013 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-05-21T13:33:36.114 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-05-21T13:33:36.289 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-05-21T13:33:36.416 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up zip (3.0-12build2) ... 2024-05-21T13:33:36.517 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-05-21T13:33:36.565 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-05-21T13:33:36.874 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up zip (3.0-12build2) ... 2024-05-21T13:33:36.984 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-05-21T13:33:37.152 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-05-21T13:33:37.403 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-05-21T13:33:37.529 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-05-21T13:33:37.655 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-21T13:33:37.702 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-05-21T13:33:37.956 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-05-21T13:33:37.970 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-05-21T13:33:38.097 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-05-21T13:33:38.222 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-05-21T13:33:38.332 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-05-21T13:33:38.548 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-05-21T13:33:38.558 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-05-21T13:33:38.902 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-21T13:33:38.925 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-05-21T13:33:39.168 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-05-21T13:33:39.195 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-05-21T13:33:39.512 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-05-21T13:33:39.544 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-05-21T13:33:39.837 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-05-21T13:33:39.855 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-05-21T13:33:40.155 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-05-21T13:33:40.293 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-05-21T13:33:40.498 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-05-21T13:33:40.583 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-ceph-common (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:33:40.741 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-05-21T13:33:40.859 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-ceph-common (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:33:40.867 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-idna (3.3-1) ... 2024-05-21T13:33:41.143 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-idna (3.3-1) ... 2024-05-21T13:33:41.160 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-21T13:33:41.469 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-05-21T13:33:42.324 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-05-21T13:33:42.551 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-21T13:33:42.677 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-toml (0.10.2-1) ... 2024-05-21T13:33:42.717 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-05-21T13:33:42.953 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-21T13:33:42.960 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-21T13:33:43.079 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-05-21T13:33:43.095 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-toml (0.10.2-1) ... 2024-05-21T13:33:43.205 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-21T13:33:43.372 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-05-21T13:33:43.497 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-05-21T13:33:43.498 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-05-21T13:33:43.623 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-05-21T13:33:43.724 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-05-21T13:33:43.925 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-05-21T13:33:43.984 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-21T13:33:44.093 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-05-21T13:33:44.176 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-05-21T13:33:44.395 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-05-21T13:33:44.435 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-21T13:33:44.561 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-05-21T13:33:44.654 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-05-21T13:33:44.880 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-05-21T13:33:44.913 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-05-21T13:33:45.131 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-05-21T13:33:45.190 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-05-21T13:33:45.374 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-05-21T13:33:45.424 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-05-21T13:33:45.633 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-05-21T13:33:45.675 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-21T13:33:45.776 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-05-21T13:33:45.884 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-05-21T13:33:46.052 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-21T13:33:46.135 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-05-21T13:33:46.178 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-21T13:33:46.261 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-05-21T13:33:46.480 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-05-21T13:33:46.588 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-05-21T13:33:46.689 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-05-21T13:33:46.781 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-05-21T13:33:46.965 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-05-21T13:33:47.015 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-05-21T13:33:47.116 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-05-21T13:33:47.226 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-05-21T13:33:47.266 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-05-21T13:33:47.307 INFO:teuthology.orchestra.run.smithi115.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-05-21T13:33:47.517 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-05-21T13:33:47.569 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-21T13:33:47.618 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-05-21T13:33:47.695 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-05-21T13:33:47.744 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-05-21T13:33:47.833 INFO:teuthology.orchestra.run.smithi022.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-05-21T13:33:48.063 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-05-21T13:33:48.080 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-05-21T13:33:48.164 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-05-21T13:33:48.332 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up lua-any (27ubuntu1) ... 2024-05-21T13:33:48.440 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-portend (3.0.0-1) ... 2024-05-21T13:33:48.557 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-05-21T13:33:48.683 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-21T13:33:48.784 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-05-21T13:33:48.825 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up lua-any (27ubuntu1) ... 2024-05-21T13:33:48.951 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-portend (3.0.0-1) ... 2024-05-21T13:33:49.102 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-05-21T13:33:49.228 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-05-21T13:33:49.353 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-05-21T13:33:49.412 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-21T13:33:49.680 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-05-21T13:33:49.680 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-05-21T13:33:49.899 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-rsa (4.8-1) ... 2024-05-21T13:33:49.964 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-05-21T13:33:50.159 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-05-21T13:33:50.232 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-05-21T13:33:50.418 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-21T13:33:50.468 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-rsa (4.8-1) ... 2024-05-21T13:33:50.686 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-05-21T13:33:50.736 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-05-21T13:33:51.038 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-05-21T13:33:51.063 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-05-21T13:33:51.297 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-05-21T13:33:51.339 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-05-21T13:33:51.658 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-21T13:33:51.768 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up librados2 (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:33:51.833 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-05-21T13:33:51.894 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:33:52.020 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-05-21T13:33:52.126 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-05-21T13:33:52.339 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libcephfs2 (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:33:52.440 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libradosstriper1 (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:33:52.469 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-05-21T13:33:52.566 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-05-21T13:33:52.596 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up librados2 (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:33:52.722 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:33:52.848 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-05-21T13:33:52.851 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up librbd1 (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:33:52.977 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up ceph-mgr-modules-core (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:33:53.103 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up ceph-fuse (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:33:53.168 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up libcephfs2 (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:33:53.285 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up libradosstriper1 (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:33:53.314 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-21T13:33:53.315 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-21T13:33:53.412 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-05-21T13:33:53.697 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up librbd1 (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:33:53.798 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up ceph-mgr-modules-core (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:33:53.829 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libcephfs-dev (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:33:53.899 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up ceph-fuse (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:33:53.956 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-rados (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:33:54.090 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up librgw2 (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:33:54.109 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-21T13:33:54.109 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-05-21T13:33:54.200 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up cephfs-top (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:33:54.309 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-21T13:33:54.592 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up libcephfs-dev (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:33:54.735 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-rados (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:33:54.877 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up librgw2 (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:33:55.004 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up cephfs-top (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:33:55.156 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-05-21T13:33:55.467 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-rbd (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:33:55.594 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up rbd-fuse (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:33:55.745 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-rgw (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:33:55.871 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up python3-cephfs (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:33:55.997 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up cephfs-shell (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:33:56.114 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up ceph-common (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:33:56.418 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-rbd (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:33:56.544 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up rbd-fuse (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:33:56.658 INFO:teuthology.orchestra.run.smithi115.stdout:Adding group ceph....done 2024-05-21T13:33:56.670 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-rgw (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:33:56.805 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up python3-cephfs (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:33:56.931 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up cephfs-shell (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:33:57.017 INFO:teuthology.orchestra.run.smithi115.stdout:Adding system user ceph....done 2024-05-21T13:33:57.032 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up ceph-common (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:33:57.160 INFO:teuthology.orchestra.run.smithi115.stdout:Setting system user ceph properties....done 2024-05-21T13:33:57.176 INFO:teuthology.orchestra.run.smithi115.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-05-21T13:33:57.314 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-05-21T13:33:57.532 INFO:teuthology.orchestra.run.smithi022.stdout:Adding group ceph....done 2024-05-21T13:33:57.629 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-05-21T13:33:57.895 INFO:teuthology.orchestra.run.smithi022.stdout:Adding system user ceph....done 2024-05-21T13:33:58.064 INFO:teuthology.orchestra.run.smithi022.stdout:Setting system user ceph properties....done 2024-05-21T13:33:58.078 INFO:teuthology.orchestra.run.smithi022.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-05-21T13:33:58.132 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up cephfs-mirror (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:33:58.222 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-05-21T13:33:58.348 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-05-21T13:33:58.348 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-05-21T13:33:58.581 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-05-21T13:33:58.959 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up ceph-test (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:33:59.046 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up cephfs-mirror (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:33:59.085 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up radosgw (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:33:59.265 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-05-21T13:33:59.265 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-05-21T13:33:59.567 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-21T13:33:59.567 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-21T13:33:59.753 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up ceph-test (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:33:59.879 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up radosgw (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:34:00.032 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up ceph-base (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:34:00.351 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-21T13:34:00.352 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-05-21T13:34:00.389 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-05-21T13:34:00.839 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up ceph-base (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:34:00.851 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up ceph-mds (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:34:01.076 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-21T13:34:01.076 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-21T13:34:01.202 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-05-21T13:34:01.569 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up ceph-mgr (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:34:01.674 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up ceph-mds (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:34:01.780 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-21T13:34:01.780 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-21T13:34:01.897 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-21T13:34:01.898 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-05-21T13:34:02.270 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up ceph-osd (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:34:02.460 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up ceph-mgr (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:34:02.524 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-21T13:34:02.524 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-21T13:34:02.669 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-21T13:34:02.669 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-05-21T13:34:02.964 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:34:03.089 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:34:03.151 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up ceph-osd (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:34:03.241 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up ceph-mon (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:34:03.456 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-21T13:34:03.456 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-05-21T13:34:03.480 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-21T13:34:03.480 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-21T13:34:03.975 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up ceph-mgr-cephadm (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:34:03.976 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:34:04.102 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:34:04.126 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up ceph (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:34:04.252 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up ceph-mgr-dashboard (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:34:04.270 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up ceph-mon (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:34:04.479 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up ceph-volume (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:34:04.483 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-21T13:34:04.483 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-05-21T13:34:04.833 INFO:teuthology.orchestra.run.smithi115.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-05-21T13:34:04.934 INFO:teuthology.orchestra.run.smithi115.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-05-21T13:34:04.989 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up ceph-mgr-cephadm (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:34:05.086 INFO:teuthology.orchestra.run.smithi115.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-05-21T13:34:05.201 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up ceph (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:34:05.420 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up ceph-mgr-dashboard (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:34:05.732 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up ceph-volume (19.0.0-3857-g7956b5e9-1jammy) ... 2024-05-21T13:34:05.869 INFO:teuthology.orchestra.run.smithi115.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-05-21T13:34:06.154 INFO:teuthology.orchestra.run.smithi022.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-05-21T13:34:06.263 INFO:teuthology.orchestra.run.smithi022.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-05-21T13:34:06.415 INFO:teuthology.orchestra.run.smithi022.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-05-21T13:34:06.550 INFO:teuthology.orchestra.run.smithi115.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-05-21T13:34:06.553 DEBUG:teuthology.orchestra.run.smithi115:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-05-21T13:34:06.647 INFO:teuthology.orchestra.run.smithi115.stdout:Reading package lists... 2024-05-21T13:34:06.848 INFO:teuthology.orchestra.run.smithi115.stdout:Building dependency tree... 2024-05-21T13:34:06.849 INFO:teuthology.orchestra.run.smithi115.stdout:Reading state information... 2024-05-21T13:34:07.043 INFO:teuthology.orchestra.run.smithi115.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-05-21T13:34:07.043 INFO:teuthology.orchestra.run.smithi115.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-05-21T13:34:07.043 INFO:teuthology.orchestra.run.smithi115.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-05-21T13:34:07.043 INFO:teuthology.orchestra.run.smithi115.stdout:The following packages were automatically installed and are no longer required: 2024-05-21T13:34:07.043 INFO:teuthology.orchestra.run.smithi115.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-21T13:34:07.043 INFO:teuthology.orchestra.run.smithi115.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-21T13:34:07.043 INFO:teuthology.orchestra.run.smithi115.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-21T13:34:07.044 INFO:teuthology.orchestra.run.smithi115.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-21T13:34:07.044 INFO:teuthology.orchestra.run.smithi115.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-21T13:34:07.044 INFO:teuthology.orchestra.run.smithi115.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-21T13:34:07.045 INFO:teuthology.orchestra.run.smithi115.stdout:The following additional packages will be installed: 2024-05-21T13:34:07.045 INFO:teuthology.orchestra.run.smithi115.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-05-21T13:34:07.045 INFO:teuthology.orchestra.run.smithi115.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-05-21T13:34:07.045 INFO:teuthology.orchestra.run.smithi115.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-05-21T13:34:07.046 INFO:teuthology.orchestra.run.smithi115.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-05-21T13:34:07.046 INFO:teuthology.orchestra.run.smithi115.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-05-21T13:34:07.047 INFO:teuthology.orchestra.run.smithi115.stdout:Suggested packages: 2024-05-21T13:34:07.047 INFO:teuthology.orchestra.run.smithi115.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-05-21T13:34:07.047 INFO:teuthology.orchestra.run.smithi115.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-05-21T13:34:07.047 INFO:teuthology.orchestra.run.smithi115.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-05-21T13:34:07.090 INFO:teuthology.orchestra.run.smithi115.stdout:The following NEW packages will be installed: 2024-05-21T13:34:07.090 INFO:teuthology.orchestra.run.smithi115.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-05-21T13:34:07.091 INFO:teuthology.orchestra.run.smithi115.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-05-21T13:34:07.091 INFO:teuthology.orchestra.run.smithi115.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-05-21T13:34:07.091 INFO:teuthology.orchestra.run.smithi115.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-05-21T13:34:07.091 INFO:teuthology.orchestra.run.smithi115.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-05-21T13:34:07.091 INFO:teuthology.orchestra.run.smithi115.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-05-21T13:34:07.092 INFO:teuthology.orchestra.run.smithi115.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-05-21T13:34:07.092 INFO:teuthology.orchestra.run.smithi115.stdout:The following packages will be upgraded: 2024-05-21T13:34:07.093 INFO:teuthology.orchestra.run.smithi115.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-05-21T13:34:07.149 INFO:teuthology.orchestra.run.smithi022.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-05-21T13:34:07.152 INFO:teuthology.orchestra.run.smithi115.stdout:4 upgraded, 39 newly installed, 0 to remove and 303 not upgraded. 2024-05-21T13:34:07.152 INFO:teuthology.orchestra.run.smithi115.stdout:Need to get 55.7 MB of archives. 2024-05-21T13:34:07.152 INFO:teuthology.orchestra.run.smithi115.stdout:After this operation, 202 MB of additional disk space will be used. 2024-05-21T13:34:07.152 INFO:teuthology.orchestra.run.smithi115.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-05-21T13:34:07.315 INFO:teuthology.orchestra.run.smithi115.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-05-21T13:34:07.324 INFO:teuthology.orchestra.run.smithi115.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-05-21T13:34:07.366 INFO:teuthology.orchestra.run.smithi115.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-05-21T13:34:07.367 INFO:teuthology.orchestra.run.smithi115.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-05-21T13:34:07.368 INFO:teuthology.orchestra.run.smithi115.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-05-21T13:34:07.378 INFO:teuthology.orchestra.run.smithi115.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-05-21T13:34:07.379 INFO:teuthology.orchestra.run.smithi115.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-05-21T13:34:07.381 INFO:teuthology.orchestra.run.smithi115.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-05-21T13:34:07.383 INFO:teuthology.orchestra.run.smithi115.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-05-21T13:34:07.383 INFO:teuthology.orchestra.run.smithi115.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-05-21T13:34:07.384 INFO:teuthology.orchestra.run.smithi115.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-05-21T13:34:07.395 INFO:teuthology.orchestra.run.smithi115.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-05-21T13:34:07.406 INFO:teuthology.orchestra.run.smithi115.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-05-21T13:34:07.407 INFO:teuthology.orchestra.run.smithi115.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-05-21T13:34:07.408 INFO:teuthology.orchestra.run.smithi115.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-05-21T13:34:07.862 INFO:teuthology.orchestra.run.smithi022.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-05-21T13:34:07.865 DEBUG:teuthology.orchestra.run.smithi022:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-05-21T13:34:07.909 INFO:teuthology.orchestra.run.smithi115.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-05-21T13:34:07.912 INFO:teuthology.orchestra.run.smithi115.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-05-21T13:34:07.912 INFO:teuthology.orchestra.run.smithi115.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-05-21T13:34:07.916 INFO:teuthology.orchestra.run.smithi115.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-05-21T13:34:07.916 INFO:teuthology.orchestra.run.smithi115.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-05-21T13:34:07.921 INFO:teuthology.orchestra.run.smithi022.stdout:Reading package lists... 2024-05-21T13:34:07.922 INFO:teuthology.orchestra.run.smithi115.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-05-21T13:34:07.924 INFO:teuthology.orchestra.run.smithi115.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-05-21T13:34:07.933 INFO:teuthology.orchestra.run.smithi115.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-05-21T13:34:07.934 INFO:teuthology.orchestra.run.smithi115.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-05-21T13:34:07.962 INFO:teuthology.orchestra.run.smithi115.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-05-21T13:34:07.972 INFO:teuthology.orchestra.run.smithi115.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-05-21T13:34:08.002 INFO:teuthology.orchestra.run.smithi115.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-05-21T13:34:08.127 INFO:teuthology.orchestra.run.smithi022.stdout:Building dependency tree... 2024-05-21T13:34:08.128 INFO:teuthology.orchestra.run.smithi022.stdout:Reading state information... 2024-05-21T13:34:08.154 INFO:teuthology.orchestra.run.smithi115.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-05-21T13:34:08.160 INFO:teuthology.orchestra.run.smithi115.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-05-21T13:34:08.161 INFO:teuthology.orchestra.run.smithi115.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-05-21T13:34:08.161 INFO:teuthology.orchestra.run.smithi115.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-05-21T13:34:08.162 INFO:teuthology.orchestra.run.smithi115.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-05-21T13:34:08.183 INFO:teuthology.orchestra.run.smithi115.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-05-21T13:34:08.186 INFO:teuthology.orchestra.run.smithi115.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-05-21T13:34:08.331 INFO:teuthology.orchestra.run.smithi022.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-05-21T13:34:08.332 INFO:teuthology.orchestra.run.smithi022.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-05-21T13:34:08.332 INFO:teuthology.orchestra.run.smithi022.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-05-21T13:34:08.332 INFO:teuthology.orchestra.run.smithi022.stdout:The following packages were automatically installed and are no longer required: 2024-05-21T13:34:08.332 INFO:teuthology.orchestra.run.smithi022.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-05-21T13:34:08.332 INFO:teuthology.orchestra.run.smithi022.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-05-21T13:34:08.332 INFO:teuthology.orchestra.run.smithi022.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-05-21T13:34:08.332 INFO:teuthology.orchestra.run.smithi022.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-05-21T13:34:08.333 INFO:teuthology.orchestra.run.smithi022.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-05-21T13:34:08.333 INFO:teuthology.orchestra.run.smithi022.stdout:Use 'sudo apt autoremove' to remove them. 2024-05-21T13:34:08.333 INFO:teuthology.orchestra.run.smithi022.stdout:The following additional packages will be installed: 2024-05-21T13:34:08.333 INFO:teuthology.orchestra.run.smithi022.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-05-21T13:34:08.333 INFO:teuthology.orchestra.run.smithi022.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-05-21T13:34:08.334 INFO:teuthology.orchestra.run.smithi022.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-05-21T13:34:08.334 INFO:teuthology.orchestra.run.smithi022.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-05-21T13:34:08.334 INFO:teuthology.orchestra.run.smithi022.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-05-21T13:34:08.335 INFO:teuthology.orchestra.run.smithi022.stdout:Suggested packages: 2024-05-21T13:34:08.335 INFO:teuthology.orchestra.run.smithi022.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-05-21T13:34:08.336 INFO:teuthology.orchestra.run.smithi022.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-05-21T13:34:08.336 INFO:teuthology.orchestra.run.smithi022.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-05-21T13:34:08.376 INFO:teuthology.orchestra.run.smithi022.stdout:The following NEW packages will be installed: 2024-05-21T13:34:08.377 INFO:teuthology.orchestra.run.smithi022.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-05-21T13:34:08.377 INFO:teuthology.orchestra.run.smithi022.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-05-21T13:34:08.377 INFO:teuthology.orchestra.run.smithi022.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-05-21T13:34:08.377 INFO:teuthology.orchestra.run.smithi022.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-05-21T13:34:08.377 INFO:teuthology.orchestra.run.smithi022.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-05-21T13:34:08.377 INFO:teuthology.orchestra.run.smithi022.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-05-21T13:34:08.378 INFO:teuthology.orchestra.run.smithi022.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-05-21T13:34:08.378 INFO:teuthology.orchestra.run.smithi022.stdout:The following packages will be upgraded: 2024-05-21T13:34:08.379 INFO:teuthology.orchestra.run.smithi022.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-05-21T13:34:08.475 INFO:teuthology.orchestra.run.smithi115.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-05-21T13:34:08.475 INFO:teuthology.orchestra.run.smithi115.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-05-21T13:34:08.513 INFO:teuthology.orchestra.run.smithi115.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-05-21T13:34:08.514 INFO:teuthology.orchestra.run.smithi115.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-05-21T13:34:08.514 INFO:teuthology.orchestra.run.smithi115.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-05-21T13:34:08.514 INFO:teuthology.orchestra.run.smithi115.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-05-21T13:34:08.530 INFO:teuthology.orchestra.run.smithi115.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-05-21T13:34:08.530 INFO:teuthology.orchestra.run.smithi115.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-05-21T13:34:08.560 INFO:teuthology.orchestra.run.smithi022.stdout:4 upgraded, 39 newly installed, 0 to remove and 303 not upgraded. 2024-05-21T13:34:08.560 INFO:teuthology.orchestra.run.smithi022.stdout:Need to get 55.7 MB of archives. 2024-05-21T13:34:08.560 INFO:teuthology.orchestra.run.smithi022.stdout:After this operation, 202 MB of additional disk space will be used. 2024-05-21T13:34:08.560 INFO:teuthology.orchestra.run.smithi022.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-05-21T13:34:08.937 INFO:teuthology.orchestra.run.smithi115.stdout:Preconfiguring packages ... 2024-05-21T13:34:09.087 INFO:teuthology.orchestra.run.smithi115.stdout:Fetched 55.7 MB in 1s (39.0 MB/s) 2024-05-21T13:34:09.189 INFO:teuthology.orchestra.run.smithi022.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-05-21T13:34:09.205 INFO:teuthology.orchestra.run.smithi022.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-05-21T13:34:09.331 INFO:teuthology.orchestra.run.smithi022.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-05-21T13:34:09.332 INFO:teuthology.orchestra.run.smithi022.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-05-21T13:34:09.333 INFO:teuthology.orchestra.run.smithi022.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-05-21T13:34:09.362 INFO:teuthology.orchestra.run.smithi022.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-05-21T13:34:09.363 INFO:teuthology.orchestra.run.smithi022.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-05-21T13:34:09.367 INFO:teuthology.orchestra.run.smithi022.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-05-21T13:34:09.370 INFO:teuthology.orchestra.run.smithi022.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-05-21T13:34:09.371 INFO:teuthology.orchestra.run.smithi022.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-05-21T13:34:09.424 INFO:teuthology.orchestra.run.smithi115.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173986 files and directories currently installed.) 2024-05-21T13:34:09.429 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-05-21T13:34:09.538 INFO:teuthology.orchestra.run.smithi022.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-05-21T13:34:09.582 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-05-21T13:34:09.831 INFO:teuthology.orchestra.run.smithi022.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-05-21T13:34:09.841 INFO:teuthology.orchestra.run.smithi022.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-05-21T13:34:09.845 INFO:teuthology.orchestra.run.smithi022.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-05-21T13:34:09.932 INFO:teuthology.orchestra.run.smithi022.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-05-21T13:34:10.196 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-05-21T13:34:11.048 INFO:teuthology.orchestra.run.smithi022.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-05-21T13:34:11.052 INFO:teuthology.orchestra.run.smithi022.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-05-21T13:34:11.053 INFO:teuthology.orchestra.run.smithi022.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-05-21T13:34:11.059 INFO:teuthology.orchestra.run.smithi022.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-05-21T13:34:11.060 INFO:teuthology.orchestra.run.smithi022.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-05-21T13:34:11.071 INFO:teuthology.orchestra.run.smithi022.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-05-21T13:34:11.154 INFO:teuthology.orchestra.run.smithi115.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-05-21T13:34:11.238 INFO:teuthology.orchestra.run.smithi022.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-05-21T13:34:11.790 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package flex. 2024-05-21T13:34:11.835 INFO:teuthology.orchestra.run.smithi022.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-05-21T13:34:11.835 INFO:teuthology.orchestra.run.smithi022.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-05-21T13:34:11.896 INFO:teuthology.orchestra.run.smithi115.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173986 files and directories currently installed.) 2024-05-21T13:34:11.902 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-05-21T13:34:11.947 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking flex (2.6.4-8build2) ... 2024-05-21T13:34:12.015 INFO:teuthology.orchestra.run.smithi022.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-05-21T13:34:12.016 INFO:teuthology.orchestra.run.smithi022.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-05-21T13:34:12.060 INFO:teuthology.orchestra.run.smithi022.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-05-21T13:34:12.115 INFO:teuthology.orchestra.run.smithi022.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-05-21T13:34:12.122 INFO:teuthology.orchestra.run.smithi022.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-05-21T13:34:12.123 INFO:teuthology.orchestra.run.smithi022.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-05-21T13:34:12.124 INFO:teuthology.orchestra.run.smithi022.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-05-21T13:34:12.125 INFO:teuthology.orchestra.run.smithi022.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-05-21T13:34:12.340 INFO:teuthology.orchestra.run.smithi022.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-05-21T13:34:12.463 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-05-21T13:34:12.636 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-05-21T13:34:12.751 INFO:teuthology.orchestra.run.smithi022.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-05-21T13:34:13.039 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-05-21T13:34:13.566 INFO:teuthology.orchestra.run.smithi115.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174059 files and directories currently installed.) 2024-05-21T13:34:13.571 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-05-21T13:34:13.603 INFO:teuthology.orchestra.run.smithi022.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-05-21T13:34:13.603 INFO:teuthology.orchestra.run.smithi022.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-05-21T13:34:13.603 INFO:teuthology.orchestra.run.smithi022.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-05-21T13:34:13.603 INFO:teuthology.orchestra.run.smithi022.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-05-21T13:34:13.604 INFO:teuthology.orchestra.run.smithi022.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-05-21T13:34:13.651 INFO:teuthology.orchestra.run.smithi022.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-05-21T13:34:13.683 INFO:teuthology.orchestra.run.smithi022.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-05-21T13:34:13.684 INFO:teuthology.orchestra.run.smithi022.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-05-21T13:34:13.702 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-05-21T13:34:14.093 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-05-21T13:34:14.119 INFO:teuthology.orchestra.run.smithi022.stdout:Preconfiguring packages ... 2024-05-21T13:34:14.199 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-05-21T13:34:14.270 INFO:teuthology.orchestra.run.smithi022.stdout:Fetched 55.7 MB in 5s (10.5 MB/s) 2024-05-21T13:34:14.526 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-05-21T13:34:14.591 INFO:teuthology.orchestra.run.smithi022.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173986 files and directories currently installed.) 2024-05-21T13:34:14.597 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-05-21T13:34:14.823 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-05-21T13:34:14.875 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package bison. 2024-05-21T13:34:14.978 INFO:teuthology.orchestra.run.smithi115.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174059 files and directories currently installed.) 2024-05-21T13:34:14.983 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-05-21T13:34:15.027 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-05-21T13:34:15.403 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-05-21T13:34:15.431 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-05-21T13:34:15.454 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-05-21T13:34:15.461 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-05-21T13:34:15.806 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package dump. 2024-05-21T13:34:15.833 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-05-21T13:34:15.873 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking dump (0.4b47-3) ... 2024-05-21T13:34:16.302 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package indent. 2024-05-21T13:34:16.329 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-05-21T13:34:16.368 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-05-21T13:34:16.488 INFO:teuthology.orchestra.run.smithi022.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-05-21T13:34:16.621 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-05-21T13:34:16.648 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-05-21T13:34:16.687 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-05-21T13:34:16.727 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package flex. 2024-05-21T13:34:16.803 INFO:teuthology.orchestra.run.smithi022.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173986 files and directories currently installed.) 2024-05-21T13:34:16.809 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-05-21T13:34:16.851 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking flex (2.6.4-8build2) ... 2024-05-21T13:34:17.050 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-05-21T13:34:17.077 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-05-21T13:34:17.116 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-05-21T13:34:17.335 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-05-21T13:34:17.386 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-05-21T13:34:17.413 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-05-21T13:34:17.452 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-05-21T13:34:17.507 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-05-21T13:34:17.756 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libfl2:amd64. 2024-05-21T13:34:17.783 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-05-21T13:34:17.822 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-05-21T13:34:17.911 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-05-21T13:34:18.050 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-05-21T13:34:18.066 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-05-21T13:34:18.108 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-05-21T13:34:18.352 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libjson-perl. 2024-05-21T13:34:18.380 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-05-21T13:34:18.419 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-05-21T13:34:18.423 INFO:teuthology.orchestra.run.smithi022.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174059 files and directories currently installed.) 2024-05-21T13:34:18.428 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-05-21T13:34:18.548 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-05-21T13:34:18.722 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libllvm14:amd64. 2024-05-21T13:34:18.738 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-05-21T13:34:18.781 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-05-21T13:34:18.942 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-05-21T13:34:19.072 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-05-21T13:34:19.409 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-05-21T13:34:19.756 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package bison. 2024-05-21T13:34:19.863 INFO:teuthology.orchestra.run.smithi022.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174059 files and directories currently installed.) 2024-05-21T13:34:19.869 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-05-21T13:34:19.908 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-05-21T13:34:20.125 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-05-21T13:34:20.141 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-05-21T13:34:20.175 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-05-21T13:34:20.284 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-05-21T13:34:20.314 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-05-21T13:34:20.342 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-05-21T13:34:20.444 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libmbim-proxy. 2024-05-21T13:34:20.472 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-05-21T13:34:20.511 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-05-21T13:34:20.629 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package dump. 2024-05-21T13:34:20.658 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-05-21T13:34:20.695 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking dump (0.4b47-3) ... 2024-05-21T13:34:20.831 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-05-21T13:34:20.858 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-05-21T13:34:20.897 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-05-21T13:34:20.974 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package indent. 2024-05-21T13:34:20.992 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-05-21T13:34:21.033 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-05-21T13:34:21.183 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libndp0:amd64. 2024-05-21T13:34:21.199 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-05-21T13:34:21.233 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-05-21T13:34:21.285 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-05-21T13:34:21.303 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-05-21T13:34:21.344 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-05-21T13:34:21.561 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libnm0:amd64. 2024-05-21T13:34:21.589 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-05-21T13:34:21.628 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-05-21T13:34:21.648 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-05-21T13:34:21.677 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-05-21T13:34:21.715 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-05-21T13:34:21.976 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-05-21T13:34:21.981 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libpq5:amd64. 2024-05-21T13:34:22.005 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-05-21T13:34:22.008 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-05-21T13:34:22.042 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-05-21T13:34:22.047 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-05-21T13:34:22.338 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package libfl2:amd64. 2024-05-21T13:34:22.367 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-05-21T13:34:22.367 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-05-21T13:34:22.380 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-05-21T13:34:22.404 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-05-21T13:34:22.408 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-05-21T13:34:22.624 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-05-21T13:34:22.653 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-05-21T13:34:22.690 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-05-21T13:34:22.702 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libqmi-proxy. 2024-05-21T13:34:22.718 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-05-21T13:34:22.761 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-05-21T13:34:22.960 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package libjson-perl. 2024-05-21T13:34:22.989 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-05-21T13:34:23.005 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-05-21T13:34:23.026 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-05-21T13:34:23.033 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-05-21T13:34:23.072 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-05-21T13:34:23.338 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package libllvm14:amd64. 2024-05-21T13:34:23.367 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-05-21T13:34:23.404 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-05-21T13:34:23.534 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-05-21T13:34:23.561 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-05-21T13:34:23.600 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-05-21T13:34:23.928 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package modemmanager. 2024-05-21T13:34:23.956 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-05-21T13:34:23.995 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-05-21T13:34:24.619 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package network-manager. 2024-05-21T13:34:24.646 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-05-21T13:34:24.685 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-05-21T13:34:25.100 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-05-21T13:34:25.128 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-05-21T13:34:25.157 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-05-21T13:34:25.292 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package ppp. 2024-05-21T13:34:25.320 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-05-21T13:34:25.427 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package libmbim-proxy. 2024-05-21T13:34:25.446 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-05-21T13:34:25.485 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-05-21T13:34:25.608 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-05-21T13:34:25.822 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-05-21T13:34:25.851 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-05-21T13:34:25.888 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-05-21T13:34:25.915 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package pptp-linux. 2024-05-21T13:34:25.942 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-05-21T13:34:25.980 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-05-21T13:34:26.200 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package libndp0:amd64. 2024-05-21T13:34:26.229 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-05-21T13:34:26.233 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package network-manager-pptp. 2024-05-21T13:34:26.249 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-05-21T13:34:26.258 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-05-21T13:34:26.291 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-05-21T13:34:26.561 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package libnm0:amd64. 2024-05-21T13:34:26.569 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package postgresql-client-common. 2024-05-21T13:34:26.589 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-05-21T13:34:26.597 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-05-21T13:34:26.627 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-05-21T13:34:26.627 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking postgresql-client-common (238) ... 2024-05-21T13:34:26.932 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package postgresql-client-14. 2024-05-21T13:34:26.959 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-05-21T13:34:26.981 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package libpq5:amd64. 2024-05-21T13:34:26.998 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-21T13:34:27.010 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-05-21T13:34:27.047 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-05-21T13:34:27.367 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-05-21T13:34:27.396 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-05-21T13:34:27.425 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-05-21T13:34:27.536 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package postgresql-common. 2024-05-21T13:34:27.564 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-05-21T13:34:27.622 INFO:teuthology.orchestra.run.smithi115.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-05-21T13:34:27.643 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking postgresql-common (238) ... 2024-05-21T13:34:27.720 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package libqmi-proxy. 2024-05-21T13:34:27.748 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-05-21T13:34:27.787 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-05-21T13:34:28.063 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-05-21T13:34:28.077 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package postgresql-14. 2024-05-21T13:34:28.080 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-05-21T13:34:28.106 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-05-21T13:34:28.122 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-05-21T13:34:28.146 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-21T13:34:28.584 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-05-21T13:34:28.602 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-05-21T13:34:28.634 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-05-21T13:34:28.979 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package modemmanager. 2024-05-21T13:34:29.008 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-05-21T13:34:29.045 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-05-21T13:34:29.597 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package postgresql. 2024-05-21T13:34:29.625 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-05-21T13:34:29.663 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking postgresql (14+238) ... 2024-05-21T13:34:29.703 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package network-manager. 2024-05-21T13:34:29.732 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-05-21T13:34:29.778 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-05-21T13:34:29.890 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package postgresql-client. 2024-05-21T13:34:29.918 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-05-21T13:34:29.957 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking postgresql-client (14+238) ... 2024-05-21T13:34:30.201 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package postgresql-contrib. 2024-05-21T13:34:30.229 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-05-21T13:34:30.267 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking postgresql-contrib (14+238) ... 2024-05-21T13:34:30.427 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package ppp. 2024-05-21T13:34:30.456 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-05-21T13:34:30.562 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package tcl8.6. 2024-05-21T13:34:30.590 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-05-21T13:34:30.620 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-05-21T13:34:30.730 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-05-21T13:34:30.881 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package tcl. 2024-05-21T13:34:30.909 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-05-21T13:34:30.952 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-05-21T13:34:31.074 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package pptp-linux. 2024-05-21T13:34:31.091 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-05-21T13:34:31.132 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-05-21T13:34:31.300 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package wpasupplicant. 2024-05-21T13:34:31.329 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-05-21T13:34:31.367 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-05-21T13:34:31.385 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package network-manager-pptp. 2024-05-21T13:34:31.414 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-05-21T13:34:31.452 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-05-21T13:34:31.713 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-05-21T13:34:31.730 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package postgresql-client-common. 2024-05-21T13:34:31.741 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-05-21T13:34:31.759 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-05-21T13:34:31.779 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-05-21T13:34:31.788 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking postgresql-client-common (238) ... 2024-05-21T13:34:32.107 INFO:teuthology.orchestra.run.smithi115.stdout:Selecting previously unselected package usb-modeswitch. 2024-05-21T13:34:32.108 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package postgresql-client-14. 2024-05-21T13:34:32.135 INFO:teuthology.orchestra.run.smithi115.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-05-21T13:34:32.137 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-05-21T13:34:32.175 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-21T13:34:32.182 INFO:teuthology.orchestra.run.smithi115.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-05-21T13:34:32.512 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up postgresql-client-common (238) ... 2024-05-21T13:34:32.738 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up flex (2.6.4-8build2) ... 2024-05-21T13:34:32.772 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package postgresql-common. 2024-05-21T13:34:32.801 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-05-21T13:34:32.839 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-05-21T13:34:32.858 INFO:teuthology.orchestra.run.smithi022.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-05-21T13:34:32.878 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking postgresql-common (238) ... 2024-05-21T13:34:32.957 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-05-21T13:34:33.083 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-05-21T13:34:33.218 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-05-21T13:34:33.360 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-21T13:34:33.804 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package postgresql-14. 2024-05-21T13:34:33.833 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-05-21T13:34:33.835 INFO:teuthology.orchestra.run.smithi115.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-05-21T13:34:33.874 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-21T13:34:33.916 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-05-21T13:34:34.251 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-05-21T13:34:34.251 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-05-21T13:34:34.760 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-05-21T13:34:34.886 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-05-21T13:34:35.012 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-05-21T13:34:35.138 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-05-21T13:34:35.174 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package postgresql. 2024-05-21T13:34:35.192 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-05-21T13:34:35.233 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking postgresql (14+238) ... 2024-05-21T13:34:35.264 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-05-21T13:34:35.390 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-05-21T13:34:35.476 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package postgresql-client. 2024-05-21T13:34:35.493 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-05-21T13:34:35.499 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-05-21T13:34:35.535 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking postgresql-client (14+238) ... 2024-05-21T13:34:35.600 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-05-21T13:34:35.778 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package postgresql-contrib. 2024-05-21T13:34:35.808 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-05-21T13:34:35.845 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking postgresql-contrib (14+238) ... 2024-05-21T13:34:36.165 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package tcl8.6. 2024-05-21T13:34:36.194 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-05-21T13:34:36.231 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-05-21T13:34:36.239 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-05-21T13:34:36.365 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up dump (0.4b47-3) ... 2024-05-21T13:34:36.492 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package tcl. 2024-05-21T13:34:36.522 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-05-21T13:34:36.564 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-05-21T13:34:36.600 INFO:teuthology.orchestra.run.smithi115.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-05-21T13:34:36.673 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-05-21T13:34:36.785 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-05-21T13:34:36.910 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up tcl (8.6.11+1build2) ... 2024-05-21T13:34:36.912 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package wpasupplicant. 2024-05-21T13:34:36.941 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-05-21T13:34:36.978 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-05-21T13:34:37.036 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libjson-perl (4.04000-1) ... 2024-05-21T13:34:37.162 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-05-21T13:34:37.253 INFO:teuthology.orchestra.run.smithi115.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-05-21T13:34:37.322 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-05-21T13:34:37.366 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-05-21T13:34:37.396 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-05-21T13:34:37.433 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-05-21T13:34:37.674 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-05-21T13:34:37.744 INFO:teuthology.orchestra.run.smithi022.stdout:Selecting previously unselected package usb-modeswitch. 2024-05-21T13:34:37.774 INFO:teuthology.orchestra.run.smithi022.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-05-21T13:34:37.819 INFO:teuthology.orchestra.run.smithi022.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-05-21T13:34:37.958 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-05-21T13:34:38.068 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-05-21T13:34:38.117 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up postgresql-client-common (238) ... 2024-05-21T13:34:38.185 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-05-21T13:34:38.309 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up flex (2.6.4-8build2) ... 2024-05-21T13:34:38.353 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up postgresql-client (14+238) ... 2024-05-21T13:34:38.479 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-05-21T13:34:38.810 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-05-21T13:34:38.937 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-05-21T13:34:38.940 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-21T13:34:38.940 INFO:teuthology.orchestra.run.smithi115.stdout:The following network interfaces were found in /etc/network/interfaces 2024-05-21T13:34:38.940 INFO:teuthology.orchestra.run.smithi115.stdout:which means they are currently configured by ifupdown: 2024-05-21T13:34:38.940 INFO:teuthology.orchestra.run.smithi115.stdout:- enp3s0f1 2024-05-21T13:34:38.940 INFO:teuthology.orchestra.run.smithi115.stdout:If you want to manage those interfaces with NetworkManager instead 2024-05-21T13:34:38.940 INFO:teuthology.orchestra.run.smithi115.stdout:remove their configuration from /etc/network/interfaces. 2024-05-21T13:34:38.940 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-21T13:34:39.055 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-05-21T13:34:39.062 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-05-21T13:34:39.189 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-05-21T13:34:39.290 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-21T13:34:39.385 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-05-21T13:34:39.704 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-05-21T13:34:39.855 INFO:teuthology.orchestra.run.smithi022.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-05-21T13:34:39.946 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-05-21T13:34:40.208 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-05-21T13:34:40.342 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-05-21T13:34:40.342 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-05-21T13:34:40.342 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-05-21T13:34:40.451 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-05-21T13:34:40.560 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up postgresql-common (238) ... 2024-05-21T13:34:40.834 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-05-21T13:34:40.943 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-05-21T13:34:41.069 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-05-21T13:34:41.195 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-05-21T13:34:41.321 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-05-21T13:34:41.422 INFO:teuthology.orchestra.run.smithi115.stdout:Adding user postgres to group ssl-cert 2024-05-21T13:34:41.447 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-05-21T13:34:41.573 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-05-21T13:34:41.663 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-21T13:34:41.663 INFO:teuthology.orchestra.run.smithi115.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-05-21T13:34:41.698 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-05-21T13:34:41.873 INFO:teuthology.orchestra.run.smithi115.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-05-21T13:34:41.873 INFO:teuthology.orchestra.run.smithi115.stdout:Removing obsolete dictionary files: 2024-05-21T13:34:42.295 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-05-21T13:34:42.415 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-05-21T13:34:42.421 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up dump (0.4b47-3) ... 2024-05-21T13:34:42.507 INFO:teuthology.orchestra.run.smithi022.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-05-21T13:34:42.564 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-05-21T13:34:42.665 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-05-21T13:34:42.783 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up tcl (8.6.11+1build2) ... 2024-05-21T13:34:42.812 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-21T13:34:42.909 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up libjson-perl (4.04000-1) ... 2024-05-21T13:34:43.035 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-05-21T13:34:43.115 INFO:teuthology.orchestra.run.smithi115.stdout:Creating new PostgreSQL cluster 14/main ... 2024-05-21T13:34:43.125 INFO:teuthology.orchestra.run.smithi022.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-05-21T13:34:43.137 INFO:teuthology.orchestra.run.smithi115.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-05-21T13:34:43.186 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-05-21T13:34:43.187 INFO:teuthology.orchestra.run.smithi115.stdout:The files belonging to this database system will be owned by user "postgres". 2024-05-21T13:34:43.188 INFO:teuthology.orchestra.run.smithi115.stdout:This user must also own the server process. 2024-05-21T13:34:43.188 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-21T13:34:43.188 INFO:teuthology.orchestra.run.smithi115.stdout:The database cluster will be initialized with locale "en_US". 2024-05-21T13:34:43.188 INFO:teuthology.orchestra.run.smithi115.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-05-21T13:34:43.188 INFO:teuthology.orchestra.run.smithi115.stdout:The default text search configuration will be set to "english". 2024-05-21T13:34:43.188 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-21T13:34:43.188 INFO:teuthology.orchestra.run.smithi115.stdout:Data page checksums are disabled. 2024-05-21T13:34:43.188 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-21T13:34:43.188 INFO:teuthology.orchestra.run.smithi115.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-05-21T13:34:43.189 INFO:teuthology.orchestra.run.smithi115.stdout:creating subdirectories ... ok 2024-05-21T13:34:43.189 INFO:teuthology.orchestra.run.smithi115.stdout:selecting dynamic shared memory implementation ... posix 2024-05-21T13:34:43.204 INFO:teuthology.orchestra.run.smithi115.stdout:selecting default max_connections ... 100 2024-05-21T13:34:43.225 INFO:teuthology.orchestra.run.smithi115.stdout:selecting default shared_buffers ... 128MB 2024-05-21T13:34:43.235 INFO:teuthology.orchestra.run.smithi115.stdout:selecting default time zone ... Etc/UTC 2024-05-21T13:34:43.236 INFO:teuthology.orchestra.run.smithi115.stdout:creating configuration files ... ok 2024-05-21T13:34:43.313 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-05-21T13:34:43.350 INFO:teuthology.orchestra.run.smithi115.stdout:running bootstrap script ... ok 2024-05-21T13:34:43.489 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-05-21T13:34:43.615 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-05-21T13:34:43.741 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-05-21T13:34:43.900 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up postgresql-client (14+238) ... 2024-05-21T13:34:43.961 INFO:teuthology.orchestra.run.smithi115.stdout:performing post-bootstrap initialization ... ok 2024-05-21T13:34:44.035 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-05-21T13:34:44.526 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-21T13:34:44.526 INFO:teuthology.orchestra.run.smithi022.stdout:The following network interfaces were found in /etc/network/interfaces 2024-05-21T13:34:44.527 INFO:teuthology.orchestra.run.smithi022.stdout:which means they are currently configured by ifupdown: 2024-05-21T13:34:44.527 INFO:teuthology.orchestra.run.smithi022.stdout:- ens1f0 2024-05-21T13:34:44.527 INFO:teuthology.orchestra.run.smithi022.stdout:If you want to manage those interfaces with NetworkManager instead 2024-05-21T13:34:44.527 INFO:teuthology.orchestra.run.smithi022.stdout:remove their configuration from /etc/network/interfaces. 2024-05-21T13:34:44.527 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-21T13:34:44.631 INFO:teuthology.orchestra.run.smithi115.stdout:syncing data to disk ... ok 2024-05-21T13:34:44.669 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-05-21T13:34:45.001 INFO:teuthology.orchestra.run.smithi115.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-05-21T13:34:45.004 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-05-21T13:34:45.351 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-05-21T13:34:45.853 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-05-21T13:34:45.988 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-05-21T13:34:46.114 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-05-21T13:34:46.240 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up postgresql-common (238) ... 2024-05-21T13:34:47.329 INFO:teuthology.orchestra.run.smithi022.stdout:Adding user postgres to group ssl-cert 2024-05-21T13:34:47.578 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-21T13:34:47.578 INFO:teuthology.orchestra.run.smithi022.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-05-21T13:34:47.768 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-05-21T13:34:47.788 INFO:teuthology.orchestra.run.smithi022.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-05-21T13:34:47.788 INFO:teuthology.orchestra.run.smithi022.stdout:Removing obsolete dictionary files: 2024-05-21T13:34:47.894 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up postgresql-contrib (14+238) ... 2024-05-21T13:34:48.011 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up postgresql (14+238) ... 2024-05-21T13:34:48.112 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-05-21T13:34:48.238 INFO:teuthology.orchestra.run.smithi115.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-05-21T13:34:48.368 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-05-21T13:34:48.493 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-05-21T13:34:48.493 INFO:teuthology.orchestra.run.smithi115.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-05-21T13:34:48.783 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-05-21T13:34:49.050 INFO:teuthology.orchestra.run.smithi115.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-05-21T13:34:49.124 INFO:teuthology.orchestra.run.smithi022.stdout:Creating new PostgreSQL cluster 14/main ... 2024-05-21T13:34:49.135 INFO:teuthology.orchestra.run.smithi022.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-05-21T13:34:49.159 INFO:teuthology.orchestra.run.smithi115.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-05-21T13:34:49.199 INFO:teuthology.orchestra.run.smithi022.stdout:The files belonging to this database system will be owned by user "postgres". 2024-05-21T13:34:49.199 INFO:teuthology.orchestra.run.smithi022.stdout:This user must also own the server process. 2024-05-21T13:34:49.199 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-21T13:34:49.199 INFO:teuthology.orchestra.run.smithi022.stdout:The database cluster will be initialized with locale "en_US". 2024-05-21T13:34:49.199 INFO:teuthology.orchestra.run.smithi022.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-05-21T13:34:49.199 INFO:teuthology.orchestra.run.smithi022.stdout:The default text search configuration will be set to "english". 2024-05-21T13:34:49.199 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-21T13:34:49.200 INFO:teuthology.orchestra.run.smithi022.stdout:Data page checksums are disabled. 2024-05-21T13:34:49.200 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-21T13:34:49.200 INFO:teuthology.orchestra.run.smithi022.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-05-21T13:34:49.200 INFO:teuthology.orchestra.run.smithi022.stdout:creating subdirectories ... ok 2024-05-21T13:34:49.200 INFO:teuthology.orchestra.run.smithi022.stdout:selecting dynamic shared memory implementation ... posix 2024-05-21T13:34:49.217 INFO:teuthology.orchestra.run.smithi022.stdout:selecting default max_connections ... 100 2024-05-21T13:34:49.237 INFO:teuthology.orchestra.run.smithi022.stdout:selecting default shared_buffers ... 128MB 2024-05-21T13:34:49.247 INFO:teuthology.orchestra.run.smithi022.stdout:selecting default time zone ... Etc/UTC 2024-05-21T13:34:49.248 INFO:teuthology.orchestra.run.smithi022.stdout:creating configuration files ... ok 2024-05-21T13:34:49.368 INFO:teuthology.orchestra.run.smithi022.stdout:running bootstrap script ... ok 2024-05-21T13:34:49.453 INFO:teuthology.orchestra.run.smithi115.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-05-21T13:34:49.604 INFO:teuthology.orchestra.run.smithi115.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-05-21T13:34:50.014 INFO:teuthology.orchestra.run.smithi022.stdout:performing post-bootstrap initialization ... ok 2024-05-21T13:34:50.669 INFO:teuthology.orchestra.run.smithi022.stdout:syncing data to disk ... ok 2024-05-21T13:34:50.941 INFO:teuthology.orchestra.run.smithi115.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-05-21T13:34:51.040 INFO:teuthology.orchestra.run.smithi115.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-05-21T13:34:51.066 INFO:teuthology.orchestra.run.smithi022.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-05-21T13:34:51.531 INFO:teuthology.orchestra.run.smithi115.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-05-21T13:34:51.536 DEBUG:teuthology.parallel:result is None 2024-05-21T13:34:53.831 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-05-21T13:34:53.956 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up postgresql-contrib (14+238) ... 2024-05-21T13:34:54.074 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up postgresql (14+238) ... 2024-05-21T13:34:54.175 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-05-21T13:34:54.284 INFO:teuthology.orchestra.run.smithi022.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-05-21T13:34:54.544 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-05-21T13:34:54.544 INFO:teuthology.orchestra.run.smithi022.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-05-21T13:34:55.095 INFO:teuthology.orchestra.run.smithi022.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-05-21T13:34:55.187 INFO:teuthology.orchestra.run.smithi022.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-05-21T13:34:55.473 INFO:teuthology.orchestra.run.smithi022.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-05-21T13:34:55.625 INFO:teuthology.orchestra.run.smithi022.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-05-21T13:34:57.044 INFO:teuthology.orchestra.run.smithi022.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-05-21T13:34:57.144 INFO:teuthology.orchestra.run.smithi022.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-05-21T13:34:57.608 INFO:teuthology.orchestra.run.smithi022.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-05-21T13:34:57.613 DEBUG:teuthology.parallel:result is None 2024-05-21T13:34:57.614 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=7956b5e965f6ee5669688b5643c11d881b72442c 2024-05-21T13:34:57.840 DEBUG:teuthology.orchestra.run.smithi022:> dpkg-query -W -f '${Version}' ceph 2024-05-21T13:34:57.860 INFO:teuthology.orchestra.run.smithi022.stdout:19.0.0-3857-g7956b5e9-1jammy 2024-05-21T13:34:57.861 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3857-g7956b5e9-1jammy 2024-05-21T13:34:57.861 INFO:teuthology.task.install:The correct ceph version 19.0.0-3857-g7956b5e9-1jammy is installed. 2024-05-21T13:34:57.863 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=7956b5e965f6ee5669688b5643c11d881b72442c 2024-05-21T13:34:58.084 DEBUG:teuthology.orchestra.run.smithi115:> dpkg-query -W -f '${Version}' ceph 2024-05-21T13:34:58.103 INFO:teuthology.orchestra.run.smithi115.stdout:19.0.0-3857-g7956b5e9-1jammy 2024-05-21T13:34:58.104 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3857-g7956b5e9-1jammy 2024-05-21T13:34:58.104 INFO:teuthology.task.install:The correct ceph version 19.0.0-3857-g7956b5e9-1jammy is installed. 2024-05-21T13:34:58.106 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-05-21T13:34:58.106 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-05-21T13:34:58.106 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-21T13:34:58.121 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-21T13:34:58.121 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-05-21T13:34:58.159 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-05-21T13:34:58.159 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-05-21T13:34:58.159 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/usr/bin/daemon-helper 2024-05-21T13:34:58.178 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-21T13:34:58.233 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-21T13:34:58.233 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/usr/bin/daemon-helper 2024-05-21T13:34:58.247 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-05-21T13:34:58.300 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-05-21T13:34:58.301 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-05-21T13:34:58.301 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-21T13:34:58.314 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-21T13:34:58.370 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-21T13:34:58.370 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/usr/bin/adjust-ulimits 2024-05-21T13:34:58.383 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-05-21T13:34:58.437 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-05-21T13:34:58.437 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-05-21T13:34:58.437 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/usr/bin/stdin-killer 2024-05-21T13:34:58.451 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-21T13:34:58.506 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-21T13:34:58.506 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/usr/bin/stdin-killer 2024-05-21T13:34:58.519 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-05-21T13:34:58.573 INFO:teuthology.run_tasks:Running task ceph... 2024-05-21T13:34:58.648 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-05-21T13:34:58.648 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 777 /var/log/ceph 2024-05-21T13:34:58.650 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 777 /var/log/ceph 2024-05-21T13:34:58.663 INFO:tasks.ceph:Disabling ceph logrotate... 2024-05-21T13:34:58.663 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-21T13:34:58.707 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm -f -- /etc/logrotate.d/ceph 2024-05-21T13:34:58.719 INFO:tasks.ceph:Creating extra log directories... 2024-05-21T13:34:58.719 DEBUG:teuthology.orchestra.run.smithi022:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-21T13:34:58.763 DEBUG:teuthology.orchestra.run.smithi115:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-05-21T13:34:58.783 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-05-21T13:34:58.783 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-05-21T13:34:58.783 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-05-21T13:34:58.783 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-05-21T13:34:58.783 DEBUG:teuthology.orchestra.run.smithi022:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-21T13:34:58.823 DEBUG:teuthology.orchestra.run.smithi022:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-21T13:34:58.898 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-21T13:34:58.898 DEBUG:teuthology.orchestra.run.smithi115:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-05-21T13:34:58.904 DEBUG:teuthology.orchestra.run.smithi115:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-05-21T13:34:58.984 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-05-21T13:34:58.984 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-05-21T13:34:58.984 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/leonidus-2024-05-21_13:01:15-fs-wip-lusov-quiesce-overdrive-export-distro-default-smithi/7718504', 'branch': 'wip-lusov-quiesce-overdrive-export', 'description': 'fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/with-quiesce 2-workunit/suites/iozone}}', 'email': None, 'first_in_suite': False, 'job_id': '7718504', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'leonidus-2024-05-21_13:01:15-fs-wip-lusov-quiesce-overdrive-export-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-lusov-quiesce-overdrive-export'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'sha1': '7956b5e965f6ee5669688b5643c11d881b72442c'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'check-counter': {'counters': {'mds': ['mds.exported', 'mds.imported']}}, 'install': {'ceph': {'flavor': 'default', 'sha1': '7956b5e965f6ee5669688b5643c11d881b72442c'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-lusov-quiesce-overdrive-export', 'sha1': '7956b5e965f6ee5669688b5643c11d881b72442c'}}, 'owner': 'scheduled_leonidus@teuthology', 'priority': 70, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 5442, 'sha1': '7956b5e965f6ee5669688b5643c11d881b72442c', 'sleep_before_teardown': 0, 'subset': '941/111111', 'suite': 'fs', 'suite_branch': 'wip-lusov-quiesce-overdrive-export', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_7956b5e965f6ee5669688b5643c11d881b72442c/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '7956b5e965f6ee5669688b5643c11d881b72442c', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi022.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHJqrrsETYNb+VzHcB6nvWtPiszHYKly9hXL0CJJSHqGK1WBhk5LQWtrYNCc7n2FVHhfvGhp/HTpLWIWx/ZnMWs=', 'smithi115.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM7NYN4uE55xoFgGohPtMRi+uQV95aBIvaSJHKV4zXyU+bQot8U5vhZH1uh86SVQVoXKiBt2VC/xwBIEk6ED9hU='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '7956b5e965f6ee5669688b5643c11d881b72442c'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'sha1': '7956b5e965f6ee5669688b5643c11d881b72442c', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'ceph-fuse': None}, {'quiescer': None}, {'workunit': {'clients': {'all': ['suites/iozone.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'install-fix', 'teuthology_sha1': '4fbe5e8dc899215f216853b8569a107d8be8861d', 'timestamp': '2024-05-21_13:01:15', 'tube': 'smithi', 'user': 'leonidus', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2698841'} 2024-05-21T13:34:58.985 DEBUG:teuthology.orchestra.run.smithi022:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-21T13:34:58.987 DEBUG:teuthology.orchestra.run.smithi115:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-05-21T13:34:59.030 DEBUG:teuthology.orchestra.run.smithi022:> sudo install -d -m0777 -- /var/run/ceph 2024-05-21T13:34:59.035 DEBUG:teuthology.orchestra.run.smithi115:> sudo install -d -m0777 -- /var/run/ceph 2024-05-21T13:34:59.086 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-05-21T13:34:59.086 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/scratch_devs of=/dev/stdout 2024-05-21T13:34:59.094 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-21T13:34:59.094 DEBUG:teuthology.orchestra.run.smithi022:> stat /dev/vg_nvme/lv_1 2024-05-21T13:34:59.142 INFO:teuthology.orchestra.run.smithi022.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-21T13:34:59.142 INFO:teuthology.orchestra.run.smithi022.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-21T13:34:59.142 INFO:teuthology.orchestra.run.smithi022.stdout:Device: 5h/5d Inode: 879 Links: 1 2024-05-21T13:34:59.142 INFO:teuthology.orchestra.run.smithi022.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-21T13:34:59.143 INFO:teuthology.orchestra.run.smithi022.stdout:Access: 2024-05-21 13:28:47.767940109 +0000 2024-05-21T13:34:59.143 INFO:teuthology.orchestra.run.smithi022.stdout:Modify: 2024-05-21 13:28:47.503942467 +0000 2024-05-21T13:34:59.143 INFO:teuthology.orchestra.run.smithi022.stdout:Change: 2024-05-21 13:28:47.503942467 +0000 2024-05-21T13:34:59.143 INFO:teuthology.orchestra.run.smithi022.stdout: Birth: - 2024-05-21T13:34:59.143 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-21T13:34:59.197 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-05-21T13:34:59.197 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-05-21T13:34:59.197 INFO:teuthology.orchestra.run.smithi022.stderr:512 bytes copied, 0.0003174 s, 1.6 MB/s 2024-05-21T13:34:59.198 DEBUG:teuthology.orchestra.run.smithi022:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-21T13:34:59.248 DEBUG:teuthology.orchestra.run.smithi022:> stat /dev/vg_nvme/lv_2 2024-05-21T13:34:59.294 INFO:teuthology.orchestra.run.smithi022.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-21T13:34:59.294 INFO:teuthology.orchestra.run.smithi022.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-21T13:34:59.295 INFO:teuthology.orchestra.run.smithi022.stdout:Device: 5h/5d Inode: 897 Links: 1 2024-05-21T13:34:59.295 INFO:teuthology.orchestra.run.smithi022.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-21T13:34:59.295 INFO:teuthology.orchestra.run.smithi022.stdout:Access: 2024-05-21 13:28:48.271935607 +0000 2024-05-21T13:34:59.295 INFO:teuthology.orchestra.run.smithi022.stdout:Modify: 2024-05-21 13:28:48.003938000 +0000 2024-05-21T13:34:59.295 INFO:teuthology.orchestra.run.smithi022.stdout:Change: 2024-05-21 13:28:48.003938000 +0000 2024-05-21T13:34:59.295 INFO:teuthology.orchestra.run.smithi022.stdout: Birth: - 2024-05-21T13:34:59.295 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-21T13:34:59.349 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-05-21T13:34:59.349 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-05-21T13:34:59.349 INFO:teuthology.orchestra.run.smithi022.stderr:512 bytes copied, 0.000304314 s, 1.7 MB/s 2024-05-21T13:34:59.350 DEBUG:teuthology.orchestra.run.smithi022:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-21T13:34:59.400 DEBUG:teuthology.orchestra.run.smithi022:> stat /dev/vg_nvme/lv_3 2024-05-21T13:34:59.446 INFO:teuthology.orchestra.run.smithi022.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-21T13:34:59.446 INFO:teuthology.orchestra.run.smithi022.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-21T13:34:59.446 INFO:teuthology.orchestra.run.smithi022.stdout:Device: 5h/5d Inode: 914 Links: 1 2024-05-21T13:34:59.447 INFO:teuthology.orchestra.run.smithi022.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-21T13:34:59.447 INFO:teuthology.orchestra.run.smithi022.stdout:Access: 2024-05-21 13:28:48.767931177 +0000 2024-05-21T13:34:59.447 INFO:teuthology.orchestra.run.smithi022.stdout:Modify: 2024-05-21 13:28:48.495933606 +0000 2024-05-21T13:34:59.447 INFO:teuthology.orchestra.run.smithi022.stdout:Change: 2024-05-21 13:28:48.495933606 +0000 2024-05-21T13:34:59.447 INFO:teuthology.orchestra.run.smithi022.stdout: Birth: - 2024-05-21T13:34:59.447 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-21T13:34:59.501 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-05-21T13:34:59.501 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-05-21T13:34:59.501 INFO:teuthology.orchestra.run.smithi022.stderr:512 bytes copied, 0.000301884 s, 1.7 MB/s 2024-05-21T13:34:59.503 DEBUG:teuthology.orchestra.run.smithi022:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-21T13:34:59.552 DEBUG:teuthology.orchestra.run.smithi022:> stat /dev/vg_nvme/lv_4 2024-05-21T13:34:59.598 INFO:teuthology.orchestra.run.smithi022.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-21T13:34:59.598 INFO:teuthology.orchestra.run.smithi022.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-21T13:34:59.598 INFO:teuthology.orchestra.run.smithi022.stdout:Device: 5h/5d Inode: 931 Links: 1 2024-05-21T13:34:59.598 INFO:teuthology.orchestra.run.smithi022.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-21T13:34:59.598 INFO:teuthology.orchestra.run.smithi022.stdout:Access: 2024-05-21 13:28:49.243926925 +0000 2024-05-21T13:34:59.599 INFO:teuthology.orchestra.run.smithi022.stdout:Modify: 2024-05-21 13:28:48.995929139 +0000 2024-05-21T13:34:59.599 INFO:teuthology.orchestra.run.smithi022.stdout:Change: 2024-05-21 13:28:48.995929139 +0000 2024-05-21T13:34:59.599 INFO:teuthology.orchestra.run.smithi022.stdout: Birth: - 2024-05-21T13:34:59.599 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-21T13:34:59.653 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records in 2024-05-21T13:34:59.653 INFO:teuthology.orchestra.run.smithi022.stderr:1+0 records out 2024-05-21T13:34:59.653 INFO:teuthology.orchestra.run.smithi022.stderr:512 bytes copied, 0.000246904 s, 2.1 MB/s 2024-05-21T13:34:59.654 DEBUG:teuthology.orchestra.run.smithi022:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-21T13:34:59.703 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-21T13:34:59.704 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-21T13:34:59.704 DEBUG:teuthology.orchestra.run.smithi115:> dd if=/scratch_devs of=/dev/stdout 2024-05-21T13:34:59.709 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-21T13:34:59.710 DEBUG:teuthology.orchestra.run.smithi115:> stat /dev/vg_nvme/lv_1 2024-05-21T13:34:59.759 INFO:teuthology.orchestra.run.smithi115.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-21T13:34:59.759 INFO:teuthology.orchestra.run.smithi115.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-21T13:34:59.759 INFO:teuthology.orchestra.run.smithi115.stdout:Device: 5h/5d Inode: 892 Links: 1 2024-05-21T13:34:59.759 INFO:teuthology.orchestra.run.smithi115.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-21T13:34:59.759 INFO:teuthology.orchestra.run.smithi115.stdout:Access: 2024-05-21 13:28:47.895898127 +0000 2024-05-21T13:34:59.759 INFO:teuthology.orchestra.run.smithi115.stdout:Modify: 2024-05-21 13:28:47.891898163 +0000 2024-05-21T13:34:59.759 INFO:teuthology.orchestra.run.smithi115.stdout:Change: 2024-05-21 13:28:47.891898163 +0000 2024-05-21T13:34:59.759 INFO:teuthology.orchestra.run.smithi115.stdout: Birth: - 2024-05-21T13:34:59.760 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-21T13:34:59.813 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2024-05-21T13:34:59.813 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2024-05-21T13:34:59.813 INFO:teuthology.orchestra.run.smithi115.stderr:512 bytes copied, 0.000450292 s, 1.1 MB/s 2024-05-21T13:34:59.814 DEBUG:teuthology.orchestra.run.smithi115:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-21T13:34:59.863 DEBUG:teuthology.orchestra.run.smithi115:> stat /dev/vg_nvme/lv_2 2024-05-21T13:34:59.910 INFO:teuthology.orchestra.run.smithi115.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-21T13:34:59.910 INFO:teuthology.orchestra.run.smithi115.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-21T13:34:59.910 INFO:teuthology.orchestra.run.smithi115.stdout:Device: 5h/5d Inode: 904 Links: 1 2024-05-21T13:34:59.910 INFO:teuthology.orchestra.run.smithi115.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-21T13:34:59.910 INFO:teuthology.orchestra.run.smithi115.stdout:Access: 2024-05-21 13:28:48.671891196 +0000 2024-05-21T13:34:59.911 INFO:teuthology.orchestra.run.smithi115.stdout:Modify: 2024-05-21 13:28:48.399893624 +0000 2024-05-21T13:34:59.911 INFO:teuthology.orchestra.run.smithi115.stdout:Change: 2024-05-21 13:28:48.399893624 +0000 2024-05-21T13:34:59.911 INFO:teuthology.orchestra.run.smithi115.stdout: Birth: - 2024-05-21T13:34:59.911 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-21T13:34:59.964 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2024-05-21T13:34:59.964 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2024-05-21T13:34:59.964 INFO:teuthology.orchestra.run.smithi115.stderr:512 bytes copied, 0.000349868 s, 1.5 MB/s 2024-05-21T13:34:59.965 DEBUG:teuthology.orchestra.run.smithi115:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-21T13:35:00.016 DEBUG:teuthology.orchestra.run.smithi115:> stat /dev/vg_nvme/lv_3 2024-05-21T13:35:00.062 INFO:teuthology.orchestra.run.smithi115.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-21T13:35:00.062 INFO:teuthology.orchestra.run.smithi115.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-21T13:35:00.062 INFO:teuthology.orchestra.run.smithi115.stdout:Device: 5h/5d Inode: 927 Links: 1 2024-05-21T13:35:00.062 INFO:teuthology.orchestra.run.smithi115.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-21T13:35:00.062 INFO:teuthology.orchestra.run.smithi115.stdout:Access: 2024-05-21 13:28:49.131887086 +0000 2024-05-21T13:35:00.062 INFO:teuthology.orchestra.run.smithi115.stdout:Modify: 2024-05-21 13:28:48.899889160 +0000 2024-05-21T13:35:00.063 INFO:teuthology.orchestra.run.smithi115.stdout:Change: 2024-05-21 13:28:48.899889160 +0000 2024-05-21T13:35:00.063 INFO:teuthology.orchestra.run.smithi115.stdout: Birth: - 2024-05-21T13:35:00.063 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-21T13:35:00.117 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2024-05-21T13:35:00.117 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2024-05-21T13:35:00.117 INFO:teuthology.orchestra.run.smithi115.stderr:512 bytes copied, 0.000315529 s, 1.6 MB/s 2024-05-21T13:35:00.119 DEBUG:teuthology.orchestra.run.smithi115:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-21T13:35:00.168 DEBUG:teuthology.orchestra.run.smithi115:> stat /dev/vg_nvme/lv_4 2024-05-21T13:35:00.215 INFO:teuthology.orchestra.run.smithi115.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-21T13:35:00.215 INFO:teuthology.orchestra.run.smithi115.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-21T13:35:00.215 INFO:teuthology.orchestra.run.smithi115.stdout:Device: 5h/5d Inode: 936 Links: 1 2024-05-21T13:35:00.215 INFO:teuthology.orchestra.run.smithi115.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-21T13:35:00.215 INFO:teuthology.orchestra.run.smithi115.stdout:Access: 2024-05-21 13:28:49.615882765 +0000 2024-05-21T13:35:00.216 INFO:teuthology.orchestra.run.smithi115.stdout:Modify: 2024-05-21 13:28:49.359885051 +0000 2024-05-21T13:35:00.216 INFO:teuthology.orchestra.run.smithi115.stdout:Change: 2024-05-21 13:28:49.359885051 +0000 2024-05-21T13:35:00.216 INFO:teuthology.orchestra.run.smithi115.stdout: Birth: - 2024-05-21T13:35:00.216 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-21T13:35:00.269 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records in 2024-05-21T13:35:00.269 INFO:teuthology.orchestra.run.smithi115.stderr:1+0 records out 2024-05-21T13:35:00.269 INFO:teuthology.orchestra.run.smithi115.stderr:512 bytes copied, 0.000333775 s, 1.5 MB/s 2024-05-21T13:35:00.270 DEBUG:teuthology.orchestra.run.smithi115:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-21T13:35:00.319 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-21T13:35:00.319 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi022.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi115.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-21T13:35:00.319 INFO:tasks.ceph:Generating config... 2024-05-21T13:35:00.321 INFO:tasks.ceph:[client] client mount timeout = 600 2024-05-21T13:35:00.321 INFO:tasks.ceph:[client] client_shutdown_timeout = 120 2024-05-21T13:35:00.321 INFO:tasks.ceph:[client] debug client = 20 2024-05-21T13:35:00.321 INFO:tasks.ceph:[client] debug ms = 1 2024-05-21T13:35:00.321 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-05-21T13:35:00.321 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-05-21T13:35:00.321 INFO:tasks.ceph:[mds] debug mds = 20 2024-05-21T13:35:00.321 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-05-21T13:35:00.321 INFO:tasks.ceph:[mds] debug ms = 1 2024-05-21T13:35:00.321 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2024-05-21T13:35:00.321 INFO:tasks.ceph:[mds] mds bal merge size = 5 2024-05-21T13:35:00.322 INFO:tasks.ceph:[mds] mds bal split bits = 3 2024-05-21T13:35:00.322 INFO:tasks.ceph:[mds] mds bal split size = 100 2024-05-21T13:35:00.322 INFO:tasks.ceph:[mds] mds debug frag = True 2024-05-21T13:35:00.322 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-05-21T13:35:00.322 INFO:tasks.ceph:[mds] mds oft prefetch dirfrags = True 2024-05-21T13:35:00.322 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-05-21T13:35:00.323 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-05-21T13:35:00.323 INFO:tasks.ceph:[mds] mds_dir_prefetch = True 2024-05-21T13:35:00.323 INFO:tasks.ceph:[mds] mds_sleep_rank_change = 5000000.0 2024-05-21T13:35:00.323 INFO:tasks.ceph:[mds] mon client directed command retry = 5 2024-05-21T13:35:00.323 INFO:tasks.ceph:[mds] ms inject delay max = 1 2024-05-21T13:35:00.323 INFO:tasks.ceph:[mds] ms inject delay probability = 0.005 2024-05-21T13:35:00.324 INFO:tasks.ceph:[mds] ms inject delay type = client mds osd 2024-05-21T13:35:00.324 INFO:tasks.ceph:[mds] ms inject socket failures = 2500 2024-05-21T13:35:00.324 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-05-21T13:35:00.324 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-05-21T13:35:00.324 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-05-21T13:35:00.324 INFO:tasks.ceph:[mgr] debug client = 20 2024-05-21T13:35:00.324 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-05-21T13:35:00.324 INFO:tasks.ceph:[mgr] debug ms = 1 2024-05-21T13:35:00.324 INFO:tasks.ceph:[mon] debug mon = 20 2024-05-21T13:35:00.324 INFO:tasks.ceph:[mon] debug ms = 1 2024-05-21T13:35:00.324 INFO:tasks.ceph:[mon] debug paxos = 20 2024-05-21T13:35:00.324 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-05-21T13:35:00.324 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-05-21T13:35:00.324 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-05-21T13:35:00.325 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-05-21T13:35:00.325 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-05-21T13:35:00.325 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-05-21T13:35:00.325 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-05-21T13:35:00.325 INFO:tasks.ceph:[osd] debug ms = 1 2024-05-21T13:35:00.325 INFO:tasks.ceph:[osd] debug osd = 20 2024-05-21T13:35:00.325 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-05-21T13:35:00.325 INFO:tasks.ceph:[osd] mon client directed command retry = 5 2024-05-21T13:35:00.325 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-05-21T13:35:00.325 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-05-21T13:35:00.325 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-05-21T13:35:00.325 INFO:tasks.ceph:[osd] ms inject delay max = 1 2024-05-21T13:35:00.325 INFO:tasks.ceph:[osd] ms inject delay probability = 0.005 2024-05-21T13:35:00.325 INFO:tasks.ceph:[osd] ms inject delay type = client mds 2024-05-21T13:35:00.326 INFO:tasks.ceph:[osd] ms inject socket failures = 2500 2024-05-21T13:35:00.326 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-05-21T13:35:00.326 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-05-21T13:35:00.326 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-05-21T13:35:00.326 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-05-21T13:35:00.326 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-05-21T13:35:00.326 INFO:tasks.ceph:Setting up mon.a... 2024-05-21T13:35:00.326 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-05-21T13:35:00.361 INFO:teuthology.orchestra.run.smithi022.stdout:creating /etc/ceph/ceph.keyring 2024-05-21T13:35:00.376 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-05-21T13:35:00.455 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-21T13:35:00.509 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.22'), ('mon.b', '172.21.15.115'), ('mon.c', '[v2:172.21.15.115:3301,v1:172.21.15.115:6790]')] 2024-05-21T13:35:00.510 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.22,172.21.15.115,[v2:172.21.15.115:3301,v1:172.21.15.115:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-05-21T13:35:00.514 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-05-21T13:35:00.515 DEBUG:teuthology.orchestra.run.smithi022:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-05-21T13:35:00.558 DEBUG:teuthology.orchestra.run.smithi022:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.22 --add b 172.21.15.115 --addv c '[v2:172.21.15.115:3301,v1:172.21.15.115:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-05-21T13:35:00.644 INFO:teuthology.orchestra.run.smithi022.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-05-21T13:35:00.644 INFO:teuthology.orchestra.run.smithi022.stdout:monmaptool: generated fsid f2c96204-e240-4e7f-8a76-927b4f80f534 2024-05-21T13:35:00.644 INFO:teuthology.orchestra.run.smithi022.stdout:setting min_mon_release = quincy 2024-05-21T13:35:00.644 INFO:teuthology.orchestra.run.smithi022.stdout:epoch 0 2024-05-21T13:35:00.644 INFO:teuthology.orchestra.run.smithi022.stdout:fsid f2c96204-e240-4e7f-8a76-927b4f80f534 2024-05-21T13:35:00.644 INFO:teuthology.orchestra.run.smithi022.stdout:last_changed 2024-05-21T13:35:00.669100+0000 2024-05-21T13:35:00.645 INFO:teuthology.orchestra.run.smithi022.stdout:created 2024-05-21T13:35:00.669100+0000 2024-05-21T13:35:00.645 INFO:teuthology.orchestra.run.smithi022.stdout:min_mon_release 17 (quincy) 2024-05-21T13:35:00.645 INFO:teuthology.orchestra.run.smithi022.stdout:election_strategy: 1 2024-05-21T13:35:00.645 INFO:teuthology.orchestra.run.smithi022.stdout:0: [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] mon.a 2024-05-21T13:35:00.645 INFO:teuthology.orchestra.run.smithi022.stdout:1: [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] mon.b 2024-05-21T13:35:00.645 INFO:teuthology.orchestra.run.smithi022.stdout:2: [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] mon.c 2024-05-21T13:35:00.645 INFO:teuthology.orchestra.run.smithi022.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-05-21T13:35:00.646 DEBUG:teuthology.orchestra.run.smithi022:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-05-21T13:35:00.694 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID f2c96204-e240-4e7f-8a76-927b4f80f534... 2024-05-21T13:35:00.695 DEBUG:teuthology.orchestra.run.smithi022:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-21T13:35:00.739 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-05-21T13:35:00.771 INFO:teuthology.orchestra.run.smithi115.stdout:[global] 2024-05-21T13:35:00.772 INFO:teuthology.orchestra.run.smithi115.stdout: chdir = "" 2024-05-21T13:35:00.772 INFO:teuthology.orchestra.run.smithi115.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-21T13:35:00.772 INFO:teuthology.orchestra.run.smithi115.stdout: auth supported = cephx 2024-05-21T13:35:00.772 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-21T13:35:00.772 INFO:teuthology.orchestra.run.smithi115.stdout: filestore xattr use omap = true 2024-05-21T13:35:00.772 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-21T13:35:00.772 INFO:teuthology.orchestra.run.smithi115.stdout: mon clock drift allowed = 1.000 2024-05-21T13:35:00.772 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-21T13:35:00.772 INFO:teuthology.orchestra.run.smithi115.stdout: osd crush chooseleaf type = 0 2024-05-21T13:35:00.772 INFO:teuthology.orchestra.run.smithi115.stdout: auth debug = true 2024-05-21T13:35:00.772 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-21T13:35:00.772 INFO:teuthology.orchestra.run.smithi115.stdout: ms die on old message = true 2024-05-21T13:35:00.772 INFO:teuthology.orchestra.run.smithi115.stdout: ms die on bug = true 2024-05-21T13:35:00.772 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-21T13:35:00.773 INFO:teuthology.orchestra.run.smithi115.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-21T13:35:00.773 INFO:teuthology.orchestra.run.smithi115.stdout: mon pg warn max object skew = 0 2024-05-21T13:35:00.773 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-21T13:35:00.773 INFO:teuthology.orchestra.run.smithi115.stdout: # disable pg_autoscaler by default for new pools 2024-05-21T13:35:00.773 INFO:teuthology.orchestra.run.smithi115.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-21T13:35:00.773 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-21T13:35:00.773 INFO:teuthology.orchestra.run.smithi115.stdout: osd pool default size = 2 2024-05-21T13:35:00.773 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-21T13:35:00.773 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd allow primary affinity = true 2024-05-21T13:35:00.773 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd allow pg remap = true 2024-05-21T13:35:00.773 INFO:teuthology.orchestra.run.smithi115.stdout: mon warn on legacy crush tunables = false 2024-05-21T13:35:00.773 INFO:teuthology.orchestra.run.smithi115.stdout: mon warn on crush straw calc version zero = false 2024-05-21T13:35:00.773 INFO:teuthology.orchestra.run.smithi115.stdout: mon warn on no sortbitwise = false 2024-05-21T13:35:00.773 INFO:teuthology.orchestra.run.smithi115.stdout: mon warn on osd down out interval zero = false 2024-05-21T13:35:00.773 INFO:teuthology.orchestra.run.smithi115.stdout: mon warn on too few osds = false 2024-05-21T13:35:00.774 INFO:teuthology.orchestra.run.smithi115.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-21T13:35:00.774 INFO:teuthology.orchestra.run.smithi115.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-21T13:35:00.774 INFO:teuthology.orchestra.run.smithi115.stdout: mon_allow_pool_size_one = true 2024-05-21T13:35:00.774 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-21T13:35:00.774 INFO:teuthology.orchestra.run.smithi115.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-21T13:35:00.774 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-21T13:35:00.774 INFO:teuthology.orchestra.run.smithi115.stdout: osd default data pool replay window = 5 2024-05-21T13:35:00.774 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-21T13:35:00.774 INFO:teuthology.orchestra.run.smithi115.stdout: mon allow pool delete = true 2024-05-21T13:35:00.774 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-21T13:35:00.774 INFO:teuthology.orchestra.run.smithi115.stdout: mon cluster log file level = debug 2024-05-21T13:35:00.774 INFO:teuthology.orchestra.run.smithi115.stdout: debug asserts on shutdown = true 2024-05-21T13:35:00.774 INFO:teuthology.orchestra.run.smithi115.stdout: mon health detail to clog = false 2024-05-21T13:35:00.775 INFO:teuthology.orchestra.run.smithi115.stdout: mon host = "172.21.15.22,172.21.15.115,[v2:172.21.15.115:3301,v1:172.21.15.115:6790]" 2024-05-21T13:35:00.775 INFO:teuthology.orchestra.run.smithi115.stdout: fsid = f2c96204-e240-4e7f-8a76-927b4f80f534 2024-05-21T13:35:00.775 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-21T13:35:00.775 INFO:teuthology.orchestra.run.smithi115.stdout:[osd] 2024-05-21T13:35:00.775 INFO:teuthology.orchestra.run.smithi115.stdout: osd journal size = 100 2024-05-21T13:35:00.775 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-21T13:35:00.775 INFO:teuthology.orchestra.run.smithi115.stdout: osd scrub load threshold = 5.0 2024-05-21T13:35:00.775 INFO:teuthology.orchestra.run.smithi115.stdout: osd scrub max interval = 600 2024-05-21T13:35:00.775 INFO:teuthology.orchestra.run.smithi115.stdout: osd mclock profile = high_recovery_ops 2024-05-21T13:35:00.775 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-21T13:35:00.775 INFO:teuthology.orchestra.run.smithi115.stdout: osd recover clone overlap = true 2024-05-21T13:35:00.775 INFO:teuthology.orchestra.run.smithi115.stdout: osd recovery max chunk = 1048576 2024-05-21T13:35:00.775 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-21T13:35:00.775 INFO:teuthology.orchestra.run.smithi115.stdout: osd debug shutdown = true 2024-05-21T13:35:00.776 INFO:teuthology.orchestra.run.smithi115.stdout: osd debug op order = true 2024-05-21T13:35:00.776 INFO:teuthology.orchestra.run.smithi115.stdout: osd debug verify stray on activate = true 2024-05-21T13:35:00.776 INFO:teuthology.orchestra.run.smithi115.stdout: osd debug trim objects = true 2024-05-21T13:35:00.776 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-21T13:35:00.776 INFO:teuthology.orchestra.run.smithi115.stdout: osd open classes on start = true 2024-05-21T13:35:00.776 INFO:teuthology.orchestra.run.smithi115.stdout: osd debug pg log writeout = true 2024-05-21T13:35:00.776 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-21T13:35:00.776 INFO:teuthology.orchestra.run.smithi115.stdout: osd deep scrub update digest min age = 30 2024-05-21T13:35:00.776 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-21T13:35:00.776 INFO:teuthology.orchestra.run.smithi115.stdout: osd map max advance = 10 2024-05-21T13:35:00.776 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-21T13:35:00.776 INFO:teuthology.orchestra.run.smithi115.stdout: journal zero on create = true 2024-05-21T13:35:00.776 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-21T13:35:00.777 INFO:teuthology.orchestra.run.smithi115.stdout: filestore ondisk finisher threads = 3 2024-05-21T13:35:00.777 INFO:teuthology.orchestra.run.smithi115.stdout: filestore apply finisher threads = 3 2024-05-21T13:35:00.777 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-21T13:35:00.777 INFO:teuthology.orchestra.run.smithi115.stdout: bdev debug aio = true 2024-05-21T13:35:00.777 INFO:teuthology.orchestra.run.smithi115.stdout: osd debug misdirected ops = true 2024-05-21T13:35:00.777 INFO:teuthology.orchestra.run.smithi115.stdout: bluestore block size = 96636764160 2024-05-21T13:35:00.777 INFO:teuthology.orchestra.run.smithi115.stdout: bluestore compression mode = aggressive 2024-05-21T13:35:00.777 INFO:teuthology.orchestra.run.smithi115.stdout: bluestore fsck on mount = True 2024-05-21T13:35:00.777 INFO:teuthology.orchestra.run.smithi115.stdout: debug bluefs = 20 2024-05-21T13:35:00.777 INFO:teuthology.orchestra.run.smithi115.stdout: debug bluestore = 20 2024-05-21T13:35:00.777 INFO:teuthology.orchestra.run.smithi115.stdout: debug ms = 1 2024-05-21T13:35:00.777 INFO:teuthology.orchestra.run.smithi115.stdout: debug osd = 20 2024-05-21T13:35:00.777 INFO:teuthology.orchestra.run.smithi115.stdout: debug rocksdb = 10 2024-05-21T13:35:00.777 INFO:teuthology.orchestra.run.smithi115.stdout: mon client directed command retry = 5 2024-05-21T13:35:00.778 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd backfillfull_ratio = 0.85 2024-05-21T13:35:00.778 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd full ratio = 0.9 2024-05-21T13:35:00.778 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd nearfull ratio = 0.8 2024-05-21T13:35:00.778 INFO:teuthology.orchestra.run.smithi115.stdout: ms inject delay max = 1 2024-05-21T13:35:00.778 INFO:teuthology.orchestra.run.smithi115.stdout: ms inject delay probability = 0.005 2024-05-21T13:35:00.778 INFO:teuthology.orchestra.run.smithi115.stdout: ms inject delay type = client mds 2024-05-21T13:35:00.778 INFO:teuthology.orchestra.run.smithi115.stdout: ms inject socket failures = 2500 2024-05-21T13:35:00.778 INFO:teuthology.orchestra.run.smithi115.stdout: osd blocked scrub grace period = 3600 2024-05-21T13:35:00.778 INFO:teuthology.orchestra.run.smithi115.stdout: osd failsafe full ratio = 0.95 2024-05-21T13:35:00.778 INFO:teuthology.orchestra.run.smithi115.stdout: osd max markdown count = 1000 2024-05-21T13:35:00.778 INFO:teuthology.orchestra.run.smithi115.stdout: osd objectstore = bluestore 2024-05-21T13:35:00.778 INFO:teuthology.orchestra.run.smithi115.stdout: osd op complaint time = 180 2024-05-21T13:35:00.778 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-21T13:35:00.779 INFO:teuthology.orchestra.run.smithi115.stdout:[mgr] 2024-05-21T13:35:00.779 INFO:teuthology.orchestra.run.smithi115.stdout: debug ms = 1 2024-05-21T13:35:00.779 INFO:teuthology.orchestra.run.smithi115.stdout: debug mgr = 20 2024-05-21T13:35:00.779 INFO:teuthology.orchestra.run.smithi115.stdout: debug mon = 20 2024-05-21T13:35:00.779 INFO:teuthology.orchestra.run.smithi115.stdout: debug auth = 20 2024-05-21T13:35:00.779 INFO:teuthology.orchestra.run.smithi115.stdout: mon reweight min pgs per osd = 4 2024-05-21T13:35:00.779 INFO:teuthology.orchestra.run.smithi115.stdout: mon reweight min bytes per osd = 10 2024-05-21T13:35:00.779 INFO:teuthology.orchestra.run.smithi115.stdout: mgr/telemetry/nag = false 2024-05-21T13:35:00.779 INFO:teuthology.orchestra.run.smithi115.stdout: debug client = 20 2024-05-21T13:35:00.779 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-21T13:35:00.779 INFO:teuthology.orchestra.run.smithi115.stdout:[mon] 2024-05-21T13:35:00.779 INFO:teuthology.orchestra.run.smithi115.stdout: debug ms = 1 2024-05-21T13:35:00.779 INFO:teuthology.orchestra.run.smithi115.stdout: debug mon = 20 2024-05-21T13:35:00.779 INFO:teuthology.orchestra.run.smithi115.stdout: debug paxos = 20 2024-05-21T13:35:00.780 INFO:teuthology.orchestra.run.smithi115.stdout: debug auth = 20 2024-05-21T13:35:00.780 INFO:teuthology.orchestra.run.smithi115.stdout: mon data avail warn = 5 2024-05-21T13:35:00.780 INFO:teuthology.orchestra.run.smithi115.stdout: mon mgr mkfs grace = 240 2024-05-21T13:35:00.780 INFO:teuthology.orchestra.run.smithi115.stdout: mon reweight min pgs per osd = 4 2024-05-21T13:35:00.780 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd reporter subtree level = osd 2024-05-21T13:35:00.780 INFO:teuthology.orchestra.run.smithi115.stdout: mon osd prime pg temp = true 2024-05-21T13:35:00.780 INFO:teuthology.orchestra.run.smithi115.stdout: mon reweight min bytes per osd = 10 2024-05-21T13:35:00.780 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-21T13:35:00.780 INFO:teuthology.orchestra.run.smithi115.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-21T13:35:00.780 INFO:teuthology.orchestra.run.smithi115.stdout: auth mon ticket ttl = 660 # 11m 2024-05-21T13:35:00.780 INFO:teuthology.orchestra.run.smithi115.stdout: auth service ticket ttl = 240 # 4m 2024-05-21T13:35:00.780 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-21T13:35:00.780 INFO:teuthology.orchestra.run.smithi115.stdout: # don't complain about insecure global_id in the test suite 2024-05-21T13:35:00.781 INFO:teuthology.orchestra.run.smithi115.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-21T13:35:00.781 INFO:teuthology.orchestra.run.smithi115.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-21T13:35:00.781 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-21T13:35:00.781 INFO:teuthology.orchestra.run.smithi115.stdout: # 1m isn't quite enough 2024-05-21T13:35:00.781 INFO:teuthology.orchestra.run.smithi115.stdout: mon_down_mkfs_grace = 2m 2024-05-21T13:35:00.781 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-21T13:35:00.781 INFO:teuthology.orchestra.run.smithi115.stdout: mon_warn_on_filestore_osds = false 2024-05-21T13:35:00.781 INFO:teuthology.orchestra.run.smithi115.stdout: mon down mkfs grace = 300 2024-05-21T13:35:00.781 INFO:teuthology.orchestra.run.smithi115.stdout: mon op complaint time = 120 2024-05-21T13:35:00.781 INFO:teuthology.orchestra.run.smithi115.stdout: 2024-05-21T13:35:00.781 INFO:teuthology.orchestra.run.smithi115.stdout:[client] 2024-05-21T13:35:00.781 INFO:teuthology.orchestra.run.smithi115.stdout: rgw cache enabled = true 2024-05-21T13:35:00.781 INFO:teuthology.orchestra.run.smithi115.stdout: rgw enable ops log = true 2024-05-21T13:35:00.782 INFO:teuthology.orchestra.run.smithi115.stdout: rgw enable usage log = true 2024-05-21T13:35:00.782 INFO:teuthology.orchestra.run.smithi115.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-21T13:35:00.782 INFO:teuthology.orchestra.run.smithi115.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-21T13:35:00.782 INFO:teuthology.orchestra.run.smithi115.stdout: client mount timeout = 600 2024-05-21T13:35:00.782 INFO:teuthology.orchestra.run.smithi115.stdout: client_shutdown_timeout = 120 2024-05-21T13:35:00.782 INFO:teuthology.orchestra.run.smithi115.stdout: debug client = 20 2024-05-21T13:35:00.782 INFO:teuthology.orchestra.run.smithi115.stdout: debug ms = 1 2024-05-21T13:35:00.782 INFO:teuthology.orchestra.run.smithi115.stdout: rados mon op timeout = 900 2024-05-21T13:35:00.782 INFO:teuthology.orchestra.run.smithi115.stdout: rados osd op timeout = 900 2024-05-21T13:35:00.782 INFO:teuthology.orchestra.run.smithi115.stdout:[mon.a] 2024-05-21T13:35:00.782 INFO:teuthology.orchestra.run.smithi115.stdout:[mon.b] 2024-05-21T13:35:00.782 INFO:teuthology.orchestra.run.smithi115.stdout:[mon.c] 2024-05-21T13:35:00.783 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.a] 2024-05-21T13:35:00.783 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.c] 2024-05-21T13:35:00.783 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.e] 2024-05-21T13:35:00.783 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.b] 2024-05-21T13:35:00.783 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.d] 2024-05-21T13:35:00.783 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.f] 2024-05-21T13:35:00.783 INFO:teuthology.orchestra.run.smithi115.stdout:[mds] 2024-05-21T13:35:00.783 INFO:teuthology.orchestra.run.smithi115.stdout: debug mds = 20 2024-05-21T13:35:00.783 INFO:teuthology.orchestra.run.smithi115.stdout: debug mds balancer = 20 2024-05-21T13:35:00.783 INFO:teuthology.orchestra.run.smithi115.stdout: debug ms = 1 2024-05-21T13:35:00.783 INFO:teuthology.orchestra.run.smithi115.stdout: mds bal fragment size max = 10000 2024-05-21T13:35:00.783 INFO:teuthology.orchestra.run.smithi115.stdout: mds bal merge size = 5 2024-05-21T13:35:00.783 INFO:teuthology.orchestra.run.smithi115.stdout: mds bal split bits = 3 2024-05-21T13:35:00.783 INFO:teuthology.orchestra.run.smithi115.stdout: mds bal split size = 100 2024-05-21T13:35:00.783 INFO:teuthology.orchestra.run.smithi115.stdout: mds debug frag = True 2024-05-21T13:35:00.784 INFO:teuthology.orchestra.run.smithi115.stdout: mds debug scatterstat = True 2024-05-21T13:35:00.784 INFO:teuthology.orchestra.run.smithi115.stdout: mds oft prefetch dirfrags = True 2024-05-21T13:35:00.784 INFO:teuthology.orchestra.run.smithi115.stdout: mds op complaint time = 180 2024-05-21T13:35:00.784 INFO:teuthology.orchestra.run.smithi115.stdout: mds verify scatter = True 2024-05-21T13:35:00.784 INFO:teuthology.orchestra.run.smithi115.stdout: mds_dir_prefetch = True 2024-05-21T13:35:00.784 INFO:teuthology.orchestra.run.smithi115.stdout: mds_sleep_rank_change = 5000000.0 2024-05-21T13:35:00.784 INFO:teuthology.orchestra.run.smithi115.stdout: mon client directed command retry = 5 2024-05-21T13:35:00.784 INFO:teuthology.orchestra.run.smithi115.stdout: ms inject delay max = 1 2024-05-21T13:35:00.784 INFO:teuthology.orchestra.run.smithi115.stdout: ms inject delay probability = 0.005 2024-05-21T13:35:00.784 INFO:teuthology.orchestra.run.smithi115.stdout: ms inject delay type = client mds osd 2024-05-21T13:35:00.784 INFO:teuthology.orchestra.run.smithi115.stdout: ms inject socket failures = 2500 2024-05-21T13:35:00.784 INFO:teuthology.orchestra.run.smithi115.stdout: osd op complaint time = 180 2024-05-21T13:35:00.784 INFO:teuthology.orchestra.run.smithi115.stdout: rados mon op timeout = 900 2024-05-21T13:35:00.784 INFO:teuthology.orchestra.run.smithi115.stdout: rados osd op timeout = 900 2024-05-21T13:35:00.785 INFO:teuthology.orchestra.run.smithi022.stdout:[global] 2024-05-21T13:35:00.785 INFO:teuthology.orchestra.run.smithi022.stdout: chdir = "" 2024-05-21T13:35:00.785 INFO:teuthology.orchestra.run.smithi022.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-05-21T13:35:00.785 INFO:teuthology.orchestra.run.smithi022.stdout: auth supported = cephx 2024-05-21T13:35:00.785 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-21T13:35:00.785 INFO:teuthology.orchestra.run.smithi022.stdout: filestore xattr use omap = true 2024-05-21T13:35:00.785 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-21T13:35:00.785 INFO:teuthology.orchestra.run.smithi022.stdout: mon clock drift allowed = 1.000 2024-05-21T13:35:00.785 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-21T13:35:00.785 INFO:teuthology.orchestra.run.smithi022.stdout: osd crush chooseleaf type = 0 2024-05-21T13:35:00.785 INFO:teuthology.orchestra.run.smithi022.stdout: auth debug = true 2024-05-21T13:35:00.785 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-21T13:35:00.786 INFO:teuthology.orchestra.run.smithi022.stdout: ms die on old message = true 2024-05-21T13:35:00.786 INFO:teuthology.orchestra.run.smithi022.stdout: ms die on bug = true 2024-05-21T13:35:00.786 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-21T13:35:00.786 INFO:teuthology.orchestra.run.smithi022.stdout: mon max pg per osd = 10000 # >= luminous 2024-05-21T13:35:00.786 INFO:teuthology.orchestra.run.smithi022.stdout: mon pg warn max object skew = 0 2024-05-21T13:35:00.786 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-21T13:35:00.786 INFO:teuthology.orchestra.run.smithi022.stdout: # disable pg_autoscaler by default for new pools 2024-05-21T13:35:00.786 INFO:teuthology.orchestra.run.smithi022.stdout: osd_pool_default_pg_autoscale_mode = off 2024-05-21T13:35:00.786 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-21T13:35:00.786 INFO:teuthology.orchestra.run.smithi022.stdout: osd pool default size = 2 2024-05-21T13:35:00.786 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-21T13:35:00.786 INFO:teuthology.orchestra.run.smithi022.stdout: mon osd allow primary affinity = true 2024-05-21T13:35:00.786 INFO:teuthology.orchestra.run.smithi022.stdout: mon osd allow pg remap = true 2024-05-21T13:35:00.787 INFO:teuthology.orchestra.run.smithi022.stdout: mon warn on legacy crush tunables = false 2024-05-21T13:35:00.787 INFO:teuthology.orchestra.run.smithi022.stdout: mon warn on crush straw calc version zero = false 2024-05-21T13:35:00.787 INFO:teuthology.orchestra.run.smithi022.stdout: mon warn on no sortbitwise = false 2024-05-21T13:35:00.787 INFO:teuthology.orchestra.run.smithi022.stdout: mon warn on osd down out interval zero = false 2024-05-21T13:35:00.787 INFO:teuthology.orchestra.run.smithi022.stdout: mon warn on too few osds = false 2024-05-21T13:35:00.787 INFO:teuthology.orchestra.run.smithi022.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-05-21T13:35:00.787 INFO:teuthology.orchestra.run.smithi022.stdout: mon_warn_on_pool_no_redundancy = false 2024-05-21T13:35:00.787 INFO:teuthology.orchestra.run.smithi022.stdout: mon_allow_pool_size_one = true 2024-05-21T13:35:00.787 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-21T13:35:00.787 INFO:teuthology.orchestra.run.smithi022.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-05-21T13:35:00.787 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-21T13:35:00.787 INFO:teuthology.orchestra.run.smithi022.stdout: osd default data pool replay window = 5 2024-05-21T13:35:00.788 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-21T13:35:00.788 INFO:teuthology.orchestra.run.smithi022.stdout: mon allow pool delete = true 2024-05-21T13:35:00.788 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-21T13:35:00.788 INFO:teuthology.orchestra.run.smithi022.stdout: mon cluster log file level = debug 2024-05-21T13:35:00.788 INFO:teuthology.orchestra.run.smithi022.stdout: debug asserts on shutdown = true 2024-05-21T13:35:00.788 INFO:teuthology.orchestra.run.smithi022.stdout: mon health detail to clog = false 2024-05-21T13:35:00.788 INFO:teuthology.orchestra.run.smithi022.stdout: mon host = "172.21.15.22,172.21.15.115,[v2:172.21.15.115:3301,v1:172.21.15.115:6790]" 2024-05-21T13:35:00.788 INFO:teuthology.orchestra.run.smithi022.stdout: fsid = f2c96204-e240-4e7f-8a76-927b4f80f534 2024-05-21T13:35:00.788 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-21T13:35:00.788 INFO:teuthology.orchestra.run.smithi022.stdout:[osd] 2024-05-21T13:35:00.788 INFO:teuthology.orchestra.run.smithi022.stdout: osd journal size = 100 2024-05-21T13:35:00.788 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-21T13:35:00.788 INFO:teuthology.orchestra.run.smithi022.stdout: osd scrub load threshold = 5.0 2024-05-21T13:35:00.788 INFO:teuthology.orchestra.run.smithi022.stdout: osd scrub max interval = 600 2024-05-21T13:35:00.789 INFO:teuthology.orchestra.run.smithi022.stdout: osd mclock profile = high_recovery_ops 2024-05-21T13:35:00.789 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-21T13:35:00.789 INFO:teuthology.orchestra.run.smithi022.stdout: osd recover clone overlap = true 2024-05-21T13:35:00.789 INFO:teuthology.orchestra.run.smithi022.stdout: osd recovery max chunk = 1048576 2024-05-21T13:35:00.789 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-21T13:35:00.789 INFO:teuthology.orchestra.run.smithi022.stdout: osd debug shutdown = true 2024-05-21T13:35:00.789 INFO:teuthology.orchestra.run.smithi022.stdout: osd debug op order = true 2024-05-21T13:35:00.789 INFO:teuthology.orchestra.run.smithi022.stdout: osd debug verify stray on activate = true 2024-05-21T13:35:00.789 INFO:teuthology.orchestra.run.smithi022.stdout: osd debug trim objects = true 2024-05-21T13:35:00.789 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-21T13:35:00.789 INFO:teuthology.orchestra.run.smithi022.stdout: osd open classes on start = true 2024-05-21T13:35:00.789 INFO:teuthology.orchestra.run.smithi022.stdout: osd debug pg log writeout = true 2024-05-21T13:35:00.789 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-21T13:35:00.790 INFO:teuthology.orchestra.run.smithi022.stdout: osd deep scrub update digest min age = 30 2024-05-21T13:35:00.790 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-21T13:35:00.790 INFO:teuthology.orchestra.run.smithi022.stdout: osd map max advance = 10 2024-05-21T13:35:00.790 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-21T13:35:00.790 INFO:teuthology.orchestra.run.smithi022.stdout: journal zero on create = true 2024-05-21T13:35:00.790 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-21T13:35:00.790 INFO:teuthology.orchestra.run.smithi022.stdout: filestore ondisk finisher threads = 3 2024-05-21T13:35:00.790 INFO:teuthology.orchestra.run.smithi022.stdout: filestore apply finisher threads = 3 2024-05-21T13:35:00.790 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-21T13:35:00.790 INFO:teuthology.orchestra.run.smithi022.stdout: bdev debug aio = true 2024-05-21T13:35:00.790 INFO:teuthology.orchestra.run.smithi022.stdout: osd debug misdirected ops = true 2024-05-21T13:35:00.790 INFO:teuthology.orchestra.run.smithi022.stdout: bluestore block size = 96636764160 2024-05-21T13:35:00.791 INFO:teuthology.orchestra.run.smithi022.stdout: bluestore compression mode = aggressive 2024-05-21T13:35:00.791 INFO:teuthology.orchestra.run.smithi022.stdout: bluestore fsck on mount = True 2024-05-21T13:35:00.791 INFO:teuthology.orchestra.run.smithi022.stdout: debug bluefs = 20 2024-05-21T13:35:00.791 INFO:teuthology.orchestra.run.smithi022.stdout: debug bluestore = 20 2024-05-21T13:35:00.792 INFO:teuthology.orchestra.run.smithi022.stdout: debug ms = 1 2024-05-21T13:35:00.792 INFO:teuthology.orchestra.run.smithi022.stdout: debug osd = 20 2024-05-21T13:35:00.792 INFO:teuthology.orchestra.run.smithi022.stdout: debug rocksdb = 10 2024-05-21T13:35:00.792 INFO:teuthology.orchestra.run.smithi022.stdout: mon client directed command retry = 5 2024-05-21T13:35:00.792 INFO:teuthology.orchestra.run.smithi022.stdout: mon osd backfillfull_ratio = 0.85 2024-05-21T13:35:00.792 INFO:teuthology.orchestra.run.smithi022.stdout: mon osd full ratio = 0.9 2024-05-21T13:35:00.792 INFO:teuthology.orchestra.run.smithi022.stdout: mon osd nearfull ratio = 0.8 2024-05-21T13:35:00.792 INFO:teuthology.orchestra.run.smithi022.stdout: ms inject delay max = 1 2024-05-21T13:35:00.792 INFO:teuthology.orchestra.run.smithi022.stdout: ms inject delay probability = 0.005 2024-05-21T13:35:00.792 INFO:teuthology.orchestra.run.smithi022.stdout: ms inject delay type = client mds 2024-05-21T13:35:00.792 INFO:teuthology.orchestra.run.smithi022.stdout: ms inject socket failures = 2500 2024-05-21T13:35:00.792 INFO:teuthology.orchestra.run.smithi022.stdout: osd blocked scrub grace period = 3600 2024-05-21T13:35:00.792 INFO:teuthology.orchestra.run.smithi022.stdout: osd failsafe full ratio = 0.95 2024-05-21T13:35:00.792 INFO:teuthology.orchestra.run.smithi022.stdout: osd max markdown count = 1000 2024-05-21T13:35:00.793 INFO:teuthology.orchestra.run.smithi022.stdout: osd objectstore = bluestore 2024-05-21T13:35:00.793 INFO:teuthology.orchestra.run.smithi022.stdout: osd op complaint time = 180 2024-05-21T13:35:00.793 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-21T13:35:00.793 INFO:teuthology.orchestra.run.smithi022.stdout:[mgr] 2024-05-21T13:35:00.793 INFO:teuthology.orchestra.run.smithi022.stdout: debug ms = 1 2024-05-21T13:35:00.793 INFO:teuthology.orchestra.run.smithi022.stdout: debug mgr = 20 2024-05-21T13:35:00.793 INFO:teuthology.orchestra.run.smithi022.stdout: debug mon = 20 2024-05-21T13:35:00.793 INFO:teuthology.orchestra.run.smithi022.stdout: debug auth = 20 2024-05-21T13:35:00.793 INFO:teuthology.orchestra.run.smithi022.stdout: mon reweight min pgs per osd = 4 2024-05-21T13:35:00.793 INFO:teuthology.orchestra.run.smithi022.stdout: mon reweight min bytes per osd = 10 2024-05-21T13:35:00.794 INFO:teuthology.orchestra.run.smithi022.stdout: mgr/telemetry/nag = false 2024-05-21T13:35:00.794 INFO:teuthology.orchestra.run.smithi022.stdout: debug client = 20 2024-05-21T13:35:00.794 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-21T13:35:00.794 INFO:teuthology.orchestra.run.smithi022.stdout:[mon] 2024-05-21T13:35:00.794 INFO:teuthology.orchestra.run.smithi022.stdout: debug ms = 1 2024-05-21T13:35:00.794 INFO:teuthology.orchestra.run.smithi022.stdout: debug mon = 20 2024-05-21T13:35:00.794 INFO:teuthology.orchestra.run.smithi022.stdout: debug paxos = 20 2024-05-21T13:35:00.794 INFO:teuthology.orchestra.run.smithi022.stdout: debug auth = 20 2024-05-21T13:35:00.794 INFO:teuthology.orchestra.run.smithi022.stdout: mon data avail warn = 5 2024-05-21T13:35:00.794 INFO:teuthology.orchestra.run.smithi022.stdout: mon mgr mkfs grace = 240 2024-05-21T13:35:00.794 INFO:teuthology.orchestra.run.smithi022.stdout: mon reweight min pgs per osd = 4 2024-05-21T13:35:00.795 INFO:teuthology.orchestra.run.smithi022.stdout: mon osd reporter subtree level = osd 2024-05-21T13:35:00.795 INFO:teuthology.orchestra.run.smithi022.stdout: mon osd prime pg temp = true 2024-05-21T13:35:00.795 INFO:teuthology.orchestra.run.smithi022.stdout: mon reweight min bytes per osd = 10 2024-05-21T13:35:00.795 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-21T13:35:00.795 INFO:teuthology.orchestra.run.smithi022.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-05-21T13:35:00.795 INFO:teuthology.orchestra.run.smithi022.stdout: auth mon ticket ttl = 660 # 11m 2024-05-21T13:35:00.795 INFO:teuthology.orchestra.run.smithi022.stdout: auth service ticket ttl = 240 # 4m 2024-05-21T13:35:00.795 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-21T13:35:00.795 INFO:teuthology.orchestra.run.smithi022.stdout: # don't complain about insecure global_id in the test suite 2024-05-21T13:35:00.795 INFO:teuthology.orchestra.run.smithi022.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-05-21T13:35:00.795 INFO:teuthology.orchestra.run.smithi022.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-05-21T13:35:00.795 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-21T13:35:00.795 INFO:teuthology.orchestra.run.smithi022.stdout: # 1m isn't quite enough 2024-05-21T13:35:00.796 INFO:teuthology.orchestra.run.smithi022.stdout: mon_down_mkfs_grace = 2m 2024-05-21T13:35:00.796 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-21T13:35:00.796 INFO:teuthology.orchestra.run.smithi022.stdout: mon_warn_on_filestore_osds = false 2024-05-21T13:35:00.796 INFO:teuthology.orchestra.run.smithi022.stdout: mon down mkfs grace = 300 2024-05-21T13:35:00.796 INFO:teuthology.orchestra.run.smithi022.stdout: mon op complaint time = 120 2024-05-21T13:35:00.796 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-21T13:35:00.796 INFO:teuthology.orchestra.run.smithi022.stdout:[client] 2024-05-21T13:35:00.796 INFO:teuthology.orchestra.run.smithi022.stdout: rgw cache enabled = true 2024-05-21T13:35:00.796 INFO:teuthology.orchestra.run.smithi022.stdout: rgw enable ops log = true 2024-05-21T13:35:00.796 INFO:teuthology.orchestra.run.smithi022.stdout: rgw enable usage log = true 2024-05-21T13:35:00.796 INFO:teuthology.orchestra.run.smithi022.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-05-21T13:35:00.796 INFO:teuthology.orchestra.run.smithi022.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-05-21T13:35:00.796 INFO:teuthology.orchestra.run.smithi022.stdout: client mount timeout = 600 2024-05-21T13:35:00.796 INFO:teuthology.orchestra.run.smithi022.stdout: client_shutdown_timeout = 120 2024-05-21T13:35:00.797 INFO:teuthology.orchestra.run.smithi022.stdout: debug client = 20 2024-05-21T13:35:00.797 INFO:teuthology.orchestra.run.smithi022.stdout: debug ms = 1 2024-05-21T13:35:00.797 INFO:teuthology.orchestra.run.smithi022.stdout: rados mon op timeout = 900 2024-05-21T13:35:00.797 INFO:teuthology.orchestra.run.smithi022.stdout: rados osd op timeout = 900 2024-05-21T13:35:00.797 INFO:teuthology.orchestra.run.smithi022.stdout:[mon.a] 2024-05-21T13:35:00.797 INFO:teuthology.orchestra.run.smithi022.stdout:[mon.b] 2024-05-21T13:35:00.797 INFO:teuthology.orchestra.run.smithi022.stdout:[mon.c] 2024-05-21T13:35:00.797 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.a] 2024-05-21T13:35:00.797 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.c] 2024-05-21T13:35:00.797 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.e] 2024-05-21T13:35:00.797 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.b] 2024-05-21T13:35:00.797 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.d] 2024-05-21T13:35:00.797 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.f] 2024-05-21T13:35:00.798 INFO:teuthology.orchestra.run.smithi022.stdout:[mds] 2024-05-21T13:35:00.798 INFO:teuthology.orchestra.run.smithi022.stdout: debug mds = 20 2024-05-21T13:35:00.798 INFO:teuthology.orchestra.run.smithi022.stdout: debug mds balancer = 20 2024-05-21T13:35:00.798 INFO:teuthology.orchestra.run.smithi022.stdout: debug ms = 1 2024-05-21T13:35:00.798 INFO:teuthology.orchestra.run.smithi022.stdout: mds bal fragment size max = 10000 2024-05-21T13:35:00.798 INFO:teuthology.orchestra.run.smithi022.stdout: mds bal merge size = 5 2024-05-21T13:35:00.798 INFO:teuthology.orchestra.run.smithi022.stdout: mds bal split bits = 3 2024-05-21T13:35:00.798 INFO:teuthology.orchestra.run.smithi022.stdout: mds bal split size = 100 2024-05-21T13:35:00.798 INFO:teuthology.orchestra.run.smithi022.stdout: mds debug frag = True 2024-05-21T13:35:00.798 INFO:teuthology.orchestra.run.smithi022.stdout: mds debug scatterstat = True 2024-05-21T13:35:00.798 INFO:teuthology.orchestra.run.smithi022.stdout: mds oft prefetch dirfrags = True 2024-05-21T13:35:00.798 INFO:teuthology.orchestra.run.smithi022.stdout: mds op complaint time = 180 2024-05-21T13:35:00.798 INFO:teuthology.orchestra.run.smithi022.stdout: mds verify scatter = True 2024-05-21T13:35:00.798 INFO:teuthology.orchestra.run.smithi022.stdout: mds_dir_prefetch = True 2024-05-21T13:35:00.799 INFO:teuthology.orchestra.run.smithi022.stdout: mds_sleep_rank_change = 5000000.0 2024-05-21T13:35:00.799 INFO:teuthology.orchestra.run.smithi022.stdout: mon client directed command retry = 5 2024-05-21T13:35:00.799 INFO:teuthology.orchestra.run.smithi022.stdout: ms inject delay max = 1 2024-05-21T13:35:00.799 INFO:teuthology.orchestra.run.smithi022.stdout: ms inject delay probability = 0.005 2024-05-21T13:35:00.799 INFO:teuthology.orchestra.run.smithi022.stdout: ms inject delay type = client mds osd 2024-05-21T13:35:00.799 INFO:teuthology.orchestra.run.smithi022.stdout: ms inject socket failures = 2500 2024-05-21T13:35:00.799 INFO:teuthology.orchestra.run.smithi022.stdout: osd op complaint time = 180 2024-05-21T13:35:00.799 INFO:teuthology.orchestra.run.smithi022.stdout: rados mon op timeout = 900 2024-05-21T13:35:00.799 INFO:teuthology.orchestra.run.smithi022.stdout: rados osd op timeout = 900 2024-05-21T13:35:00.801 INFO:tasks.ceph:Creating admin key on mon.a... 2024-05-21T13:35:00.801 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-05-21T13:35:00.896 INFO:tasks.ceph:Copying monmap to all nodes... 2024-05-21T13:35:00.896 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-05-21T13:35:00.896 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-05-21T13:35:00.902 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-05-21T13:35:00.902 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-05-21T13:35:00.950 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi022.front.sepia.ceph.com 2024-05-21T13:35:00.950 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-05-21T13:35:00.950 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-21T13:35:00.950 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-21T13:35:01.013 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-05-21T13:35:01.013 DEBUG:teuthology.orchestra.run.smithi022:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-21T13:35:01.062 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi115.front.sepia.ceph.com 2024-05-21T13:35:01.063 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-21T13:35:01.063 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd of=/etc/ceph/ceph.keyring 2024-05-21T13:35:01.063 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-05-21T13:35:01.087 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-21T13:35:01.087 DEBUG:teuthology.orchestra.run.smithi115:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-05-21T13:35:01.135 INFO:tasks.ceph:Setting up mon nodes... 2024-05-21T13:35:01.135 INFO:tasks.ceph:Setting up mgr nodes... 2024-05-21T13:35:01.135 DEBUG:teuthology.orchestra.run.smithi022:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-05-21T13:35:01.179 INFO:teuthology.orchestra.run.smithi022.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-05-21T13:35:01.183 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-05-21T13:35:01.226 INFO:teuthology.orchestra.run.smithi115.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-05-21T13:35:01.248 INFO:tasks.ceph:Setting up mds nodes... 2024-05-21T13:35:01.249 DEBUG:teuthology.orchestra.run.smithi022:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-05-21T13:35:01.293 INFO:teuthology.orchestra.run.smithi022.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-05-21T13:35:01.296 DEBUG:teuthology.orchestra.run.smithi022:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-05-21T13:35:01.351 DEBUG:teuthology.orchestra.run.smithi022:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-05-21T13:35:01.437 INFO:teuthology.orchestra.run.smithi022.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-05-21T13:35:01.440 DEBUG:teuthology.orchestra.run.smithi022:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-05-21T13:35:01.453 DEBUG:teuthology.orchestra.run.smithi022:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2024-05-21T13:35:01.535 INFO:teuthology.orchestra.run.smithi022.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2024-05-21T13:35:01.538 DEBUG:teuthology.orchestra.run.smithi022:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2024-05-21T13:35:01.594 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-05-21T13:35:01.640 INFO:teuthology.orchestra.run.smithi115.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-05-21T13:35:01.642 DEBUG:teuthology.orchestra.run.smithi115:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-05-21T13:35:01.698 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-05-21T13:35:01.785 INFO:teuthology.orchestra.run.smithi115.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-05-21T13:35:01.787 DEBUG:teuthology.orchestra.run.smithi115:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-05-21T13:35:01.841 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2024-05-21T13:35:01.926 INFO:teuthology.orchestra.run.smithi115.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2024-05-21T13:35:01.929 DEBUG:teuthology.orchestra.run.smithi115:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2024-05-21T13:35:01.982 INFO:tasks.ceph_client:Setting up client nodes... 2024-05-21T13:35:01.982 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-21T13:35:02.021 INFO:teuthology.orchestra.run.smithi022.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-05-21T13:35:02.033 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-05-21T13:35:02.033 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi022.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi115.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-05-21T13:35:02.034 DEBUG:teuthology.orchestra.run.smithi022:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-05-21T13:35:02.091 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-21T13:35:02.091 INFO:tasks.ceph:role: osd.0 2024-05-21T13:35:02.091 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi022.front.sepia.ceph.com 2024-05-21T13:35:02.091 DEBUG:teuthology.orchestra.run.smithi022:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-21T13:35:02.146 INFO:teuthology.orchestra.run.smithi022.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-21T13:35:02.146 INFO:teuthology.orchestra.run.smithi022.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-21T13:35:02.146 INFO:teuthology.orchestra.run.smithi022.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-21T13:35:02.146 INFO:teuthology.orchestra.run.smithi022.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-21T13:35:02.146 INFO:teuthology.orchestra.run.smithi022.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-21T13:35:02.146 INFO:teuthology.orchestra.run.smithi022.stdout: = sunit=0 swidth=0 blks 2024-05-21T13:35:02.146 INFO:teuthology.orchestra.run.smithi022.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-21T13:35:02.146 INFO:teuthology.orchestra.run.smithi022.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-21T13:35:02.146 INFO:teuthology.orchestra.run.smithi022.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-21T13:35:02.146 INFO:teuthology.orchestra.run.smithi022.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-21T13:35:02.170 INFO:teuthology.orchestra.run.smithi022.stdout:Discarding blocks...Done. 2024-05-21T13:35:02.177 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi022.front.sepia.ceph.com -o noatime 2024-05-21T13:35:02.178 DEBUG:teuthology.orchestra.run.smithi022:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-05-21T13:35:02.239 DEBUG:teuthology.orchestra.run.smithi022:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-05-21T13:35:02.292 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-21T13:35:02.293 INFO:teuthology.orchestra.run.smithi022.stderr:sudo: /sbin/restorecon: command not found 2024-05-21T13:35:02.293 DEBUG:teuthology.orchestra.run.smithi022:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-05-21T13:35:02.350 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-21T13:35:02.350 INFO:tasks.ceph:role: osd.1 2024-05-21T13:35:02.350 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi022.front.sepia.ceph.com 2024-05-21T13:35:02.350 DEBUG:teuthology.orchestra.run.smithi022:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-21T13:35:02.406 INFO:teuthology.orchestra.run.smithi022.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-21T13:35:02.407 INFO:teuthology.orchestra.run.smithi022.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-21T13:35:02.407 INFO:teuthology.orchestra.run.smithi022.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-21T13:35:02.407 INFO:teuthology.orchestra.run.smithi022.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-21T13:35:02.407 INFO:teuthology.orchestra.run.smithi022.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-21T13:35:02.407 INFO:teuthology.orchestra.run.smithi022.stdout: = sunit=0 swidth=0 blks 2024-05-21T13:35:02.407 INFO:teuthology.orchestra.run.smithi022.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-21T13:35:02.407 INFO:teuthology.orchestra.run.smithi022.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-21T13:35:02.407 INFO:teuthology.orchestra.run.smithi022.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-21T13:35:02.407 INFO:teuthology.orchestra.run.smithi022.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-21T13:35:02.430 INFO:teuthology.orchestra.run.smithi022.stdout:Discarding blocks...Done. 2024-05-21T13:35:02.433 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi022.front.sepia.ceph.com -o noatime 2024-05-21T13:35:02.433 DEBUG:teuthology.orchestra.run.smithi022:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-05-21T13:35:02.495 DEBUG:teuthology.orchestra.run.smithi022:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-05-21T13:35:02.547 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-21T13:35:02.547 INFO:teuthology.orchestra.run.smithi022.stderr:sudo: /sbin/restorecon: command not found 2024-05-21T13:35:02.547 DEBUG:teuthology.orchestra.run.smithi022:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-05-21T13:35:02.603 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-21T13:35:02.603 INFO:tasks.ceph:role: osd.2 2024-05-21T13:35:02.603 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi022.front.sepia.ceph.com 2024-05-21T13:35:02.603 DEBUG:teuthology.orchestra.run.smithi022:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-21T13:35:02.658 INFO:teuthology.orchestra.run.smithi022.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-21T13:35:02.658 INFO:teuthology.orchestra.run.smithi022.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-21T13:35:02.658 INFO:teuthology.orchestra.run.smithi022.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-21T13:35:02.659 INFO:teuthology.orchestra.run.smithi022.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-21T13:35:02.659 INFO:teuthology.orchestra.run.smithi022.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-21T13:35:02.659 INFO:teuthology.orchestra.run.smithi022.stdout: = sunit=0 swidth=0 blks 2024-05-21T13:35:02.659 INFO:teuthology.orchestra.run.smithi022.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-21T13:35:02.659 INFO:teuthology.orchestra.run.smithi022.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-21T13:35:02.659 INFO:teuthology.orchestra.run.smithi022.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-21T13:35:02.659 INFO:teuthology.orchestra.run.smithi022.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-21T13:35:02.682 INFO:teuthology.orchestra.run.smithi022.stdout:Discarding blocks...Done. 2024-05-21T13:35:02.684 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi022.front.sepia.ceph.com -o noatime 2024-05-21T13:35:02.684 DEBUG:teuthology.orchestra.run.smithi022:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-05-21T13:35:02.741 DEBUG:teuthology.orchestra.run.smithi022:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-05-21T13:35:02.800 INFO:teuthology.orchestra.run.smithi022.stderr:sudo: /sbin/restorecon: command not found 2024-05-21T13:35:02.800 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-21T13:35:02.801 DEBUG:teuthology.orchestra.run.smithi022:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-05-21T13:35:02.858 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-05-21T13:35:02.858 INFO:tasks.ceph:role: osd.3 2024-05-21T13:35:02.858 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi022.front.sepia.ceph.com 2024-05-21T13:35:02.858 DEBUG:teuthology.orchestra.run.smithi022:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-21T13:35:02.914 INFO:teuthology.orchestra.run.smithi022.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-21T13:35:02.914 INFO:teuthology.orchestra.run.smithi022.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-21T13:35:02.914 INFO:teuthology.orchestra.run.smithi022.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-21T13:35:02.914 INFO:teuthology.orchestra.run.smithi022.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-21T13:35:02.914 INFO:teuthology.orchestra.run.smithi022.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-21T13:35:02.914 INFO:teuthology.orchestra.run.smithi022.stdout: = sunit=0 swidth=0 blks 2024-05-21T13:35:02.914 INFO:teuthology.orchestra.run.smithi022.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-21T13:35:02.914 INFO:teuthology.orchestra.run.smithi022.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-21T13:35:02.915 INFO:teuthology.orchestra.run.smithi022.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-21T13:35:02.915 INFO:teuthology.orchestra.run.smithi022.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-21T13:35:02.938 INFO:teuthology.orchestra.run.smithi022.stdout:Discarding blocks...Done. 2024-05-21T13:35:02.940 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi022.front.sepia.ceph.com -o noatime 2024-05-21T13:35:02.940 DEBUG:teuthology.orchestra.run.smithi022:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-05-21T13:35:03.001 DEBUG:teuthology.orchestra.run.smithi022:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-05-21T13:35:03.050 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-21T13:35:03.051 INFO:teuthology.orchestra.run.smithi022.stderr:sudo: /sbin/restorecon: command not found 2024-05-21T13:35:03.051 DEBUG:teuthology.orchestra.run.smithi022:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-21T13:35:03.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:03.184+0000 7f3b3e5c27c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-05-21T13:35:03.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:03.184+0000 7f3b3e5c27c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-05-21T13:35:03.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:03.184+0000 7f3b3e5c27c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-21T13:35:03.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:03.184+0000 7f3b3e5c27c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-21T13:35:03.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:03.184+0000 7f3b3e5c27c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-05-21T13:35:03.164 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:03.184+0000 7f3b3e5c27c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-05-21T13:35:06.127 DEBUG:teuthology.orchestra.run.smithi022:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-21T13:35:06.141 DEBUG:teuthology.orchestra.run.smithi022:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-21T13:35:06.230 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:06.252+0000 7fbc08a1c7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-05-21T13:35:06.230 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:06.252+0000 7fbc08a1c7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-05-21T13:35:06.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:06.252+0000 7fbc08a1c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-21T13:35:06.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:06.252+0000 7fbc08a1c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-21T13:35:06.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:06.252+0000 7fbc08a1c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-05-21T13:35:06.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:06.252+0000 7fbc08a1c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-05-21T13:35:09.177 DEBUG:teuthology.orchestra.run.smithi022:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-05-21T13:35:09.235 DEBUG:teuthology.orchestra.run.smithi022:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-21T13:35:09.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:09.340+0000 7f477cedb7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-05-21T13:35:09.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:09.340+0000 7f477cedb7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-05-21T13:35:09.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:09.340+0000 7f477cedb7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-21T13:35:09.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:09.340+0000 7f477cedb7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-21T13:35:09.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:09.340+0000 7f477cedb7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-05-21T13:35:09.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:09.340+0000 7f477cedb7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-05-21T13:35:12.293 DEBUG:teuthology.orchestra.run.smithi022:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-05-21T13:35:12.350 DEBUG:teuthology.orchestra.run.smithi022:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-21T13:35:12.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:12.456+0000 7f69916807c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-05-21T13:35:12.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:12.456+0000 7f69916807c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-05-21T13:35:12.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:12.456+0000 7f69916807c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-21T13:35:12.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:12.456+0000 7f69916807c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-21T13:35:12.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:12.456+0000 7f69916807c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-05-21T13:35:12.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:12.456+0000 7f69916807c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-05-21T13:35:15.397 DEBUG:teuthology.orchestra.run.smithi022:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-05-21T13:35:15.459 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-05-21T13:35:15.474 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-21T13:35:15.474 INFO:tasks.ceph:role: osd.4 2024-05-21T13:35:15.474 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi115.front.sepia.ceph.com 2024-05-21T13:35:15.475 DEBUG:teuthology.orchestra.run.smithi115:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-05-21T13:35:15.538 INFO:teuthology.orchestra.run.smithi115.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-05-21T13:35:15.538 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-21T13:35:15.538 INFO:teuthology.orchestra.run.smithi115.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-21T13:35:15.538 INFO:teuthology.orchestra.run.smithi115.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-21T13:35:15.538 INFO:teuthology.orchestra.run.smithi115.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-21T13:35:15.538 INFO:teuthology.orchestra.run.smithi115.stdout: = sunit=0 swidth=0 blks 2024-05-21T13:35:15.538 INFO:teuthology.orchestra.run.smithi115.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-21T13:35:15.538 INFO:teuthology.orchestra.run.smithi115.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-21T13:35:15.539 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-21T13:35:15.539 INFO:teuthology.orchestra.run.smithi115.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-21T13:35:16.007 INFO:teuthology.orchestra.run.smithi115.stdout:Discarding blocks...Done. 2024-05-21T13:35:16.009 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi115.front.sepia.ceph.com -o noatime 2024-05-21T13:35:16.009 DEBUG:teuthology.orchestra.run.smithi115:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-05-21T13:35:16.147 DEBUG:teuthology.orchestra.run.smithi115:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-05-21T13:35:16.159 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-21T13:35:16.159 INFO:teuthology.orchestra.run.smithi115.stderr:sudo: /sbin/restorecon: command not found 2024-05-21T13:35:16.159 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-05-21T13:35:16.213 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-21T13:35:16.213 INFO:tasks.ceph:role: osd.5 2024-05-21T13:35:16.214 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi115.front.sepia.ceph.com 2024-05-21T13:35:16.214 DEBUG:teuthology.orchestra.run.smithi115:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-05-21T13:35:16.283 INFO:teuthology.orchestra.run.smithi115.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-05-21T13:35:16.283 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-21T13:35:16.283 INFO:teuthology.orchestra.run.smithi115.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-21T13:35:16.283 INFO:teuthology.orchestra.run.smithi115.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-21T13:35:16.283 INFO:teuthology.orchestra.run.smithi115.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-21T13:35:16.283 INFO:teuthology.orchestra.run.smithi115.stdout: = sunit=0 swidth=0 blks 2024-05-21T13:35:16.283 INFO:teuthology.orchestra.run.smithi115.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-21T13:35:16.283 INFO:teuthology.orchestra.run.smithi115.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-21T13:35:16.283 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-21T13:35:16.284 INFO:teuthology.orchestra.run.smithi115.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-21T13:35:16.701 INFO:teuthology.orchestra.run.smithi115.stdout:Discarding blocks...Done. 2024-05-21T13:35:16.704 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi115.front.sepia.ceph.com -o noatime 2024-05-21T13:35:16.705 DEBUG:teuthology.orchestra.run.smithi115:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-05-21T13:35:16.767 DEBUG:teuthology.orchestra.run.smithi115:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-05-21T13:35:16.818 INFO:teuthology.orchestra.run.smithi115.stderr:sudo: /sbin/restorecon: command not found 2024-05-21T13:35:16.819 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-21T13:35:16.820 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-05-21T13:35:16.872 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-21T13:35:16.872 INFO:tasks.ceph:role: osd.6 2024-05-21T13:35:16.873 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi115.front.sepia.ceph.com 2024-05-21T13:35:16.873 DEBUG:teuthology.orchestra.run.smithi115:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-05-21T13:35:16.933 INFO:teuthology.orchestra.run.smithi115.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-05-21T13:35:16.934 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-21T13:35:16.934 INFO:teuthology.orchestra.run.smithi115.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-21T13:35:16.934 INFO:teuthology.orchestra.run.smithi115.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-21T13:35:16.934 INFO:teuthology.orchestra.run.smithi115.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-21T13:35:16.934 INFO:teuthology.orchestra.run.smithi115.stdout: = sunit=0 swidth=0 blks 2024-05-21T13:35:16.934 INFO:teuthology.orchestra.run.smithi115.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-21T13:35:16.934 INFO:teuthology.orchestra.run.smithi115.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-21T13:35:16.934 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-21T13:35:16.934 INFO:teuthology.orchestra.run.smithi115.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-21T13:35:17.403 INFO:teuthology.orchestra.run.smithi115.stdout:Discarding blocks...Done. 2024-05-21T13:35:17.404 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi115.front.sepia.ceph.com -o noatime 2024-05-21T13:35:17.405 DEBUG:teuthology.orchestra.run.smithi115:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-05-21T13:35:17.489 DEBUG:teuthology.orchestra.run.smithi115:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-05-21T13:35:17.544 INFO:teuthology.orchestra.run.smithi115.stderr:sudo: /sbin/restorecon: command not found 2024-05-21T13:35:17.544 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-21T13:35:17.545 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-05-21T13:35:17.601 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-05-21T13:35:17.602 INFO:tasks.ceph:role: osd.7 2024-05-21T13:35:17.602 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi115.front.sepia.ceph.com 2024-05-21T13:35:17.602 DEBUG:teuthology.orchestra.run.smithi115:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-05-21T13:35:17.667 INFO:teuthology.orchestra.run.smithi115.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-05-21T13:35:17.667 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 attr=2, projid32bit=1 2024-05-21T13:35:17.667 INFO:teuthology.orchestra.run.smithi115.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-05-21T13:35:17.667 INFO:teuthology.orchestra.run.smithi115.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-05-21T13:35:17.667 INFO:teuthology.orchestra.run.smithi115.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-05-21T13:35:17.667 INFO:teuthology.orchestra.run.smithi115.stdout: = sunit=0 swidth=0 blks 2024-05-21T13:35:17.668 INFO:teuthology.orchestra.run.smithi115.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-05-21T13:35:17.668 INFO:teuthology.orchestra.run.smithi115.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-05-21T13:35:17.668 INFO:teuthology.orchestra.run.smithi115.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-05-21T13:35:17.668 INFO:teuthology.orchestra.run.smithi115.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-05-21T13:35:18.147 INFO:teuthology.orchestra.run.smithi115.stdout:Discarding blocks...Done. 2024-05-21T13:35:18.149 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi115.front.sepia.ceph.com -o noatime 2024-05-21T13:35:18.149 DEBUG:teuthology.orchestra.run.smithi115:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-05-21T13:35:18.293 DEBUG:teuthology.orchestra.run.smithi115:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-05-21T13:35:18.304 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-21T13:35:18.305 INFO:teuthology.orchestra.run.smithi115.stderr:sudo: /sbin/restorecon: command not found 2024-05-21T13:35:18.305 DEBUG:teuthology.orchestra.run.smithi115:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-21T13:35:18.424 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:18.444+0000 7fdb818c47c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-05-21T13:35:18.427 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:18.448+0000 7fdb818c47c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-05-21T13:35:18.427 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:18.448+0000 7fdb818c47c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-21T13:35:18.427 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:18.448+0000 7fdb818c47c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-21T13:35:18.427 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:18.448+0000 7fdb818c47c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-05-21T13:35:18.433 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:18.456+0000 7fdb818c47c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-05-21T13:35:21.398 DEBUG:teuthology.orchestra.run.smithi115:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-05-21T13:35:21.413 DEBUG:teuthology.orchestra.run.smithi115:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-21T13:35:21.497 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:21.520+0000 7ff25436d7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-05-21T13:35:21.498 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:21.520+0000 7ff25436d7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-05-21T13:35:21.499 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:21.520+0000 7ff25436d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-21T13:35:21.499 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:21.520+0000 7ff25436d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-21T13:35:21.499 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:21.520+0000 7ff25436d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-05-21T13:35:21.499 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:21.520+0000 7ff25436d7c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-05-21T13:35:24.484 DEBUG:teuthology.orchestra.run.smithi115:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-05-21T13:35:24.543 DEBUG:teuthology.orchestra.run.smithi115:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-21T13:35:24.629 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:24.648+0000 7f84b68537c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-05-21T13:35:24.629 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:24.652+0000 7f84b68537c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-05-21T13:35:24.630 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:24.652+0000 7f84b68537c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-21T13:35:24.630 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:24.652+0000 7f84b68537c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-21T13:35:24.630 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:24.652+0000 7f84b68537c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-05-21T13:35:24.633 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:24.652+0000 7f84b68537c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-05-21T13:35:27.606 DEBUG:teuthology.orchestra.run.smithi115:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-05-21T13:35:27.666 DEBUG:teuthology.orchestra.run.smithi115:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-05-21T13:35:27.748 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:27.768+0000 7f62af8557c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-05-21T13:35:27.749 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:27.768+0000 7f62af8557c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-05-21T13:35:27.749 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:27.768+0000 7f62af8557c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-21T13:35:27.749 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:27.768+0000 7f62af8557c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-21T13:35:27.749 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:27.768+0000 7f62af8557c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-05-21T13:35:27.750 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:27.772+0000 7f62af8557c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-05-21T13:35:28.986 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-21T13:35:28.990 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-21T13:35:30.749 DEBUG:teuthology.orchestra.run.smithi115:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-05-21T13:35:30.763 INFO:tasks.ceph:Reading keys from all nodes... 2024-05-21T13:35:30.763 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-05-21T13:35:30.764 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-05-21T13:35:30.779 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-05-21T13:35:30.779 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-05-21T13:35:30.834 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-05-21T13:35:30.834 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-05-21T13:35:30.891 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-05-21T13:35:30.891 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2024-05-21T13:35:30.949 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-05-21T13:35:30.949 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-05-21T13:35:31.006 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-05-21T13:35:31.006 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-05-21T13:35:31.061 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-05-21T13:35:31.062 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-05-21T13:35:31.117 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-05-21T13:35:31.117 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-05-21T13:35:31.173 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-21T13:35:31.173 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-05-21T13:35:31.187 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-21T13:35:31.187 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-05-21T13:35:31.242 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-21T13:35:31.242 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-05-21T13:35:31.297 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-21T13:35:31.297 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2024-05-21T13:35:31.352 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-21T13:35:31.352 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-05-21T13:35:31.405 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-21T13:35:31.405 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-05-21T13:35:31.461 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-21T13:35:31.461 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-05-21T13:35:31.517 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-21T13:35:31.517 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-05-21T13:35:31.572 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-05-21T13:35:31.572 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-05-21T13:35:31.578 INFO:tasks.ceph:Adding keys to all mons... 2024-05-21T13:35:31.578 DEBUG:teuthology.orchestra.run.smithi022:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-21T13:35:31.622 DEBUG:teuthology.orchestra.run.smithi115:> sudo tee -a /etc/ceph/ceph.keyring 2024-05-21T13:35:31.632 INFO:teuthology.orchestra.run.smithi022.stdout:[mgr.y] 2024-05-21T13:35:31.633 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQAFo0xmtgY2DBAAXznZX07iSQSSz/Y1Ejbh0w== 2024-05-21T13:35:31.633 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.a] 2024-05-21T13:35:31.633 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQAFo0xmS639EhAAoktjtI9WlRMudqmCUQci+A== 2024-05-21T13:35:31.633 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.c] 2024-05-21T13:35:31.633 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQAFo0xm/uOYGxAARiyJsBRwfxkNNPLQl5c8MA== 2024-05-21T13:35:31.633 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.e] 2024-05-21T13:35:31.634 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQAFo0xmRJ9yIRAAFvlUQkRz6XHtzCTCj+/kvw== 2024-05-21T13:35:31.634 INFO:teuthology.orchestra.run.smithi022.stdout:[osd.0] 2024-05-21T13:35:31.634 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQAHo0xmlNlDCxAAKMXFMTlylxQNTxk12TKkrg== 2024-05-21T13:35:31.634 INFO:teuthology.orchestra.run.smithi022.stdout:[osd.1] 2024-05-21T13:35:31.634 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQAKo0xmpTA5DxAAjCTqELOSXr9oBC5x+DVajw== 2024-05-21T13:35:31.634 INFO:teuthology.orchestra.run.smithi022.stdout:[osd.2] 2024-05-21T13:35:31.634 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQANo0xm+Qt8FBAAHyzbJTKqDCAKWxKYZ1/bGA== 2024-05-21T13:35:31.634 INFO:teuthology.orchestra.run.smithi022.stdout:[osd.3] 2024-05-21T13:35:31.634 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQAQo0xmOoZ9GxAA6lkEzMhd6Y3Wb3izN0enyw== 2024-05-21T13:35:31.635 INFO:teuthology.orchestra.run.smithi022.stdout:[mgr.x] 2024-05-21T13:35:31.635 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQAFo0xmlI0GDxAAL/Jf81XMcNK/wd3KLPqamw== 2024-05-21T13:35:31.635 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.b] 2024-05-21T13:35:31.635 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQAFo0xmez+0JxAAcq78o/u9ww351p8FKTvQDg== 2024-05-21T13:35:31.635 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.d] 2024-05-21T13:35:31.635 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQAFo0xmsRtYMBAAkYfX7FN7HUW3wgmyitKvKg== 2024-05-21T13:35:31.635 INFO:teuthology.orchestra.run.smithi022.stdout:[mds.f] 2024-05-21T13:35:31.635 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQAFo0xm2rrHOBAAKf7o2rqYSlvIa1SF4kJ6KA== 2024-05-21T13:35:31.635 INFO:teuthology.orchestra.run.smithi022.stdout:[osd.4] 2024-05-21T13:35:31.635 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQAWo0xm7R3YGhAA9oZVwNqafr6l4Ghbpqjtuw== 2024-05-21T13:35:31.635 INFO:teuthology.orchestra.run.smithi022.stdout:[osd.5] 2024-05-21T13:35:31.635 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQAZo0xmb486HxAAp+VXuK+FZnuZbeEglfNT9w== 2024-05-21T13:35:31.635 INFO:teuthology.orchestra.run.smithi022.stdout:[osd.6] 2024-05-21T13:35:31.636 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQAco0xmS8MPJxAAGC0GyPaBVZvmZKZ3qKfeYQ== 2024-05-21T13:35:31.636 INFO:teuthology.orchestra.run.smithi022.stdout:[osd.7] 2024-05-21T13:35:31.636 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQAfo0xmGO0yLhAAMcHN9KW3NblqrsDaGN+Stg== 2024-05-21T13:35:31.636 INFO:teuthology.orchestra.run.smithi022.stdout:[client.0] 2024-05-21T13:35:31.636 INFO:teuthology.orchestra.run.smithi022.stdout: key = AQAGo0xmOB3IAhAABLi5yGEouzzzdcI/oHI0gg== 2024-05-21T13:35:31.637 INFO:teuthology.orchestra.run.smithi115.stdout:[mgr.y] 2024-05-21T13:35:31.637 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQAFo0xmtgY2DBAAXznZX07iSQSSz/Y1Ejbh0w== 2024-05-21T13:35:31.637 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.a] 2024-05-21T13:35:31.637 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQAFo0xmS639EhAAoktjtI9WlRMudqmCUQci+A== 2024-05-21T13:35:31.638 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.c] 2024-05-21T13:35:31.638 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQAFo0xm/uOYGxAARiyJsBRwfxkNNPLQl5c8MA== 2024-05-21T13:35:31.638 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.e] 2024-05-21T13:35:31.638 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQAFo0xmRJ9yIRAAFvlUQkRz6XHtzCTCj+/kvw== 2024-05-21T13:35:31.638 INFO:teuthology.orchestra.run.smithi115.stdout:[osd.0] 2024-05-21T13:35:31.638 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQAHo0xmlNlDCxAAKMXFMTlylxQNTxk12TKkrg== 2024-05-21T13:35:31.638 INFO:teuthology.orchestra.run.smithi115.stdout:[osd.1] 2024-05-21T13:35:31.638 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQAKo0xmpTA5DxAAjCTqELOSXr9oBC5x+DVajw== 2024-05-21T13:35:31.638 INFO:teuthology.orchestra.run.smithi115.stdout:[osd.2] 2024-05-21T13:35:31.638 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQANo0xm+Qt8FBAAHyzbJTKqDCAKWxKYZ1/bGA== 2024-05-21T13:35:31.638 INFO:teuthology.orchestra.run.smithi115.stdout:[osd.3] 2024-05-21T13:35:31.638 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQAQo0xmOoZ9GxAA6lkEzMhd6Y3Wb3izN0enyw== 2024-05-21T13:35:31.639 INFO:teuthology.orchestra.run.smithi115.stdout:[mgr.x] 2024-05-21T13:35:31.639 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQAFo0xmlI0GDxAAL/Jf81XMcNK/wd3KLPqamw== 2024-05-21T13:35:31.639 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.b] 2024-05-21T13:35:31.639 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQAFo0xmez+0JxAAcq78o/u9ww351p8FKTvQDg== 2024-05-21T13:35:31.639 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.d] 2024-05-21T13:35:31.639 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQAFo0xmsRtYMBAAkYfX7FN7HUW3wgmyitKvKg== 2024-05-21T13:35:31.639 INFO:teuthology.orchestra.run.smithi115.stdout:[mds.f] 2024-05-21T13:35:31.639 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQAFo0xm2rrHOBAAKf7o2rqYSlvIa1SF4kJ6KA== 2024-05-21T13:35:31.639 INFO:teuthology.orchestra.run.smithi115.stdout:[osd.4] 2024-05-21T13:35:31.639 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQAWo0xm7R3YGhAA9oZVwNqafr6l4Ghbpqjtuw== 2024-05-21T13:35:31.639 INFO:teuthology.orchestra.run.smithi115.stdout:[osd.5] 2024-05-21T13:35:31.639 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQAZo0xmb486HxAAp+VXuK+FZnuZbeEglfNT9w== 2024-05-21T13:35:31.639 INFO:teuthology.orchestra.run.smithi115.stdout:[osd.6] 2024-05-21T13:35:31.640 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQAco0xmS8MPJxAAGC0GyPaBVZvmZKZ3qKfeYQ== 2024-05-21T13:35:31.641 INFO:teuthology.orchestra.run.smithi115.stdout:[osd.7] 2024-05-21T13:35:31.641 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQAfo0xmGO0yLhAAMcHN9KW3NblqrsDaGN+Stg== 2024-05-21T13:35:31.641 INFO:teuthology.orchestra.run.smithi115.stdout:[client.0] 2024-05-21T13:35:31.641 INFO:teuthology.orchestra.run.smithi115.stdout: key = AQAGo0xmOB3IAhAABLi5yGEouzzzdcI/oHI0gg== 2024-05-21T13:35:31.642 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-21T13:35:31.683 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-21T13:35:31.729 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-21T13:35:31.731 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-21T13:35:31.822 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-21T13:35:31.825 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-21T13:35:31.868 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-21T13:35:31.911 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-21T13:35:31.955 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-21T13:35:31.957 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-21T13:35:32.040 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-21T13:35:32.043 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-21T13:35:32.133 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-21T13:35:32.136 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-21T13:35:32.220 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-21T13:35:32.222 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-21T13:35:32.302 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-21T13:35:32.306 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-05-21T13:35:32.384 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-21T13:35:32.390 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-21T13:35:32.474 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-21T13:35:32.477 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-21T13:35:32.524 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-21T13:35:32.526 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-05-21T13:35:32.603 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-21T13:35:32.619 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-21T13:35:32.683 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-21T13:35:32.710 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-21T13:35:32.766 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-21T13:35:32.769 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-21T13:35:32.854 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-21T13:35:32.857 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-05-21T13:35:32.901 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-21T13:35:32.946 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-05-21T13:35:32.994 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-05-21T13:35:32.995 DEBUG:teuthology.orchestra.run.smithi022:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-05-21T13:35:33.008 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-21T13:35:33.099 DEBUG:teuthology.orchestra.run.smithi022:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-05-21T13:35:33.109 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-05-21T13:35:33.122 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-21T13:35:33.215 DEBUG:teuthology.orchestra.run.smithi115:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-05-21T13:35:33.226 DEBUG:teuthology.orchestra.run.smithi115:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-05-21T13:35:33.279 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-05-21T13:35:33.370 DEBUG:teuthology.orchestra.run.smithi115:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-05-21T13:35:33.382 DEBUG:teuthology.orchestra.run.smithi022:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-21T13:35:33.385 DEBUG:teuthology.orchestra.run.smithi115:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-05-21T13:35:33.429 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-05-21T13:35:33.429 INFO:tasks.ceph.mon.a:Restarting daemon 2024-05-21T13:35:33.430 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-05-21T13:35:33.434 INFO:tasks.ceph.mon.a:Started 2024-05-21T13:35:33.434 INFO:tasks.ceph.mon.b:Restarting daemon 2024-05-21T13:35:33.434 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-05-21T13:35:33.474 INFO:tasks.ceph.mon.b:Started 2024-05-21T13:35:33.474 INFO:tasks.ceph.mon.c:Restarting daemon 2024-05-21T13:35:33.474 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-05-21T13:35:33.476 INFO:tasks.ceph.mon.c:Started 2024-05-21T13:35:33.476 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-05-21T13:35:33.476 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-05-21T13:35:33.477 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-05-21T13:35:33.479 INFO:tasks.ceph.mgr.y:Started 2024-05-21T13:35:33.479 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-05-21T13:35:33.479 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-05-21T13:35:33.483 INFO:tasks.ceph.mgr.x:Started 2024-05-21T13:35:33.483 INFO:tasks.ceph:Setting crush tunables to default 2024-05-21T13:35:33.483 DEBUG:teuthology.orchestra.run.smithi022:> sudo ceph --cluster ceph osd crush tunables default 2024-05-21T13:35:33.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.620+0000 7f5dfee60640 1 Processor -- start 2024-05-21T13:35:33.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.620+0000 7f5dfee60640 1 -- start start 2024-05-21T13:35:33.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.620+0000 7f5dfee60640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f5df815c5a0 0x7f5df8068c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:33.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.620+0000 7f5dfee60640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5df806d7a0 0x7f5df806dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:33.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.620+0000 7f5dfee60640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5df80c6620 con 0x7f5df806d3c0 2024-05-21T13:35:33.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.620+0000 7f5dfee60640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f5df80c76c0 con 0x7f5df815c5a0 2024-05-21T13:35:33.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.620+0000 7f5dfee60640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f5df80c6900 con 0x7f5df806d7a0 2024-05-21T13:35:33.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.624+0000 7f5df7fff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f5df815c5a0 0x7f5df8068c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:33.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.624+0000 7f5dfcbfc640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f5df806d3c0 0x7f5df80ccbb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.22:53902/0 (socket says 172.21.15.22:53902) 2024-05-21T13:35:33.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.624+0000 7f5dfcbfc640 1 -- 172.21.15.22:0/1544045460 learned_addr learned my addr 172.21.15.22:0/1544045460 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-21T13:35:33.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.624+0000 7f5dfd3fd640 1 --2- 172.21.15.22:0/1544045460 >> v2:172.21.15.115:3300/0 conn(0x7f5df806d7a0 0x7f5df806dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:33.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.624+0000 7f5df7fff640 1 -- 172.21.15.22:0/1544045460 >> v2:172.21.15.22:3300/0 conn(0x7f5df815c5a0 msgr2=0x7f5df8068c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-21T13:35:33.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.624+0000 7f5df7fff640 1 -- 172.21.15.22:0/1544045460 >> v2:172.21.15.22:3300/0 conn(0x7f5df815c5a0 msgr2=0x7f5df8068c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-21T13:35:33.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.624+0000 7f5df7fff640 1 --2- 172.21.15.22:0/1544045460 >> v2:172.21.15.22:3300/0 conn(0x7f5df815c5a0 0x7f5df8068c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-21T13:35:33.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.624+0000 7f5df7fff640 1 --2- 172.21.15.22:0/1544045460 >> v2:172.21.15.22:3300/0 conn(0x7f5df815c5a0 0x7f5df8068c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-21T13:35:33.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.624+0000 7f5dfd3fd640 1 -- 172.21.15.22:0/1544045460 >> v2:172.21.15.115:3300/0 conn(0x7f5df806d7a0 msgr2=0x7f5df806dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-05-21T13:35:33.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.624+0000 7f5dfd3fd640 1 -- 172.21.15.22:0/1544045460 >> v2:172.21.15.115:3300/0 conn(0x7f5df806d7a0 msgr2=0x7f5df806dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-21T13:35:33.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.624+0000 7f5dfd3fd640 1 --2- 172.21.15.22:0/1544045460 >> v2:172.21.15.115:3300/0 conn(0x7f5df806d7a0 0x7f5df806dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-21T13:35:33.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.624+0000 7f5dfd3fd640 1 --2- 172.21.15.22:0/1544045460 >> v2:172.21.15.115:3300/0 conn(0x7f5df806d7a0 0x7f5df806dba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-21T13:35:33.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.828+0000 7f5df7fff640 1 --2- 172.21.15.22:0/1544045460 >> v2:172.21.15.22:3300/0 conn(0x7f5df815c5a0 0x7f5df8068c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:33.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.828+0000 7f5dfd3fd640 1 --2- 172.21.15.22:0/1544045460 >> v2:172.21.15.115:3300/0 conn(0x7f5df806d7a0 0x7f5df806dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:33.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.828+0000 7f5df7fff640 1 -- 172.21.15.22:0/1544045460 >> v2:172.21.15.22:3300/0 conn(0x7f5df815c5a0 msgr2=0x7f5df8068c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-05-21T13:35:33.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.828+0000 7f5df7fff640 1 -- 172.21.15.22:0/1544045460 >> v2:172.21.15.22:3300/0 conn(0x7f5df815c5a0 msgr2=0x7f5df8068c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-21T13:35:33.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.828+0000 7f5df7fff640 1 --2- 172.21.15.22:0/1544045460 >> v2:172.21.15.22:3300/0 conn(0x7f5df815c5a0 0x7f5df8068c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-21T13:35:33.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.828+0000 7f5df7fff640 1 --2- 172.21.15.22:0/1544045460 >> v2:172.21.15.22:3300/0 conn(0x7f5df815c5a0 0x7f5df8068c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-21T13:35:33.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.828+0000 7f5dfd3fd640 1 -- 172.21.15.22:0/1544045460 >> v2:172.21.15.115:3300/0 conn(0x7f5df806d7a0 msgr2=0x7f5df806dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-05-21T13:35:33.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.828+0000 7f5dfd3fd640 1 -- 172.21.15.22:0/1544045460 >> v2:172.21.15.115:3300/0 conn(0x7f5df806d7a0 msgr2=0x7f5df806dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-21T13:35:33.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.828+0000 7f5dfd3fd640 1 --2- 172.21.15.22:0/1544045460 >> v2:172.21.15.115:3300/0 conn(0x7f5df806d7a0 0x7f5df806dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-21T13:35:33.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.828+0000 7f5dfd3fd640 1 --2- 172.21.15.22:0/1544045460 >> v2:172.21.15.115:3300/0 conn(0x7f5df806d7a0 0x7f5df806dba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-05-21T13:35:33.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.848+0000 7f5df77fe640 1 -- 172.21.15.22:0/1544045460 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1686321271 0 0) 0x7f5df80c6620 con 0x7f5df806d3c0 2024-05-21T13:35:33.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.848+0000 7f5df77fe640 1 -- 172.21.15.22:0/1544045460 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5de4003530 con 0x7f5df806d3c0 2024-05-21T13:35:33.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.856+0000 7f5df77fe640 1 -- 172.21.15.22:0/1544045460 <== mon.1 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3256181939 0 0) 0x7f5de4003530 con 0x7f5df806d3c0 2024-05-21T13:35:33.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.856+0000 7f5df77fe640 1 -- 172.21.15.22:0/1544045460 >> v2:172.21.15.115:3300/0 conn(0x7f5df806d7a0 msgr2=0x7f5df806dba0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-21T13:35:33.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.856+0000 7f5df77fe640 1 --2- 172.21.15.22:0/1544045460 >> v2:172.21.15.115:3300/0 conn(0x7f5df806d7a0 0x7f5df806dba0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:33.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.856+0000 7f5df77fe640 1 -- 172.21.15.22:0/1544045460 >> v2:172.21.15.22:3300/0 conn(0x7f5df815c5a0 msgr2=0x7f5df8068c90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-21T13:35:33.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.856+0000 7f5df77fe640 1 --2- 172.21.15.22:0/1544045460 >> v2:172.21.15.22:3300/0 conn(0x7f5df815c5a0 0x7f5df8068c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:33.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.856+0000 7f5df77fe640 1 -- 172.21.15.22:0/1544045460 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5df80c6be0 con 0x7f5df806d3c0 2024-05-21T13:35:33.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.856+0000 7f5df77fe640 1 -- 172.21.15.22:0/1544045460 <== mon.1 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2684847062 0 0) 0x7f5df0001700 con 0x7f5df806d3c0 2024-05-21T13:35:33.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.856+0000 7f5df77fe640 1 -- 172.21.15.22:0/1544045460 >> v1:172.21.15.115:6789/0 conn(0x7f5df806d3c0 legacy=0x7f5df80ccbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:33.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.856+0000 7f5df77fe640 1 --2- 172.21.15.22:0/1544045460 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5de4003ab0 0x7f5de4003ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:33.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.856+0000 7f5df77fe640 1 --2- 172.21.15.22:0/1544045460 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5de4004810 0x7f5de4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:33.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.856+0000 7f5df77fe640 1 --2- 172.21.15.22:0/1544045460 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5de4005220 0x7f5de400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:33.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.856+0000 7f5df77fe640 1 -- 172.21.15.22:0/1544045460 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5df80c76c0 con 0x7f5de4005220 2024-05-21T13:35:33.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.856+0000 7f5df77fe640 1 -- 172.21.15.22:0/1544045460 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f5df80c6900 con 0x7f5de4003ab0 2024-05-21T13:35:33.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.856+0000 7f5df77fe640 1 -- 172.21.15.22:0/1544045460 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f5de400c1b0 con 0x7f5de4004810 2024-05-21T13:35:33.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.856+0000 7f5dfd3fd640 1 --2- 172.21.15.22:0/1544045460 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5de4005220 0x7f5de400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:33.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.856+0000 7f5dfcbfc640 1 --2- 172.21.15.22:0/1544045460 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5de4003ab0 0x7f5de4003ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:33.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.856+0000 7f5df7fff640 1 --2- 172.21.15.22:0/1544045460 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5de4004810 0x7f5de4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:33.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.856+0000 7f5dfd3fd640 1 -- 172.21.15.22:0/1544045460 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5de4004810 msgr2=0x7f5de4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:35:33.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.856+0000 7f5dfd3fd640 1 --2- 172.21.15.22:0/1544045460 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5de4004810 0x7f5de4004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:33.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.856+0000 7f5dfd3fd640 1 -- 172.21.15.22:0/1544045460 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5de4003ab0 msgr2=0x7f5de4003ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:35:33.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.856+0000 7f5dfd3fd640 1 --2- 172.21.15.22:0/1544045460 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5de4003ab0 0x7f5de4003ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:33.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.856+0000 7f5dfd3fd640 1 -- 172.21.15.22:0/1544045460 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5de4003530 con 0x7f5de4005220 2024-05-21T13:35:33.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.860+0000 7f5df7fff640 1 --2- 172.21.15.22:0/1544045460 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5de4004810 0x7f5de4004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T13:35:33.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.860+0000 7f5dfd3fd640 1 -- 172.21.15.22:0/1544045460 reap_dead start 2024-05-21T13:35:33.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.860+0000 7f5dfd3fd640 1 --2- 172.21.15.22:0/1544045460 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5de4005220 0x7f5de400b9d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5de8009a40 tx=0x7f5de801d030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fe618dcb73d0bba server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:35:33.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.860+0000 7f5df77fe640 1 -- 172.21.15.22:0/1544045460 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5de8009640 con 0x7f5de4005220 2024-05-21T13:35:33.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.860+0000 7f5df77fe640 1 -- 172.21.15.22:0/1544045460 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5de80ac680 con 0x7f5de4005220 2024-05-21T13:35:33.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.860+0000 7f5df77fe640 1 -- 172.21.15.22:0/1544045460 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5de80aca70 con 0x7f5de4005220 2024-05-21T13:35:33.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.860+0000 7f5dfee60640 1 -- 172.21.15.22:0/1544045460 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5de4005220 msgr2=0x7f5de400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:33.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.860+0000 7f5dfee60640 1 --2- 172.21.15.22:0/1544045460 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5de4005220 0x7f5de400b9d0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f5de8009a40 tx=0x7f5de801d030 comp rx=0 tx=0).stop 2024-05-21T13:35:33.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.860+0000 7f5dfee60640 1 -- 172.21.15.22:0/1544045460 shutdown_connections 2024-05-21T13:35:33.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.860+0000 7f5dfee60640 1 --2- 172.21.15.22:0/1544045460 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5de4005220 0x7f5de400b9d0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:33.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.860+0000 7f5dfee60640 1 -- 172.21.15.22:0/1544045460 >> 172.21.15.22:0/1544045460 conn(0x7f5df8073c20 msgr2=0x7f5df8068260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:35:33.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.860+0000 7f5dfee60640 1 -- 172.21.15.22:0/1544045460 shutdown_connections 2024-05-21T13:35:33.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.860+0000 7f5dfee60640 1 -- 172.21.15.22:0/1544045460 wait complete. 2024-05-21T13:35:33.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.864+0000 7f5dfee60640 1 Processor -- start 2024-05-21T13:35:33.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.864+0000 7f5dfee60640 1 -- start start 2024-05-21T13:35:33.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.864+0000 7f5dfee60640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5de4005220 0x7f5df81f50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:33.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.864+0000 7f5dfee60640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5df80ce450 0x7f5df814a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:33.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.864+0000 7f5dfee60640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5df80cc980 0x7f5df80b58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:33.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.864+0000 7f5dfee60640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5df80c71a0 con 0x7f5de4005220 2024-05-21T13:35:33.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.864+0000 7f5dfee60640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f5df80c6430 con 0x7f5df80ce450 2024-05-21T13:35:33.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.864+0000 7f5dfee60640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f5df815ca10 con 0x7f5df80cc980 2024-05-21T13:35:33.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.864+0000 7f5dfcbfc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5de4005220 0x7f5df81f50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:33.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.864+0000 7f5dfcbfc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5de4005220 0x7f5df81f50c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55036/0 (socket says 172.21.15.22:55036) 2024-05-21T13:35:33.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.864+0000 7f5dfcbfc640 1 -- 172.21.15.22:0/4290330956 learned_addr learned my addr 172.21.15.22:0/4290330956 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:35:33.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.864+0000 7f5dfd3fd640 1 --2- 172.21.15.22:0/4290330956 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5df80cc980 0x7f5df80b58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:33.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.864+0000 7f5df7fff640 1 --2- 172.21.15.22:0/4290330956 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5df80ce450 0x7f5df814a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:33.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.864+0000 7f5dfcbfc640 1 -- 172.21.15.22:0/4290330956 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5df80cc980 msgr2=0x7f5df80b58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:33.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.864+0000 7f5dfcbfc640 1 --2- 172.21.15.22:0/4290330956 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5df80cc980 0x7f5df80b58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:33.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.864+0000 7f5dfcbfc640 1 -- 172.21.15.22:0/4290330956 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5df80ce450 msgr2=0x7f5df814a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:33.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.864+0000 7f5dfcbfc640 1 --2- 172.21.15.22:0/4290330956 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5df80ce450 0x7f5df814a2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:33.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.864+0000 7f5dfcbfc640 1 -- 172.21.15.22:0/4290330956 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5df814ff00 con 0x7f5de4005220 2024-05-21T13:35:33.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.864+0000 7f5df7fff640 1 --2- 172.21.15.22:0/4290330956 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5df80ce450 0x7f5df814a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-21T13:35:33.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.864+0000 7f5dfcbfc640 1 --2- 172.21.15.22:0/4290330956 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5de4005220 0x7f5df81f50c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5df0007310 tx=0x7f5df00077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:35:33.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.864+0000 7f5df57fa640 1 -- 172.21.15.22:0/4290330956 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df0001740 con 0x7f5de4005220 2024-05-21T13:35:33.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.864+0000 7f5df57fa640 1 -- 172.21.15.22:0/4290330956 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5df0018070 con 0x7f5de4005220 2024-05-21T13:35:33.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.864+0000 7f5dfee60640 1 -- 172.21.15.22:0/4290330956 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5df8159be0 con 0x7f5de4005220 2024-05-21T13:35:33.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.864+0000 7f5df57fa640 1 -- 172.21.15.22:0/4290330956 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5df000fc00 con 0x7f5de4005220 2024-05-21T13:35:33.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.864+0000 7f5dfee60640 1 -- 172.21.15.22:0/4290330956 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5df815a1a0 con 0x7f5de4005220 2024-05-21T13:35:33.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.864+0000 7f5df57fa640 1 -- 172.21.15.22:0/4290330956 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5df001d460 con 0x7f5de4005220 2024-05-21T13:35:33.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.864+0000 7f5df57fa640 1 -- 172.21.15.22:0/4290330956 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f5df0013660 con 0x7f5de4005220 2024-05-21T13:35:33.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.864+0000 7f5dfee60640 1 -- 172.21.15.22:0/4290330956 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5df8077bb0 con 0x7f5de4005220 2024-05-21T13:35:33.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.888+0000 7f5df57fa640 1 -- 172.21.15.22:0/4290330956 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f5df000fda0 con 0x7f5de4005220 2024-05-21T13:35:33.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.960+0000 7f5dfee60640 1 -- 172.21.15.22:0/4290330956 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f5df80cc3a0 con 0x7f5de4005220 2024-05-21T13:35:33.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.964+0000 7f5df57fa640 1 -- 172.21.15.22:0/4290330956 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f5df001d890 con 0x7f5de4005220 2024-05-21T13:35:33.943 INFO:teuthology.orchestra.run.smithi022.stderr:adjusted tunables profile to default 2024-05-21T13:35:33.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.964+0000 7f5dfee60640 1 -- 172.21.15.22:0/4290330956 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5de4005220 msgr2=0x7f5df81f50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:33.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.964+0000 7f5dfee60640 1 --2- 172.21.15.22:0/4290330956 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5de4005220 0x7f5df81f50c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f5df0007310 tx=0x7f5df00077d0 comp rx=0 tx=0).stop 2024-05-21T13:35:33.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.964+0000 7f5dfee60640 1 -- 172.21.15.22:0/4290330956 shutdown_connections 2024-05-21T13:35:33.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.964+0000 7f5dfee60640 1 --2- 172.21.15.22:0/4290330956 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5df80cc980 0x7f5df80b58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:33.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.964+0000 7f5dfee60640 1 --2- 172.21.15.22:0/4290330956 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5df80ce450 0x7f5df814a2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:33.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.964+0000 7f5dfee60640 1 --2- 172.21.15.22:0/4290330956 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5de4005220 0x7f5df81f50c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:33.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.964+0000 7f5dfee60640 1 -- 172.21.15.22:0/4290330956 >> 172.21.15.22:0/4290330956 conn(0x7f5df8073c20 msgr2=0x7f5df814afe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:35:33.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.964+0000 7f5dfee60640 1 -- 172.21.15.22:0/4290330956 shutdown_connections 2024-05-21T13:35:33.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:33.968+0000 7f5dfee60640 1 -- 172.21.15.22:0/4290330956 wait complete. 2024-05-21T13:35:33.965 INFO:tasks.ceph:check_enable_crimson: False 2024-05-21T13:35:33.965 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-05-21T13:35:33.966 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-05-21T13:35:33.966 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-05-21T13:35:33.978 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-05-21T13:35:33.978 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-05-21T13:35:34.032 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-05-21T13:35:34.032 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-05-21T13:35:34.036 INFO:tasks.ceph.mgr.x.smithi115.stderr:2024-05-21T13:35:34.056+0000 7fce83649180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-21T13:35:34.050 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-05-21T13:35:34.072+0000 7f780882a180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-21T13:35:34.062 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-05-21T13:35:34.062 DEBUG:teuthology.orchestra.run.smithi022:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-05-21T13:35:34.118 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-21T13:35:34.118 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-05-21T13:35:34.131 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-21T13:35:34.131 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-05-21T13:35:34.185 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-21T13:35:34.185 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-05-21T13:35:34.240 DEBUG:teuthology.orchestra.run.smithi115:> set -ex 2024-05-21T13:35:34.240 DEBUG:teuthology.orchestra.run.smithi115:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-05-21T13:35:34.294 DEBUG:teuthology.orchestra.run.smithi115:> sudo ceph --cluster ceph osd new 09157d4a-9443-4e10-bbb3-cf8ed7c42cb9 0 2024-05-21T13:35:34.460 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.480+0000 7f73f1da5640 1 Processor -- start 2024-05-21T13:35:34.460 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.480+0000 7f73f1da5640 1 -- start start 2024-05-21T13:35:34.461 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.480+0000 7f73f1da5640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f73ec153b00 0x7f73ec0c9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:34.461 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.484+0000 7f73f1da5640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f73ec0c4e70 0x7f73ec0c52c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:34.462 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.484+0000 7f73f1da5640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73ec0cad80 con 0x7f73ec071700 2024-05-21T13:35:34.462 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.484+0000 7f73f1da5640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f73ec071b30 con 0x7f73ec153b00 2024-05-21T13:35:34.462 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.484+0000 7f73f1da5640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f73ec15a6f0 con 0x7f73ec0c4e70 2024-05-21T13:35:34.462 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.484+0000 7f73ebfff640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f73ec0c4e70 0x7f73ec0c52c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:34.462 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.484+0000 7f73ebfff640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f73ec0c4e70 0x7f73ec0c52c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52414/0 (socket says 172.21.15.115:52414) 2024-05-21T13:35:34.462 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.484+0000 7f73ebfff640 1 -- 172.21.15.115:0/66562710 learned_addr learned my addr 172.21.15.115:0/66562710 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-21T13:35:34.462 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.484+0000 7f73eb7fe640 1 --2- 172.21.15.115:0/66562710 >> v2:172.21.15.22:3300/0 conn(0x7f73ec153b00 0x7f73ec0c9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:34.462 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.484+0000 7f73ebfff640 1 -- 172.21.15.115:0/66562710 >> v2:172.21.15.22:3300/0 conn(0x7f73ec153b00 msgr2=0x7f73ec0c9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:35:34.462 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.484+0000 7f73ebfff640 1 --2- 172.21.15.115:0/66562710 >> v2:172.21.15.22:3300/0 conn(0x7f73ec153b00 0x7f73ec0c9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:34.462 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.484+0000 7f73ebfff640 1 -- 172.21.15.115:0/66562710 >> v1:172.21.15.115:6789/0 conn(0x7f73ec071700 legacy=0x7f73ec070a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:34.462 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.484+0000 7f73ebfff640 1 -- 172.21.15.115:0/66562710 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73ec0cb040 con 0x7f73ec0c4e70 2024-05-21T13:35:34.462 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.484+0000 7f73eb7fe640 1 --2- 172.21.15.115:0/66562710 >> v2:172.21.15.22:3300/0 conn(0x7f73ec153b00 0x7f73ec0c9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:35:34.463 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.484+0000 7f73ebfff640 1 --2- 172.21.15.115:0/66562710 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f73ec0c4e70 0x7f73ec0c52c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f73ec0cd340 tx=0x7f73dc01ed10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b2877687ecd29fa1 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:35:34.464 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.484+0000 7f73ea7fc640 1 -- 172.21.15.115:0/66562710 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73dc0b5070 con 0x7f73ec0c4e70 2024-05-21T13:35:34.464 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.484+0000 7f73ea7fc640 1 -- 172.21.15.115:0/66562710 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73dc0a8a10 con 0x7f73ec0c4e70 2024-05-21T13:35:34.464 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.484+0000 7f73ea7fc640 1 -- 172.21.15.115:0/66562710 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73dc0a8de0 con 0x7f73ec0c4e70 2024-05-21T13:35:34.465 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.484+0000 7f73f1da5640 1 -- 172.21.15.115:0/66562710 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f73ec0c4e70 msgr2=0x7f73ec0c52c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:34.465 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.484+0000 7f73f1da5640 1 --2- 172.21.15.115:0/66562710 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f73ec0c4e70 0x7f73ec0c52c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f73ec0cd340 tx=0x7f73dc01ed10 comp rx=0 tx=0).stop 2024-05-21T13:35:34.465 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.484+0000 7f73f1da5640 1 -- 172.21.15.115:0/66562710 shutdown_connections 2024-05-21T13:35:34.465 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.484+0000 7f73f1da5640 1 --2- 172.21.15.115:0/66562710 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f73ec0c4e70 0x7f73ec0c52c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:34.465 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.484+0000 7f73f1da5640 1 --2- 172.21.15.115:0/66562710 >> v2:172.21.15.22:3300/0 conn(0x7f73ec153b00 0x7f73ec0c9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:34.465 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.484+0000 7f73f1da5640 1 -- 172.21.15.115:0/66562710 >> 172.21.15.115:0/66562710 conn(0x7f73ec072090 msgr2=0x7f73ec0724a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:35:34.465 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.484+0000 7f73f1da5640 1 -- 172.21.15.115:0/66562710 shutdown_connections 2024-05-21T13:35:34.465 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.484+0000 7f73f1da5640 1 -- 172.21.15.115:0/66562710 wait complete. 2024-05-21T13:35:34.468 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.488+0000 7f73f1da5640 1 Processor -- start 2024-05-21T13:35:34.468 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.488+0000 7f73f1da5640 1 -- start start 2024-05-21T13:35:34.468 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.488+0000 7f73f1da5640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f73ec071700 0x7f73ec14c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:34.468 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.488+0000 7f73f1da5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f73ec0c4e70 0x7f73ec1f0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:34.468 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.488+0000 7f73f1da5640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f73ec1596c0 0x7f73ec1f1290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:34.468 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.488+0000 7f73f1da5640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f73ec071110 con 0x7f73ec0c4e70 2024-05-21T13:35:34.468 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.488+0000 7f73f1da5640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f73ec0704e0 con 0x7f73ec071700 2024-05-21T13:35:34.468 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.488+0000 7f73f1da5640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f73ec071290 con 0x7f73ec1596c0 2024-05-21T13:35:34.468 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.488+0000 7f73ebfff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f73ec1596c0 0x7f73ec1f1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:34.468 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.488+0000 7f73eb7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f73ec071700 0x7f73ec14c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:34.468 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.488+0000 7f73ebfff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f73ec1596c0 0x7f73ec1f1290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:52684/0 (socket says 172.21.15.115:52684) 2024-05-21T13:35:34.468 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.488+0000 7f73ebfff640 1 -- 172.21.15.115:0/3059120349 learned_addr learned my addr 172.21.15.115:0/3059120349 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-21T13:35:34.469 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.488+0000 7f73eaffd640 1 --2- 172.21.15.115:0/3059120349 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f73ec0c4e70 0x7f73ec1f0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:34.469 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.488+0000 7f73ebfff640 1 -- 172.21.15.115:0/3059120349 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f73ec071700 msgr2=0x7f73ec14c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:34.469 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.488+0000 7f73ebfff640 1 --2- 172.21.15.115:0/3059120349 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f73ec071700 0x7f73ec14c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:34.469 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.488+0000 7f73ebfff640 1 -- 172.21.15.115:0/3059120349 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f73ec0c4e70 msgr2=0x7f73ec1f0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:34.469 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.488+0000 7f73ebfff640 1 --2- 172.21.15.115:0/3059120349 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f73ec0c4e70 0x7f73ec1f0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:34.469 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.488+0000 7f73ebfff640 1 -- 172.21.15.115:0/3059120349 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73ec151620 con 0x7f73ec1596c0 2024-05-21T13:35:34.469 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.488+0000 7f73ebfff640 1 --2- 172.21.15.115:0/3059120349 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f73ec1596c0 0x7f73ec1f1290 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f73dc009930 tx=0x7f73dc01bab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:35:34.469 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.488+0000 7f73d3fff640 1 -- 172.21.15.115:0/3059120349 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73dc0bf070 con 0x7f73ec1596c0 2024-05-21T13:35:34.469 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.488+0000 7f73d3fff640 1 -- 172.21.15.115:0/3059120349 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f73dc0b08a0 con 0x7f73ec1596c0 2024-05-21T13:35:34.469 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.488+0000 7f73f1da5640 1 -- 172.21.15.115:0/3059120349 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73ec152bb0 con 0x7f73ec1596c0 2024-05-21T13:35:34.469 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.488+0000 7f73d3fff640 1 -- 172.21.15.115:0/3059120349 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73dc0b5040 con 0x7f73ec1596c0 2024-05-21T13:35:34.469 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.488+0000 7f73f1da5640 1 -- 172.21.15.115:0/3059120349 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f73ec1525f0 con 0x7f73ec1596c0 2024-05-21T13:35:34.469 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.488+0000 7f73d3fff640 1 -- 172.21.15.115:0/3059120349 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f73dc0c2070 con 0x7f73ec1596c0 2024-05-21T13:35:34.470 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.488+0000 7f73d3fff640 1 -- 172.21.15.115:0/3059120349 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f73dc0b93f0 con 0x7f73ec1596c0 2024-05-21T13:35:34.470 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.488+0000 7f73f1da5640 1 -- 172.21.15.115:0/3059120349 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73ec0697d0 con 0x7f73ec1596c0 2024-05-21T13:35:34.479 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.500+0000 7f73d3fff640 1 -- 172.21.15.115:0/3059120349 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f73dc0c9020 con 0x7f73ec1596c0 2024-05-21T13:35:34.515 INFO:tasks.ceph.mgr.x.smithi115.stderr:2024-05-21T13:35:34.536+0000 7fce83649180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-21T13:35:34.548 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.568+0000 7f73f1da5640 1 -- 172.21.15.115:0/3059120349 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "osd new", "uuid": "09157d4a-9443-4e10-bbb3-cf8ed7c42cb9", "id": 0} v 0) -- 0x7f73ec152e10 con 0x7f73ec1596c0 2024-05-21T13:35:34.553 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.572+0000 7f73d3fff640 1 -- 172.21.15.115:0/3059120349 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "09157d4a-9443-4e10-bbb3-cf8ed7c42cb9", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f73dc018870 con 0x7f73ec1596c0 2024-05-21T13:35:34.553 INFO:teuthology.orchestra.run.smithi115.stdout:0 2024-05-21T13:35:34.554 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.576+0000 7f73f1da5640 1 -- 172.21.15.115:0/3059120349 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f73ec1596c0 msgr2=0x7f73ec1f1290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:34.554 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.576+0000 7f73f1da5640 1 --2- 172.21.15.115:0/3059120349 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f73ec1596c0 0x7f73ec1f1290 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f73dc009930 tx=0x7f73dc01bab0 comp rx=0 tx=0).stop 2024-05-21T13:35:34.554 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.576+0000 7f73f1da5640 1 -- 172.21.15.115:0/3059120349 shutdown_connections 2024-05-21T13:35:34.554 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.576+0000 7f73f1da5640 1 --2- 172.21.15.115:0/3059120349 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f73ec1596c0 0x7f73ec1f1290 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:34.555 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.576+0000 7f73f1da5640 1 --2- 172.21.15.115:0/3059120349 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f73ec0c4e70 0x7f73ec1f0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:34.555 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.576+0000 7f73f1da5640 1 --2- 172.21.15.115:0/3059120349 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f73ec071700 0x7f73ec14c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:34.555 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.576+0000 7f73f1da5640 1 -- 172.21.15.115:0/3059120349 >> 172.21.15.115:0/3059120349 conn(0x7f73ec072090 msgr2=0x7f73ec14e220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:35:34.555 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.576+0000 7f73f1da5640 1 -- 172.21.15.115:0/3059120349 shutdown_connections 2024-05-21T13:35:34.555 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.576+0000 7f73f1da5640 1 -- 172.21.15.115:0/3059120349 wait complete. 2024-05-21T13:35:34.570 DEBUG:teuthology.orchestra.run.smithi115:> sudo ceph --cluster ceph osd new 2a6a87c0-01ad-4a98-a538-c0a8e865b05d 1 2024-05-21T13:35:34.578 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-05-21T13:35:34.600+0000 7f780882a180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-21T13:35:34.683 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.704+0000 7f727599f640 1 Processor -- start 2024-05-21T13:35:34.683 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.704+0000 7f727599f640 1 -- start start 2024-05-21T13:35:34.685 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.704+0000 7f727599f640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f72700c8460 0x7f7270070e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:34.685 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.704+0000 7f727599f640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f72700713a0 0x7f7270158a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:34.685 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.704+0000 7f727599f640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7270074930 con 0x7f7270152ba0 2024-05-21T13:35:34.685 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.704+0000 7f727599f640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f72700c7470 con 0x7f72700713a0 2024-05-21T13:35:34.686 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.704+0000 7f727599f640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f72700c7750 con 0x7f72700c8460 2024-05-21T13:35:34.686 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.704+0000 7f7267fff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f72700c8460 0x7f7270070e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:34.686 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.704+0000 7f7267fff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f72700c8460 0x7f7270070e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:52694/0 (socket says 172.21.15.115:52694) 2024-05-21T13:35:34.686 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.704+0000 7f7267fff640 1 -- 172.21.15.115:0/2607304680 learned_addr learned my addr 172.21.15.115:0/2607304680 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-21T13:35:34.686 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.704+0000 7f726f7fe640 1 --2- 172.21.15.115:0/2607304680 >> v2:172.21.15.22:3300/0 conn(0x7f72700713a0 0x7f7270158a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:34.686 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.704+0000 7f7267fff640 1 -- 172.21.15.115:0/2607304680 >> v2:172.21.15.22:3300/0 conn(0x7f72700713a0 msgr2=0x7f7270158a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:35:34.686 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.704+0000 7f7267fff640 1 --2- 172.21.15.115:0/2607304680 >> v2:172.21.15.22:3300/0 conn(0x7f72700713a0 0x7f7270158a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:34.687 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.704+0000 7f7267fff640 1 -- 172.21.15.115:0/2607304680 >> v1:172.21.15.22:6789/0 conn(0x7f7270152ba0 legacy=0x7f72700c5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:35:34.687 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.704+0000 7f7267fff640 1 -- 172.21.15.115:0/2607304680 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72700c7a30 con 0x7f72700c8460 2024-05-21T13:35:34.687 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.708+0000 7f7267fff640 1 --2- 172.21.15.115:0/2607304680 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f72700c8460 0x7f7270070e60 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7258009870 tx=0x7f725801c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=158fbe3249e129de server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:35:34.687 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.708+0000 7f726e7fc640 1 -- 172.21.15.115:0/2607304680 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72580b0070 con 0x7f72700c8460 2024-05-21T13:35:34.687 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.708+0000 7f726e7fc640 1 -- 172.21.15.115:0/2607304680 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72580ab600 con 0x7f72700c8460 2024-05-21T13:35:34.687 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.708+0000 7f726e7fc640 1 -- 172.21.15.115:0/2607304680 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72580ab9d0 con 0x7f72700c8460 2024-05-21T13:35:34.688 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.708+0000 7f727599f640 1 -- 172.21.15.115:0/2607304680 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f72700c8460 msgr2=0x7f7270070e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:34.688 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.708+0000 7f727599f640 1 --2- 172.21.15.115:0/2607304680 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f72700c8460 0x7f7270070e60 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f7258009870 tx=0x7f725801c4a0 comp rx=0 tx=0).stop 2024-05-21T13:35:34.689 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.708+0000 7f727599f640 1 -- 172.21.15.115:0/2607304680 shutdown_connections 2024-05-21T13:35:34.689 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.708+0000 7f727599f640 1 --2- 172.21.15.115:0/2607304680 >> v2:172.21.15.22:3300/0 conn(0x7f72700713a0 0x7f7270158a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:34.689 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.708+0000 7f727599f640 1 --2- 172.21.15.115:0/2607304680 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f72700c8460 0x7f7270070e60 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:34.689 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.708+0000 7f727599f640 1 -- 172.21.15.115:0/2607304680 >> 172.21.15.115:0/2607304680 conn(0x7f72700ce640 msgr2=0x7f72700cea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:35:34.689 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.708+0000 7f727599f640 1 -- 172.21.15.115:0/2607304680 shutdown_connections 2024-05-21T13:35:34.689 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.708+0000 7f727599f640 1 -- 172.21.15.115:0/2607304680 wait complete. 2024-05-21T13:35:34.690 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.712+0000 7f727599f640 1 Processor -- start 2024-05-21T13:35:34.690 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.712+0000 7f727599f640 1 -- start start 2024-05-21T13:35:34.692 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.712+0000 7f727599f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72700713a0 0x7f727014d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:34.692 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.712+0000 7f727599f640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f72700c8460 0x7f7270157280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:34.692 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.712+0000 7f727599f640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7270152ba0 0x7f72701577c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:34.692 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.712+0000 7f727599f640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7270074670 con 0x7f72700713a0 2024-05-21T13:35:34.692 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.712+0000 7f727599f640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f72700744f0 con 0x7f7270152ba0 2024-05-21T13:35:34.693 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.712+0000 7f727599f640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f72701658f0 con 0x7f72700c8460 2024-05-21T13:35:34.693 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.712+0000 7f7267fff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f72700c8460 0x7f7270157280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:34.693 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.712+0000 7f7267fff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f72700c8460 0x7f7270157280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:52708/0 (socket says 172.21.15.115:52708) 2024-05-21T13:35:34.693 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.712+0000 7f7267fff640 1 -- 172.21.15.115:0/2562553584 learned_addr learned my addr 172.21.15.115:0/2562553584 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-21T13:35:34.693 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.712+0000 7f726f7fe640 1 --2- 172.21.15.115:0/2562553584 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7270152ba0 0x7f72701577c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:34.693 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.712+0000 7f726effd640 1 --2- 172.21.15.115:0/2562553584 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72700713a0 0x7f727014d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:34.693 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.712+0000 7f7267fff640 1 -- 172.21.15.115:0/2562553584 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7270152ba0 msgr2=0x7f72701577c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:34.693 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.712+0000 7f7267fff640 1 --2- 172.21.15.115:0/2562553584 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7270152ba0 0x7f72701577c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:34.693 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.712+0000 7f7267fff640 1 -- 172.21.15.115:0/2562553584 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72700713a0 msgr2=0x7f727014d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:34.693 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.712+0000 7f7267fff640 1 --2- 172.21.15.115:0/2562553584 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72700713a0 0x7f727014d520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:34.693 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.712+0000 7f7267fff640 1 -- 172.21.15.115:0/2562553584 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72701f4f50 con 0x7f72700c8460 2024-05-21T13:35:34.693 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.712+0000 7f726f7fe640 1 --2- 172.21.15.115:0/2562553584 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7270152ba0 0x7f72701577c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-21T13:35:34.694 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.712+0000 7f7267fff640 1 --2- 172.21.15.115:0/2562553584 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f72700c8460 0x7f7270157280 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f725801cd40 tx=0x7f7258019240 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:35:34.694 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.712+0000 7f726cff9640 1 -- 172.21.15.115:0/2562553584 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72580b0040 con 0x7f72700c8460 2024-05-21T13:35:34.694 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.712+0000 7f726cff9640 1 -- 172.21.15.115:0/2562553584 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72580b9070 con 0x7f72700c8460 2024-05-21T13:35:34.694 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.712+0000 7f726cff9640 1 -- 172.21.15.115:0/2562553584 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72580b4880 con 0x7f72700c8460 2024-05-21T13:35:34.694 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.712+0000 7f727599f640 1 -- 172.21.15.115:0/2562553584 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72701564c0 con 0x7f72700c8460 2024-05-21T13:35:34.694 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.712+0000 7f727599f640 1 -- 172.21.15.115:0/2562553584 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7270156a80 con 0x7f72700c8460 2024-05-21T13:35:34.694 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.712+0000 7f727599f640 1 -- 172.21.15.115:0/2562553584 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72700697d0 con 0x7f72700c8460 2024-05-21T13:35:34.694 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.712+0000 7f726cff9640 1 -- 172.21.15.115:0/2562553584 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f72580ab4c0 con 0x7f72700c8460 2024-05-21T13:35:34.694 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.712+0000 7f726cff9640 1 -- 172.21.15.115:0/2562553584 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f72580bec20 con 0x7f72700c8460 2024-05-21T13:35:34.694 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.716+0000 7f726cff9640 1 -- 172.21.15.115:0/2562553584 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f7258016150 con 0x7f72700c8460 2024-05-21T13:35:34.724 INFO:tasks.ceph.mgr.x.smithi115.stderr:2024-05-21T13:35:34.744+0000 7fce83649180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-21T13:35:34.762 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.784+0000 7f727599f640 1 -- 172.21.15.115:0/2562553584 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "osd new", "uuid": "2a6a87c0-01ad-4a98-a538-c0a8e865b05d", "id": 1} v 0) -- 0x7f7270149c60 con 0x7f72700c8460 2024-05-21T13:35:34.767 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.788+0000 7f726cff9640 1 -- 172.21.15.115:0/2562553584 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2a6a87c0-01ad-4a98-a538-c0a8e865b05d", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f72580b4a20 con 0x7f72700c8460 2024-05-21T13:35:34.767 INFO:teuthology.orchestra.run.smithi115.stdout:1 2024-05-21T13:35:34.768 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.788+0000 7f727599f640 1 -- 172.21.15.115:0/2562553584 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f72700c8460 msgr2=0x7f7270157280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:34.769 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.788+0000 7f727599f640 1 --2- 172.21.15.115:0/2562553584 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f72700c8460 0x7f7270157280 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f725801cd40 tx=0x7f7258019240 comp rx=0 tx=0).stop 2024-05-21T13:35:34.769 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.788+0000 7f727599f640 1 -- 172.21.15.115:0/2562553584 shutdown_connections 2024-05-21T13:35:34.769 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.788+0000 7f727599f640 1 --2- 172.21.15.115:0/2562553584 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7270152ba0 0x7f72701577c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:34.769 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.788+0000 7f727599f640 1 --2- 172.21.15.115:0/2562553584 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f72700c8460 0x7f7270157280 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:34.769 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.788+0000 7f727599f640 1 --2- 172.21.15.115:0/2562553584 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f72700713a0 0x7f727014d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:34.769 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.788+0000 7f727599f640 1 -- 172.21.15.115:0/2562553584 >> 172.21.15.115:0/2562553584 conn(0x7f72700ce640 msgr2=0x7f72700c9a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:35:34.769 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.788+0000 7f727599f640 1 -- 172.21.15.115:0/2562553584 shutdown_connections 2024-05-21T13:35:34.769 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.788+0000 7f727599f640 1 -- 172.21.15.115:0/2562553584 wait complete. 2024-05-21T13:35:34.775 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-05-21T13:35:34.796+0000 7f780882a180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-21T13:35:34.784 DEBUG:teuthology.orchestra.run.smithi115:> sudo ceph --cluster ceph osd new 4c18f931-40a4-46ac-a752-0d1be35b01a5 2 2024-05-21T13:35:34.896 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.916+0000 7f850feaa640 1 Processor -- start 2024-05-21T13:35:34.896 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.916+0000 7f850feaa640 1 -- start start 2024-05-21T13:35:34.897 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.916+0000 7f850feaa640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8508152ba0 0x7f85080c5970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:34.897 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.916+0000 7f850feaa640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f85080c8460 0x7f8508070e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:34.898 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.916+0000 7f850feaa640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8508074930 con 0x7f85080713a0 2024-05-21T13:35:34.898 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.916+0000 7f850feaa640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f85080c7470 con 0x7f85080c8460 2024-05-21T13:35:34.898 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.916+0000 7f850feaa640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f85080c7750 con 0x7f8508152ba0 2024-05-21T13:35:34.898 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.920+0000 7f850dc46640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8508152ba0 0x7f85080c5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:34.898 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.920+0000 7f850dc46640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8508152ba0 0x7f85080c5970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52426/0 (socket says 172.21.15.115:52426) 2024-05-21T13:35:34.898 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.920+0000 7f850dc46640 1 -- 172.21.15.115:0/3482985475 learned_addr learned my addr 172.21.15.115:0/3482985475 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-21T13:35:34.898 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.920+0000 7f850d445640 1 --2- 172.21.15.115:0/3482985475 >> v2:172.21.15.22:3300/0 conn(0x7f85080c8460 0x7f8508070e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:34.898 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.920+0000 7f850dc46640 1 -- 172.21.15.115:0/3482985475 >> v2:172.21.15.22:3300/0 conn(0x7f85080c8460 msgr2=0x7f8508070e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:35:34.898 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.920+0000 7f850dc46640 1 --2- 172.21.15.115:0/3482985475 >> v2:172.21.15.22:3300/0 conn(0x7f85080c8460 0x7f8508070e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:34.898 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.920+0000 7f850dc46640 1 -- 172.21.15.115:0/3482985475 >> v1:172.21.15.22:6789/0 conn(0x7f85080713a0 legacy=0x7f8508158a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:35:34.898 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.920+0000 7f850dc46640 1 -- 172.21.15.115:0/3482985475 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85080c7a30 con 0x7f8508152ba0 2024-05-21T13:35:34.899 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.920+0000 7f850dc46640 1 --2- 172.21.15.115:0/3482985475 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8508152ba0 0x7f85080c5970 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f850806e590 tx=0x7f84f801ebc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df579ca8e481396f server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:35:34.899 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.920+0000 7f850cc44640 1 -- 172.21.15.115:0/3482985475 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84f80b4070 con 0x7f8508152ba0 2024-05-21T13:35:34.899 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.920+0000 7f850cc44640 1 -- 172.21.15.115:0/3482985475 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84f80a7b70 con 0x7f8508152ba0 2024-05-21T13:35:34.899 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.920+0000 7f850cc44640 1 -- 172.21.15.115:0/3482985475 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84f80af440 con 0x7f8508152ba0 2024-05-21T13:35:34.900 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.920+0000 7f850feaa640 1 -- 172.21.15.115:0/3482985475 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8508152ba0 msgr2=0x7f85080c5970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:34.900 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.920+0000 7f850feaa640 1 --2- 172.21.15.115:0/3482985475 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8508152ba0 0x7f85080c5970 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f850806e590 tx=0x7f84f801ebc0 comp rx=0 tx=0).stop 2024-05-21T13:35:34.901 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.920+0000 7f850feaa640 1 -- 172.21.15.115:0/3482985475 shutdown_connections 2024-05-21T13:35:34.901 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.920+0000 7f850feaa640 1 --2- 172.21.15.115:0/3482985475 >> v2:172.21.15.22:3300/0 conn(0x7f85080c8460 0x7f8508070e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:34.901 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.920+0000 7f850feaa640 1 --2- 172.21.15.115:0/3482985475 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8508152ba0 0x7f85080c5970 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:34.901 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.920+0000 7f850feaa640 1 -- 172.21.15.115:0/3482985475 >> 172.21.15.115:0/3482985475 conn(0x7f85080ce640 msgr2=0x7f85080cea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:35:34.901 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.920+0000 7f850feaa640 1 -- 172.21.15.115:0/3482985475 shutdown_connections 2024-05-21T13:35:34.901 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.920+0000 7f850feaa640 1 -- 172.21.15.115:0/3482985475 wait complete. 2024-05-21T13:35:34.901 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.924+0000 7f850feaa640 1 Processor -- start 2024-05-21T13:35:34.901 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.924+0000 7f850feaa640 1 -- start start 2024-05-21T13:35:34.903 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.924+0000 7f850feaa640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f85080713a0 0x7f85081f0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:34.903 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.924+0000 7f850feaa640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f85080c8460 0x7f8508147130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:34.905 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.924+0000 7f850feaa640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8508152ba0 0x7f850815c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:34.905 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.924+0000 7f850feaa640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8508074670 con 0x7f85080c8460 2024-05-21T13:35:34.905 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.924+0000 7f850feaa640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f85080744f0 con 0x7f85080713a0 2024-05-21T13:35:34.905 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.924+0000 7f850feaa640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f850806cd00 con 0x7f8508152ba0 2024-05-21T13:35:34.905 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.924+0000 7f850dc46640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f85080713a0 0x7f85081f0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:34.905 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.924+0000 7f850e447640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8508152ba0 0x7f850815c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:34.905 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.924+0000 7f850dc46640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f85080713a0 0x7f85081f0b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52442/0 (socket says 172.21.15.115:52442) 2024-05-21T13:35:34.905 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.924+0000 7f850dc46640 1 -- 172.21.15.115:0/1559797483 learned_addr learned my addr 172.21.15.115:0/1559797483 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-21T13:35:34.906 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.924+0000 7f850d445640 1 --2- 172.21.15.115:0/1559797483 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f85080c8460 0x7f8508147130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:34.906 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.924+0000 7f850e447640 1 -- 172.21.15.115:0/1559797483 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f85080713a0 msgr2=0x7f85081f0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:34.906 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.924+0000 7f850e447640 1 --2- 172.21.15.115:0/1559797483 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f85080713a0 0x7f85081f0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:34.906 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.924+0000 7f850e447640 1 -- 172.21.15.115:0/1559797483 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f85080c8460 msgr2=0x7f8508147130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:34.906 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.924+0000 7f850e447640 1 --2- 172.21.15.115:0/1559797483 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f85080c8460 0x7f8508147130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:34.906 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.924+0000 7f850e447640 1 -- 172.21.15.115:0/1559797483 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8508071b30 con 0x7f8508152ba0 2024-05-21T13:35:34.906 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.924+0000 7f850dc46640 1 --2- 172.21.15.115:0/1559797483 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f85080713a0 0x7f85081f0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-21T13:35:34.906 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.924+0000 7f850e447640 1 --2- 172.21.15.115:0/1559797483 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8508152ba0 0x7f850815c4e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f850000c780 tx=0x7f850000cc40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:35:34.906 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.924+0000 7f84fe7fc640 1 -- 172.21.15.115:0/1559797483 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8500016020 con 0x7f8508152ba0 2024-05-21T13:35:34.906 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.924+0000 7f84fe7fc640 1 -- 172.21.15.115:0/1559797483 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f850000a9f0 con 0x7f8508152ba0 2024-05-21T13:35:34.906 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.924+0000 7f850feaa640 1 -- 172.21.15.115:0/1559797483 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85081f00d0 con 0x7f8508152ba0 2024-05-21T13:35:34.906 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.924+0000 7f84fe7fc640 1 -- 172.21.15.115:0/1559797483 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f850000ae20 con 0x7f8508152ba0 2024-05-21T13:35:34.906 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.924+0000 7f850feaa640 1 -- 172.21.15.115:0/1559797483 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f850815ca20 con 0x7f8508152ba0 2024-05-21T13:35:34.907 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.924+0000 7f84fe7fc640 1 -- 172.21.15.115:0/1559797483 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8500019020 con 0x7f8508152ba0 2024-05-21T13:35:34.907 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.924+0000 7f84fe7fc640 1 -- 172.21.15.115:0/1559797483 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f850001bcd0 con 0x7f8508152ba0 2024-05-21T13:35:34.907 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.924+0000 7f850feaa640 1 -- 172.21.15.115:0/1559797483 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85080697d0 con 0x7f8508152ba0 2024-05-21T13:35:34.907 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.928+0000 7f84fe7fc640 1 -- 172.21.15.115:0/1559797483 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f8500020020 con 0x7f8508152ba0 2024-05-21T13:35:34.973 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:34.996+0000 7f850feaa640 1 -- 172.21.15.115:0/1559797483 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "osd new", "uuid": "4c18f931-40a4-46ac-a752-0d1be35b01a5", "id": 2} v 0) -- 0x7f85080ca460 con 0x7f8508152ba0 2024-05-21T13:35:34.979 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.000+0000 7f84fe7fc640 1 -- 172.21.15.115:0/1559797483 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4c18f931-40a4-46ac-a752-0d1be35b01a5", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f85081f00d0 con 0x7f8508152ba0 2024-05-21T13:35:34.979 INFO:teuthology.orchestra.run.smithi115.stdout:2 2024-05-21T13:35:34.981 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.000+0000 7f850feaa640 1 -- 172.21.15.115:0/1559797483 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8508152ba0 msgr2=0x7f850815c4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:34.981 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.000+0000 7f850feaa640 1 --2- 172.21.15.115:0/1559797483 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8508152ba0 0x7f850815c4e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f850000c780 tx=0x7f850000cc40 comp rx=0 tx=0).stop 2024-05-21T13:35:34.981 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.000+0000 7f850feaa640 1 -- 172.21.15.115:0/1559797483 shutdown_connections 2024-05-21T13:35:34.981 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.000+0000 7f850feaa640 1 --2- 172.21.15.115:0/1559797483 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8508152ba0 0x7f850815c4e0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:34.981 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.000+0000 7f850feaa640 1 --2- 172.21.15.115:0/1559797483 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f85080c8460 0x7f8508147130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:34.981 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.000+0000 7f850feaa640 1 --2- 172.21.15.115:0/1559797483 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f85080713a0 0x7f85081f0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:34.981 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.000+0000 7f850feaa640 1 -- 172.21.15.115:0/1559797483 >> 172.21.15.115:0/1559797483 conn(0x7f85080ce640 msgr2=0x7f8508150280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:35:34.981 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.000+0000 7f850feaa640 1 -- 172.21.15.115:0/1559797483 shutdown_connections 2024-05-21T13:35:34.981 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.004+0000 7f850feaa640 1 -- 172.21.15.115:0/1559797483 wait complete. 2024-05-21T13:35:34.996 DEBUG:teuthology.orchestra.run.smithi115:> sudo ceph --cluster ceph osd new d57ee7fd-b73e-41ec-8e3b-e62fb8898128 3 2024-05-21T13:35:35.112 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.132+0000 7f8b5eaa0640 1 Processor -- start 2024-05-21T13:35:35.112 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.132+0000 7f8b5eaa0640 1 -- start start 2024-05-21T13:35:35.113 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.132+0000 7f8b5eaa0640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b581538f0 0x7f8b58074700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:35.113 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.136+0000 7f8b5eaa0640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b5815d510 con 0x7f8b58071b60 2024-05-21T13:35:35.114 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.136+0000 7f8b5eaa0640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b58073980 con 0x7f8b58153cd0 2024-05-21T13:35:35.114 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.136+0000 7f8b5eaa0640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f8b580c94b0 con 0x7f8b581538f0 2024-05-21T13:35:35.114 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.136+0000 7f8b5c83c640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b581538f0 0x7f8b58074700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:35.114 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.136+0000 7f8b5c83c640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b581538f0 0x7f8b58074700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:52726/0 (socket says 172.21.15.115:52726) 2024-05-21T13:35:35.114 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.136+0000 7f8b5c83c640 1 -- 172.21.15.115:0/2079205838 learned_addr learned my addr 172.21.15.115:0/2079205838 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-21T13:35:35.114 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.136+0000 7f8b5c83c640 1 -- 172.21.15.115:0/2079205838 >> v1:172.21.15.115:6789/0 conn(0x7f8b58153cd0 legacy=0x7f8b5815ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:35.114 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.136+0000 7f8b5c83c640 1 -- 172.21.15.115:0/2079205838 >> v1:172.21.15.22:6789/0 conn(0x7f8b58071b60 legacy=0x7f8b580c7b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:35.115 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.136+0000 7f8b577fe640 1 -- 172.21.15.115:0/2079205838 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3738352937 0 0) 0x7f8b58073980 con 0x7f8b58153cd0 2024-05-21T13:35:35.115 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.136+0000 7f8b5c83c640 1 -- 172.21.15.115:0/2079205838 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b580c8f10 con 0x7f8b581538f0 2024-05-21T13:35:35.115 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.136+0000 7f8b5c83c640 1 --2- 172.21.15.115:0/2079205838 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b581538f0 0x7f8b58074700 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8b50009e80 tx=0x7f8b5001f230 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e8bd97354b319530 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:35:35.115 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.136+0000 7f8b577fe640 1 -- 172.21.15.115:0/2079205838 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b500b4070 con 0x7f8b581538f0 2024-05-21T13:35:35.116 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.136+0000 7f8b577fe640 1 -- 172.21.15.115:0/2079205838 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b500af400 con 0x7f8b581538f0 2024-05-21T13:35:35.116 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.136+0000 7f8b577fe640 1 -- 172.21.15.115:0/2079205838 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b500af7d0 con 0x7f8b581538f0 2024-05-21T13:35:35.116 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.136+0000 7f8b5eaa0640 1 -- 172.21.15.115:0/2079205838 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b581538f0 msgr2=0x7f8b58074700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:35.116 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.136+0000 7f8b5eaa0640 1 --2- 172.21.15.115:0/2079205838 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b581538f0 0x7f8b58074700 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f8b50009e80 tx=0x7f8b5001f230 comp rx=0 tx=0).stop 2024-05-21T13:35:35.117 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.136+0000 7f8b5eaa0640 1 -- 172.21.15.115:0/2079205838 shutdown_connections 2024-05-21T13:35:35.117 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.136+0000 7f8b5eaa0640 1 --2- 172.21.15.115:0/2079205838 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b581538f0 0x7f8b58074700 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:35.117 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.136+0000 7f8b5eaa0640 1 -- 172.21.15.115:0/2079205838 >> 172.21.15.115:0/2079205838 conn(0x7f8b580ce640 msgr2=0x7f8b580cea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:35:35.117 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.136+0000 7f8b5eaa0640 1 -- 172.21.15.115:0/2079205838 shutdown_connections 2024-05-21T13:35:35.117 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.136+0000 7f8b5eaa0640 1 -- 172.21.15.115:0/2079205838 wait complete. 2024-05-21T13:35:35.117 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.140+0000 7f8b5eaa0640 1 Processor -- start 2024-05-21T13:35:35.117 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.140+0000 7f8b5eaa0640 1 -- start start 2024-05-21T13:35:35.120 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.140+0000 7f8b5eaa0640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b58071b60 0x7f8b581efce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:35.120 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.140+0000 7f8b5eaa0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b581538f0 0x7f8b580cd520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:35.120 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.140+0000 7f8b5eaa0640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b58153cd0 0x7f8b5815c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:35.120 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.140+0000 7f8b5eaa0640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8b5806ef40 con 0x7f8b581538f0 2024-05-21T13:35:35.120 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.140+0000 7f8b5eaa0640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f8b5806ec60 con 0x7f8b58071b60 2024-05-21T13:35:35.121 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.140+0000 7f8b5eaa0640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f8b5806f900 con 0x7f8b58153cd0 2024-05-21T13:35:35.121 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.140+0000 7f8b5d03d640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b58153cd0 0x7f8b5815c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:35.121 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.140+0000 7f8b5d03d640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b58153cd0 0x7f8b5815c5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:52730/0 (socket says 172.21.15.115:52730) 2024-05-21T13:35:35.121 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.140+0000 7f8b5d03d640 1 -- 172.21.15.115:0/4004988499 learned_addr learned my addr 172.21.15.115:0/4004988499 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-21T13:35:35.121 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.140+0000 7f8b5c83c640 1 --2- 172.21.15.115:0/4004988499 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b58071b60 0x7f8b581efce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:35.121 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.140+0000 7f8b57fff640 1 --2- 172.21.15.115:0/4004988499 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b581538f0 0x7f8b580cd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:35.122 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.140+0000 7f8b5d03d640 1 -- 172.21.15.115:0/4004988499 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b58071b60 msgr2=0x7f8b581efce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:35.122 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.140+0000 7f8b5d03d640 1 --2- 172.21.15.115:0/4004988499 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b58071b60 0x7f8b581efce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:35.122 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.140+0000 7f8b5d03d640 1 -- 172.21.15.115:0/4004988499 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b581538f0 msgr2=0x7f8b580cd520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:35.122 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.140+0000 7f8b5d03d640 1 --2- 172.21.15.115:0/4004988499 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b581538f0 0x7f8b580cd520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:35.122 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.140+0000 7f8b5d03d640 1 -- 172.21.15.115:0/4004988499 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b581f36f0 con 0x7f8b58153cd0 2024-05-21T13:35:35.122 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.140+0000 7f8b5c83c640 1 --2- 172.21.15.115:0/4004988499 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b58071b60 0x7f8b581efce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-21T13:35:35.123 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.140+0000 7f8b5d03d640 1 --2- 172.21.15.115:0/4004988499 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b58153cd0 0x7f8b5815c5f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8b4800c430 tx=0x7f8b4800c8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:35:35.123 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.140+0000 7f8b557fa640 1 -- 172.21.15.115:0/4004988499 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b48017070 con 0x7f8b58153cd0 2024-05-21T13:35:35.123 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.140+0000 7f8b557fa640 1 -- 172.21.15.115:0/4004988499 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b480052d0 con 0x7f8b58153cd0 2024-05-21T13:35:35.123 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.140+0000 7f8b5eaa0640 1 -- 172.21.15.115:0/4004988499 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b581f2970 con 0x7f8b58153cd0 2024-05-21T13:35:35.123 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.140+0000 7f8b557fa640 1 -- 172.21.15.115:0/4004988499 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b48003820 con 0x7f8b58153cd0 2024-05-21T13:35:35.123 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.140+0000 7f8b5eaa0640 1 -- 172.21.15.115:0/4004988499 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b581f2c10 con 0x7f8b58153cd0 2024-05-21T13:35:35.123 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.140+0000 7f8b557fa640 1 -- 172.21.15.115:0/4004988499 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f8b4801a070 con 0x7f8b58153cd0 2024-05-21T13:35:35.123 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.140+0000 7f8b557fa640 1 -- 172.21.15.115:0/4004988499 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f8b48012420 con 0x7f8b58153cd0 2024-05-21T13:35:35.123 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.140+0000 7f8b5eaa0640 1 -- 172.21.15.115:0/4004988499 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b580697d0 con 0x7f8b58153cd0 2024-05-21T13:35:35.123 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.144+0000 7f8b557fa640 1 -- 172.21.15.115:0/4004988499 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f8b48021070 con 0x7f8b58153cd0 2024-05-21T13:35:35.185 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.208+0000 7f8b5eaa0640 1 -- 172.21.15.115:0/4004988499 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d57ee7fd-b73e-41ec-8e3b-e62fb8898128", "id": 3} v 0) -- 0x7f8b581e40d0 con 0x7f8b58153cd0 2024-05-21T13:35:35.190 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.212+0000 7f8b557fa640 1 -- 172.21.15.115:0/4004988499 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d57ee7fd-b73e-41ec-8e3b-e62fb8898128", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f8b48011710 con 0x7f8b58153cd0 2024-05-21T13:35:35.191 INFO:teuthology.orchestra.run.smithi115.stdout:3 2024-05-21T13:35:35.192 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.212+0000 7f8b5eaa0640 1 -- 172.21.15.115:0/4004988499 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b58153cd0 msgr2=0x7f8b5815c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:35.192 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.212+0000 7f8b5eaa0640 1 --2- 172.21.15.115:0/4004988499 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b58153cd0 0x7f8b5815c5f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f8b4800c430 tx=0x7f8b4800c8f0 comp rx=0 tx=0).stop 2024-05-21T13:35:35.192 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.212+0000 7f8b5eaa0640 1 -- 172.21.15.115:0/4004988499 shutdown_connections 2024-05-21T13:35:35.192 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.212+0000 7f8b5eaa0640 1 --2- 172.21.15.115:0/4004988499 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b58153cd0 0x7f8b5815c5f0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:35.192 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.212+0000 7f8b5eaa0640 1 --2- 172.21.15.115:0/4004988499 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b581538f0 0x7f8b580cd520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:35.192 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.212+0000 7f8b5eaa0640 1 --2- 172.21.15.115:0/4004988499 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b58071b60 0x7f8b581efce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:35.192 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.212+0000 7f8b5eaa0640 1 -- 172.21.15.115:0/4004988499 >> 172.21.15.115:0/4004988499 conn(0x7f8b580ce640 msgr2=0x7f8b58073b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:35:35.192 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.212+0000 7f8b5eaa0640 1 -- 172.21.15.115:0/4004988499 shutdown_connections 2024-05-21T13:35:35.192 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.212+0000 7f8b5eaa0640 1 -- 172.21.15.115:0/4004988499 wait complete. 2024-05-21T13:35:35.207 DEBUG:teuthology.orchestra.run.smithi115:> sudo ceph --cluster ceph osd new 43c6494f-352b-42a7-b6a9-fe7e3573fab9 4 2024-05-21T13:35:35.307 INFO:tasks.ceph.mgr.x.smithi115.stderr:2024-05-21T13:35:35.328+0000 7fce83649180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-21T13:35:35.315 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.336+0000 7fb284995640 1 Processor -- start 2024-05-21T13:35:35.315 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.336+0000 7fb284995640 1 -- start start 2024-05-21T13:35:35.320 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.336+0000 7fb284995640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb280153b00 0x7fb2800c9f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:35.320 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.336+0000 7fb284995640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb280071700 0x7fb280070a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:35.320 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.336+0000 7fb284995640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb280070f40 0x7fb2800c4e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:35.321 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.336+0000 7fb284995640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fb2800cad80 con 0x7fb280071700 2024-05-21T13:35:35.321 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.336+0000 7fb284995640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7fb280071b30 con 0x7fb280153b00 2024-05-21T13:35:35.321 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.336+0000 7fb284995640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7fb28015a6f0 con 0x7fb280070f40 2024-05-21T13:35:35.321 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.336+0000 7fb27e59c640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb280153b00 0x7fb2800c9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:35.321 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.336+0000 7fb27ed9d640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb280070f40 0x7fb2800c4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:35.321 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.336+0000 7fb27e59c640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb280153b00 0x7fb2800c9f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52468/0 (socket says 172.21.15.115:52468) 2024-05-21T13:35:35.322 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.336+0000 7fb27e59c640 1 -- 172.21.15.115:0/3954473570 learned_addr learned my addr 172.21.15.115:0/3954473570 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-21T13:35:35.322 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.336+0000 7fb277fff640 1 --2- 172.21.15.115:0/3954473570 >> v2:172.21.15.22:3300/0 conn(0x7fb280071700 0x7fb280070a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:35.322 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.336+0000 7fb27e59c640 1 -- 172.21.15.115:0/3954473570 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb280070f40 msgr2=0x7fb2800c4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:35:35.322 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.336+0000 7fb27e59c640 1 --2- 172.21.15.115:0/3954473570 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb280070f40 0x7fb2800c4e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:35.323 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.336+0000 7fb27e59c640 1 -- 172.21.15.115:0/3954473570 >> v2:172.21.15.22:3300/0 conn(0x7fb280071700 msgr2=0x7fb280070a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:35:35.323 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.336+0000 7fb27e59c640 1 --2- 172.21.15.115:0/3954473570 >> v2:172.21.15.22:3300/0 conn(0x7fb280071700 0x7fb280070a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:35.323 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.336+0000 7fb27e59c640 1 -- 172.21.15.115:0/3954473570 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2800cb040 con 0x7fb280153b00 2024-05-21T13:35:35.323 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.336+0000 7fb27ed9d640 1 --2- 172.21.15.115:0/3954473570 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb280070f40 0x7fb2800c4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-21T13:35:35.323 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.336+0000 7fb277fff640 1 --2- 172.21.15.115:0/3954473570 >> v2:172.21.15.22:3300/0 conn(0x7fb280071700 0x7fb280070a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:35:35.323 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.340+0000 7fb27e59c640 1 --2- 172.21.15.115:0/3954473570 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb280153b00 0x7fb2800c9f40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb280071690 tx=0x7fb26801ed10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f9a255b03ae079d server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:35:35.324 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.340+0000 7fb27dd9b640 1 -- 172.21.15.115:0/3954473570 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2680b5070 con 0x7fb280153b00 2024-05-21T13:35:35.324 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.340+0000 7fb27dd9b640 1 -- 172.21.15.115:0/3954473570 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2680a89d0 con 0x7fb280153b00 2024-05-21T13:35:35.324 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.340+0000 7fb27dd9b640 1 -- 172.21.15.115:0/3954473570 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2680a8da0 con 0x7fb280153b00 2024-05-21T13:35:35.324 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.340+0000 7fb284995640 1 -- 172.21.15.115:0/3954473570 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb280153b00 msgr2=0x7fb2800c9f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:35.324 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.340+0000 7fb284995640 1 --2- 172.21.15.115:0/3954473570 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb280153b00 0x7fb2800c9f40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb280071690 tx=0x7fb26801ed10 comp rx=0 tx=0).stop 2024-05-21T13:35:35.325 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.340+0000 7fb284995640 1 -- 172.21.15.115:0/3954473570 shutdown_connections 2024-05-21T13:35:35.325 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.340+0000 7fb284995640 1 --2- 172.21.15.115:0/3954473570 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb280070f40 0x7fb2800c4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:35.325 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.340+0000 7fb284995640 1 --2- 172.21.15.115:0/3954473570 >> v2:172.21.15.22:3300/0 conn(0x7fb280071700 0x7fb280070a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:35.325 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.340+0000 7fb284995640 1 --2- 172.21.15.115:0/3954473570 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb280153b00 0x7fb2800c9f40 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:35.325 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.340+0000 7fb284995640 1 -- 172.21.15.115:0/3954473570 >> 172.21.15.115:0/3954473570 conn(0x7fb280072090 msgr2=0x7fb2800724a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:35:35.326 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.340+0000 7fb284995640 1 -- 172.21.15.115:0/3954473570 shutdown_connections 2024-05-21T13:35:35.326 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.340+0000 7fb284995640 1 -- 172.21.15.115:0/3954473570 wait complete. 2024-05-21T13:35:35.326 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.340+0000 7fb284995640 1 Processor -- start 2024-05-21T13:35:35.326 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.340+0000 7fb284995640 1 -- start start 2024-05-21T13:35:35.331 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.340+0000 7fb284995640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb280070f40 0x7fb28015bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:35.331 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.340+0000 7fb284995640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb280071700 0x7fb28015c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:35.331 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.340+0000 7fb284995640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb28015cd60 0x7fb2801f48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:35.332 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.340+0000 7fb284995640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb28015a2a0 con 0x7fb28015cd60 2024-05-21T13:35:35.332 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.340+0000 7fb284995640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fb2800704e0 con 0x7fb280071700 2024-05-21T13:35:35.332 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.340+0000 7fb284995640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7fb28015a420 con 0x7fb280070f40 2024-05-21T13:35:35.332 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.340+0000 7fb27e59c640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb280070f40 0x7fb28015bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:35.332 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.340+0000 7fb27e59c640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb280070f40 0x7fb28015bc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:52744/0 (socket says 172.21.15.115:52744) 2024-05-21T13:35:35.332 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.340+0000 7fb277fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb280071700 0x7fb28015c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:35.333 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.340+0000 7fb27e59c640 1 -- 172.21.15.115:0/3612832063 learned_addr learned my addr 172.21.15.115:0/3612832063 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-21T13:35:35.333 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.344+0000 7fb27ed9d640 1 --2- 172.21.15.115:0/3612832063 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb28015cd60 0x7fb2801f48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:35.333 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.344+0000 7fb27e59c640 1 -- 172.21.15.115:0/3612832063 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb280071700 msgr2=0x7fb28015c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:35.334 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.344+0000 7fb27e59c640 1 --2- 172.21.15.115:0/3612832063 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb280071700 0x7fb28015c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:35.334 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.344+0000 7fb27e59c640 1 -- 172.21.15.115:0/3612832063 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb28015cd60 msgr2=0x7fb2801f48a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:35.334 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.344+0000 7fb27e59c640 1 --2- 172.21.15.115:0/3612832063 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb28015cd60 0x7fb2801f48a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:35.334 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.344+0000 7fb27e59c640 1 -- 172.21.15.115:0/3612832063 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2800c9610 con 0x7fb280070f40 2024-05-21T13:35:35.334 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.344+0000 7fb27ed9d640 1 --2- 172.21.15.115:0/3612832063 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb28015cd60 0x7fb2801f48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:35:35.335 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.344+0000 7fb27e59c640 1 --2- 172.21.15.115:0/3612832063 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb280070f40 0x7fb28015bc70 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb2680b3040 tx=0x7fb26801bab0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:35:35.335 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.344+0000 7fb276ffd640 1 -- 172.21.15.115:0/3612832063 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2680b5070 con 0x7fb280070f40 2024-05-21T13:35:35.335 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.344+0000 7fb276ffd640 1 -- 172.21.15.115:0/3612832063 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2680b0a30 con 0x7fb280070f40 2024-05-21T13:35:35.335 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.344+0000 7fb276ffd640 1 -- 172.21.15.115:0/3612832063 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2680b0e20 con 0x7fb280070f40 2024-05-21T13:35:35.335 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.344+0000 7fb284995640 1 -- 172.21.15.115:0/3612832063 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2800cd530 con 0x7fb280070f40 2024-05-21T13:35:35.336 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.344+0000 7fb284995640 1 -- 172.21.15.115:0/3612832063 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb28015ca50 con 0x7fb280070f40 2024-05-21T13:35:35.336 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.344+0000 7fb276ffd640 1 -- 172.21.15.115:0/3612832063 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fb2680b9030 con 0x7fb280070f40 2024-05-21T13:35:35.336 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.344+0000 7fb276ffd640 1 -- 172.21.15.115:0/3612832063 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7fb2680bbc80 con 0x7fb280070f40 2024-05-21T13:35:35.336 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.344+0000 7fb284995640 1 -- 172.21.15.115:0/3612832063 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2800697d0 con 0x7fb280070f40 2024-05-21T13:35:35.336 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.344+0000 7fb276ffd640 1 -- 172.21.15.115:0/3612832063 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fb268018870 con 0x7fb280070f40 2024-05-21T13:35:35.366 INFO:tasks.ceph.mgr.x.smithi115.stderr:2024-05-21T13:35:35.388+0000 7fce83649180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-21T13:35:35.373 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-05-21T13:35:35.392+0000 7f780882a180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-21T13:35:35.389 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.408+0000 7fb284995640 1 -- 172.21.15.115:0/3612832063 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "osd new", "uuid": "43c6494f-352b-42a7-b6a9-fe7e3573fab9", "id": 4} v 0) -- 0x7fb2800ca4e0 con 0x7fb280070f40 2024-05-21T13:35:35.395 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.416+0000 7fb276ffd640 1 -- 172.21.15.115:0/3612832063 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "43c6494f-352b-42a7-b6a9-fe7e3573fab9", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7fb2680a89a0 con 0x7fb280070f40 2024-05-21T13:35:35.395 INFO:teuthology.orchestra.run.smithi115.stdout:4 2024-05-21T13:35:35.397 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.416+0000 7fb284995640 1 -- 172.21.15.115:0/3612832063 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb280070f40 msgr2=0x7fb28015bc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:35.397 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.416+0000 7fb284995640 1 --2- 172.21.15.115:0/3612832063 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb280070f40 0x7fb28015bc70 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fb2680b3040 tx=0x7fb26801bab0 comp rx=0 tx=0).stop 2024-05-21T13:35:35.397 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.416+0000 7fb284995640 1 -- 172.21.15.115:0/3612832063 shutdown_connections 2024-05-21T13:35:35.397 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.416+0000 7fb284995640 1 --2- 172.21.15.115:0/3612832063 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb28015cd60 0x7fb2801f48a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:35.398 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.416+0000 7fb284995640 1 --2- 172.21.15.115:0/3612832063 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb280071700 0x7fb28015c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:35.398 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.416+0000 7fb284995640 1 --2- 172.21.15.115:0/3612832063 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb280070f40 0x7fb28015bc70 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:35.398 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.416+0000 7fb284995640 1 -- 172.21.15.115:0/3612832063 >> 172.21.15.115:0/3612832063 conn(0x7fb280072090 msgr2=0x7fb2800b1df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:35:35.398 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.416+0000 7fb284995640 1 -- 172.21.15.115:0/3612832063 shutdown_connections 2024-05-21T13:35:35.398 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.416+0000 7fb284995640 1 -- 172.21.15.115:0/3612832063 wait complete. 2024-05-21T13:35:35.412 DEBUG:teuthology.orchestra.run.smithi115:> sudo ceph --cluster ceph osd new 25fc861c-593d-4d49-942a-c75c19f25994 5 2024-05-21T13:35:35.424 INFO:tasks.ceph.mgr.x.smithi115.stderr:2024-05-21T13:35:35.444+0000 7fce83649180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-21T13:35:35.430 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-05-21T13:35:35.452+0000 7f780882a180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-21T13:35:35.485 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-05-21T13:35:35.508+0000 7f780882a180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-21T13:35:35.505 INFO:tasks.ceph.mgr.x.smithi115.stderr:2024-05-21T13:35:35.528+0000 7fce83649180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-21T13:35:35.528 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.548+0000 7f32e882e640 1 Processor -- start 2024-05-21T13:35:35.528 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.548+0000 7f32e882e640 1 -- start start 2024-05-21T13:35:35.529 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.552+0000 7f32e882e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f32e415a540 0x7f32e40711b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:35.529 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.552+0000 7f32e882e640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32e4071930 con 0x7f32e41538f0 2024-05-21T13:35:35.529 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.552+0000 7f32e882e640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32e406e110 con 0x7f32e406e530 2024-05-21T13:35:35.529 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.552+0000 7f32e882e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f32e40716f0 con 0x7f32e415a540 2024-05-21T13:35:35.529 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.552+0000 7f32e1d9b640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f32e406e530 0x7f32e4159e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:43326/0 (socket says 172.21.15.115:43326) 2024-05-21T13:35:35.530 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.552+0000 7f32e2d9d640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f32e415a540 0x7f32e40711b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:35.530 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.552+0000 7f32e1d9b640 1 -- 172.21.15.115:0/1679575113 learned_addr learned my addr 172.21.15.115:0/1679575113 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-21T13:35:35.530 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.552+0000 7f32e159a640 1 -- 172.21.15.115:0/1679575113 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1744181892 0 0) 0x7f32e406e110 con 0x7f32e406e530 2024-05-21T13:35:35.531 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.552+0000 7f32e159a640 1 -- 172.21.15.115:0/1679575113 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f32cc003530 con 0x7f32e406e530 2024-05-21T13:35:35.531 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.552+0000 7f32e2d9d640 1 -- 172.21.15.115:0/1679575113 >> v1:172.21.15.115:6789/0 conn(0x7f32e406e530 legacy=0x7f32e4159e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:35.531 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.552+0000 7f32e2d9d640 1 -- 172.21.15.115:0/1679575113 >> v1:172.21.15.22:6789/0 conn(0x7f32e41538f0 legacy=0x7f32e40c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:35:35.531 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.552+0000 7f32e2d9d640 1 -- 172.21.15.115:0/1679575113 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32e40c8ec0 con 0x7f32e415a540 2024-05-21T13:35:35.532 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.552+0000 7f32e2d9d640 1 --2- 172.21.15.115:0/1679575113 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f32e415a540 0x7f32e40711b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f32dc009dc0 tx=0x7f32dc01f170 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4bbe4c1845f39b3a server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:35:35.532 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.552+0000 7f32e159a640 1 -- 172.21.15.115:0/1679575113 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32dc0b4070 con 0x7f32e415a540 2024-05-21T13:35:35.532 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.552+0000 7f32e159a640 1 -- 172.21.15.115:0/1679575113 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32dc0af600 con 0x7f32e415a540 2024-05-21T13:35:35.532 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.552+0000 7f32e159a640 1 -- 172.21.15.115:0/1679575113 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32dc0af9d0 con 0x7f32e415a540 2024-05-21T13:35:35.533 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.556+0000 7f32e882e640 1 -- 172.21.15.115:0/1679575113 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f32e415a540 msgr2=0x7f32e40711b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:35.533 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.556+0000 7f32e882e640 1 --2- 172.21.15.115:0/1679575113 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f32e415a540 0x7f32e40711b0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f32dc009dc0 tx=0x7f32dc01f170 comp rx=0 tx=0).stop 2024-05-21T13:35:35.533 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.556+0000 7f32e882e640 1 -- 172.21.15.115:0/1679575113 shutdown_connections 2024-05-21T13:35:35.534 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.556+0000 7f32e882e640 1 --2- 172.21.15.115:0/1679575113 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f32e415a540 0x7f32e40711b0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:35.534 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.556+0000 7f32e882e640 1 -- 172.21.15.115:0/1679575113 >> 172.21.15.115:0/1679575113 conn(0x7f32e406f260 msgr2=0x7f32e406f670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:35:35.534 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.556+0000 7f32e882e640 1 -- 172.21.15.115:0/1679575113 shutdown_connections 2024-05-21T13:35:35.534 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.556+0000 7f32e882e640 1 -- 172.21.15.115:0/1679575113 wait complete. 2024-05-21T13:35:35.534 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.556+0000 7f32e882e640 1 Processor -- start 2024-05-21T13:35:35.534 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.556+0000 7f32e882e640 1 -- start start 2024-05-21T13:35:35.537 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.556+0000 7f32e882e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f32e406e530 0x7f32e41f2bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:35.537 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.556+0000 7f32e882e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32e41538f0 0x7f32e41f0020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:35.537 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.556+0000 7f32e882e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32e415a540 0x7f32e41e6780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:35.537 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.556+0000 7f32e882e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f32e40c9740 con 0x7f32e415a540 2024-05-21T13:35:35.537 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.556+0000 7f32e882e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f32e40c9460 con 0x7f32e41538f0 2024-05-21T13:35:35.537 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.556+0000 7f32e882e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f32e4153cd0 con 0x7f32e406e530 2024-05-21T13:35:35.537 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.556+0000 7f32e1d9b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32e41538f0 0x7f32e41f0020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:35.537 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.556+0000 7f32e259c640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f32e406e530 0x7f32e41f2bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:35.537 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.556+0000 7f32e259c640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f32e406e530 0x7f32e41f2bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:52750/0 (socket says 172.21.15.115:52750) 2024-05-21T13:35:35.537 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.556+0000 7f32e1d9b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32e41538f0 0x7f32e41f0020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52480/0 (socket says 172.21.15.115:52480) 2024-05-21T13:35:35.538 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.556+0000 7f32e259c640 1 -- 172.21.15.115:0/3828187085 learned_addr learned my addr 172.21.15.115:0/3828187085 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-21T13:35:35.538 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.556+0000 7f32e2d9d640 1 --2- 172.21.15.115:0/3828187085 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32e415a540 0x7f32e41e6780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:35.538 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.556+0000 7f32e259c640 1 -- 172.21.15.115:0/3828187085 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32e41538f0 msgr2=0x7f32e41f0020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:35.538 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.556+0000 7f32e259c640 1 --2- 172.21.15.115:0/3828187085 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32e41538f0 0x7f32e41f0020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:35.538 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.556+0000 7f32e259c640 1 -- 172.21.15.115:0/3828187085 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32e415a540 msgr2=0x7f32e41e6780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:35.538 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.556+0000 7f32e259c640 1 --2- 172.21.15.115:0/3828187085 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32e415a540 0x7f32e41e6780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:35.538 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.556+0000 7f32e259c640 1 -- 172.21.15.115:0/3828187085 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32e41f3230 con 0x7f32e406e530 2024-05-21T13:35:35.538 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.556+0000 7f32e2d9d640 1 --2- 172.21.15.115:0/3828187085 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32e415a540 0x7f32e41e6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T13:35:35.538 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.556+0000 7f32e259c640 1 --2- 172.21.15.115:0/3828187085 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f32e406e530 0x7f32e41f2bf0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f32d400c480 tx=0x7f32d400c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:35:35.538 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.556+0000 7f32d2ffd640 1 -- 172.21.15.115:0/3828187085 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32d4012830 con 0x7f32e406e530 2024-05-21T13:35:35.538 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.556+0000 7f32d2ffd640 1 -- 172.21.15.115:0/3828187085 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32d4017070 con 0x7f32e406e530 2024-05-21T13:35:35.538 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.556+0000 7f32d2ffd640 1 -- 172.21.15.115:0/3828187085 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32d4012c30 con 0x7f32e406e530 2024-05-21T13:35:35.538 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.556+0000 7f32e882e640 1 -- 172.21.15.115:0/3828187085 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32e41f3510 con 0x7f32e406e530 2024-05-21T13:35:35.538 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.556+0000 7f32e882e640 1 -- 172.21.15.115:0/3828187085 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f32e41ef820 con 0x7f32e406e530 2024-05-21T13:35:35.539 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.556+0000 7f32d2ffd640 1 -- 172.21.15.115:0/3828187085 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f32d401c460 con 0x7f32e406e530 2024-05-21T13:35:35.539 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.556+0000 7f32d2ffd640 1 -- 172.21.15.115:0/3828187085 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f32d401bcb0 con 0x7f32e406e530 2024-05-21T13:35:35.539 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.556+0000 7f32e882e640 1 -- 172.21.15.115:0/3828187085 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32e40697d0 con 0x7f32e406e530 2024-05-21T13:35:35.539 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.560+0000 7f32d2ffd640 1 -- 172.21.15.115:0/3828187085 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f32d4012dd0 con 0x7f32e406e530 2024-05-21T13:35:35.560 INFO:tasks.ceph.mgr.x.smithi115.stderr:2024-05-21T13:35:35.580+0000 7fce83649180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-21T13:35:35.566 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-05-21T13:35:35.588+0000 7f780882a180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-21T13:35:35.602 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.624+0000 7f32e882e640 1 -- 172.21.15.115:0/3828187085 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "osd new", "uuid": "25fc861c-593d-4d49-942a-c75c19f25994", "id": 5} v 0) -- 0x7f32e4071cd0 con 0x7f32e406e530 2024-05-21T13:35:35.608 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.628+0000 7f32d2ffd640 1 -- 172.21.15.115:0/3828187085 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "25fc861c-593d-4d49-942a-c75c19f25994", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f32d401b730 con 0x7f32e406e530 2024-05-21T13:35:35.608 INFO:teuthology.orchestra.run.smithi115.stdout:5 2024-05-21T13:35:35.609 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.632+0000 7f32e882e640 1 -- 172.21.15.115:0/3828187085 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f32e406e530 msgr2=0x7f32e41f2bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:35.609 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.632+0000 7f32e882e640 1 --2- 172.21.15.115:0/3828187085 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f32e406e530 0x7f32e41f2bf0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f32d400c480 tx=0x7f32d400c940 comp rx=0 tx=0).stop 2024-05-21T13:35:35.609 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.632+0000 7f32e882e640 1 -- 172.21.15.115:0/3828187085 shutdown_connections 2024-05-21T13:35:35.609 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.632+0000 7f32e882e640 1 --2- 172.21.15.115:0/3828187085 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f32e415a540 0x7f32e41e6780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:35.610 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.632+0000 7f32e882e640 1 --2- 172.21.15.115:0/3828187085 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f32e41538f0 0x7f32e41f0020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:35.610 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.632+0000 7f32e882e640 1 --2- 172.21.15.115:0/3828187085 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f32e406e530 0x7f32e41f2bf0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:35.610 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.632+0000 7f32e882e640 1 -- 172.21.15.115:0/3828187085 >> 172.21.15.115:0/3828187085 conn(0x7f32e406f260 msgr2=0x7f32e4159350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:35:35.610 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.632+0000 7f32e882e640 1 -- 172.21.15.115:0/3828187085 shutdown_connections 2024-05-21T13:35:35.610 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.632+0000 7f32e882e640 1 -- 172.21.15.115:0/3828187085 wait complete. 2024-05-21T13:35:35.621 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-05-21T13:35:35.644+0000 7f780882a180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-21T13:35:35.624 DEBUG:teuthology.orchestra.run.smithi115:> sudo ceph --cluster ceph osd new 2e7fb0b8-1162-497f-bffc-e2c02b9b9ef4 6 2024-05-21T13:35:35.640 INFO:tasks.ceph.mgr.x.smithi115.stderr:2024-05-21T13:35:35.660+0000 7fce83649180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-21T13:35:35.695 INFO:tasks.ceph.mgr.x.smithi115.stderr:2024-05-21T13:35:35.716+0000 7fce83649180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-21T13:35:35.702 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-05-21T13:35:35.724+0000 7f780882a180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-21T13:35:35.747 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.768+0000 7f3a25171640 1 Processor -- start 2024-05-21T13:35:35.747 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.768+0000 7f3a25171640 1 -- start start 2024-05-21T13:35:35.748 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.768+0000 7f3a25171640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3a200c8460 0x7f3a20070e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:35.748 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.768+0000 7f3a25171640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a20074930 con 0x7f3a200713a0 2024-05-21T13:35:35.748 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.768+0000 7f3a25171640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a200c7470 con 0x7f3a20152ba0 2024-05-21T13:35:35.748 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.768+0000 7f3a25171640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f3a200c7750 con 0x7f3a200c8460 2024-05-21T13:35:35.748 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.768+0000 7f3a17fff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3a200c8460 0x7f3a20070e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:35.749 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.768+0000 7f3a1ed9d640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f3a20152ba0 0x7f3a200c5970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.115:43342/0 (socket says 172.21.15.115:43342) 2024-05-21T13:35:35.749 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.768+0000 7f3a1ed9d640 1 -- 172.21.15.115:0/3942604613 learned_addr learned my addr 172.21.15.115:0/3942604613 (peer_addr_for_me v1:172.21.15.115:0/0) 2024-05-21T13:35:35.749 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.768+0000 7f3a1e59c640 1 -- 172.21.15.115:0/3942604613 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 275168688 0 0) 0x7f3a200c7470 con 0x7f3a20152ba0 2024-05-21T13:35:35.749 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.768+0000 7f3a1e59c640 1 -- 172.21.15.115:0/3942604613 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3a00003530 con 0x7f3a20152ba0 2024-05-21T13:35:35.749 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.768+0000 7f3a17fff640 1 -- 172.21.15.115:0/3942604613 >> v1:172.21.15.115:6789/0 conn(0x7f3a20152ba0 legacy=0x7f3a200c5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:35.749 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.768+0000 7f3a17fff640 1 -- 172.21.15.115:0/3942604613 >> v1:172.21.15.22:6789/0 conn(0x7f3a200713a0 legacy=0x7f3a20158a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:35:35.749 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.768+0000 7f3a17fff640 1 -- 172.21.15.115:0/3942604613 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a200c7a30 con 0x7f3a200c8460 2024-05-21T13:35:35.750 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.772+0000 7f3a17fff640 1 --2- 172.21.15.115:0/3942604613 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3a200c8460 0x7f3a20070e60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f3a100097f0 tx=0x7f3a1001c420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c2095621ddc961b4 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:35:35.751 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.772+0000 7f3a1e59c640 1 -- 172.21.15.115:0/3942604613 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a100ab600 con 0x7f3a200c8460 2024-05-21T13:35:35.751 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.772+0000 7f3a1e59c640 1 -- 172.21.15.115:0/3942604613 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a100b0070 con 0x7f3a200c8460 2024-05-21T13:35:35.751 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.772+0000 7f3a1e59c640 1 -- 172.21.15.115:0/3942604613 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a100ab9a0 con 0x7f3a200c8460 2024-05-21T13:35:35.751 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.772+0000 7f3a25171640 1 -- 172.21.15.115:0/3942604613 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3a200c8460 msgr2=0x7f3a20070e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:35.752 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.772+0000 7f3a25171640 1 --2- 172.21.15.115:0/3942604613 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3a200c8460 0x7f3a20070e60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f3a100097f0 tx=0x7f3a1001c420 comp rx=0 tx=0).stop 2024-05-21T13:35:35.752 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.772+0000 7f3a25171640 1 -- 172.21.15.115:0/3942604613 shutdown_connections 2024-05-21T13:35:35.752 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.772+0000 7f3a25171640 1 --2- 172.21.15.115:0/3942604613 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3a200c8460 0x7f3a20070e60 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:35.752 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.772+0000 7f3a25171640 1 -- 172.21.15.115:0/3942604613 >> 172.21.15.115:0/3942604613 conn(0x7f3a200ce640 msgr2=0x7f3a200cea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:35:35.752 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.772+0000 7f3a25171640 1 -- 172.21.15.115:0/3942604613 shutdown_connections 2024-05-21T13:35:35.752 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.772+0000 7f3a25171640 1 -- 172.21.15.115:0/3942604613 wait complete. 2024-05-21T13:35:35.754 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.772+0000 7f3a25171640 1 Processor -- start 2024-05-21T13:35:35.754 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.772+0000 7f3a25171640 1 -- start start 2024-05-21T13:35:35.754 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.776+0000 7f3a25171640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a200713a0 0x7f3a20073cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:35.755 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.776+0000 7f3a25171640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3a200c8460 0x7f3a201f6910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:35.755 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.776+0000 7f3a25171640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3a20152ba0 0x7f3a20151880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:35.755 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.776+0000 7f3a25171640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f3a20166900 con 0x7f3a200713a0 2024-05-21T13:35:35.755 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.776+0000 7f3a25171640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f3a20166a80 con 0x7f3a20152ba0 2024-05-21T13:35:35.755 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.776+0000 7f3a25171640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f3a20166c00 con 0x7f3a200c8460 2024-05-21T13:35:35.755 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.776+0000 7f3a17fff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3a200c8460 0x7f3a201f6910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:35.755 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.776+0000 7f3a1f59e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3a20152ba0 0x7f3a20151880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:35.755 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.776+0000 7f3a17fff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3a200c8460 0x7f3a201f6910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:52764/0 (socket says 172.21.15.115:52764) 2024-05-21T13:35:35.755 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.776+0000 7f3a17fff640 1 -- 172.21.15.115:0/315924677 learned_addr learned my addr 172.21.15.115:0/315924677 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-21T13:35:35.755 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.776+0000 7f3a1ed9d640 1 --2- 172.21.15.115:0/315924677 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a200713a0 0x7f3a20073cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:35.755 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.776+0000 7f3a1f59e640 1 -- 172.21.15.115:0/315924677 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3a200c8460 msgr2=0x7f3a201f6910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:35.755 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.776+0000 7f3a1f59e640 1 --2- 172.21.15.115:0/315924677 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3a200c8460 0x7f3a201f6910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:35.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.776+0000 7f3a1f59e640 1 -- 172.21.15.115:0/315924677 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a200713a0 msgr2=0x7f3a20073cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:35.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.776+0000 7f3a1f59e640 1 --2- 172.21.15.115:0/315924677 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a200713a0 0x7f3a20073cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:35.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.776+0000 7f3a1f59e640 1 -- 172.21.15.115:0/315924677 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a201f6e50 con 0x7f3a20152ba0 2024-05-21T13:35:35.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.776+0000 7f3a17fff640 1 --2- 172.21.15.115:0/315924677 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3a200c8460 0x7f3a201f6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-21T13:35:35.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.776+0000 7f3a1f59e640 1 --2- 172.21.15.115:0/315924677 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3a20152ba0 0x7f3a20151880 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3a1800be30 tx=0x7f3a1800bf20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:35:35.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.776+0000 7f3a177fe640 1 -- 172.21.15.115:0/315924677 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a18019070 con 0x7f3a20152ba0 2024-05-21T13:35:35.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.776+0000 7f3a177fe640 1 -- 172.21.15.115:0/315924677 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a18014440 con 0x7f3a20152ba0 2024-05-21T13:35:35.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.776+0000 7f3a25171640 1 -- 172.21.15.115:0/315924677 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a201565d0 con 0x7f3a20152ba0 2024-05-21T13:35:35.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.776+0000 7f3a177fe640 1 -- 172.21.15.115:0/315924677 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a18014830 con 0x7f3a20152ba0 2024-05-21T13:35:35.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.776+0000 7f3a25171640 1 -- 172.21.15.115:0/315924677 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a201f6110 con 0x7f3a20152ba0 2024-05-21T13:35:35.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.776+0000 7f3a177fe640 1 -- 172.21.15.115:0/315924677 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3a1801c070 con 0x7f3a20152ba0 2024-05-21T13:35:35.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.776+0000 7f3a177fe640 1 -- 172.21.15.115:0/315924677 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f3a180046b0 con 0x7f3a20152ba0 2024-05-21T13:35:35.756 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.776+0000 7f3a25171640 1 -- 172.21.15.115:0/315924677 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a200697d0 con 0x7f3a20152ba0 2024-05-21T13:35:35.757 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.780+0000 7f3a177fe640 1 -- 172.21.15.115:0/315924677 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f3a18003980 con 0x7f3a20152ba0 2024-05-21T13:35:35.758 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-05-21T13:35:35.780+0000 7f780882a180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-21T13:35:35.826 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.848+0000 7f3a25171640 1 -- 172.21.15.115:0/315924677 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd new", "uuid": "2e7fb0b8-1162-497f-bffc-e2c02b9b9ef4", "id": 6} v 0) -- 0x7f3a200742d0 con 0x7f3a20152ba0 2024-05-21T13:35:35.833 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.852+0000 7f3a177fe640 1 -- 172.21.15.115:0/315924677 <== mon.1 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "2e7fb0b8-1162-497f-bffc-e2c02b9b9ef4", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f3a18003c30 con 0x7f3a20152ba0 2024-05-21T13:35:35.833 INFO:teuthology.orchestra.run.smithi115.stdout:6 2024-05-21T13:35:35.834 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.856+0000 7f3a25171640 1 -- 172.21.15.115:0/315924677 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3a20152ba0 msgr2=0x7f3a20151880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:35.834 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.856+0000 7f3a25171640 1 --2- 172.21.15.115:0/315924677 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3a20152ba0 0x7f3a20151880 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f3a1800be30 tx=0x7f3a1800bf20 comp rx=0 tx=0).stop 2024-05-21T13:35:35.834 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.856+0000 7f3a25171640 1 -- 172.21.15.115:0/315924677 shutdown_connections 2024-05-21T13:35:35.834 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.856+0000 7f3a25171640 1 --2- 172.21.15.115:0/315924677 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3a20152ba0 0x7f3a20151880 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:35.834 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.856+0000 7f3a25171640 1 --2- 172.21.15.115:0/315924677 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3a200c8460 0x7f3a201f6910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:35.834 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.856+0000 7f3a25171640 1 --2- 172.21.15.115:0/315924677 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3a200713a0 0x7f3a20073cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:35.835 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.856+0000 7f3a25171640 1 -- 172.21.15.115:0/315924677 >> 172.21.15.115:0/315924677 conn(0x7f3a200ce640 msgr2=0x7f3a2014c480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:35:35.835 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.856+0000 7f3a25171640 1 -- 172.21.15.115:0/315924677 shutdown_connections 2024-05-21T13:35:35.835 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.856+0000 7f3a25171640 1 -- 172.21.15.115:0/315924677 wait complete. 2024-05-21T13:35:35.850 DEBUG:teuthology.orchestra.run.smithi115:> sudo ceph --cluster ceph osd new a97df0dc-e370-45ce-8742-25ae31e2212e 7 2024-05-21T13:35:35.851 INFO:tasks.ceph.mgr.x.smithi115.stderr:2024-05-21T13:35:35.872+0000 7fce83649180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-21T13:35:35.915 INFO:tasks.ceph.mgr.x.smithi115.stderr:2024-05-21T13:35:35.936+0000 7fce83649180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-21T13:35:35.916 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-05-21T13:35:35.936+0000 7f780882a180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-21T13:35:35.956 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.976+0000 7fccc5a0e640 1 Processor -- start 2024-05-21T13:35:35.956 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.976+0000 7fccc5a0e640 1 -- start start 2024-05-21T13:35:35.957 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.976+0000 7fccc5a0e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fccc0155d60 0x7fccc015c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:35.958 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.976+0000 7fccc5a0e640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fccc00c8f20 0x7fccc006c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:35.958 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.976+0000 7fccc5a0e640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fccc006f450 con 0x7fccc00c8090 2024-05-21T13:35:35.958 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.976+0000 7fccc5a0e640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fccc015bf50 con 0x7fccc00c8f20 2024-05-21T13:35:35.958 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.976+0000 7fccc5a0e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7fccc015bc20 con 0x7fccc0155d60 2024-05-21T13:35:35.958 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.976+0000 7fccbeffd640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fccc0155d60 0x7fccc015c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:35.958 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.980+0000 7fccbeffd640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fccc0155d60 0x7fccc015c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:52774/0 (socket says 172.21.15.115:52774) 2024-05-21T13:35:35.958 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.980+0000 7fccbeffd640 1 -- 172.21.15.115:0/2116789573 learned_addr learned my addr 172.21.15.115:0/2116789573 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-21T13:35:35.958 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.980+0000 7fccb7fff640 1 --2- 172.21.15.115:0/2116789573 >> v2:172.21.15.22:3300/0 conn(0x7fccc00c8f20 0x7fccc006c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:35.958 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.980+0000 7fccbeffd640 1 -- 172.21.15.115:0/2116789573 >> v2:172.21.15.22:3300/0 conn(0x7fccc00c8f20 msgr2=0x7fccc006c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:35:35.958 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.980+0000 7fccbeffd640 1 --2- 172.21.15.115:0/2116789573 >> v2:172.21.15.22:3300/0 conn(0x7fccc00c8f20 0x7fccc006c4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:35.958 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.980+0000 7fccbeffd640 1 -- 172.21.15.115:0/2116789573 >> v1:172.21.15.22:6789/0 conn(0x7fccc00c8090 legacy=0x7fccc0070e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:35:35.959 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.980+0000 7fccbeffd640 1 -- 172.21.15.115:0/2116789573 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccc006f6f0 con 0x7fccc0155d60 2024-05-21T13:35:35.959 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.980+0000 7fccb7fff640 1 --2- 172.21.15.115:0/2116789573 >> v2:172.21.15.22:3300/0 conn(0x7fccc00c8f20 0x7fccc006c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:35:35.959 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.980+0000 7fccbeffd640 1 --2- 172.21.15.115:0/2116789573 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fccc0155d60 0x7fccc015c3e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fccb0009870 tx=0x7fccb001c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4038827bfb1c32ab server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:35:35.959 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.980+0000 7fccbe7fc640 1 -- 172.21.15.115:0/2116789573 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccb00ab5f0 con 0x7fccc0155d60 2024-05-21T13:35:35.959 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.980+0000 7fccbe7fc640 1 -- 172.21.15.115:0/2116789573 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fccb00b0070 con 0x7fccc0155d60 2024-05-21T13:35:35.960 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.980+0000 7fccbe7fc640 1 -- 172.21.15.115:0/2116789573 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccb00ab9b0 con 0x7fccc0155d60 2024-05-21T13:35:35.960 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.980+0000 7fccc5a0e640 1 -- 172.21.15.115:0/2116789573 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fccc0155d60 msgr2=0x7fccc015c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:35.960 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.980+0000 7fccc5a0e640 1 --2- 172.21.15.115:0/2116789573 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fccc0155d60 0x7fccc015c3e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fccb0009870 tx=0x7fccb001c560 comp rx=0 tx=0).stop 2024-05-21T13:35:35.961 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.980+0000 7fccc5a0e640 1 -- 172.21.15.115:0/2116789573 shutdown_connections 2024-05-21T13:35:35.961 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.980+0000 7fccc5a0e640 1 --2- 172.21.15.115:0/2116789573 >> v2:172.21.15.22:3300/0 conn(0x7fccc00c8f20 0x7fccc006c4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:35.961 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.980+0000 7fccc5a0e640 1 --2- 172.21.15.115:0/2116789573 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fccc0155d60 0x7fccc015c3e0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:35.961 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.980+0000 7fccc5a0e640 1 -- 172.21.15.115:0/2116789573 >> 172.21.15.115:0/2116789573 conn(0x7fccc00ce640 msgr2=0x7fccc00cea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:35:35.961 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.980+0000 7fccc5a0e640 1 -- 172.21.15.115:0/2116789573 shutdown_connections 2024-05-21T13:35:35.961 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.980+0000 7fccc5a0e640 1 -- 172.21.15.115:0/2116789573 wait complete. 2024-05-21T13:35:35.961 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.984+0000 7fccc5a0e640 1 Processor -- start 2024-05-21T13:35:35.961 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.984+0000 7fccc5a0e640 1 -- start start 2024-05-21T13:35:35.963 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.984+0000 7fccc5a0e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fccc00c8090 0x7fccc00c6c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:35.964 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.984+0000 7fccc5a0e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fccc00c8f20 0x7fccc01475d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:35.964 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.984+0000 7fccc5a0e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fccc0155d60 0x7fccc0147b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:35.964 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.984+0000 7fccc5a0e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fccc015f080 con 0x7fccc00c8090 2024-05-21T13:35:35.964 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.984+0000 7fccc5a0e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fccc0156140 con 0x7fccc0155d60 2024-05-21T13:35:35.964 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.984+0000 7fccc5a0e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7fccc0157460 con 0x7fccc00c8f20 2024-05-21T13:35:35.964 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.984+0000 7fccb7fff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fccc00c8f20 0x7fccc01475d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:35.964 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.984+0000 7fccbf7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fccc0155d60 0x7fccc0147b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:35.964 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.984+0000 7fccb7fff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fccc00c8f20 0x7fccc01475d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.115:52780/0 (socket says 172.21.15.115:52780) 2024-05-21T13:35:35.964 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.984+0000 7fccbf7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fccc0155d60 0x7fccc0147b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.115:52494/0 (socket says 172.21.15.115:52494) 2024-05-21T13:35:35.964 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.984+0000 7fccb7fff640 1 -- 172.21.15.115:0/2274047404 learned_addr learned my addr 172.21.15.115:0/2274047404 (peer_addr_for_me v2:172.21.15.115:0/0) 2024-05-21T13:35:35.964 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.984+0000 7fccbeffd640 1 --2- 172.21.15.115:0/2274047404 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fccc00c8090 0x7fccc00c6c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:35.964 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.984+0000 7fccb7fff640 1 -- 172.21.15.115:0/2274047404 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fccc0155d60 msgr2=0x7fccc0147b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:35.965 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.984+0000 7fccb7fff640 1 --2- 172.21.15.115:0/2274047404 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fccc0155d60 0x7fccc0147b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:35.965 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.984+0000 7fccb7fff640 1 -- 172.21.15.115:0/2274047404 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fccc00c8090 msgr2=0x7fccc00c6c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:35.965 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.984+0000 7fccb7fff640 1 --2- 172.21.15.115:0/2274047404 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fccc00c8090 0x7fccc00c6c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:35.965 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.984+0000 7fccb7fff640 1 -- 172.21.15.115:0/2274047404 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccc0154750 con 0x7fccc00c8f20 2024-05-21T13:35:35.965 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.984+0000 7fccb7fff640 1 --2- 172.21.15.115:0/2274047404 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fccc00c8f20 0x7fccc01475d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fcca800c7f0 tx=0x7fcca800ccb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:35:35.965 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.984+0000 7fccbcff9640 1 -- 172.21.15.115:0/2274047404 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcca8015070 con 0x7fccc00c8f20 2024-05-21T13:35:35.965 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.984+0000 7fccbcff9640 1 -- 172.21.15.115:0/2274047404 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcca80079d0 con 0x7fccc00c8f20 2024-05-21T13:35:35.965 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.984+0000 7fccbcff9640 1 -- 172.21.15.115:0/2274047404 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcca8007da0 con 0x7fccc00c8f20 2024-05-21T13:35:35.966 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.984+0000 7fccc5a0e640 1 -- 172.21.15.115:0/2274047404 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccc0158710 con 0x7fccc00c8f20 2024-05-21T13:35:35.966 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.984+0000 7fccc5a0e640 1 -- 172.21.15.115:0/2274047404 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fccc0158cd0 con 0x7fccc00c8f20 2024-05-21T13:35:35.966 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.984+0000 7fccbcff9640 1 -- 172.21.15.115:0/2274047404 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fcca8018070 con 0x7fccc00c8f20 2024-05-21T13:35:35.966 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.984+0000 7fccbcff9640 1 -- 172.21.15.115:0/2274047404 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7fcca801aab0 con 0x7fccc00c8f20 2024-05-21T13:35:35.967 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.984+0000 7fccc5a0e640 1 -- 172.21.15.115:0/2274047404 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccc00697d0 con 0x7fccc00c8f20 2024-05-21T13:35:35.967 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:35.988+0000 7fccbcff9640 1 -- 172.21.15.115:0/2274047404 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7fcca801a450 con 0x7fccc00c8f20 2024-05-21T13:35:35.981 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-05-21T13:35:36.000+0000 7f780882a180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-21T13:35:36.034 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:36.056+0000 7fccc5a0e640 1 -- 172.21.15.115:0/2274047404 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a97df0dc-e370-45ce-8742-25ae31e2212e", "id": 7} v 0) -- 0x7fccc00cc340 con 0x7fccc00c8f20 2024-05-21T13:35:36.044 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:36.064+0000 7fccbcff9640 1 -- 172.21.15.115:0/2274047404 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a97df0dc-e370-45ce-8742-25ae31e2212e", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7fcca801a630 con 0x7fccc00c8f20 2024-05-21T13:35:36.044 INFO:teuthology.orchestra.run.smithi115.stdout:7 2024-05-21T13:35:36.045 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:36.068+0000 7fccc5a0e640 1 -- 172.21.15.115:0/2274047404 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fccc00c8f20 msgr2=0x7fccc01475d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:36.045 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:36.068+0000 7fccc5a0e640 1 --2- 172.21.15.115:0/2274047404 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fccc00c8f20 0x7fccc01475d0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fcca800c7f0 tx=0x7fcca800ccb0 comp rx=0 tx=0).stop 2024-05-21T13:35:36.046 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:36.068+0000 7fccc5a0e640 1 -- 172.21.15.115:0/2274047404 shutdown_connections 2024-05-21T13:35:36.046 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:36.068+0000 7fccc5a0e640 1 --2- 172.21.15.115:0/2274047404 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fccc0155d60 0x7fccc0147b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:36.046 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:36.068+0000 7fccc5a0e640 1 --2- 172.21.15.115:0/2274047404 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fccc00c8f20 0x7fccc01475d0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:36.046 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:36.068+0000 7fccc5a0e640 1 --2- 172.21.15.115:0/2274047404 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fccc00c8090 0x7fccc00c6c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:36.046 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:36.068+0000 7fccc5a0e640 1 -- 172.21.15.115:0/2274047404 >> 172.21.15.115:0/2274047404 conn(0x7fccc00ce640 msgr2=0x7fccc014e2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:35:36.046 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:36.068+0000 7fccc5a0e640 1 -- 172.21.15.115:0/2274047404 shutdown_connections 2024-05-21T13:35:36.046 INFO:teuthology.orchestra.run.smithi115.stderr:2024-05-21T13:35:36.068+0000 7fccc5a0e640 1 -- 172.21.15.115:0/2274047404 wait complete. 2024-05-21T13:35:36.060 INFO:tasks.ceph.osd.0:Restarting daemon 2024-05-21T13:35:36.060 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-05-21T13:35:36.063 INFO:tasks.ceph.osd.0:Started 2024-05-21T13:35:36.063 INFO:tasks.ceph.osd.1:Restarting daemon 2024-05-21T13:35:36.063 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-05-21T13:35:36.065 INFO:tasks.ceph.osd.1:Started 2024-05-21T13:35:36.066 INFO:tasks.ceph.osd.2:Restarting daemon 2024-05-21T13:35:36.066 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-05-21T13:35:36.068 INFO:tasks.ceph.osd.2:Started 2024-05-21T13:35:36.068 INFO:tasks.ceph.osd.3:Restarting daemon 2024-05-21T13:35:36.068 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-05-21T13:35:36.070 INFO:tasks.ceph.osd.3:Started 2024-05-21T13:35:36.070 INFO:tasks.ceph.osd.4:Restarting daemon 2024-05-21T13:35:36.071 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-05-21T13:35:36.073 INFO:tasks.ceph.osd.4:Started 2024-05-21T13:35:36.073 INFO:tasks.ceph.osd.5:Restarting daemon 2024-05-21T13:35:36.073 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-05-21T13:35:36.075 INFO:tasks.ceph.osd.5:Started 2024-05-21T13:35:36.076 INFO:tasks.ceph.osd.6:Restarting daemon 2024-05-21T13:35:36.076 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-05-21T13:35:36.078 INFO:tasks.ceph.osd.6:Started 2024-05-21T13:35:36.078 INFO:tasks.ceph.osd.7:Restarting daemon 2024-05-21T13:35:36.078 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-05-21T13:35:36.080 INFO:tasks.ceph.osd.7:Started 2024-05-21T13:35:36.081 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-21T13:35:36.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:36.224+0000 7f9a354d6640 1 Processor -- start 2024-05-21T13:35:36.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:36.224+0000 7f9a354d6640 1 -- start start 2024-05-21T13:35:36.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:36.228+0000 7f9a354d6640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9a30152a10 0x7f9a300cc5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:36.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:36.228+0000 7f9a354d6640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a300c3d80 0x7f9a301592b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:36.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:36.228+0000 7f9a354d6640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a300ce5b0 con 0x7f9a300c8670 2024-05-21T13:35:36.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:36.228+0000 7f9a354d6640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f9a300ce380 con 0x7f9a30152a10 2024-05-21T13:35:36.205 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:36.228+0000 7f9a354d6640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f9a301597f0 con 0x7f9a300c3d80 2024-05-21T13:35:36.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:36.228+0000 7f9a2effd640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9a30152a10 0x7f9a300cc5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:36.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:36.228+0000 7f9a2f7fe640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a300c3d80 0x7f9a301592b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:36.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:36.228+0000 7f9a267fc640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f9a300c8670 0x7f9a3006e990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.22:39782/0 (socket says 172.21.15.22:39782) 2024-05-21T13:35:36.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:36.228+0000 7f9a267fc640 1 -- 172.21.15.22:0/2422006982 learned_addr learned my addr 172.21.15.22:0/2422006982 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-21T13:35:36.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:36.228+0000 7f9a2effd640 1 -- 172.21.15.22:0/2422006982 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a300c3d80 msgr2=0x7f9a301592b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:35:36.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:36.228+0000 7f9a2effd640 1 --2- 172.21.15.22:0/2422006982 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a300c3d80 0x7f9a301592b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:36.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:36.228+0000 7f9a2effd640 1 -- 172.21.15.22:0/2422006982 >> v1:172.21.15.115:6789/0 conn(0x7f9a300c8670 legacy=0x7f9a3006e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:36.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:36.228+0000 7f9a2effd640 1 -- 172.21.15.22:0/2422006982 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a300ce850 con 0x7f9a30152a10 2024-05-21T13:35:36.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:36.228+0000 7f9a2e7fc640 1 -- 172.21.15.22:0/2422006982 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2330052625 0 0) 0x7f9a300ce5b0 con 0x7f9a300c8670 2024-05-21T13:35:36.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:36.228+0000 7f9a2effd640 1 --2- 172.21.15.22:0/2422006982 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a30152a10 0x7f9a300cc5f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9a200097c0 tx=0x7f9a2001c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20555b6c067555af server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:35:36.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:36.228+0000 7f9a2e7fc640 1 -- 172.21.15.22:0/2422006982 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a200b0070 con 0x7f9a30152a10 2024-05-21T13:35:36.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:36.228+0000 7f9a2e7fc640 1 -- 172.21.15.22:0/2422006982 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a200ab600 con 0x7f9a30152a10 2024-05-21T13:35:36.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:36.228+0000 7f9a2e7fc640 1 -- 172.21.15.22:0/2422006982 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a200ab9d0 con 0x7f9a30152a10 2024-05-21T13:35:36.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:36.232+0000 7f9a354d6640 1 -- 172.21.15.22:0/2422006982 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a30152a10 msgr2=0x7f9a300cc5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:36.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:36.232+0000 7f9a354d6640 1 --2- 172.21.15.22:0/2422006982 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a30152a10 0x7f9a300cc5f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f9a200097c0 tx=0x7f9a2001c4a0 comp rx=0 tx=0).stop 2024-05-21T13:35:36.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:36.232+0000 7f9a354d6640 1 -- 172.21.15.22:0/2422006982 shutdown_connections 2024-05-21T13:35:36.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:36.232+0000 7f9a354d6640 1 --2- 172.21.15.22:0/2422006982 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a300c3d80 0x7f9a301592b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:36.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:36.232+0000 7f9a354d6640 1 --2- 172.21.15.22:0/2422006982 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a30152a10 0x7f9a300cc5f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:36.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:36.232+0000 7f9a354d6640 1 -- 172.21.15.22:0/2422006982 >> 172.21.15.22:0/2422006982 conn(0x7f9a30070de0 msgr2=0x7f9a300cdc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:35:36.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:36.232+0000 7f9a354d6640 1 -- 172.21.15.22:0/2422006982 shutdown_connections 2024-05-21T13:35:36.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:36.232+0000 7f9a354d6640 1 -- 172.21.15.22:0/2422006982 wait complete. 2024-05-21T13:35:36.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:36.232+0000 7f9a354d6640 1 Processor -- start 2024-05-21T13:35:36.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:36.232+0000 7f9a354d6640 1 -- start start 2024-05-21T13:35:36.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:36.232+0000 7f9a354d6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a300c3d80 0x7f9a30156780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:36.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:36.232+0000 7f9a354d6640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a300c8670 0x7f9a301576c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:36.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:36.232+0000 7f9a354d6640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a30152a10 0x7f9a301f8240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:36.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:36.232+0000 7f9a354d6640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9a300cc160 con 0x7f9a300c3d80 2024-05-21T13:35:36.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:36.232+0000 7f9a354d6640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f9a300ceb30 con 0x7f9a300c8670 2024-05-21T13:35:36.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:36.232+0000 7f9a354d6640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f9a30152df0 con 0x7f9a30152a10 2024-05-21T13:35:36.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:36.232+0000 7f9a2effd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a300c3d80 0x7f9a30156780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:36.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:36.232+0000 7f9a2effd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a300c3d80 0x7f9a30156780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43296/0 (socket says 172.21.15.22:43296) 2024-05-21T13:35:36.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:36.232+0000 7f9a2effd640 1 -- 172.21.15.22:0/985905686 learned_addr learned my addr 172.21.15.22:0/985905686 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:35:36.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:36.232+0000 7f9a2f7fe640 1 --2- 172.21.15.22:0/985905686 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a30152a10 0x7f9a301f8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:36.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:36.232+0000 7f9a267fc640 1 --2- 172.21.15.22:0/985905686 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a300c8670 0x7f9a301576c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:36.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:36.232+0000 7f9a2effd640 1 -- 172.21.15.22:0/985905686 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a30152a10 msgr2=0x7f9a301f8240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:36.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:36.232+0000 7f9a2effd640 1 --2- 172.21.15.22:0/985905686 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a30152a10 0x7f9a301f8240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:36.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:36.232+0000 7f9a2effd640 1 -- 172.21.15.22:0/985905686 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a300c8670 msgr2=0x7f9a301576c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:36.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:36.232+0000 7f9a2effd640 1 --2- 172.21.15.22:0/985905686 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a300c8670 0x7f9a301576c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:36.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:36.232+0000 7f9a2effd640 1 -- 172.21.15.22:0/985905686 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a30156cc0 con 0x7f9a300c3d80 2024-05-21T13:35:36.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:36.232+0000 7f9a267fc640 1 --2- 172.21.15.22:0/985905686 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a300c8670 0x7f9a301576c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T13:35:36.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:36.232+0000 7f9a2effd640 1 --2- 172.21.15.22:0/985905686 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a300c3d80 0x7f9a30156780 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9a200097c0 tx=0x7f9a2001ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:35:36.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:36.232+0000 7f9a27fff640 1 -- 172.21.15.22:0/985905686 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a200b0050 con 0x7f9a300c3d80 2024-05-21T13:35:36.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:36.232+0000 7f9a27fff640 1 -- 172.21.15.22:0/985905686 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a200bc070 con 0x7f9a300c3d80 2024-05-21T13:35:36.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:36.232+0000 7f9a354d6640 1 -- 172.21.15.22:0/985905686 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a30157c00 con 0x7f9a300c3d80 2024-05-21T13:35:36.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:36.232+0000 7f9a27fff640 1 -- 172.21.15.22:0/985905686 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a200b5830 con 0x7f9a300c3d80 2024-05-21T13:35:36.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:36.232+0000 7f9a354d6640 1 -- 172.21.15.22:0/985905686 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a301f8c10 con 0x7f9a300c3d80 2024-05-21T13:35:36.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:36.232+0000 7f9a27fff640 1 -- 172.21.15.22:0/985905686 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9a200b59d0 con 0x7f9a300c3d80 2024-05-21T13:35:36.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:36.232+0000 7f9a27fff640 1 -- 172.21.15.22:0/985905686 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f9a200b7b20 con 0x7f9a300c3d80 2024-05-21T13:35:36.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:36.232+0000 7f9a354d6640 1 -- 172.21.15.22:0/985905686 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a300697d0 con 0x7f9a300c3d80 2024-05-21T13:35:36.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:36.236+0000 7f9a27fff640 1 -- 172.21.15.22:0/985905686 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f9a20016090 con 0x7f9a300c3d80 2024-05-21T13:35:36.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:36.304+0000 7f9a354d6640 1 -- 172.21.15.22:0/985905686 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9a300c4280 con 0x7f9a300c3d80 2024-05-21T13:35:36.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:36.304+0000 7f9a27fff640 1 -- 172.21.15.22:0/985905686 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f9a200c1460 con 0x7f9a300c3d80 2024-05-21T13:35:36.284 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-21T13:35:36.284 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":10,"fsid":"f2c96204-e240-4e7f-8a76-927b4f80f534","created":"2024-05-21T13:35:33.827005+0000","modified":"2024-05-21T13:35:36.061492+0000","last_up_change":"0.000000","last_in_change":"2024-05-21T13:35:36.061492+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"09157d4a-9443-4e10-bbb3-cf8ed7c42cb9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2a6a87c0-01ad-4a98-a538-c0a8e865b05d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"4c18f931-40a4-46ac-a752-0d1be35b01a5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d57ee7fd-b73e-41ec-8e3b-e62fb8898128","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"43c6494f-352b-42a7-b6a9-fe7e3573fab9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"25fc861c-593d-4d49-942a-c75c19f25994","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"2e7fb0b8-1162-497f-bffc-e2c02b9b9ef4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a97df0dc-e370-45ce-8742-25ae31e2212e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-21T13:35:36.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:36.304+0000 7f9a354d6640 1 -- 172.21.15.22:0/985905686 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a300c3d80 msgr2=0x7f9a30156780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:36.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:36.304+0000 7f9a354d6640 1 --2- 172.21.15.22:0/985905686 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a300c3d80 0x7f9a30156780 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f9a200097c0 tx=0x7f9a2001ace0 comp rx=0 tx=0).stop 2024-05-21T13:35:36.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:36.304+0000 7f9a354d6640 1 -- 172.21.15.22:0/985905686 shutdown_connections 2024-05-21T13:35:36.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:36.304+0000 7f9a354d6640 1 --2- 172.21.15.22:0/985905686 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a30152a10 0x7f9a301f8240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:36.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:36.304+0000 7f9a354d6640 1 --2- 172.21.15.22:0/985905686 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a300c8670 0x7f9a301576c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:36.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:36.304+0000 7f9a354d6640 1 --2- 172.21.15.22:0/985905686 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a300c3d80 0x7f9a30156780 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:36.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:36.304+0000 7f9a354d6640 1 -- 172.21.15.22:0/985905686 >> 172.21.15.22:0/985905686 conn(0x7f9a30070de0 msgr2=0x7f9a3014fbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:35:36.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:36.304+0000 7f9a354d6640 1 -- 172.21.15.22:0/985905686 shutdown_connections 2024-05-21T13:35:36.285 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:36.304+0000 7f9a354d6640 1 -- 172.21.15.22:0/985905686 wait complete. 2024-05-21T13:35:36.307 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-05-21T13:35:36.307 INFO:tasks.ceph:Waiting for OSDs to come up 2024-05-21T13:35:36.513 INFO:tasks.ceph.mgr.x.smithi115.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-05-21T13:35:36.514 INFO:tasks.ceph.mgr.x.smithi115.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-05-21T13:35:36.514 INFO:tasks.ceph.mgr.x.smithi115.stderr: from numpy import show_config as show_numpy_config 2024-05-21T13:35:36.582 INFO:tasks.ceph.mgr.x.smithi115.stderr:2024-05-21T13:35:36.604+0000 7fce83649180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-21T13:35:36.651 INFO:tasks.ceph.mgr.y.smithi022.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-05-21T13:35:36.651 INFO:tasks.ceph.mgr.y.smithi022.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-05-21T13:35:36.651 INFO:tasks.ceph.mgr.y.smithi022.stderr: from numpy import show_config as show_numpy_config 2024-05-21T13:35:36.670 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-21T13:35:36.692+0000 7fafcb8fe7c0 -1 Falling back to public interface 2024-05-21T13:35:36.694 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-21T13:35:36.716+0000 7f43a71427c0 -1 Falling back to public interface 2024-05-21T13:35:36.694 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-21T13:35:36.716+0000 7fc6224877c0 -1 Falling back to public interface 2024-05-21T13:35:36.695 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-21T13:35:36.716+0000 7f254d00c7c0 -1 Falling back to public interface 2024-05-21T13:35:36.695 INFO:tasks.ceph.osd.0.smithi022.stderr:2024-05-21T13:35:36.716+0000 7fd3ff29d7c0 -1 Falling back to public interface 2024-05-21T13:35:36.702 INFO:tasks.ceph.osd.1.smithi022.stderr:2024-05-21T13:35:36.724+0000 7efdaaac47c0 -1 Falling back to public interface 2024-05-21T13:35:36.713 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-05-21T13:35:36.736+0000 7f780882a180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-21T13:35:36.718 INFO:tasks.ceph.osd.2.smithi022.stderr:2024-05-21T13:35:36.740+0000 7fa4b8a657c0 -1 Falling back to public interface 2024-05-21T13:35:36.722 INFO:tasks.ceph.osd.3.smithi022.stderr:2024-05-21T13:35:36.744+0000 7f71d830e7c0 -1 Falling back to public interface 2024-05-21T13:35:36.766 INFO:tasks.ceph.mgr.x.smithi115.stderr:2024-05-21T13:35:36.788+0000 7fce83649180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-21T13:35:36.873 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-05-21T13:35:36.896+0000 7f780882a180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-21T13:35:36.932 INFO:tasks.ceph.mgr.x.smithi115.stderr:2024-05-21T13:35:36.952+0000 7fce83649180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-21T13:35:36.995 INFO:tasks.ceph.mgr.x.smithi115.stderr:2024-05-21T13:35:37.016+0000 7fce83649180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-21T13:35:37.046 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-05-21T13:35:37.068+0000 7f780882a180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-21T13:35:37.115 DEBUG:teuthology.orchestra.run.smithi022:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-21T13:35:37.118 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-05-21T13:35:37.140+0000 7f780882a180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-21T13:35:37.129 INFO:tasks.ceph.mgr.x.smithi115.stderr:2024-05-21T13:35:37.152+0000 7fce83649180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-21T13:35:37.234 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:37.256+0000 7f638a322640 1 Processor -- start 2024-05-21T13:35:37.234 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:37.256+0000 7f638a322640 1 -- start start 2024-05-21T13:35:37.235 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:37.256+0000 7f638a322640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6384152ad0 0x7f63840ce140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:37.235 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:37.256+0000 7f638a322640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f63840ce680 0x7f638406e890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:37.235 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:37.256+0000 7f638a322640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f638406edd0 0x7f63841587a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:37.235 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:37.256+0000 7f638a322640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f63840735d0 con 0x7f638406edd0 2024-05-21T13:35:37.235 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:37.256+0000 7f638a322640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f6384159760 con 0x7f63840ce680 2024-05-21T13:35:37.236 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:37.256+0000 7f638a322640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f638406f260 con 0x7f6384152ad0 2024-05-21T13:35:37.236 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:37.256+0000 7f63888bf640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f638406edd0 0x7f63841587a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:37.236 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:37.256+0000 7f63888bf640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f638406edd0 0x7f63841587a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43304/0 (socket says 172.21.15.22:43304) 2024-05-21T13:35:37.236 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:37.256+0000 7f63888bf640 1 -- 172.21.15.22:0/676299468 learned_addr learned my addr 172.21.15.22:0/676299468 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:35:37.236 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:37.256+0000 7f6383fff640 1 --2- 172.21.15.22:0/676299468 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6384152ad0 0x7f63840ce140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:37.236 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:37.256+0000 7f63837fe640 1 --2- 172.21.15.22:0/676299468 >> v2:172.21.15.115:3300/0 conn(0x7f63840ce680 0x7f638406e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:37.236 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:37.256+0000 7f63888bf640 1 -- 172.21.15.22:0/676299468 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6384152ad0 msgr2=0x7f63840ce140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:35:37.236 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:37.256+0000 7f63888bf640 1 --2- 172.21.15.22:0/676299468 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6384152ad0 0x7f63840ce140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:37.236 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:37.256+0000 7f63888bf640 1 -- 172.21.15.22:0/676299468 >> v2:172.21.15.115:3300/0 conn(0x7f63840ce680 msgr2=0x7f638406e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:35:37.236 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:37.256+0000 7f63888bf640 1 --2- 172.21.15.22:0/676299468 >> v2:172.21.15.115:3300/0 conn(0x7f63840ce680 0x7f638406e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:37.236 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:37.256+0000 7f63888bf640 1 -- 172.21.15.22:0/676299468 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6384152eb0 con 0x7f638406edd0 2024-05-21T13:35:37.237 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:37.260+0000 7f63888bf640 1 --2- 172.21.15.22:0/676299468 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f638406edd0 0x7f63841587a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f63840cbcf0 tx=0x7f637c01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98eb864f39d1e9e2 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:35:37.238 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:37.260+0000 7f6382ffd640 1 -- 172.21.15.22:0/676299468 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f637c0a5670 con 0x7f638406edd0 2024-05-21T13:35:37.238 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:37.260+0000 7f6382ffd640 1 -- 172.21.15.22:0/676299468 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f637c0a5810 con 0x7f638406edd0 2024-05-21T13:35:37.238 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:37.260+0000 7f6382ffd640 1 -- 172.21.15.22:0/676299468 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f637c0a5be0 con 0x7f638406edd0 2024-05-21T13:35:37.239 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:37.260+0000 7f638a322640 1 -- 172.21.15.22:0/676299468 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f638406edd0 msgr2=0x7f63841587a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:37.239 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:37.260+0000 7f638a322640 1 --2- 172.21.15.22:0/676299468 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f638406edd0 0x7f63841587a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f63840cbcf0 tx=0x7f637c01c9f0 comp rx=0 tx=0).stop 2024-05-21T13:35:37.239 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:37.260+0000 7f638a322640 1 -- 172.21.15.22:0/676299468 shutdown_connections 2024-05-21T13:35:37.239 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:37.260+0000 7f638a322640 1 --2- 172.21.15.22:0/676299468 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f638406edd0 0x7f63841587a0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:37.239 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:37.260+0000 7f638a322640 1 --2- 172.21.15.22:0/676299468 >> v2:172.21.15.115:3300/0 conn(0x7f63840ce680 0x7f638406e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:37.240 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:37.260+0000 7f638a322640 1 --2- 172.21.15.22:0/676299468 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6384152ad0 0x7f63840ce140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:37.240 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:37.260+0000 7f638a322640 1 -- 172.21.15.22:0/676299468 >> 172.21.15.22:0/676299468 conn(0x7f638406cb00 msgr2=0x7f6384070450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:35:37.240 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:37.260+0000 7f638a322640 1 -- 172.21.15.22:0/676299468 shutdown_connections 2024-05-21T13:35:37.240 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:37.260+0000 7f638a322640 1 -- 172.21.15.22:0/676299468 wait complete. 2024-05-21T13:35:37.242 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:37.260+0000 7f638a322640 1 Processor -- start 2024-05-21T13:35:37.242 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:37.260+0000 7f638a322640 1 -- start start 2024-05-21T13:35:37.242 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:37.260+0000 7f638a322640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f638406edd0 0x7f63841f3b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:37.242 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:37.260+0000 7f638a322640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f63840ce680 0x7f63841f0f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:37.242 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:37.260+0000 7f638a322640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6384152ad0 0x7f638414b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:37.243 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:37.260+0000 7f638a322640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f638415bd90 con 0x7f63840ce680 2024-05-21T13:35:37.243 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:37.260+0000 7f638a322640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f6384073260 con 0x7f6384152ad0 2024-05-21T13:35:37.243 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:37.260+0000 7f638a322640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f638415bf10 con 0x7f638406edd0 2024-05-21T13:35:37.243 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:37.260+0000 7f63837fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f63840ce680 0x7f63841f0f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:37.243 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:37.260+0000 7f63837fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f63840ce680 0x7f63841f0f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43312/0 (socket says 172.21.15.22:43312) 2024-05-21T13:35:37.243 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:37.260+0000 7f63837fe640 1 -- 172.21.15.22:0/3522824423 learned_addr learned my addr 172.21.15.22:0/3522824423 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:35:37.243 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:37.264+0000 7f6383fff640 1 --2- 172.21.15.22:0/3522824423 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f638406edd0 0x7f63841f3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:37.243 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:37.264+0000 7f63888bf640 1 --2- 172.21.15.22:0/3522824423 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6384152ad0 0x7f638414b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:37.243 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:37.264+0000 7f63837fe640 1 -- 172.21.15.22:0/3522824423 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f638406edd0 msgr2=0x7f63841f3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:37.243 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:37.264+0000 7f63837fe640 1 --2- 172.21.15.22:0/3522824423 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f638406edd0 0x7f63841f3b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:37.243 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:37.264+0000 7f63837fe640 1 -- 172.21.15.22:0/3522824423 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6384152ad0 msgr2=0x7f638414b080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:37.244 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:37.264+0000 7f63837fe640 1 --2- 172.21.15.22:0/3522824423 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6384152ad0 0x7f638414b080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:37.244 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:37.264+0000 7f63837fe640 1 -- 172.21.15.22:0/3522824423 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63841f41f0 con 0x7f63840ce680 2024-05-21T13:35:37.244 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:37.264+0000 7f63837fe640 1 --2- 172.21.15.22:0/3522824423 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f63840ce680 0x7f63841f0f90 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f637800d800 tx=0x7f637800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:35:37.244 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:37.264+0000 7f6380ff9640 1 -- 172.21.15.22:0/3522824423 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6378018020 con 0x7f63840ce680 2024-05-21T13:35:37.244 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:37.264+0000 7f6380ff9640 1 -- 172.21.15.22:0/3522824423 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f63780096a0 con 0x7f63840ce680 2024-05-21T13:35:37.244 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:37.264+0000 7f638a322640 1 -- 172.21.15.22:0/3522824423 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63841f44b0 con 0x7f63840ce680 2024-05-21T13:35:37.244 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:37.264+0000 7f6380ff9640 1 -- 172.21.15.22:0/3522824423 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6378009a50 con 0x7f63840ce680 2024-05-21T13:35:37.244 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:37.264+0000 7f638a322640 1 -- 172.21.15.22:0/3522824423 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63841f0790 con 0x7f63840ce680 2024-05-21T13:35:37.244 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:37.264+0000 7f6380ff9640 1 -- 172.21.15.22:0/3522824423 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f637801b020 con 0x7f63840ce680 2024-05-21T13:35:37.244 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:37.264+0000 7f6380ff9640 1 -- 172.21.15.22:0/3522824423 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f6378014ae0 con 0x7f63840ce680 2024-05-21T13:35:37.244 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:37.264+0000 7f638a322640 1 -- 172.21.15.22:0/3522824423 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63840507f0 con 0x7f63840ce680 2024-05-21T13:35:37.245 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:37.264+0000 7f6380ff9640 1 -- 172.21.15.22:0/3522824423 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73389 (secure 0 0 0) 0x7f6378022020 con 0x7f63840ce680 2024-05-21T13:35:37.274 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-05-21T13:35:37.296+0000 7f780882a180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-21T13:35:37.302 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:37.324+0000 7f638a322640 1 -- 172.21.15.22:0/3522824423 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6384076060 con 0x7f63840ce680 2024-05-21T13:35:37.303 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:37.324+0000 7f6380ff9640 1 -- 172.21.15.22:0/3522824423 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f6378014410 con 0x7f63840ce680 2024-05-21T13:35:37.304 INFO:teuthology.misc.health.smithi022.stdout: 2024-05-21T13:35:37.304 INFO:teuthology.misc.health.smithi022.stdout:{"epoch":10,"fsid":"f2c96204-e240-4e7f-8a76-927b4f80f534","created":"2024-05-21T13:35:33.827005+0000","modified":"2024-05-21T13:35:36.061492+0000","last_up_change":"0.000000","last_in_change":"2024-05-21T13:35:36.061492+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"09157d4a-9443-4e10-bbb3-cf8ed7c42cb9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2a6a87c0-01ad-4a98-a538-c0a8e865b05d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"4c18f931-40a4-46ac-a752-0d1be35b01a5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d57ee7fd-b73e-41ec-8e3b-e62fb8898128","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"43c6494f-352b-42a7-b6a9-fe7e3573fab9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"25fc861c-593d-4d49-942a-c75c19f25994","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"2e7fb0b8-1162-497f-bffc-e2c02b9b9ef4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a97df0dc-e370-45ce-8742-25ae31e2212e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-21T13:35:37.306 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:37.324+0000 7f638a322640 1 -- 172.21.15.22:0/3522824423 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f63840ce680 msgr2=0x7f63841f0f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:37.306 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:37.324+0000 7f638a322640 1 --2- 172.21.15.22:0/3522824423 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f63840ce680 0x7f63841f0f90 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f637800d800 tx=0x7f637800dcc0 comp rx=0 tx=0).stop 2024-05-21T13:35:37.306 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:37.324+0000 7f638a322640 1 -- 172.21.15.22:0/3522824423 shutdown_connections 2024-05-21T13:35:37.306 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:37.324+0000 7f638a322640 1 --2- 172.21.15.22:0/3522824423 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6384152ad0 0x7f638414b080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:37.306 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:37.324+0000 7f638a322640 1 --2- 172.21.15.22:0/3522824423 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f63840ce680 0x7f63841f0f90 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:37.307 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:37.324+0000 7f638a322640 1 --2- 172.21.15.22:0/3522824423 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f638406edd0 0x7f63841f3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:37.307 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:37.324+0000 7f638a322640 1 -- 172.21.15.22:0/3522824423 >> 172.21.15.22:0/3522824423 conn(0x7f638406cb00 msgr2=0x7f6384158340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:35:37.307 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:37.324+0000 7f638a322640 1 -- 172.21.15.22:0/3522824423 shutdown_connections 2024-05-21T13:35:37.307 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:37.324+0000 7f638a322640 1 -- 172.21.15.22:0/3522824423 wait complete. 2024-05-21T13:35:37.321 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-05-21T13:35:37.751 INFO:tasks.ceph.mgr.x.smithi115.stderr:2024-05-21T13:35:37.772+0000 7fce83649180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-21T13:35:37.826 INFO:tasks.ceph.mgr.x.smithi115.stderr:2024-05-21T13:35:37.848+0000 7fce83649180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-21T13:35:37.934 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-05-21T13:35:37.956+0000 7f780882a180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-21T13:35:38.008 INFO:tasks.ceph.mgr.x.smithi115.stderr:2024-05-21T13:35:38.028+0000 7fce83649180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-21T13:35:38.014 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-05-21T13:35:38.036+0000 7f780882a180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-21T13:35:38.081 INFO:tasks.ceph.mgr.x.smithi115.stderr:2024-05-21T13:35:38.100+0000 7fce83649180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-21T13:35:38.205 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-05-21T13:35:38.228+0000 7f780882a180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-21T13:35:38.283 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-05-21T13:35:38.304+0000 7f780882a180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-21T13:35:38.372 INFO:tasks.ceph.mgr.x.smithi115.stderr:2024-05-21T13:35:38.392+0000 7fce83649180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-21T13:35:38.433 INFO:tasks.ceph.mgr.x.smithi115.stderr:2024-05-21T13:35:38.456+0000 7fce83649180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-21T13:35:38.596 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-05-21T13:35:38.616+0000 7f780882a180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-21T13:35:38.661 INFO:tasks.ceph.mgr.y.smithi022.stderr:2024-05-21T13:35:38.684+0000 7f780882a180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-21T13:35:39.472 INFO:tasks.ceph.mgr.x.smithi115.stderr:2024-05-21T13:35:39.492+0000 7fce2a290640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-05-21T13:35:39.472 INFO:tasks.ceph.mgr.x.smithi115.stderr:2024-05-21T13:35:39.492+0000 7fce2a290640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-05-21T13:35:40.424 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-21T13:35:40.444+0000 7fafcb8fe7c0 -1 osd.4 0 log_to_monitors true 2024-05-21T13:35:40.549 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-21T13:35:40.568+0000 7fc6224877c0 -1 osd.5 0 log_to_monitors true 2024-05-21T13:35:40.554 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-21T13:35:40.576+0000 7f43a71427c0 -1 osd.6 0 log_to_monitors true 2024-05-21T13:35:40.559 INFO:tasks.ceph.osd.1.smithi022.stderr:2024-05-21T13:35:40.579+0000 7efdaaac47c0 -1 osd.1 0 log_to_monitors true 2024-05-21T13:35:40.585 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-21T13:35:40.608+0000 7f254d00c7c0 -1 osd.7 0 log_to_monitors true 2024-05-21T13:35:40.631 INFO:tasks.ceph.osd.0.smithi022.stderr:2024-05-21T13:35:40.651+0000 7fd3ff29d7c0 -1 osd.0 0 log_to_monitors true 2024-05-21T13:35:40.681 INFO:tasks.ceph.osd.2.smithi022.stderr:2024-05-21T13:35:40.699+0000 7fa4b8a657c0 -1 osd.2 0 log_to_monitors true 2024-05-21T13:35:40.683 INFO:tasks.ceph.osd.3.smithi022.stderr:2024-05-21T13:35:40.703+0000 7f71d830e7c0 -1 osd.3 0 log_to_monitors true 2024-05-21T13:35:42.132 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-21T13:35:42.152+0000 7fafc78a7640 -1 osd.4 0 waiting for initial osdmap 2024-05-21T13:35:42.158 INFO:tasks.ceph.osd.4.smithi115.stderr:2024-05-21T13:35:42.180+0000 7fafbf6db640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-21T13:35:43.433 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-21T13:35:43.452+0000 7fc61e430640 -1 osd.5 0 waiting for initial osdmap 2024-05-21T13:35:43.454 INFO:tasks.ceph.osd.5.smithi115.stderr:2024-05-21T13:35:43.476+0000 7fc616264640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-21T13:35:43.484 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-21T13:35:43.504+0000 7f2548fb5640 -1 osd.7 0 waiting for initial osdmap 2024-05-21T13:35:43.490 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-21T13:35:43.512+0000 7f43a30eb640 -1 osd.6 0 waiting for initial osdmap 2024-05-21T13:35:43.522 INFO:tasks.ceph.osd.7.smithi115.stderr:2024-05-21T13:35:43.543+0000 7f2540de9640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-21T13:35:43.534 INFO:tasks.ceph.osd.6.smithi115.stderr:2024-05-21T13:35:43.555+0000 7f439af1f640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-21T13:35:43.662 INFO:tasks.ceph.osd.3.smithi022.stderr:2024-05-21T13:35:43.683+0000 7f71d42b7640 -1 osd.3 0 waiting for initial osdmap 2024-05-21T13:35:43.679 INFO:tasks.ceph.osd.1.smithi022.stderr:2024-05-21T13:35:43.699+0000 7efda6a6d640 -1 osd.1 0 waiting for initial osdmap 2024-05-21T13:35:43.686 INFO:tasks.ceph.osd.3.smithi022.stderr:2024-05-21T13:35:43.707+0000 7f71cc0eb640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-21T13:35:43.699 INFO:tasks.ceph.osd.0.smithi022.stderr:2024-05-21T13:35:43.719+0000 7fd3fb246640 -1 osd.0 0 waiting for initial osdmap 2024-05-21T13:35:43.701 INFO:tasks.ceph.osd.2.smithi022.stderr:2024-05-21T13:35:43.723+0000 7fa4b4a0e640 -1 osd.2 0 waiting for initial osdmap 2024-05-21T13:35:43.710 INFO:tasks.ceph.osd.1.smithi022.stderr:2024-05-21T13:35:43.731+0000 7efd9e8a1640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-21T13:35:43.738 INFO:tasks.ceph.osd.0.smithi022.stderr:2024-05-21T13:35:43.759+0000 7fd3f307a640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-21T13:35:43.738 INFO:tasks.ceph.osd.2.smithi022.stderr:2024-05-21T13:35:43.759+0000 7fa4ac842640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-21T13:35:44.129 DEBUG:teuthology.orchestra.run.smithi022:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-21T13:35:44.254 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:44.275+0000 7f6376734640 1 Processor -- start 2024-05-21T13:35:44.254 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:44.275+0000 7f6376734640 1 -- start start 2024-05-21T13:35:44.255 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:44.275+0000 7f6376734640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f63700c8b90 0x7f637015c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:44.255 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:44.275+0000 7f6376734640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f637006f7d0 con 0x7f6370155d60 2024-05-21T13:35:44.255 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:44.275+0000 7f6376734640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f637006fab0 con 0x7f637015f100 2024-05-21T13:35:44.255 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:44.275+0000 7f6376734640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f637006f5a0 con 0x7f63700c8b90 2024-05-21T13:35:44.255 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:44.275+0000 7f636ffff640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f6370155d60 0x7f63700cb140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:60784/0 (socket says 172.21.15.22:60784) 2024-05-21T13:35:44.255 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:44.275+0000 7f636ffff640 1 -- 172.21.15.22:0/3242220887 learned_addr learned my addr 172.21.15.22:0/3242220887 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-21T13:35:44.257 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:44.275+0000 7f636f7fe640 1 --2- 172.21.15.22:0/3242220887 >> v2:172.21.15.115:3300/0 conn(0x7f63700c8b90 0x7f637015c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:44.257 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:44.275+0000 7f636effd640 1 -- 172.21.15.22:0/3242220887 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2211849361 0 0) 0x7f637006f7d0 con 0x7f6370155d60 2024-05-21T13:35:44.257 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:44.275+0000 7f636effd640 1 -- 172.21.15.22:0/3242220887 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6358003530 con 0x7f6370155d60 2024-05-21T13:35:44.257 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:44.275+0000 7f636effd640 1 -- 172.21.15.22:0/3242220887 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 30007505 0 0) 0x7f6358003530 con 0x7f6370155d60 2024-05-21T13:35:44.258 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:44.275+0000 7f636effd640 1 -- 172.21.15.22:0/3242220887 >> v2:172.21.15.115:3300/0 conn(0x7f63700c8b90 msgr2=0x7f637015c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:35:44.258 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:44.275+0000 7f636effd640 1 --2- 172.21.15.22:0/3242220887 >> v2:172.21.15.115:3300/0 conn(0x7f63700c8b90 0x7f637015c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:44.258 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:44.275+0000 7f636effd640 1 -- 172.21.15.22:0/3242220887 >> v1:172.21.15.115:6789/0 conn(0x7f637015f100 legacy=0x7f6370166490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:44.258 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:44.275+0000 7f636effd640 1 -- 172.21.15.22:0/3242220887 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f637006eb10 con 0x7f6370155d60 2024-05-21T13:35:44.258 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:44.275+0000 7f636effd640 1 -- 172.21.15.22:0/3242220887 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2684847062 0 0) 0x7f6360001700 con 0x7f6370155d60 2024-05-21T13:35:44.258 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:44.275+0000 7f636effd640 1 -- 172.21.15.22:0/3242220887 >> v1:172.21.15.22:6789/0 conn(0x7f6370155d60 legacy=0x7f63700cb140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:44.258 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:44.275+0000 7f636effd640 1 --2- 172.21.15.22:0/3242220887 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6358003ab0 0x7f6358003ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:44.258 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:44.275+0000 7f636effd640 1 --2- 172.21.15.22:0/3242220887 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6358004810 0x7f6358004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:44.258 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:44.275+0000 7f636effd640 1 --2- 172.21.15.22:0/3242220887 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6358005220 0x7f635800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:44.258 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:44.275+0000 7f636effd640 1 -- 172.21.15.22:0/3242220887 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f635800c130 con 0x7f6358005220 2024-05-21T13:35:44.258 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:44.275+0000 7f636effd640 1 -- 172.21.15.22:0/3242220887 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f635800c2e0 con 0x7f6358004810 2024-05-21T13:35:44.258 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:44.275+0000 7f636effd640 1 -- 172.21.15.22:0/3242220887 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f635800c4e0 con 0x7f6358003ab0 2024-05-21T13:35:44.259 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:44.275+0000 7f6374cd1640 1 --2- 172.21.15.22:0/3242220887 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6358005220 0x7f635800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:44.259 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:44.275+0000 7f636ffff640 1 --2- 172.21.15.22:0/3242220887 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6358003ab0 0x7f6358003ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:44.259 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:44.275+0000 7f636f7fe640 1 --2- 172.21.15.22:0/3242220887 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6358004810 0x7f6358004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:44.259 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:44.275+0000 7f6374cd1640 1 -- 172.21.15.22:0/3242220887 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6358003ab0 msgr2=0x7f6358003ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:35:44.259 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:44.275+0000 7f6374cd1640 1 --2- 172.21.15.22:0/3242220887 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6358003ab0 0x7f6358003ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:44.259 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:44.275+0000 7f6374cd1640 1 -- 172.21.15.22:0/3242220887 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6358004810 msgr2=0x7f6358004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:35:44.259 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:44.275+0000 7f6374cd1640 1 --2- 172.21.15.22:0/3242220887 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6358004810 0x7f6358004c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:44.259 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:44.275+0000 7f6374cd1640 1 -- 172.21.15.22:0/3242220887 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6358003530 con 0x7f6358005220 2024-05-21T13:35:44.260 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:44.279+0000 7f6374cd1640 1 -- 172.21.15.22:0/3242220887 reap_dead start 2024-05-21T13:35:44.261 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:44.279+0000 7f6374cd1640 1 --2- 172.21.15.22:0/3242220887 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6358005220 0x7f635800b9d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6368007fd0 tx=0x7f636801c750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e97ca1fc44ee887a server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:35:44.261 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:44.279+0000 7f636effd640 1 -- 172.21.15.22:0/3242220887 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6368001ae0 con 0x7f6358005220 2024-05-21T13:35:44.261 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:44.279+0000 7f636effd640 1 -- 172.21.15.22:0/3242220887 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6368003b80 con 0x7f6358005220 2024-05-21T13:35:44.261 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:44.279+0000 7f636effd640 1 -- 172.21.15.22:0/3242220887 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63680050d0 con 0x7f6358005220 2024-05-21T13:35:44.261 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:44.279+0000 7f6376734640 1 -- 172.21.15.22:0/3242220887 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6358005220 msgr2=0x7f635800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:44.261 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:44.279+0000 7f6376734640 1 --2- 172.21.15.22:0/3242220887 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6358005220 0x7f635800b9d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6368007fd0 tx=0x7f636801c750 comp rx=0 tx=0).stop 2024-05-21T13:35:44.261 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:44.279+0000 7f6376734640 1 -- 172.21.15.22:0/3242220887 shutdown_connections 2024-05-21T13:35:44.261 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:44.279+0000 7f6376734640 1 --2- 172.21.15.22:0/3242220887 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6358005220 0x7f635800b9d0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:44.261 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:44.279+0000 7f6376734640 1 -- 172.21.15.22:0/3242220887 >> 172.21.15.22:0/3242220887 conn(0x7f637006c930 msgr2=0x7f637006cd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:35:44.261 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:44.279+0000 7f6376734640 1 -- 172.21.15.22:0/3242220887 shutdown_connections 2024-05-21T13:35:44.261 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:44.279+0000 7f6376734640 1 -- 172.21.15.22:0/3242220887 wait complete. 2024-05-21T13:35:44.261 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:44.279+0000 7f6376734640 1 Processor -- start 2024-05-21T13:35:44.262 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:44.279+0000 7f6376734640 1 -- start start 2024-05-21T13:35:44.263 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:44.283+0000 7f6376734640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6358005220 0x7f6370159be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:44.263 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:44.283+0000 7f6376734640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6370152f10 0x7f6370149f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:44.264 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:44.283+0000 7f6376734640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f63700cd370 0x7f637014a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:44.264 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:44.283+0000 7f6376734640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f63700ca8e0 con 0x7f6370152f10 2024-05-21T13:35:44.264 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:44.283+0000 7f6376734640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f6370156140 con 0x7f63700cd370 2024-05-21T13:35:44.264 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:44.283+0000 7f6376734640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f63700c8fc0 con 0x7f6358005220 2024-05-21T13:35:44.264 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:44.283+0000 7f636f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6370152f10 0x7f6370149f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:44.264 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:44.283+0000 7f636f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6370152f10 0x7f6370149f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43352/0 (socket says 172.21.15.22:43352) 2024-05-21T13:35:44.264 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:44.283+0000 7f636f7fe640 1 -- 172.21.15.22:0/3468232449 learned_addr learned my addr 172.21.15.22:0/3468232449 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:35:44.264 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:44.283+0000 7f6374cd1640 1 --2- 172.21.15.22:0/3468232449 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f63700cd370 0x7f637014a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:44.264 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:44.283+0000 7f636ffff640 1 --2- 172.21.15.22:0/3468232449 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6358005220 0x7f6370159be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:44.264 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:44.283+0000 7f636f7fe640 1 -- 172.21.15.22:0/3468232449 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6358005220 msgr2=0x7f6370159be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:44.264 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:44.283+0000 7f636f7fe640 1 --2- 172.21.15.22:0/3468232449 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6358005220 0x7f6370159be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:44.264 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:44.283+0000 7f636f7fe640 1 -- 172.21.15.22:0/3468232449 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f63700cd370 msgr2=0x7f637014a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:44.265 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:44.283+0000 7f636f7fe640 1 --2- 172.21.15.22:0/3468232449 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f63700cd370 0x7f637014a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:44.265 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:44.283+0000 7f636f7fe640 1 -- 172.21.15.22:0/3468232449 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63701535c0 con 0x7f6370152f10 2024-05-21T13:35:44.265 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:44.283+0000 7f636f7fe640 1 --2- 172.21.15.22:0/3468232449 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6370152f10 0x7f6370149f00 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f6364010890 tx=0x7f6364010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:35:44.265 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:44.283+0000 7f636cff9640 1 -- 172.21.15.22:0/3468232449 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f636400f040 con 0x7f6370152f10 2024-05-21T13:35:44.265 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:44.283+0000 7f636cff9640 1 -- 172.21.15.22:0/3468232449 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f636400eb60 con 0x7f6370152f10 2024-05-21T13:35:44.265 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:44.283+0000 7f6376734640 1 -- 172.21.15.22:0/3468232449 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63700cc090 con 0x7f6370152f10 2024-05-21T13:35:44.265 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:44.283+0000 7f636cff9640 1 -- 172.21.15.22:0/3468232449 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f636401c400 con 0x7f6370152f10 2024-05-21T13:35:44.265 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:44.283+0000 7f6376734640 1 -- 172.21.15.22:0/3468232449 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63701f5200 con 0x7f6370152f10 2024-05-21T13:35:44.265 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:44.283+0000 7f6376734640 1 -- 172.21.15.22:0/3468232449 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63700507f0 con 0x7f6370152f10 2024-05-21T13:35:44.265 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:44.283+0000 7f636cff9640 1 -- 172.21.15.22:0/3468232449 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 4) ==== 93151+0+0 (secure 0 0 0) 0x7f636401c5a0 con 0x7f6370152f10 2024-05-21T13:35:44.266 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:44.283+0000 7f636cff9640 1 --2- 172.21.15.22:0/3468232449 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f635c06f3a0 0x7f635c071860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:44.266 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:44.283+0000 7f636cff9640 1 -- 172.21.15.22:0/3468232449 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 2791+0+0 (secure 0 0 0) 0x7f636408eae0 con 0x7f6370152f10 2024-05-21T13:35:44.266 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:44.283+0000 7f636ffff640 1 --2- 172.21.15.22:0/3468232449 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f635c06f3a0 0x7f635c071860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:44.266 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:44.287+0000 7f636ffff640 1 --2- 172.21.15.22:0/3468232449 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f635c06f3a0 0x7f635c071860 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6360000fc0 tx=0x7f6360009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:35:44.268 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:44.287+0000 7f636cff9640 1 -- 172.21.15.22:0/3468232449 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f6364018030 con 0x7f6370152f10 2024-05-21T13:35:44.429 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:44.447+0000 7f6376734640 1 -- 172.21.15.22:0/3468232449 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f637014b460 con 0x7f6370152f10 2024-05-21T13:35:44.430 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:44.451+0000 7f636cff9640 1 -- 172.21.15.22:0/3468232449 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) ==== 74+0+8064 (secure 0 0 0) 0x7f636405c6a0 con 0x7f6370152f10 2024-05-21T13:35:44.430 INFO:teuthology.misc.health.smithi022.stdout: 2024-05-21T13:35:44.430 INFO:teuthology.misc.health.smithi022.stdout:{"epoch":14,"fsid":"f2c96204-e240-4e7f-8a76-927b4f80f534","created":"2024-05-21T13:35:33.827005+0000","modified":"2024-05-21T13:35:43.532707+0000","last_up_change":"2024-05-21T13:35:43.532707+0000","last_in_change":"2024-05-21T13:35:36.061492+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"09157d4a-9443-4e10-bbb3-cf8ed7c42cb9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"2a6a87c0-01ad-4a98-a538-c0a8e865b05d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"4c18f931-40a4-46ac-a752-0d1be35b01a5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d57ee7fd-b73e-41ec-8e3b-e62fb8898128","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"43c6494f-352b-42a7-b6a9-fe7e3573fab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":832695158},{"type":"v1","addr":"172.21.15.115:6801","nonce":832695158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":832695158},{"type":"v1","addr":"172.21.15.115:6803","nonce":832695158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":832695158},{"type":"v1","addr":"172.21.15.115:6807","nonce":832695158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":832695158},{"type":"v1","addr":"172.21.15.115:6805","nonce":832695158}]},"public_addr":"172.21.15.115:6801/832695158","cluster_addr":"172.21.15.115:6803/832695158","heartbeat_back_addr":"172.21.15.115:6807/832695158","heartbeat_front_addr":"172.21.15.115:6805/832695158","state":["exists","up"]},{"osd":5,"uuid":"25fc861c-593d-4d49-942a-c75c19f25994","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":1504764223},{"type":"v1","addr":"172.21.15.115:6815","nonce":1504764223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":1504764223},{"type":"v1","addr":"172.21.15.115:6823","nonce":1504764223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":1504764223},{"type":"v1","addr":"172.21.15.115:6830","nonce":1504764223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6825","nonce":1504764223},{"type":"v1","addr":"172.21.15.115:6827","nonce":1504764223}]},"public_addr":"172.21.15.115:6815/1504764223","cluster_addr":"172.21.15.115:6823/1504764223","heartbeat_back_addr":"172.21.15.115:6830/1504764223","heartbeat_front_addr":"172.21.15.115:6827/1504764223","state":["exists","up"]},{"osd":6,"uuid":"2e7fb0b8-1162-497f-bffc-e2c02b9b9ef4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a97df0dc-e370-45ce-8742-25ae31e2212e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.492954+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-21T13:35:44.432 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:44.451+0000 7f6376734640 1 -- 172.21.15.22:0/3468232449 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f635c06f3a0 msgr2=0x7f635c071860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:44.432 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:44.451+0000 7f6376734640 1 --2- 172.21.15.22:0/3468232449 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f635c06f3a0 0x7f635c071860 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6360000fc0 tx=0x7f6360009040 comp rx=0 tx=0).stop 2024-05-21T13:35:44.432 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:44.451+0000 7f6376734640 1 -- 172.21.15.22:0/3468232449 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6370152f10 msgr2=0x7f6370149f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:44.433 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:44.451+0000 7f6376734640 1 --2- 172.21.15.22:0/3468232449 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6370152f10 0x7f6370149f00 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f6364010890 tx=0x7f6364010d50 comp rx=0 tx=0).stop 2024-05-21T13:35:44.433 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:44.451+0000 7f6376734640 1 -- 172.21.15.22:0/3468232449 shutdown_connections 2024-05-21T13:35:44.433 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:44.451+0000 7f6376734640 1 --2- 172.21.15.22:0/3468232449 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f635c06f3a0 0x7f635c071860 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:44.433 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:44.451+0000 7f6376734640 1 --2- 172.21.15.22:0/3468232449 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f63700cd370 0x7f637014a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:44.433 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:44.451+0000 7f6376734640 1 --2- 172.21.15.22:0/3468232449 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6370152f10 0x7f6370149f00 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:44.433 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:44.451+0000 7f6376734640 1 --2- 172.21.15.22:0/3468232449 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6358005220 0x7f6370159be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:44.433 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:44.451+0000 7f6376734640 1 -- 172.21.15.22:0/3468232449 >> 172.21.15.22:0/3468232449 conn(0x7f637006c930 msgr2=0x7f637006cd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:35:44.433 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:44.451+0000 7f6376734640 1 -- 172.21.15.22:0/3468232449 shutdown_connections 2024-05-21T13:35:44.433 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:44.451+0000 7f6376734640 1 -- 172.21.15.22:0/3468232449 wait complete. 2024-05-21T13:35:44.447 DEBUG:teuthology.misc:2 of 8 OSDs are up 2024-05-21T13:35:51.254 DEBUG:teuthology.orchestra.run.smithi022:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-05-21T13:35:51.382 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:51.403+0000 7f5167290640 1 Processor -- start 2024-05-21T13:35:51.382 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:51.403+0000 7f5167290640 1 -- start start 2024-05-21T13:35:51.383 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:51.403+0000 7f5167290640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f5160155ef0 0x7f51600c6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:51.383 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:51.403+0000 7f5167290640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f516015ca60 con 0x7f51600cc2c0 2024-05-21T13:35:51.383 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:51.403+0000 7f5167290640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51600cd940 con 0x7f516015c390 2024-05-21T13:35:51.384 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:51.403+0000 7f5167290640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f516015c820 con 0x7f5160155ef0 2024-05-21T13:35:51.384 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:51.403+0000 7f516482b640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f51600cc2c0 0x7f516015bc80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:40732/0 (socket says 172.21.15.22:40732) 2024-05-21T13:35:51.384 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:51.403+0000 7f516502c640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f5160155ef0 0x7f51600c6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:51.384 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:51.403+0000 7f516482b640 1 -- 172.21.15.22:0/3539649866 learned_addr learned my addr 172.21.15.22:0/3539649866 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-21T13:35:51.384 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:51.403+0000 7f5157fff640 1 -- 172.21.15.22:0/3539649866 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 806746878 0 0) 0x7f516015ca60 con 0x7f51600cc2c0 2024-05-21T13:35:51.384 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:51.403+0000 7f5157fff640 1 -- 172.21.15.22:0/3539649866 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f514c003530 con 0x7f51600cc2c0 2024-05-21T13:35:51.384 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:51.403+0000 7f516502c640 1 -- 172.21.15.22:0/3539649866 >> v1:172.21.15.115:6789/0 conn(0x7f516015c390 legacy=0x7f5160166600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:35:51.384 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:51.403+0000 7f516502c640 1 -- 172.21.15.22:0/3539649866 >> v1:172.21.15.22:6789/0 conn(0x7f51600cc2c0 legacy=0x7f516015bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:51.384 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:51.403+0000 7f516502c640 1 -- 172.21.15.22:0/3539649866 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51600cdc20 con 0x7f5160155ef0 2024-05-21T13:35:51.386 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:51.407+0000 7f516502c640 1 --2- 172.21.15.22:0/3539649866 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5160155ef0 0x7f51600c6700 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f515c009d90 tx=0x7f515c01f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45cd89605ab723f2 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:35:51.386 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:51.407+0000 7f5157fff640 1 -- 172.21.15.22:0/3539649866 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f515c0b4070 con 0x7f5160155ef0 2024-05-21T13:35:51.387 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:51.407+0000 7f5157fff640 1 -- 172.21.15.22:0/3539649866 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f515c0af600 con 0x7f5160155ef0 2024-05-21T13:35:51.387 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:51.407+0000 7f5157fff640 1 -- 172.21.15.22:0/3539649866 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f515c0af9d0 con 0x7f5160155ef0 2024-05-21T13:35:51.388 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:51.407+0000 7f5167290640 1 -- 172.21.15.22:0/3539649866 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5160155ef0 msgr2=0x7f51600c6700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:51.388 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:51.407+0000 7f5167290640 1 --2- 172.21.15.22:0/3539649866 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5160155ef0 0x7f51600c6700 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f515c009d90 tx=0x7f515c01f150 comp rx=0 tx=0).stop 2024-05-21T13:35:51.388 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:51.407+0000 7f5167290640 1 -- 172.21.15.22:0/3539649866 shutdown_connections 2024-05-21T13:35:51.388 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:51.407+0000 7f5167290640 1 --2- 172.21.15.22:0/3539649866 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5160155ef0 0x7f51600c6700 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:51.388 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:51.407+0000 7f5167290640 1 -- 172.21.15.22:0/3539649866 >> 172.21.15.22:0/3539649866 conn(0x7f5160076540 msgr2=0x7f51600736f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:35:51.388 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:51.407+0000 7f5167290640 1 -- 172.21.15.22:0/3539649866 shutdown_connections 2024-05-21T13:35:51.388 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:51.407+0000 7f5167290640 1 -- 172.21.15.22:0/3539649866 wait complete. 2024-05-21T13:35:51.389 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:51.407+0000 7f5167290640 1 Processor -- start 2024-05-21T13:35:51.389 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:51.407+0000 7f5167290640 1 -- start start 2024-05-21T13:35:51.391 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:51.411+0000 7f5167290640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5160155ef0 0x7f516014c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:51.391 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:51.411+0000 7f5167290640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f516015c390 0x7f51601f2240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:51.391 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:51.411+0000 7f5167290640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51601f2780 0x7f5160152a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:51.392 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:51.411+0000 7f5167290640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f51600c6c40 con 0x7f51601f2780 2024-05-21T13:35:51.392 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:51.411+0000 7f5167290640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f51600ce270 con 0x7f516015c390 2024-05-21T13:35:51.392 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:51.411+0000 7f5167290640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f51600ce700 con 0x7f5160155ef0 2024-05-21T13:35:51.392 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:51.411+0000 7f516582d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51601f2780 0x7f5160152a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:51.392 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:51.411+0000 7f516582d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51601f2780 0x7f5160152a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36206/0 (socket says 172.21.15.22:36206) 2024-05-21T13:35:51.392 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:51.411+0000 7f516582d640 1 -- 172.21.15.22:0/407421076 learned_addr learned my addr 172.21.15.22:0/407421076 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:35:51.392 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:51.411+0000 7f516482b640 1 --2- 172.21.15.22:0/407421076 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f516015c390 0x7f51601f2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:51.392 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:51.411+0000 7f516502c640 1 --2- 172.21.15.22:0/407421076 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5160155ef0 0x7f516014c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:51.392 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:51.411+0000 7f516582d640 1 -- 172.21.15.22:0/407421076 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5160155ef0 msgr2=0x7f516014c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:51.392 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:51.411+0000 7f516582d640 1 --2- 172.21.15.22:0/407421076 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5160155ef0 0x7f516014c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:51.393 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:51.411+0000 7f516582d640 1 -- 172.21.15.22:0/407421076 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f516015c390 msgr2=0x7f51601f2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:51.393 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:51.411+0000 7f516582d640 1 --2- 172.21.15.22:0/407421076 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f516015c390 0x7f51601f2240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:51.393 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:51.411+0000 7f516582d640 1 -- 172.21.15.22:0/407421076 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51601f1a60 con 0x7f51601f2780 2024-05-21T13:35:51.393 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:51.411+0000 7f516582d640 1 --2- 172.21.15.22:0/407421076 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51601f2780 0x7f5160152a80 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f515800b440 tx=0x7f515800b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:35:51.393 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:51.411+0000 7f5155ffb640 1 -- 172.21.15.22:0/407421076 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5158015020 con 0x7f51601f2780 2024-05-21T13:35:51.393 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:51.411+0000 7f5155ffb640 1 -- 172.21.15.22:0/407421076 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5158011850 con 0x7f51601f2780 2024-05-21T13:35:51.393 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:51.411+0000 7f5155ffb640 1 -- 172.21.15.22:0/407421076 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5158011c40 con 0x7f51601f2780 2024-05-21T13:35:51.393 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:51.411+0000 7f5167290640 1 -- 172.21.15.22:0/407421076 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5160156fe0 con 0x7f51601f2780 2024-05-21T13:35:51.393 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:51.411+0000 7f5167290640 1 -- 172.21.15.22:0/407421076 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51601f5a80 con 0x7f51601f2780 2024-05-21T13:35:51.393 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:51.411+0000 7f5167290640 1 -- 172.21.15.22:0/407421076 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51600507f0 con 0x7f51601f2780 2024-05-21T13:35:51.394 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:51.411+0000 7f5155ffb640 1 -- 172.21.15.22:0/407421076 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f5158018020 con 0x7f51601f2780 2024-05-21T13:35:51.395 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:51.411+0000 7f5155ffb640 1 --2- 172.21.15.22:0/407421076 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f514406f400 0x7f51440718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:51.395 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:51.411+0000 7f5155ffb640 1 -- 172.21.15.22:0/407421076 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f515808ee30 con 0x7f51601f2780 2024-05-21T13:35:51.395 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:51.411+0000 7f516502c640 1 --2- 172.21.15.22:0/407421076 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f514406f400 0x7f51440718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:51.395 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:51.415+0000 7f516502c640 1 --2- 172.21.15.22:0/407421076 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f514406f400 0x7f51440718c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f515c0b1000 tx=0x7f515c0aa000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:35:51.397 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:51.419+0000 7f5155ffb640 1 -- 172.21.15.22:0/407421076 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f515801f020 con 0x7f51601f2780 2024-05-21T13:35:51.564 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:51.583+0000 7f5167290640 1 -- 172.21.15.22:0/407421076 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f51600cce20 con 0x7f51601f2780 2024-05-21T13:35:51.567 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:51.587+0000 7f5155ffb640 1 -- 172.21.15.22:0/407421076 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) ==== 74+0+12824 (secure 0 0 0) 0x7f515805c060 con 0x7f51601f2780 2024-05-21T13:35:51.567 INFO:teuthology.misc.health.smithi022.stdout: 2024-05-21T13:35:51.567 INFO:teuthology.misc.health.smithi022.stdout:{"epoch":17,"fsid":"f2c96204-e240-4e7f-8a76-927b4f80f534","created":"2024-05-21T13:35:33.827005+0000","modified":"2024-05-21T13:35:46.550661+0000","last_up_change":"2024-05-21T13:35:44.542324+0000","last_in_change":"2024-05-21T13:35:36.061492+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-21T13:35:44.536105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"09157d4a-9443-4e10-bbb3-cf8ed7c42cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":222752954},{"type":"v1","addr":"172.21.15.22:6801","nonce":222752954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":222752954},{"type":"v1","addr":"172.21.15.22:6803","nonce":222752954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":222752954},{"type":"v1","addr":"172.21.15.22:6807","nonce":222752954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":222752954},{"type":"v1","addr":"172.21.15.22:6805","nonce":222752954}]},"public_addr":"172.21.15.22:6801/222752954","cluster_addr":"172.21.15.22:6803/222752954","heartbeat_back_addr":"172.21.15.22:6807/222752954","heartbeat_front_addr":"172.21.15.22:6805/222752954","state":["exists","up"]},{"osd":1,"uuid":"2a6a87c0-01ad-4a98-a538-c0a8e865b05d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":685426272},{"type":"v1","addr":"172.21.15.22:6809","nonce":685426272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":685426272},{"type":"v1","addr":"172.21.15.22:6811","nonce":685426272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":685426272},{"type":"v1","addr":"172.21.15.22:6815","nonce":685426272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":685426272},{"type":"v1","addr":"172.21.15.22:6813","nonce":685426272}]},"public_addr":"172.21.15.22:6809/685426272","cluster_addr":"172.21.15.22:6811/685426272","heartbeat_back_addr":"172.21.15.22:6815/685426272","heartbeat_front_addr":"172.21.15.22:6813/685426272","state":["exists","up"]},{"osd":2,"uuid":"4c18f931-40a4-46ac-a752-0d1be35b01a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":2092224336},{"type":"v1","addr":"172.21.15.22:6817","nonce":2092224336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":2092224336},{"type":"v1","addr":"172.21.15.22:6819","nonce":2092224336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":2092224336},{"type":"v1","addr":"172.21.15.22:6823","nonce":2092224336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":2092224336},{"type":"v1","addr":"172.21.15.22:6821","nonce":2092224336}]},"public_addr":"172.21.15.22:6817/2092224336","cluster_addr":"172.21.15.22:6819/2092224336","heartbeat_back_addr":"172.21.15.22:6823/2092224336","heartbeat_front_addr":"172.21.15.22:6821/2092224336","state":["exists","up"]},{"osd":3,"uuid":"d57ee7fd-b73e-41ec-8e3b-e62fb8898128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":1232311110},{"type":"v1","addr":"172.21.15.22:6825","nonce":1232311110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":1232311110},{"type":"v1","addr":"172.21.15.22:6827","nonce":1232311110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":1232311110},{"type":"v1","addr":"172.21.15.22:6831","nonce":1232311110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":1232311110},{"type":"v1","addr":"172.21.15.22:6829","nonce":1232311110}]},"public_addr":"172.21.15.22:6825/1232311110","cluster_addr":"172.21.15.22:6827/1232311110","heartbeat_back_addr":"172.21.15.22:6831/1232311110","heartbeat_front_addr":"172.21.15.22:6829/1232311110","state":["exists","up"]},{"osd":4,"uuid":"43c6494f-352b-42a7-b6a9-fe7e3573fab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":832695158},{"type":"v1","addr":"172.21.15.115:6801","nonce":832695158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":832695158},{"type":"v1","addr":"172.21.15.115:6803","nonce":832695158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":832695158},{"type":"v1","addr":"172.21.15.115:6807","nonce":832695158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":832695158},{"type":"v1","addr":"172.21.15.115:6805","nonce":832695158}]},"public_addr":"172.21.15.115:6801/832695158","cluster_addr":"172.21.15.115:6803/832695158","heartbeat_back_addr":"172.21.15.115:6807/832695158","heartbeat_front_addr":"172.21.15.115:6805/832695158","state":["exists","up"]},{"osd":5,"uuid":"25fc861c-593d-4d49-942a-c75c19f25994","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":1504764223},{"type":"v1","addr":"172.21.15.115:6815","nonce":1504764223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":1504764223},{"type":"v1","addr":"172.21.15.115:6823","nonce":1504764223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":1504764223},{"type":"v1","addr":"172.21.15.115:6830","nonce":1504764223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6825","nonce":1504764223},{"type":"v1","addr":"172.21.15.115:6827","nonce":1504764223}]},"public_addr":"172.21.15.115:6815/1504764223","cluster_addr":"172.21.15.115:6823/1504764223","heartbeat_back_addr":"172.21.15.115:6830/1504764223","heartbeat_front_addr":"172.21.15.115:6827/1504764223","state":["exists","up"]},{"osd":6,"uuid":"2e7fb0b8-1162-497f-bffc-e2c02b9b9ef4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":959292720},{"type":"v1","addr":"172.21.15.115:6809","nonce":959292720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":959292720},{"type":"v1","addr":"172.21.15.115:6813","nonce":959292720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":959292720},{"type":"v1","addr":"172.21.15.115:6822","nonce":959292720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":959292720},{"type":"v1","addr":"172.21.15.115:6818","nonce":959292720}]},"public_addr":"172.21.15.115:6809/959292720","cluster_addr":"172.21.15.115:6813/959292720","heartbeat_back_addr":"172.21.15.115:6822/959292720","heartbeat_front_addr":"172.21.15.115:6818/959292720","state":["exists","up"]},{"osd":7,"uuid":"a97df0dc-e370-45ce-8742-25ae31e2212e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6811","nonce":20268513},{"type":"v1","addr":"172.21.15.115:6814","nonce":20268513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":20268513},{"type":"v1","addr":"172.21.15.115:6821","nonce":20268513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6829","nonce":20268513},{"type":"v1","addr":"172.21.15.115:6831","nonce":20268513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":20268513},{"type":"v1","addr":"172.21.15.115:6826","nonce":20268513}]},"public_addr":"172.21.15.115:6814/20268513","cluster_addr":"172.21.15.115:6821/20268513","heartbeat_back_addr":"172.21.15.115:6831/20268513","heartbeat_front_addr":"172.21.15.115:6826/20268513","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.692890+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.545577+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.712724+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.681944+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.492954+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.553222+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.597022+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.601698+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-21T13:35:51.569 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:51.587+0000 7f5167290640 1 -- 172.21.15.22:0/407421076 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f514406f400 msgr2=0x7f51440718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:51.569 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:51.587+0000 7f5167290640 1 --2- 172.21.15.22:0/407421076 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f514406f400 0x7f51440718c0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f515c0b1000 tx=0x7f515c0aa000 comp rx=0 tx=0).stop 2024-05-21T13:35:51.569 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:51.587+0000 7f5167290640 1 -- 172.21.15.22:0/407421076 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51601f2780 msgr2=0x7f5160152a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:51.569 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:51.587+0000 7f5167290640 1 --2- 172.21.15.22:0/407421076 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51601f2780 0x7f5160152a80 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f515800b440 tx=0x7f515800b900 comp rx=0 tx=0).stop 2024-05-21T13:35:51.569 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:51.587+0000 7f5167290640 1 -- 172.21.15.22:0/407421076 shutdown_connections 2024-05-21T13:35:51.569 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:51.587+0000 7f5167290640 1 --2- 172.21.15.22:0/407421076 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f514406f400 0x7f51440718c0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:51.569 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:51.587+0000 7f5167290640 1 --2- 172.21.15.22:0/407421076 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f51601f2780 0x7f5160152a80 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:51.569 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:51.587+0000 7f5167290640 1 --2- 172.21.15.22:0/407421076 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f516015c390 0x7f51601f2240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:51.569 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:51.587+0000 7f5167290640 1 --2- 172.21.15.22:0/407421076 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5160155ef0 0x7f516014c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:51.569 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:51.587+0000 7f5167290640 1 -- 172.21.15.22:0/407421076 >> 172.21.15.22:0/407421076 conn(0x7f51600cc2c0 msgr2=0x7f5160155150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:35:51.569 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:51.587+0000 7f5167290640 1 -- 172.21.15.22:0/407421076 shutdown_connections 2024-05-21T13:35:51.570 INFO:teuthology.misc.health.smithi022.stderr:2024-05-21T13:35:51.587+0000 7f5167290640 1 -- 172.21.15.22:0/407421076 wait complete. 2024-05-21T13:35:51.585 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-05-21T13:35:51.585 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-05-21T13:35:51.586 INFO:tasks.ceph.mds.a:Restarting daemon 2024-05-21T13:35:51.586 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-05-21T13:35:51.588 INFO:tasks.ceph.mds.a:Started 2024-05-21T13:35:51.588 INFO:tasks.ceph.mds.c:Restarting daemon 2024-05-21T13:35:51.588 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-05-21T13:35:51.590 INFO:tasks.ceph.mds.c:Started 2024-05-21T13:35:51.590 INFO:tasks.ceph.mds.e:Restarting daemon 2024-05-21T13:35:51.590 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i e 2024-05-21T13:35:51.592 INFO:tasks.ceph.mds.e:Started 2024-05-21T13:35:51.592 INFO:tasks.ceph.mds.b:Restarting daemon 2024-05-21T13:35:51.592 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-05-21T13:35:51.595 INFO:tasks.ceph.mds.b:Started 2024-05-21T13:35:51.595 INFO:tasks.ceph.mds.d:Restarting daemon 2024-05-21T13:35:51.596 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-05-21T13:35:51.598 INFO:tasks.ceph.mds.d:Started 2024-05-21T13:35:51.598 INFO:tasks.ceph.mds.f:Restarting daemon 2024-05-21T13:35:51.598 DEBUG:teuthology.orchestra.run.smithi115:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i f 2024-05-21T13:35:51.601 INFO:tasks.ceph.mds.f:Started 2024-05-21T13:35:51.601 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-05-21T13:35:51.601 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-21T13:35:51.658 INFO:tasks.ceph.mds.a.smithi022.stdout:starting mds.a at 2024-05-21T13:35:51.663 INFO:tasks.ceph.mds.e.smithi022.stdout:starting mds.e at 2024-05-21T13:35:51.665 INFO:tasks.ceph.mds.c.smithi022.stdout:starting mds.c at 2024-05-21T13:35:51.679 INFO:tasks.ceph.mds.b.smithi115.stdout:starting mds.b at 2024-05-21T13:35:51.680 INFO:tasks.ceph.mds.d.smithi115.stdout:starting mds.d at 2024-05-21T13:35:51.680 INFO:tasks.ceph.mds.f.smithi115.stdout:starting mds.f at 2024-05-21T13:35:51.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:51.751+0000 7f8fd0a20640 1 Processor -- start 2024-05-21T13:35:51.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:51.751+0000 7f8fd0a20640 1 -- start start 2024-05-21T13:35:51.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:51.751+0000 7f8fd0a20640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8fcc071110 0x7f8fcc0c8f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:51.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:51.751+0000 7f8fd0a20640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8fcc0714f0 0x7f8fcc15bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:51.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:51.751+0000 7f8fd0a20640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8fcc15c0b0 0x7f8fcc155920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:51.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:51.751+0000 7f8fd0a20640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f8fcc0c8420 con 0x7f8fcc15c0b0 2024-05-21T13:35:51.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:51.751+0000 7f8fd0a20640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f8fcc15f200 con 0x7f8fcc0714f0 2024-05-21T13:35:51.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:51.751+0000 7f8fd0a20640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f8fcc15f4e0 con 0x7f8fcc071110 2024-05-21T13:35:51.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:51.751+0000 7f8fcad9d640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8fcc15c0b0 0x7f8fcc155920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:51.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:51.751+0000 7f8fcad9d640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8fcc15c0b0 0x7f8fcc155920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36282/0 (socket says 172.21.15.22:36282) 2024-05-21T13:35:51.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:51.751+0000 7f8fcad9d640 1 -- 172.21.15.22:0/656284526 learned_addr learned my addr 172.21.15.22:0/656284526 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:35:51.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:51.751+0000 7f8fc3fff640 1 --2- 172.21.15.22:0/656284526 >> v2:172.21.15.115:3300/0 conn(0x7f8fcc0714f0 0x7f8fcc15bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:51.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:51.751+0000 7f8fca59c640 1 --2- 172.21.15.22:0/656284526 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8fcc071110 0x7f8fcc0c8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:51.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:51.751+0000 7f8fcad9d640 1 -- 172.21.15.22:0/656284526 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8fcc071110 msgr2=0x7f8fcc0c8f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:35:51.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:51.751+0000 7f8fcad9d640 1 --2- 172.21.15.22:0/656284526 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8fcc071110 0x7f8fcc0c8f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:51.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:51.751+0000 7f8fcad9d640 1 -- 172.21.15.22:0/656284526 >> v2:172.21.15.115:3300/0 conn(0x7f8fcc0714f0 msgr2=0x7f8fcc15bb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:35:51.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:51.751+0000 7f8fcad9d640 1 --2- 172.21.15.22:0/656284526 >> v2:172.21.15.115:3300/0 conn(0x7f8fcc0714f0 0x7f8fcc15bb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:51.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:51.751+0000 7f8fcad9d640 1 -- 172.21.15.22:0/656284526 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fcc15f7c0 con 0x7f8fcc15c0b0 2024-05-21T13:35:51.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:51.751+0000 7f8fc3fff640 1 --2- 172.21.15.22:0/656284526 >> v2:172.21.15.115:3300/0 conn(0x7f8fcc0714f0 0x7f8fcc15bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:35:51.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:51.755+0000 7f8fcad9d640 1 --2- 172.21.15.22:0/656284526 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fcc15c0b0 0x7f8fcc155920 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc0cf060 tx=0x7f8fc401f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=171758579ef4a93 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:35:51.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:51.755+0000 7f8fc9d9b640 1 -- 172.21.15.22:0/656284526 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fc40b4070 con 0x7f8fcc15c0b0 2024-05-21T13:35:51.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:51.755+0000 7f8fc9d9b640 1 -- 172.21.15.22:0/656284526 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fc40af400 con 0x7f8fcc15c0b0 2024-05-21T13:35:51.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:51.755+0000 7f8fc9d9b640 1 -- 172.21.15.22:0/656284526 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fc40af7d0 con 0x7f8fcc15c0b0 2024-05-21T13:35:51.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:51.755+0000 7f8fd0a20640 1 -- 172.21.15.22:0/656284526 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fcc15c0b0 msgr2=0x7f8fcc155920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:51.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:51.755+0000 7f8fd0a20640 1 --2- 172.21.15.22:0/656284526 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fcc15c0b0 0x7f8fcc155920 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc0cf060 tx=0x7f8fc401f1e0 comp rx=0 tx=0).stop 2024-05-21T13:35:51.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:51.755+0000 7f8fd0a20640 1 -- 172.21.15.22:0/656284526 shutdown_connections 2024-05-21T13:35:51.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:51.755+0000 7f8fd0a20640 1 --2- 172.21.15.22:0/656284526 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fcc15c0b0 0x7f8fcc155920 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:51.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:51.755+0000 7f8fd0a20640 1 --2- 172.21.15.22:0/656284526 >> v2:172.21.15.115:3300/0 conn(0x7f8fcc0714f0 0x7f8fcc15bb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:51.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:51.755+0000 7f8fd0a20640 1 --2- 172.21.15.22:0/656284526 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8fcc071110 0x7f8fcc0c8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:51.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:51.755+0000 7f8fd0a20640 1 -- 172.21.15.22:0/656284526 >> 172.21.15.22:0/656284526 conn(0x7f8fcc0ce290 msgr2=0x7f8fcc0ce6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:35:51.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:51.755+0000 7f8fd0a20640 1 -- 172.21.15.22:0/656284526 shutdown_connections 2024-05-21T13:35:51.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:51.755+0000 7f8fd0a20640 1 -- 172.21.15.22:0/656284526 wait complete. 2024-05-21T13:35:51.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:51.755+0000 7f8fd0a20640 1 Processor -- start 2024-05-21T13:35:51.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:51.755+0000 7f8fd0a20640 1 -- start start 2024-05-21T13:35:51.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:51.759+0000 7f8fd0a20640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fcc071110 0x7f8fcc151e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:51.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:51.759+0000 7f8fd0a20640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8fcc0714f0 0x7f8fcc0ccfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:51.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:51.759+0000 7f8fd0a20640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fcc15c0b0 0x7f8fcc1f4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:51.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:51.759+0000 7f8fd0a20640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8fcc15ffc0 con 0x7f8fcc15c0b0 2024-05-21T13:35:51.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:51.759+0000 7f8fd0a20640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f8fcc0c9480 con 0x7f8fcc071110 2024-05-21T13:35:51.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:51.759+0000 7f8fd0a20640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f8fcc0c86e0 con 0x7f8fcc0714f0 2024-05-21T13:35:51.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:51.759+0000 7f8fcad9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fcc15c0b0 0x7f8fcc1f4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:51.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:51.759+0000 7f8fcad9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fcc15c0b0 0x7f8fcc1f4a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36286/0 (socket says 172.21.15.22:36286) 2024-05-21T13:35:51.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:51.759+0000 7f8fcad9d640 1 -- 172.21.15.22:0/2547372450 learned_addr learned my addr 172.21.15.22:0/2547372450 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:35:51.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:51.759+0000 7f8fc3fff640 1 --2- 172.21.15.22:0/2547372450 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8fcc0714f0 0x7f8fcc0ccfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:51.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:51.759+0000 7f8fca59c640 1 --2- 172.21.15.22:0/2547372450 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fcc071110 0x7f8fcc151e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:51.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:51.759+0000 7f8fcad9d640 1 -- 172.21.15.22:0/2547372450 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8fcc0714f0 msgr2=0x7f8fcc0ccfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:51.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:51.759+0000 7f8fcad9d640 1 --2- 172.21.15.22:0/2547372450 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8fcc0714f0 0x7f8fcc0ccfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:51.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:51.759+0000 7f8fcad9d640 1 -- 172.21.15.22:0/2547372450 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fcc071110 msgr2=0x7f8fcc151e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:51.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:51.759+0000 7f8fcad9d640 1 --2- 172.21.15.22:0/2547372450 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fcc071110 0x7f8fcc151e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:51.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:51.759+0000 7f8fcad9d640 1 -- 172.21.15.22:0/2547372450 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fcc0c9a30 con 0x7f8fcc15c0b0 2024-05-21T13:35:51.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:51.759+0000 7f8fc3fff640 1 --2- 172.21.15.22:0/2547372450 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8fcc0714f0 0x7f8fcc0ccfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T13:35:51.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:51.759+0000 7f8fca59c640 1 --2- 172.21.15.22:0/2547372450 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fcc071110 0x7f8fcc151e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T13:35:51.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:51.759+0000 7f8fcad9d640 1 --2- 172.21.15.22:0/2547372450 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fcc15c0b0 0x7f8fcc1f4a10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8fc401fa80 tx=0x7f8fc401bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:35:51.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:51.759+0000 7f8fc2ffd640 1 -- 172.21.15.22:0/2547372450 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fc40b4040 con 0x7f8fcc15c0b0 2024-05-21T13:35:51.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:51.759+0000 7f8fc2ffd640 1 -- 172.21.15.22:0/2547372450 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fc40afd90 con 0x7f8fcc15c0b0 2024-05-21T13:35:51.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:51.759+0000 7f8fc2ffd640 1 -- 172.21.15.22:0/2547372450 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fc40b9460 con 0x7f8fcc15c0b0 2024-05-21T13:35:51.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:51.759+0000 7f8fd0a20640 1 -- 172.21.15.22:0/2547372450 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fcc0c9e90 con 0x7f8fcc15c0b0 2024-05-21T13:35:51.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:51.759+0000 7f8fd0a20640 1 -- 172.21.15.22:0/2547372450 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fcc1e8c40 con 0x7f8fcc15c0b0 2024-05-21T13:35:51.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:51.759+0000 7f8fd0a20640 1 -- 172.21.15.22:0/2547372450 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fcc0697d0 con 0x7f8fcc15c0b0 2024-05-21T13:35:51.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:51.759+0000 7f8fc2ffd640 1 -- 172.21.15.22:0/2547372450 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f8fc40c3020 con 0x7f8fcc15c0b0 2024-05-21T13:35:51.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:51.759+0000 7f8fc2ffd640 1 --2- 172.21.15.22:0/2547372450 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f8fac06f400 0x7f8fac0718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:51.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:51.759+0000 7f8fc2ffd640 1 -- 172.21.15.22:0/2547372450 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f8fc412cba0 con 0x7f8fcc15c0b0 2024-05-21T13:35:51.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:51.763+0000 7f8fca59c640 1 --2- 172.21.15.22:0/2547372450 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f8fac06f400 0x7f8fac0718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:51.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:51.763+0000 7f8fca59c640 1 --2- 172.21.15.22:0/2547372450 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f8fac06f400 0x7f8fac0718c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc00aa70 tx=0x7f8fbc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:35:51.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:51.767+0000 7f8fc2ffd640 1 -- 172.21.15.22:0/2547372450 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f8fc40ca020 con 0x7f8fcc15c0b0 2024-05-21T13:35:51.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:51.963+0000 7f8fd0a20640 1 -- 172.21.15.22:0/2547372450 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8fcc071920 con 0x7f8fcc15c0b0 2024-05-21T13:35:51.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:51.963+0000 7f8fc2ffd640 1 -- 172.21.15.22:0/2547372450 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1392 (secure 0 0 0) 0x7f8fc4018d40 con 0x7f8fcc15c0b0 2024-05-21T13:35:51.943 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-21T13:35:51.943 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4233,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3840772609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3840772609},{"type":"v1","addr":"172.21.15.22:6837","nonce":3840772609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-05-21T13:35:51.943 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 2 2024-05-21T13:35:51.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:51.967+0000 7f8fd0a20640 1 -- 172.21.15.22:0/2547372450 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f8fac06f400 msgr2=0x7f8fac0718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:51.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:51.967+0000 7f8fd0a20640 1 --2- 172.21.15.22:0/2547372450 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f8fac06f400 0x7f8fac0718c0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8fbc00aa70 tx=0x7f8fbc008040 comp rx=0 tx=0).stop 2024-05-21T13:35:51.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:51.967+0000 7f8fd0a20640 1 -- 172.21.15.22:0/2547372450 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fcc15c0b0 msgr2=0x7f8fcc1f4a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:51.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:51.967+0000 7f8fd0a20640 1 --2- 172.21.15.22:0/2547372450 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fcc15c0b0 0x7f8fcc1f4a10 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f8fc401fa80 tx=0x7f8fc401bf80 comp rx=0 tx=0).stop 2024-05-21T13:35:51.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:51.967+0000 7f8fd0a20640 1 -- 172.21.15.22:0/2547372450 shutdown_connections 2024-05-21T13:35:51.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:51.967+0000 7f8fd0a20640 1 --2- 172.21.15.22:0/2547372450 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f8fac06f400 0x7f8fac0718c0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:51.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:51.967+0000 7f8fd0a20640 1 --2- 172.21.15.22:0/2547372450 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8fcc15c0b0 0x7f8fcc1f4a10 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:51.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:51.967+0000 7f8fd0a20640 1 --2- 172.21.15.22:0/2547372450 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8fcc0714f0 0x7f8fcc0ccfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:51.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:51.967+0000 7f8fd0a20640 1 --2- 172.21.15.22:0/2547372450 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8fcc071110 0x7f8fcc151e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:51.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:51.967+0000 7f8fd0a20640 1 -- 172.21.15.22:0/2547372450 >> 172.21.15.22:0/2547372450 conn(0x7f8fcc0ce290 msgr2=0x7f8fcc15c4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:35:51.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:51.967+0000 7f8fd0a20640 1 -- 172.21.15.22:0/2547372450 shutdown_connections 2024-05-21T13:35:51.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:51.967+0000 7f8fd0a20640 1 -- 172.21.15.22:0/2547372450 wait complete. 2024-05-21T13:35:53.963 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-21T13:35:54.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.119+0000 7f08c20b6640 1 Processor -- start 2024-05-21T13:35:54.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.119+0000 7f08c20b6640 1 -- start start 2024-05-21T13:35:54.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.119+0000 7f08c20b6640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f08bc0c4bf0 0x7f08bc0c7df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:54.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.119+0000 7f08c20b6640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f08bc0c8330 0x7f08bc0c9e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:54.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.119+0000 7f08c20b6640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08bc1530a0 con 0x7f08bc152cc0 2024-05-21T13:35:54.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.119+0000 7f08c20b6640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f08bc1592b0 con 0x7f08bc0c4bf0 2024-05-21T13:35:54.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.119+0000 7f08c20b6640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f08bc074840 con 0x7f08bc0c8330 2024-05-21T13:35:54.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.119+0000 7f08baffd640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f08bc0c4bf0 0x7f08bc0c7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:54.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.119+0000 7f08baffd640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f08bc0c4bf0 0x7f08bc0c7df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36290/0 (socket says 172.21.15.22:36290) 2024-05-21T13:35:54.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.119+0000 7f08baffd640 1 -- 172.21.15.22:0/1628214014 learned_addr learned my addr 172.21.15.22:0/1628214014 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:35:54.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.119+0000 7f08bbfff640 1 --2- 172.21.15.22:0/1628214014 >> v2:172.21.15.115:3300/0 conn(0x7f08bc0c8330 0x7f08bc0c9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:54.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.119+0000 7f08baffd640 1 -- 172.21.15.22:0/1628214014 >> v2:172.21.15.115:3300/0 conn(0x7f08bc0c8330 msgr2=0x7f08bc0c9e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:35:54.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.119+0000 7f08baffd640 1 --2- 172.21.15.22:0/1628214014 >> v2:172.21.15.115:3300/0 conn(0x7f08bc0c8330 0x7f08bc0c9e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:54.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.119+0000 7f08baffd640 1 -- 172.21.15.22:0/1628214014 >> v1:172.21.15.115:6789/0 conn(0x7f08bc152cc0 legacy=0x7f08bc0c66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:54.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.119+0000 7f08baffd640 1 -- 172.21.15.22:0/1628214014 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08bc0c5060 con 0x7f08bc0c4bf0 2024-05-21T13:35:54.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.123+0000 7f08baffd640 1 --2- 172.21.15.22:0/1628214014 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f08bc0c4bf0 0x7f08bc0c7df0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f08bc0caea0 tx=0x7f08a401ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31bb476535ac0881 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:35:54.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.123+0000 7f08ba7fc640 1 -- 172.21.15.22:0/1628214014 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08a40b4070 con 0x7f08bc0c4bf0 2024-05-21T13:35:54.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.123+0000 7f08ba7fc640 1 -- 172.21.15.22:0/1628214014 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08a40a7ad0 con 0x7f08bc0c4bf0 2024-05-21T13:35:54.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.123+0000 7f08ba7fc640 1 -- 172.21.15.22:0/1628214014 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08a40af440 con 0x7f08bc0c4bf0 2024-05-21T13:35:54.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.123+0000 7f08c20b6640 1 -- 172.21.15.22:0/1628214014 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f08bc0c4bf0 msgr2=0x7f08bc0c7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:54.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.123+0000 7f08c20b6640 1 --2- 172.21.15.22:0/1628214014 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f08bc0c4bf0 0x7f08bc0c7df0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f08bc0caea0 tx=0x7f08a401ebf0 comp rx=0 tx=0).stop 2024-05-21T13:35:54.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.123+0000 7f08c20b6640 1 -- 172.21.15.22:0/1628214014 shutdown_connections 2024-05-21T13:35:54.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.123+0000 7f08c20b6640 1 --2- 172.21.15.22:0/1628214014 >> v2:172.21.15.115:3300/0 conn(0x7f08bc0c8330 0x7f08bc0c9e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:54.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.123+0000 7f08c20b6640 1 --2- 172.21.15.22:0/1628214014 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f08bc0c4bf0 0x7f08bc0c7df0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:54.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.123+0000 7f08c20b6640 1 -- 172.21.15.22:0/1628214014 >> 172.21.15.22:0/1628214014 conn(0x7f08bc06ea10 msgr2=0x7f08bc06ff50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:35:54.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.123+0000 7f08c20b6640 1 -- 172.21.15.22:0/1628214014 shutdown_connections 2024-05-21T13:35:54.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.123+0000 7f08c20b6640 1 -- 172.21.15.22:0/1628214014 wait complete. 2024-05-21T13:35:54.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.123+0000 7f08c20b6640 1 Processor -- start 2024-05-21T13:35:54.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.123+0000 7f08c20b6640 1 -- start start 2024-05-21T13:35:54.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.127+0000 7f08c20b6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f08bc0c4bf0 0x7f08bc1f4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:54.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.127+0000 7f08c20b6640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08bc0c8330 0x7f08bc15ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:54.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.127+0000 7f08c20b6640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08bc152cc0 0x7f08bc152220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:54.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.127+0000 7f08c20b6640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f08bc158f40 con 0x7f08bc0c4bf0 2024-05-21T13:35:54.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.127+0000 7f08c20b6640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f08bc158c60 con 0x7f08bc152cc0 2024-05-21T13:35:54.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.127+0000 7f08c20b6640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f08bc159720 con 0x7f08bc0c8330 2024-05-21T13:35:54.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.127+0000 7f08bb7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f08bc0c4bf0 0x7f08bc1f4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:54.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.127+0000 7f08bb7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f08bc0c4bf0 0x7f08bc1f4560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36296/0 (socket says 172.21.15.22:36296) 2024-05-21T13:35:54.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.127+0000 7f08bb7fe640 1 -- 172.21.15.22:0/1494257128 learned_addr learned my addr 172.21.15.22:0/1494257128 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:35:54.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.127+0000 7f08bbfff640 1 --2- 172.21.15.22:0/1494257128 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08bc152cc0 0x7f08bc152220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:54.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.127+0000 7f08bb7fe640 1 -- 172.21.15.22:0/1494257128 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08bc0c8330 msgr2=0x7f08bc15ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:54.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.127+0000 7f08baffd640 1 --2- 172.21.15.22:0/1494257128 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08bc0c8330 0x7f08bc15ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:54.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.127+0000 7f08bb7fe640 1 --2- 172.21.15.22:0/1494257128 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08bc0c8330 0x7f08bc15ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:54.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.127+0000 7f08bb7fe640 1 -- 172.21.15.22:0/1494257128 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08bc152cc0 msgr2=0x7f08bc152220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:54.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.127+0000 7f08bb7fe640 1 --2- 172.21.15.22:0/1494257128 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08bc152cc0 0x7f08bc152220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:54.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.127+0000 7f08bb7fe640 1 -- 172.21.15.22:0/1494257128 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08bc15b250 con 0x7f08bc0c4bf0 2024-05-21T13:35:54.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.127+0000 7f08bbfff640 1 --2- 172.21.15.22:0/1494257128 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08bc152cc0 0x7f08bc152220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:35:54.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.127+0000 7f08bb7fe640 1 --2- 172.21.15.22:0/1494257128 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f08bc0c4bf0 0x7f08bc1f4560 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f08ac00c760 tx=0x7f08ac00cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:35:54.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.127+0000 7f08b3fff640 1 -- 172.21.15.22:0/1494257128 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08ac003b80 con 0x7f08bc0c4bf0 2024-05-21T13:35:54.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.127+0000 7f08b3fff640 1 -- 172.21.15.22:0/1494257128 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08ac003d40 con 0x7f08bc0c4bf0 2024-05-21T13:35:54.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.127+0000 7f08c20b6640 1 -- 172.21.15.22:0/1494257128 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08bc1f05e0 con 0x7f08bc0c4bf0 2024-05-21T13:35:54.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.127+0000 7f08b3fff640 1 -- 172.21.15.22:0/1494257128 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08ac00aa90 con 0x7f08bc0c4bf0 2024-05-21T13:35:54.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.127+0000 7f08c20b6640 1 -- 172.21.15.22:0/1494257128 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08bc15a860 con 0x7f08bc0c4bf0 2024-05-21T13:35:54.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.127+0000 7f08c20b6640 1 -- 172.21.15.22:0/1494257128 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08bc1f1560 con 0x7f08bc0c4bf0 2024-05-21T13:35:54.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.127+0000 7f08b3fff640 1 -- 172.21.15.22:0/1494257128 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f08ac00ac30 con 0x7f08bc0c4bf0 2024-05-21T13:35:54.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.127+0000 7f08b3fff640 1 --2- 172.21.15.22:0/1494257128 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f089c06f430 0x7f089c0718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:54.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.127+0000 7f08b3fff640 1 -- 172.21.15.22:0/1494257128 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f08ac08ed80 con 0x7f08bc0c4bf0 2024-05-21T13:35:54.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.127+0000 7f08baffd640 1 --2- 172.21.15.22:0/1494257128 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f089c06f430 0x7f089c0718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:54.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.131+0000 7f08baffd640 1 --2- 172.21.15.22:0/1494257128 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f089c06f430 0x7f089c0718f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f08a40b1000 tx=0x7f08a40a9070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:35:54.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.131+0000 7f08b3fff640 1 -- 172.21.15.22:0/1494257128 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f08bc1f1560 con 0x7f08bc0c4bf0 2024-05-21T13:35:54.307 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.327+0000 7f08c20b6640 1 -- 172.21.15.22:0/1494257128 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f08bc077bb0 con 0x7f08bc0c4bf0 2024-05-21T13:35:54.308 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.327+0000 7f08b3fff640 1 -- 172.21.15.22:0/1494257128 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+5518 (secure 0 0 0) 0x7f08ac05c0e0 con 0x7f08bc0c4bf0 2024-05-21T13:35:54.308 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-21T13:35:54.308 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4224,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/355756580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":355756580},{"type":"v1","addr":"172.21.15.22:6833","nonce":355756580}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4230,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3277017116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":3277017116},{"type":"v1","addr":"172.21.15.22:6835","nonce":3277017116}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4233,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3840772609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3840772609},{"type":"v1","addr":"172.21.15.22:6837","nonce":3840772609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4248,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/2009761279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":2009761279},{"type":"v1","addr":"172.21.15.115:6837","nonce":2009761279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/3894678097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3894678097},{"type":"v1","addr":"172.21.15.115:6835","nonce":3894678097}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4300,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6839/1525097577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6838","nonce":1525097577},{"type":"v1","addr":"172.21.15.115:6839","nonce":1525097577}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-05-21T13:35:54.308 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 3 2024-05-21T13:35:54.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.331+0000 7f08c20b6640 1 -- 172.21.15.22:0/1494257128 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f089c06f430 msgr2=0x7f089c0718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:54.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.331+0000 7f08c20b6640 1 --2- 172.21.15.22:0/1494257128 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f089c06f430 0x7f089c0718f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f08a40b1000 tx=0x7f08a40a9070 comp rx=0 tx=0).stop 2024-05-21T13:35:54.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.331+0000 7f08c20b6640 1 -- 172.21.15.22:0/1494257128 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f08bc0c4bf0 msgr2=0x7f08bc1f4560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:54.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.331+0000 7f08c20b6640 1 --2- 172.21.15.22:0/1494257128 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f08bc0c4bf0 0x7f08bc1f4560 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f08ac00c760 tx=0x7f08ac00cc20 comp rx=0 tx=0).stop 2024-05-21T13:35:54.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.331+0000 7f08c20b6640 1 -- 172.21.15.22:0/1494257128 shutdown_connections 2024-05-21T13:35:54.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.331+0000 7f08c20b6640 1 --2- 172.21.15.22:0/1494257128 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f089c06f430 0x7f089c0718f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:54.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.331+0000 7f08c20b6640 1 --2- 172.21.15.22:0/1494257128 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f08bc152cc0 0x7f08bc152220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:54.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.331+0000 7f08c20b6640 1 --2- 172.21.15.22:0/1494257128 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f08bc0c8330 0x7f08bc15ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:54.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.331+0000 7f08c20b6640 1 --2- 172.21.15.22:0/1494257128 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f08bc0c4bf0 0x7f08bc1f4560 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:54.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.331+0000 7f08c20b6640 1 -- 172.21.15.22:0/1494257128 >> 172.21.15.22:0/1494257128 conn(0x7f08bc06ea10 msgr2=0x7f08bc0c7580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:35:54.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.331+0000 7f08c20b6640 1 -- 172.21.15.22:0/1494257128 shutdown_connections 2024-05-21T13:35:54.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.331+0000 7f08c20b6640 1 -- 172.21.15.22:0/1494257128 wait complete. 2024-05-21T13:35:54.325 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-05-21T13:35:54.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.459+0000 7efcd48a5640 1 Processor -- start 2024-05-21T13:35:54.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.459+0000 7efcd48a5640 1 -- start start 2024-05-21T13:35:54.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.459+0000 7efcd48a5640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7efcd0073ca0 0x7efcd015c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:54.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.459+0000 7efcd48a5640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcd00ca680 con 0x7efcd01560d0 2024-05-21T13:35:54.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.459+0000 7efcd48a5640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efcd00c9b00 con 0x7efcd0073830 2024-05-21T13:35:54.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.459+0000 7efcd48a5640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7efcd00c9de0 con 0x7efcd0073ca0 2024-05-21T13:35:54.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.459+0000 7efcced9d640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7efcd0073ca0 0x7efcd015c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:54.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.459+0000 7efcce59c640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7efcd01560d0 0x7efcd0074610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:40756/0 (socket says 172.21.15.22:40756) 2024-05-21T13:35:54.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.459+0000 7efcce59c640 1 -- 172.21.15.22:0/1621026644 learned_addr learned my addr 172.21.15.22:0/1621026644 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-21T13:35:54.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.459+0000 7efcced9d640 1 -- 172.21.15.22:0/1621026644 >> v1:172.21.15.115:6789/0 conn(0x7efcd0073830 legacy=0x7efcd00ce4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:35:54.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.459+0000 7efcced9d640 1 -- 172.21.15.22:0/1621026644 >> v1:172.21.15.22:6789/0 conn(0x7efcd01560d0 legacy=0x7efcd0074610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:54.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.459+0000 7efcced9d640 1 -- 172.21.15.22:0/1621026644 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcd00ca0c0 con 0x7efcd0073ca0 2024-05-21T13:35:54.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.463+0000 7efcced9d640 1 --2- 172.21.15.22:0/1621026644 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efcd0073ca0 0x7efcd015c1b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7efcc8009d90 tx=0x7efcc801c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e254028a699955e server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:35:54.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.463+0000 7efccd59a640 1 -- 172.21.15.22:0/1621026644 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcc80b2070 con 0x7efcd0073ca0 2024-05-21T13:35:54.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.463+0000 7efccd59a640 1 -- 172.21.15.22:0/1621026644 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcc80a59e0 con 0x7efcd0073ca0 2024-05-21T13:35:54.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.463+0000 7efccd59a640 1 -- 172.21.15.22:0/1621026644 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcc80a5db0 con 0x7efcd0073ca0 2024-05-21T13:35:54.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.463+0000 7efcd48a5640 1 -- 172.21.15.22:0/1621026644 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efcd0073ca0 msgr2=0x7efcd015c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:54.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.463+0000 7efcd48a5640 1 --2- 172.21.15.22:0/1621026644 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efcd0073ca0 0x7efcd015c1b0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7efcc8009d90 tx=0x7efcc801c940 comp rx=0 tx=0).stop 2024-05-21T13:35:54.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.463+0000 7efcd48a5640 1 -- 172.21.15.22:0/1621026644 shutdown_connections 2024-05-21T13:35:54.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.463+0000 7efcd48a5640 1 --2- 172.21.15.22:0/1621026644 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efcd0073ca0 0x7efcd015c1b0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:54.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.463+0000 7efcd48a5640 1 -- 172.21.15.22:0/1621026644 >> 172.21.15.22:0/1621026644 conn(0x7efcd006fd30 msgr2=0x7efcd006d600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:35:54.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.463+0000 7efcd48a5640 1 -- 172.21.15.22:0/1621026644 shutdown_connections 2024-05-21T13:35:54.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.463+0000 7efcd48a5640 1 -- 172.21.15.22:0/1621026644 wait complete. 2024-05-21T13:35:54.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.463+0000 7efcd48a5640 1 Processor -- start 2024-05-21T13:35:54.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.463+0000 7efcd48a5640 1 -- start start 2024-05-21T13:35:54.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.463+0000 7efcd48a5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efcd0073830 0x7efcd014e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:54.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.463+0000 7efcd48a5640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efcd0073ca0 0x7efcd0159d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:54.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.463+0000 7efcd48a5640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efcd01560d0 0x7efcd0144df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:54.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.463+0000 7efcd48a5640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7efcd00ced70 con 0x7efcd0073830 2024-05-21T13:35:54.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.463+0000 7efcd48a5640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7efcd00cebf0 con 0x7efcd01560d0 2024-05-21T13:35:54.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.463+0000 7efcd48a5640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7efcd016a420 con 0x7efcd0073ca0 2024-05-21T13:35:54.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.463+0000 7efcce59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efcd0073830 0x7efcd014e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:54.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.463+0000 7efcce59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efcd0073830 0x7efcd014e920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36304/0 (socket says 172.21.15.22:36304) 2024-05-21T13:35:54.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.463+0000 7efcce59c640 1 -- 172.21.15.22:0/627652763 learned_addr learned my addr 172.21.15.22:0/627652763 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:35:54.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.463+0000 7efcce59c640 1 -- 172.21.15.22:0/627652763 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efcd0073ca0 msgr2=0x7efcd0159d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:54.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.463+0000 7efcced9d640 1 --2- 172.21.15.22:0/627652763 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efcd01560d0 0x7efcd0144df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:54.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.463+0000 7efccdd9b640 1 --2- 172.21.15.22:0/627652763 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efcd0073ca0 0x7efcd0159d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:54.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.463+0000 7efcce59c640 1 --2- 172.21.15.22:0/627652763 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efcd0073ca0 0x7efcd0159d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:54.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.463+0000 7efcce59c640 1 -- 172.21.15.22:0/627652763 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efcd01560d0 msgr2=0x7efcd0144df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:54.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.463+0000 7efcce59c640 1 --2- 172.21.15.22:0/627652763 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efcd01560d0 0x7efcd0144df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:54.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.463+0000 7efcce59c640 1 -- 172.21.15.22:0/627652763 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcd015a7e0 con 0x7efcd0073830 2024-05-21T13:35:54.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.463+0000 7efccdd9b640 1 --2- 172.21.15.22:0/627652763 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efcd0073ca0 0x7efcd0159d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:35:54.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.463+0000 7efcce59c640 1 --2- 172.21.15.22:0/627652763 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efcd0073830 0x7efcd014e920 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7efcc000c430 tx=0x7efcc000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:35:54.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.463+0000 7efcbeffd640 1 -- 172.21.15.22:0/627652763 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcc0017070 con 0x7efcd0073830 2024-05-21T13:35:54.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.463+0000 7efcbeffd640 1 -- 172.21.15.22:0/627652763 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcc0005d10 con 0x7efcd0073830 2024-05-21T13:35:54.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.463+0000 7efcd48a5640 1 -- 172.21.15.22:0/627652763 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcd015aaa0 con 0x7efcd0073830 2024-05-21T13:35:54.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.463+0000 7efcbeffd640 1 -- 172.21.15.22:0/627652763 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcc0007310 con 0x7efcd0073830 2024-05-21T13:35:54.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.463+0000 7efcd48a5640 1 -- 172.21.15.22:0/627652763 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcd014f9d0 con 0x7efcd0073830 2024-05-21T13:35:54.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.467+0000 7efcd48a5640 1 -- 172.21.15.22:0/627652763 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcd00697d0 con 0x7efcd0073830 2024-05-21T13:35:54.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.467+0000 7efcbeffd640 1 -- 172.21.15.22:0/627652763 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7efcc001a070 con 0x7efcd0073830 2024-05-21T13:35:54.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.467+0000 7efcbeffd640 1 --2- 172.21.15.22:0/627652763 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7efcb006f400 0x7efcb00718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:54.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.467+0000 7efcbeffd640 1 -- 172.21.15.22:0/627652763 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7efcc008e330 con 0x7efcd0073830 2024-05-21T13:35:54.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.467+0000 7efccdd9b640 1 --2- 172.21.15.22:0/627652763 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7efcb006f400 0x7efcb00718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:54.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.467+0000 7efccdd9b640 1 --2- 172.21.15.22:0/627652763 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7efcb006f400 0x7efcb00718c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7efcd015aff0 tx=0x7efcc4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:35:54.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.471+0000 7efcbeffd640 1 -- 172.21.15.22:0/627652763 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7efcc005b570 con 0x7efcd0073830 2024-05-21T13:35:54.618 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.639+0000 7efcd48a5640 1 -- 172.21.15.22:0/627652763 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7efcd0148b80 con 0x7efcd0073830 2024-05-21T13:35:54.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.639+0000 7efcbeffd640 1 -- 172.21.15.22:0/627652763 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) ==== 84+0+65 (secure 0 0 0) 0x7efcc005ae70 con 0x7efcd0073830 2024-05-21T13:35:54.619 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-21T13:35:54.619 INFO:teuthology.orchestra.run.smithi022.stdout:[ 2024-05-21T13:35:54.619 INFO:teuthology.orchestra.run.smithi022.stdout: { 2024-05-21T13:35:54.619 INFO:teuthology.orchestra.run.smithi022.stdout: "poolnum": 1, 2024-05-21T13:35:54.619 INFO:teuthology.orchestra.run.smithi022.stdout: "poolname": ".mgr" 2024-05-21T13:35:54.619 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-05-21T13:35:54.619 INFO:teuthology.orchestra.run.smithi022.stdout:] 2024-05-21T13:35:54.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.639+0000 7efcd48a5640 1 -- 172.21.15.22:0/627652763 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7efcb006f400 msgr2=0x7efcb00718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:54.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.639+0000 7efcd48a5640 1 --2- 172.21.15.22:0/627652763 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7efcb006f400 0x7efcb00718c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7efcd015aff0 tx=0x7efcc4009040 comp rx=0 tx=0).stop 2024-05-21T13:35:54.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.639+0000 7efcd48a5640 1 -- 172.21.15.22:0/627652763 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efcd0073830 msgr2=0x7efcd014e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:54.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.639+0000 7efcd48a5640 1 --2- 172.21.15.22:0/627652763 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efcd0073830 0x7efcd014e920 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7efcc000c430 tx=0x7efcc000c8f0 comp rx=0 tx=0).stop 2024-05-21T13:35:54.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.639+0000 7efcd48a5640 1 -- 172.21.15.22:0/627652763 shutdown_connections 2024-05-21T13:35:54.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.639+0000 7efcd48a5640 1 --2- 172.21.15.22:0/627652763 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7efcb006f400 0x7efcb00718c0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:54.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.639+0000 7efcd48a5640 1 --2- 172.21.15.22:0/627652763 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efcd01560d0 0x7efcd0144df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:54.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.639+0000 7efcd48a5640 1 --2- 172.21.15.22:0/627652763 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efcd0073ca0 0x7efcd0159d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:54.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.639+0000 7efcd48a5640 1 --2- 172.21.15.22:0/627652763 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efcd0073830 0x7efcd014e920 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:54.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.639+0000 7efcd48a5640 1 -- 172.21.15.22:0/627652763 >> 172.21.15.22:0/627652763 conn(0x7efcd006fd30 msgr2=0x7efcd00c8c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:35:54.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.639+0000 7efcd48a5640 1 -- 172.21.15.22:0/627652763 shutdown_connections 2024-05-21T13:35:54.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.639+0000 7efcd48a5640 1 -- 172.21.15.22:0/627652763 wait complete. 2024-05-21T13:35:54.638 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-05-21T13:35:54.638 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-05-21T13:35:54.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.783+0000 7f9e4a26d640 1 Processor -- start 2024-05-21T13:35:54.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.783+0000 7f9e4a26d640 1 -- start start 2024-05-21T13:35:54.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.783+0000 7f9e4a26d640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9e44070040 0x7f9e440c47f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:54.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.783+0000 7f9e4a26d640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9e44073030 0x7f9e44152580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:54.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.783+0000 7f9e4a26d640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e440c4d30 con 0x7f9e44070420 2024-05-21T13:35:54.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.783+0000 7f9e4a26d640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f9e44074930 con 0x7f9e44070040 2024-05-21T13:35:54.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.783+0000 7f9e4a26d640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f9e44072890 con 0x7f9e44073030 2024-05-21T13:35:54.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.783+0000 7f9e43fff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9e44070040 0x7f9e440c47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:54.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.783+0000 7f9e43fff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9e44070040 0x7f9e440c47f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36312/0 (socket says 172.21.15.22:36312) 2024-05-21T13:35:54.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.783+0000 7f9e43fff640 1 -- 172.21.15.22:0/3177277103 learned_addr learned my addr 172.21.15.22:0/3177277103 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:35:54.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.783+0000 7f9e4880a640 1 --2- 172.21.15.22:0/3177277103 >> v2:172.21.15.115:3300/0 conn(0x7f9e44073030 0x7f9e44152580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:54.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.783+0000 7f9e43fff640 1 -- 172.21.15.22:0/3177277103 >> v2:172.21.15.115:3300/0 conn(0x7f9e44073030 msgr2=0x7f9e44152580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:35:54.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.783+0000 7f9e43fff640 1 --2- 172.21.15.22:0/3177277103 >> v2:172.21.15.115:3300/0 conn(0x7f9e44073030 0x7f9e44152580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:54.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.783+0000 7f9e43fff640 1 -- 172.21.15.22:0/3177277103 >> v1:172.21.15.115:6789/0 conn(0x7f9e44070420 legacy=0x7f9e4415bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:35:54.766 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.783+0000 7f9e43fff640 1 -- 172.21.15.22:0/3177277103 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e44072dc0 con 0x7f9e44070040 2024-05-21T13:35:54.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.787+0000 7f9e43fff640 1 --2- 172.21.15.22:0/3177277103 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e44070040 0x7f9e440c47f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9e4406d5b0 tx=0x7f9e340213e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1249f1271fc6feaf server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:35:54.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.787+0000 7f9e42ffd640 1 -- 172.21.15.22:0/3177277103 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e340b6070 con 0x7f9e44070040 2024-05-21T13:35:54.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.787+0000 7f9e42ffd640 1 -- 172.21.15.22:0/3177277103 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e3400b2d0 con 0x7f9e44070040 2024-05-21T13:35:54.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.787+0000 7f9e42ffd640 1 -- 172.21.15.22:0/3177277103 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e3400b480 con 0x7f9e44070040 2024-05-21T13:35:54.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.787+0000 7f9e4a26d640 1 -- 172.21.15.22:0/3177277103 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e44070040 msgr2=0x7f9e440c47f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:54.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.787+0000 7f9e4a26d640 1 --2- 172.21.15.22:0/3177277103 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e44070040 0x7f9e440c47f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9e4406d5b0 tx=0x7f9e340213e0 comp rx=0 tx=0).stop 2024-05-21T13:35:54.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.787+0000 7f9e4a26d640 1 -- 172.21.15.22:0/3177277103 shutdown_connections 2024-05-21T13:35:54.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.787+0000 7f9e4a26d640 1 --2- 172.21.15.22:0/3177277103 >> v2:172.21.15.115:3300/0 conn(0x7f9e44073030 0x7f9e44152580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:54.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.787+0000 7f9e4a26d640 1 --2- 172.21.15.22:0/3177277103 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e44070040 0x7f9e440c47f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:54.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.787+0000 7f9e4a26d640 1 -- 172.21.15.22:0/3177277103 >> 172.21.15.22:0/3177277103 conn(0x7f9e4406cc50 msgr2=0x7f9e440cd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:35:54.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.787+0000 7f9e4a26d640 1 -- 172.21.15.22:0/3177277103 shutdown_connections 2024-05-21T13:35:54.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.787+0000 7f9e4a26d640 1 -- 172.21.15.22:0/3177277103 wait complete. 2024-05-21T13:35:54.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.791+0000 7f9e4a26d640 1 Processor -- start 2024-05-21T13:35:54.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.791+0000 7f9e4a26d640 1 -- start start 2024-05-21T13:35:54.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.791+0000 7f9e4a26d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e44070040 0x7f9e44155800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:54.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.791+0000 7f9e4a26d640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9e44070420 0x7f9e4414e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:54.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.791+0000 7f9e4a26d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e44073030 0x7f9e44154c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:54.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.791+0000 7f9e4a26d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9e44073b70 con 0x7f9e44073030 2024-05-21T13:35:54.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.791+0000 7f9e4a26d640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f9e440744a0 con 0x7f9e44070040 2024-05-21T13:35:54.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.791+0000 7f9e4a26d640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f9e44073e50 con 0x7f9e44070420 2024-05-21T13:35:54.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.791+0000 7f9e4880a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e44073030 0x7f9e44154c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:54.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.791+0000 7f9e4880a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e44073030 0x7f9e44154c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36314/0 (socket says 172.21.15.22:36314) 2024-05-21T13:35:54.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.791+0000 7f9e4880a640 1 -- 172.21.15.22:0/2346760446 learned_addr learned my addr 172.21.15.22:0/2346760446 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:35:54.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.791+0000 7f9e43fff640 1 --2- 172.21.15.22:0/2346760446 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e44070040 0x7f9e44155800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:54.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.791+0000 7f9e437fe640 1 --2- 172.21.15.22:0/2346760446 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9e44070420 0x7f9e4414e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:54.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.791+0000 7f9e4880a640 1 -- 172.21.15.22:0/2346760446 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9e44070420 msgr2=0x7f9e4414e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:54.772 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.791+0000 7f9e4880a640 1 --2- 172.21.15.22:0/2346760446 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9e44070420 0x7f9e4414e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:54.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.791+0000 7f9e4880a640 1 -- 172.21.15.22:0/2346760446 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e44070040 msgr2=0x7f9e44155800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:54.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.791+0000 7f9e4880a640 1 --2- 172.21.15.22:0/2346760446 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e44070040 0x7f9e44155800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:54.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.791+0000 7f9e4880a640 1 -- 172.21.15.22:0/2346760446 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e4415c9c0 con 0x7f9e44073030 2024-05-21T13:35:54.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.791+0000 7f9e437fe640 1 --2- 172.21.15.22:0/2346760446 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9e44070420 0x7f9e4414e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:35:54.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.791+0000 7f9e4880a640 1 --2- 172.21.15.22:0/2346760446 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e44073030 0x7f9e44154c20 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c00d580 tx=0x7f9e3c00da40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:35:54.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.791+0000 7f9e40ff9640 1 -- 172.21.15.22:0/2346760446 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e3c0125f0 con 0x7f9e44073030 2024-05-21T13:35:54.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.791+0000 7f9e40ff9640 1 -- 172.21.15.22:0/2346760446 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e3c019070 con 0x7f9e44073030 2024-05-21T13:35:54.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.791+0000 7f9e4a26d640 1 -- 172.21.15.22:0/2346760446 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e44155e90 con 0x7f9e44073030 2024-05-21T13:35:54.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.791+0000 7f9e40ff9640 1 -- 172.21.15.22:0/2346760446 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e3c0129d0 con 0x7f9e44073030 2024-05-21T13:35:54.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.791+0000 7f9e4a26d640 1 -- 172.21.15.22:0/2346760446 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e4415c090 con 0x7f9e44073030 2024-05-21T13:35:54.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.791+0000 7f9e4a26d640 1 -- 172.21.15.22:0/2346760446 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e440766d0 con 0x7f9e44073030 2024-05-21T13:35:54.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.795+0000 7f9e40ff9640 1 -- 172.21.15.22:0/2346760446 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f9e3c012b70 con 0x7f9e44073030 2024-05-21T13:35:54.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.795+0000 7f9e40ff9640 1 --2- 172.21.15.22:0/2346760446 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f9e3006f400 0x7f9e300718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:54.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.795+0000 7f9e40ff9640 1 -- 172.21.15.22:0/2346760446 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 4857+0+0 (secure 0 0 0) 0x7f9e3c08fd00 con 0x7f9e44073030 2024-05-21T13:35:54.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.795+0000 7f9e43fff640 1 --2- 172.21.15.22:0/2346760446 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f9e3006f400 0x7f9e300718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:54.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.795+0000 7f9e43fff640 1 --2- 172.21.15.22:0/2346760446 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f9e3006f400 0x7f9e300718c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9e340b3000 tx=0x7f9e340ac000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:35:54.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.799+0000 7f9e40ff9640 1 -- 172.21.15.22:0/2346760446 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f9e3c05d060 con 0x7f9e44073030 2024-05-21T13:35:54.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:54.963+0000 7f9e4a26d640 1 -- 172.21.15.22:0/2346760446 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f9e440c8490 con 0x7f9e44073030 2024-05-21T13:35:55.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:55.707+0000 7f9e40ff9640 1 -- 172.21.15.22:0/2346760446 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) ==== 138+0+0 (secure 0 0 0) 0x7f9e3c05c960 con 0x7f9e44073030 2024-05-21T13:35:55.687 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_metadata' created 2024-05-21T13:35:55.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:55.711+0000 7f9e4a26d640 1 -- 172.21.15.22:0/2346760446 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f9e3006f400 msgr2=0x7f9e300718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:55.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:55.711+0000 7f9e4a26d640 1 --2- 172.21.15.22:0/2346760446 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f9e3006f400 0x7f9e300718c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9e340b3000 tx=0x7f9e340ac000 comp rx=0 tx=0).stop 2024-05-21T13:35:55.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:55.711+0000 7f9e4a26d640 1 -- 172.21.15.22:0/2346760446 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e44073030 msgr2=0x7f9e44154c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:55.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:55.711+0000 7f9e4a26d640 1 --2- 172.21.15.22:0/2346760446 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e44073030 0x7f9e44154c20 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c00d580 tx=0x7f9e3c00da40 comp rx=0 tx=0).stop 2024-05-21T13:35:55.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:55.711+0000 7f9e4a26d640 1 -- 172.21.15.22:0/2346760446 shutdown_connections 2024-05-21T13:35:55.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:55.711+0000 7f9e4a26d640 1 --2- 172.21.15.22:0/2346760446 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f9e3006f400 0x7f9e300718c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:55.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:55.711+0000 7f9e4a26d640 1 --2- 172.21.15.22:0/2346760446 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9e44073030 0x7f9e44154c20 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:55.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:55.711+0000 7f9e4a26d640 1 --2- 172.21.15.22:0/2346760446 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9e44070420 0x7f9e4414e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:55.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:55.711+0000 7f9e4a26d640 1 --2- 172.21.15.22:0/2346760446 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9e44070040 0x7f9e44155800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:55.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:55.711+0000 7f9e4a26d640 1 -- 172.21.15.22:0/2346760446 >> 172.21.15.22:0/2346760446 conn(0x7f9e4406cc50 msgr2=0x7f9e440c79e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:35:55.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:55.711+0000 7f9e4a26d640 1 -- 172.21.15.22:0/2346760446 shutdown_connections 2024-05-21T13:35:55.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:55.711+0000 7f9e4a26d640 1 -- 172.21.15.22:0/2346760446 wait complete. 2024-05-21T13:35:55.719 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-05-21T13:35:55.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:55.875+0000 7ff312f05640 1 Processor -- start 2024-05-21T13:35:55.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:55.875+0000 7ff312f05640 1 -- start start 2024-05-21T13:35:55.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:55.875+0000 7ff312f05640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff30c0cacf0 0x7ff30c0c50e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:55.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:55.875+0000 7ff312f05640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff30c1589f0 con 0x7ff30c159490 2024-05-21T13:35:55.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:55.875+0000 7ff312f05640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff30c072d60 con 0x7ff30c152980 2024-05-21T13:35:55.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:55.875+0000 7ff312f05640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7ff30c073320 con 0x7ff30c0cacf0 2024-05-21T13:35:55.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:55.875+0000 7ff30bfff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff30c0cacf0 0x7ff30c0c50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:55.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:55.875+0000 7ff30bfff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff30c0cacf0 0x7ff30c0c50e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37642/0 (socket says 172.21.15.22:37642) 2024-05-21T13:35:55.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:55.875+0000 7ff30bfff640 1 -- 172.21.15.22:0/709787631 learned_addr learned my addr 172.21.15.22:0/709787631 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:35:55.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:55.875+0000 7ff3114a2640 1 --1- 172.21.15.22:0/709787631 >> v1:172.21.15.22:6789/0 conn(0x7ff30c159490 0x7ff30c0c6d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:51708/0 (socket says 172.21.15.22:51708) 2024-05-21T13:35:55.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:55.875+0000 7ff30bfff640 1 -- 172.21.15.22:0/709787631 >> v1:172.21.15.115:6789/0 conn(0x7ff30c152980 legacy=0x7ff30c0736b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:55.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:55.875+0000 7ff30bfff640 1 -- 172.21.15.22:0/709787631 >> v1:172.21.15.22:6789/0 conn(0x7ff30c159490 legacy=0x7ff30c0c6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:55.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:55.875+0000 7ff30bfff640 1 -- 172.21.15.22:0/709787631 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff30c073040 con 0x7ff30c0cacf0 2024-05-21T13:35:55.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:55.875+0000 7ff30b7fe640 1 -- 172.21.15.22:0/709787631 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4235818030 0 0) 0x7ff30c1589f0 con 0x7ff30c159490 2024-05-21T13:35:55.860 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:55.879+0000 7ff30bfff640 1 --2- 172.21.15.22:0/709787631 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff30c0cacf0 0x7ff30c0c50e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff300009870 tx=0x7ff30001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fe5c22d2ac98727 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:35:55.860 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:55.879+0000 7ff30b7fe640 1 -- 172.21.15.22:0/709787631 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3000b0070 con 0x7ff30c0cacf0 2024-05-21T13:35:55.860 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:55.879+0000 7ff30b7fe640 1 -- 172.21.15.22:0/709787631 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3000ab600 con 0x7ff30c0cacf0 2024-05-21T13:35:55.860 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:55.879+0000 7ff30b7fe640 1 -- 172.21.15.22:0/709787631 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3000ab9d0 con 0x7ff30c0cacf0 2024-05-21T13:35:55.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:55.879+0000 7ff312f05640 1 -- 172.21.15.22:0/709787631 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff30c0cacf0 msgr2=0x7ff30c0c50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:55.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:55.879+0000 7ff312f05640 1 --2- 172.21.15.22:0/709787631 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff30c0cacf0 0x7ff30c0c50e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff300009870 tx=0x7ff30001c560 comp rx=0 tx=0).stop 2024-05-21T13:35:55.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:55.879+0000 7ff312f05640 1 -- 172.21.15.22:0/709787631 shutdown_connections 2024-05-21T13:35:55.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:55.879+0000 7ff312f05640 1 --2- 172.21.15.22:0/709787631 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff30c0cacf0 0x7ff30c0c50e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:55.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:55.879+0000 7ff312f05640 1 -- 172.21.15.22:0/709787631 >> 172.21.15.22:0/709787631 conn(0x7ff30c0cdbe0 msgr2=0x7ff30c0cdff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:35:55.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:55.879+0000 7ff312f05640 1 -- 172.21.15.22:0/709787631 shutdown_connections 2024-05-21T13:35:55.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:55.879+0000 7ff312f05640 1 -- 172.21.15.22:0/709787631 wait complete. 2024-05-21T13:35:55.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:55.883+0000 7ff312f05640 1 Processor -- start 2024-05-21T13:35:55.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:55.883+0000 7ff312f05640 1 -- start start 2024-05-21T13:35:55.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:55.883+0000 7ff312f05640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff30c0cacf0 0x7ff30c144810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:55.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:55.883+0000 7ff312f05640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff30c152980 0x7ff30c1f47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:55.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:55.883+0000 7ff312f05640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff30c159490 0x7ff30c1f87a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:55.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:55.883+0000 7ff312f05640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff30c0c57a0 con 0x7ff30c0cacf0 2024-05-21T13:35:55.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:55.883+0000 7ff312f05640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7ff30c0c5620 con 0x7ff30c152980 2024-05-21T13:35:55.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:55.883+0000 7ff312f05640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7ff30c0c7430 con 0x7ff30c159490 2024-05-21T13:35:55.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:55.883+0000 7ff310ca1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff30c0cacf0 0x7ff30c144810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:55.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:55.883+0000 7ff310ca1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff30c0cacf0 0x7ff30c144810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37650/0 (socket says 172.21.15.22:37650) 2024-05-21T13:35:55.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:55.883+0000 7ff310ca1640 1 -- 172.21.15.22:0/2315357653 learned_addr learned my addr 172.21.15.22:0/2315357653 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:35:55.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:55.883+0000 7ff30bfff640 1 --2- 172.21.15.22:0/2315357653 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff30c152980 0x7ff30c1f47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:55.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:55.883+0000 7ff3114a2640 1 --2- 172.21.15.22:0/2315357653 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff30c159490 0x7ff30c1f87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:55.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:55.883+0000 7ff310ca1640 1 -- 172.21.15.22:0/2315357653 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff30c159490 msgr2=0x7ff30c1f87a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:55.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:55.883+0000 7ff310ca1640 1 --2- 172.21.15.22:0/2315357653 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff30c159490 0x7ff30c1f87a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:55.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:55.883+0000 7ff310ca1640 1 -- 172.21.15.22:0/2315357653 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff30c152980 msgr2=0x7ff30c1f47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:55.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:55.883+0000 7ff310ca1640 1 --2- 172.21.15.22:0/2315357653 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff30c152980 0x7ff30c1f47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:55.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:55.883+0000 7ff310ca1640 1 -- 172.21.15.22:0/2315357653 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff30c15c510 con 0x7ff30c0cacf0 2024-05-21T13:35:55.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:55.883+0000 7ff310ca1640 1 --2- 172.21.15.22:0/2315357653 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff30c0cacf0 0x7ff30c144810 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc00c4b0 tx=0x7ff2fc00c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:35:55.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:55.883+0000 7ff3097fa640 1 -- 172.21.15.22:0/2315357653 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2fc0052d0 con 0x7ff30c0cacf0 2024-05-21T13:35:55.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:55.883+0000 7ff3097fa640 1 -- 172.21.15.22:0/2315357653 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2fc005470 con 0x7ff30c0cacf0 2024-05-21T13:35:55.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:55.883+0000 7ff312f05640 1 -- 172.21.15.22:0/2315357653 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff30c15c780 con 0x7ff30c0cacf0 2024-05-21T13:35:55.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:55.883+0000 7ff3097fa640 1 -- 172.21.15.22:0/2315357653 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2fc012850 con 0x7ff30c0cacf0 2024-05-21T13:35:55.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:55.883+0000 7ff312f05640 1 -- 172.21.15.22:0/2315357653 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff30c1f7fa0 con 0x7ff30c0cacf0 2024-05-21T13:35:55.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:55.887+0000 7ff312f05640 1 -- 172.21.15.22:0/2315357653 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff30c077bb0 con 0x7ff30c0cacf0 2024-05-21T13:35:55.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:55.887+0000 7ff3097fa640 1 -- 172.21.15.22:0/2315357653 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ff2fc0129f0 con 0x7ff30c0cacf0 2024-05-21T13:35:55.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:55.887+0000 7ff3097fa640 1 --2- 172.21.15.22:0/2315357653 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7ff2f806f430 0x7ff2f80718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:55.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:55.887+0000 7ff3097fa640 1 -- 172.21.15.22:0/2315357653 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5227+0+0 (secure 0 0 0) 0x7ff2fc08ec30 con 0x7ff30c0cacf0 2024-05-21T13:35:55.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:55.887+0000 7ff30bfff640 1 --2- 172.21.15.22:0/2315357653 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7ff2f806f430 0x7ff2f80718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:55.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:55.887+0000 7ff30bfff640 1 --2- 172.21.15.22:0/2315357653 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7ff2f806f430 0x7ff2f80718f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff3000ad000 tx=0x7ff3000a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:35:55.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:55.891+0000 7ff3097fa640 1 -- 172.21.15.22:0/2315357653 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7ff2fc05bd80 con 0x7ff30c0cacf0 2024-05-21T13:35:56.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:56.055+0000 7ff312f05640 1 -- 172.21.15.22:0/2315357653 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7ff30c156430 con 0x7ff30c0cacf0 2024-05-21T13:35:56.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:56.711+0000 7ff3097fa640 1 -- 172.21.15.22:0/2315357653 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v19) ==== 171+0+0 (secure 0 0 0) 0x7ff2fc05b680 con 0x7ff30c0cacf0 2024-05-21T13:35:56.691 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_data' created 2024-05-21T13:35:56.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:56.715+0000 7ff312f05640 1 -- 172.21.15.22:0/2315357653 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7ff2f806f430 msgr2=0x7ff2f80718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:56.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:56.715+0000 7ff312f05640 1 --2- 172.21.15.22:0/2315357653 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7ff2f806f430 0x7ff2f80718f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff3000ad000 tx=0x7ff3000a6000 comp rx=0 tx=0).stop 2024-05-21T13:35:56.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:56.715+0000 7ff312f05640 1 -- 172.21.15.22:0/2315357653 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff30c0cacf0 msgr2=0x7ff30c144810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:56.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:56.715+0000 7ff312f05640 1 --2- 172.21.15.22:0/2315357653 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff30c0cacf0 0x7ff30c144810 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc00c4b0 tx=0x7ff2fc00c970 comp rx=0 tx=0).stop 2024-05-21T13:35:56.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:56.715+0000 7ff312f05640 1 -- 172.21.15.22:0/2315357653 shutdown_connections 2024-05-21T13:35:56.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:56.715+0000 7ff312f05640 1 --2- 172.21.15.22:0/2315357653 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7ff2f806f430 0x7ff2f80718f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:56.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:56.715+0000 7ff312f05640 1 --2- 172.21.15.22:0/2315357653 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff30c159490 0x7ff30c1f87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:56.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:56.715+0000 7ff312f05640 1 --2- 172.21.15.22:0/2315357653 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff30c152980 0x7ff30c1f47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:56.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:56.715+0000 7ff312f05640 1 --2- 172.21.15.22:0/2315357653 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff30c0cacf0 0x7ff30c144810 secure :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc00c4b0 tx=0x7ff2fc00c970 comp rx=0 tx=0).stop 2024-05-21T13:35:56.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:56.715+0000 7ff312f05640 1 -- 172.21.15.22:0/2315357653 >> 172.21.15.22:0/2315357653 conn(0x7ff30c0cdbe0 msgr2=0x7ff30c0ca3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:35:56.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:56.715+0000 7ff312f05640 1 -- 172.21.15.22:0/2315357653 shutdown_connections 2024-05-21T13:35:56.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:56.715+0000 7ff312f05640 1 -- 172.21.15.22:0/2315357653 wait complete. 2024-05-21T13:35:56.736 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-05-21T13:35:56.860 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:56.879+0000 7f6846643640 1 Processor -- start 2024-05-21T13:35:56.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:56.879+0000 7f6846643640 1 -- start start 2024-05-21T13:35:56.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:56.883+0000 7f6846643640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6840152d20 0x7f6840073dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:56.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:56.883+0000 7f6846643640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6840072d50 con 0x7f6840070040 2024-05-21T13:35:56.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:56.883+0000 7f6846643640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6840074520 con 0x7f6840070420 2024-05-21T13:35:56.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:56.883+0000 7f6846643640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f6840074300 con 0x7f6840152d20 2024-05-21T13:35:56.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:56.883+0000 7f683ffff640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f6840070040 0x7f68400c47f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:51718/0 (socket says 172.21.15.22:51718) 2024-05-21T13:35:56.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:56.883+0000 7f683ffff640 1 -- 172.21.15.22:0/2366560272 learned_addr learned my addr 172.21.15.22:0/2366560272 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-21T13:35:56.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:56.883+0000 7f6844be0640 1 --2- 172.21.15.22:0/2366560272 >> v2:172.21.15.115:3300/0 conn(0x7f6840152d20 0x7f6840073dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:56.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:56.883+0000 7f683effd640 1 -- 172.21.15.22:0/2366560272 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3486643057 0 0) 0x7f6840072d50 con 0x7f6840070040 2024-05-21T13:35:56.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:56.883+0000 7f683effd640 1 -- 172.21.15.22:0/2366560272 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6828003530 con 0x7f6840070040 2024-05-21T13:35:56.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:56.883+0000 7f683effd640 1 -- 172.21.15.22:0/2366560272 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1737579067 0 0) 0x7f6828003530 con 0x7f6840070040 2024-05-21T13:35:56.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:56.883+0000 7f683effd640 1 -- 172.21.15.22:0/2366560272 >> v2:172.21.15.115:3300/0 conn(0x7f6840152d20 msgr2=0x7f6840073dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:35:56.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:56.883+0000 7f683effd640 1 --2- 172.21.15.22:0/2366560272 >> v2:172.21.15.115:3300/0 conn(0x7f6840152d20 0x7f6840073dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:56.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:56.883+0000 7f683effd640 1 -- 172.21.15.22:0/2366560272 >> v1:172.21.15.115:6789/0 conn(0x7f6840070420 legacy=0x7f6840152610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:56.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:56.883+0000 7f683effd640 1 -- 172.21.15.22:0/2366560272 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6840074800 con 0x7f6840070040 2024-05-21T13:35:56.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:56.883+0000 7f683effd640 1 -- 172.21.15.22:0/2366560272 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2684847062 0 0) 0x7f6830001700 con 0x7f6840070040 2024-05-21T13:35:56.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:56.883+0000 7f683effd640 1 -- 172.21.15.22:0/2366560272 >> v1:172.21.15.22:6789/0 conn(0x7f6840070040 legacy=0x7f68400c47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:56.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:56.883+0000 7f683effd640 1 --2- 172.21.15.22:0/2366560272 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6828003ab0 0x7f6828003ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:56.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:56.883+0000 7f683effd640 1 --2- 172.21.15.22:0/2366560272 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6828004810 0x7f6828004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:56.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:56.883+0000 7f683effd640 1 --2- 172.21.15.22:0/2366560272 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6828005220 0x7f682800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:56.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:56.883+0000 7f683effd640 1 -- 172.21.15.22:0/2366560272 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6840074300 con 0x7f6828005220 2024-05-21T13:35:56.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:56.883+0000 7f683effd640 1 -- 172.21.15.22:0/2366560272 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f682800c160 con 0x7f6828003ab0 2024-05-21T13:35:56.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:56.883+0000 7f683effd640 1 -- 172.21.15.22:0/2366560272 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f682800c360 con 0x7f6828004810 2024-05-21T13:35:56.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:56.883+0000 7f6844be0640 1 --2- 172.21.15.22:0/2366560272 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6828005220 0x7f682800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:56.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:56.883+0000 7f683ffff640 1 --2- 172.21.15.22:0/2366560272 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6828003ab0 0x7f6828003ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:56.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:56.883+0000 7f683f7fe640 1 --2- 172.21.15.22:0/2366560272 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6828004810 0x7f6828004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:56.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:56.883+0000 7f6844be0640 1 -- 172.21.15.22:0/2366560272 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6828004810 msgr2=0x7f6828004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:35:56.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:56.883+0000 7f6844be0640 1 --2- 172.21.15.22:0/2366560272 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6828004810 0x7f6828004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:56.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:56.883+0000 7f6844be0640 1 -- 172.21.15.22:0/2366560272 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6828003ab0 msgr2=0x7f6828003ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:35:56.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:56.883+0000 7f6844be0640 1 --2- 172.21.15.22:0/2366560272 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6828003ab0 0x7f6828003ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:56.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:56.883+0000 7f6844be0640 1 -- 172.21.15.22:0/2366560272 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6828003530 con 0x7f6828005220 2024-05-21T13:35:56.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:56.883+0000 7f683ffff640 1 --2- 172.21.15.22:0/2366560272 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6828003ab0 0x7f6828003ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T13:35:56.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:56.883+0000 7f6844be0640 1 -- 172.21.15.22:0/2366560272 reap_dead start 2024-05-21T13:35:56.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:56.883+0000 7f6844be0640 1 --2- 172.21.15.22:0/2366560272 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6828005220 0x7f682800b9d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6838009f90 tx=0x7f683801cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0731142a31b6b07 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:35:56.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:56.887+0000 7f683effd640 1 -- 172.21.15.22:0/2366560272 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6838009c10 con 0x7f6828005220 2024-05-21T13:35:56.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:56.887+0000 7f683effd640 1 -- 172.21.15.22:0/2366560272 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68380a5c70 con 0x7f6828005220 2024-05-21T13:35:56.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:56.887+0000 7f683effd640 1 -- 172.21.15.22:0/2366560272 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6838003be0 con 0x7f6828005220 2024-05-21T13:35:56.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:56.887+0000 7f6846643640 1 -- 172.21.15.22:0/2366560272 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6828005220 msgr2=0x7f682800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:56.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:56.887+0000 7f6846643640 1 --2- 172.21.15.22:0/2366560272 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6828005220 0x7f682800b9d0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6838009f90 tx=0x7f683801cc60 comp rx=0 tx=0).stop 2024-05-21T13:35:56.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:56.887+0000 7f6846643640 1 -- 172.21.15.22:0/2366560272 shutdown_connections 2024-05-21T13:35:56.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:56.887+0000 7f6846643640 1 --2- 172.21.15.22:0/2366560272 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6828005220 0x7f682800b9d0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:56.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:56.887+0000 7f6846643640 1 -- 172.21.15.22:0/2366560272 >> 172.21.15.22:0/2366560272 conn(0x7f684006cc50 msgr2=0x7f68400cd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:35:56.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:56.887+0000 7f6846643640 1 -- 172.21.15.22:0/2366560272 shutdown_connections 2024-05-21T13:35:56.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:56.887+0000 7f6846643640 1 -- 172.21.15.22:0/2366560272 wait complete. 2024-05-21T13:35:56.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:56.887+0000 7f6846643640 1 Processor -- start 2024-05-21T13:35:56.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:56.887+0000 7f6846643640 1 -- start start 2024-05-21T13:35:56.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:56.887+0000 7f6846643640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6828005220 0x7f6840133590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:56.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:56.887+0000 7f6846643640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f684013e940 0x7f6840137ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:56.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:56.887+0000 7f6846643640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f684013f850 0x7f684013fcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:56.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:56.887+0000 7f6846643640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f68400c9680 con 0x7f684013e940 2024-05-21T13:35:56.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:56.887+0000 7f6846643640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f68400c93a0 con 0x7f6828005220 2024-05-21T13:35:56.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:56.887+0000 7f6846643640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f68400c9960 con 0x7f684013f850 2024-05-21T13:35:56.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:56.887+0000 7f683f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f684013e940 0x7f6840137ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:56.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:56.887+0000 7f683f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f684013e940 0x7f6840137ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37678/0 (socket says 172.21.15.22:37678) 2024-05-21T13:35:56.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:56.887+0000 7f683f7fe640 1 -- 172.21.15.22:0/3332270797 learned_addr learned my addr 172.21.15.22:0/3332270797 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:35:56.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:56.887+0000 7f6844be0640 1 --2- 172.21.15.22:0/3332270797 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f684013f850 0x7f684013fcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:56.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:56.887+0000 7f683ffff640 1 --2- 172.21.15.22:0/3332270797 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6828005220 0x7f6840133590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:56.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:56.887+0000 7f683f7fe640 1 -- 172.21.15.22:0/3332270797 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f684013f850 msgr2=0x7f684013fcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:56.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:56.887+0000 7f683f7fe640 1 --2- 172.21.15.22:0/3332270797 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f684013f850 0x7f684013fcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:56.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:56.887+0000 7f683f7fe640 1 -- 172.21.15.22:0/3332270797 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6828005220 msgr2=0x7f6840133590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:56.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:56.887+0000 7f683f7fe640 1 --2- 172.21.15.22:0/3332270797 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6828005220 0x7f6840133590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:56.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:56.887+0000 7f683f7fe640 1 -- 172.21.15.22:0/3332270797 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6840140210 con 0x7f684013e940 2024-05-21T13:35:56.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:56.887+0000 7f683f7fe640 1 --2- 172.21.15.22:0/3332270797 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f684013e940 0x7f6840137ad0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f683400e490 tx=0x7f683400e950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:35:56.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:56.887+0000 7f683cff9640 1 -- 172.21.15.22:0/3332270797 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6834019070 con 0x7f684013e940 2024-05-21T13:35:56.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:56.887+0000 7f683cff9640 1 -- 172.21.15.22:0/3332270797 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f68340052e0 con 0x7f684013e940 2024-05-21T13:35:56.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:56.887+0000 7f683cff9640 1 -- 172.21.15.22:0/3332270797 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6834003840 con 0x7f684013e940 2024-05-21T13:35:56.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:56.887+0000 7f6846643640 1 -- 172.21.15.22:0/3332270797 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f684015a510 con 0x7f684013e940 2024-05-21T13:35:56.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:56.887+0000 7f6846643640 1 -- 172.21.15.22:0/3332270797 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f684015aa90 con 0x7f684013e940 2024-05-21T13:35:56.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:56.891+0000 7f6846643640 1 -- 172.21.15.22:0/3332270797 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68400766d0 con 0x7f684013e940 2024-05-21T13:35:56.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:56.891+0000 7f683cff9640 1 -- 172.21.15.22:0/3332270797 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f683401c070 con 0x7f684013e940 2024-05-21T13:35:56.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:56.891+0000 7f683cff9640 1 --2- 172.21.15.22:0/3332270797 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f682c06f400 0x7f682c0718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:56.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:56.891+0000 7f683cff9640 1 -- 172.21.15.22:0/3332270797 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5609+0+0 (secure 0 0 0) 0x7f683408efb0 con 0x7f684013e940 2024-05-21T13:35:56.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:56.891+0000 7f683ffff640 1 --2- 172.21.15.22:0/3332270797 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f682c06f400 0x7f682c0718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:56.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:56.891+0000 7f683ffff640 1 --2- 172.21.15.22:0/3332270797 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f682c06f400 0x7f682c0718c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6830000fc0 tx=0x7f6830009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:35:56.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:56.895+0000 7f683cff9640 1 -- 172.21.15.22:0/3332270797 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f6840140210 con 0x7f684013e940 2024-05-21T13:35:57.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:57.099+0000 7f6846643640 1 -- 172.21.15.22:0/3332270797 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f6840077bb0 con 0x7f684013e940 2024-05-21T13:35:57.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:57.774+0000 7f683cff9640 1 -- 172.21.15.22:0/3332270797 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f683405ba50 con 0x7f684013e940 2024-05-21T13:35:57.763 INFO:teuthology.orchestra.run.smithi022.stderr:new fs with metadata pool 2 and data pool 3 2024-05-21T13:35:57.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:57.790+0000 7f6846643640 1 -- 172.21.15.22:0/3332270797 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f682c06f400 msgr2=0x7f682c0718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:57.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:57.790+0000 7f6846643640 1 --2- 172.21.15.22:0/3332270797 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f682c06f400 0x7f682c0718c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f6830000fc0 tx=0x7f6830009040 comp rx=0 tx=0).stop 2024-05-21T13:35:57.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:57.790+0000 7f6846643640 1 -- 172.21.15.22:0/3332270797 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f684013e940 msgr2=0x7f6840137ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:57.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:57.790+0000 7f6846643640 1 --2- 172.21.15.22:0/3332270797 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f684013e940 0x7f6840137ad0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f683400e490 tx=0x7f683400e950 comp rx=0 tx=0).stop 2024-05-21T13:35:57.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:57.790+0000 7f6846643640 1 -- 172.21.15.22:0/3332270797 shutdown_connections 2024-05-21T13:35:57.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:57.790+0000 7f6846643640 1 --2- 172.21.15.22:0/3332270797 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f682c06f400 0x7f682c0718c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:57.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:57.790+0000 7f6846643640 1 --2- 172.21.15.22:0/3332270797 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f684013f850 0x7f684013fcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:57.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:57.790+0000 7f6846643640 1 --2- 172.21.15.22:0/3332270797 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f684013e940 0x7f6840137ad0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:57.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:57.790+0000 7f6846643640 1 --2- 172.21.15.22:0/3332270797 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6828005220 0x7f6840133590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:57.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:57.790+0000 7f6846643640 1 -- 172.21.15.22:0/3332270797 >> 172.21.15.22:0/3332270797 conn(0x7f684006cc50 msgr2=0x7f6840150b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:35:57.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:57.790+0000 7f6846643640 1 -- 172.21.15.22:0/3332270797 shutdown_connections 2024-05-21T13:35:57.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:57.790+0000 7f6846643640 1 -- 172.21.15.22:0/3332270797 wait complete. 2024-05-21T13:35:57.798 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-05-21T13:35:57.798 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-05-21T13:35:57.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:57.942+0000 7f6ba0acb640 1 Processor -- start 2024-05-21T13:35:57.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:57.942+0000 7f6ba0acb640 1 -- start start 2024-05-21T13:35:57.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:57.946+0000 7f6ba0acb640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6b9c1588e0 0x7f6b9c06e330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:57.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:57.946+0000 7f6ba0acb640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6b9c0c5ac0 0x7f6b9c0c5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:57.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:57.946+0000 7f6ba0acb640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6b9c0c8f10 con 0x7f6b9c06df50 2024-05-21T13:35:57.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:57.946+0000 7f6ba0acb640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f6b9c15b610 con 0x7f6b9c1588e0 2024-05-21T13:35:57.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:57.946+0000 7f6ba0acb640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f6b9c15b8d0 con 0x7f6b9c0c5ac0 2024-05-21T13:35:57.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:57.946+0000 7f6b99d9b640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6b9c1588e0 0x7f6b9c06e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:57.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:57.946+0000 7f6b9ad9d640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6b9c0c5ac0 0x7f6b9c0c5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:57.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:57.946+0000 7f6b99d9b640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6b9c1588e0 0x7f6b9c06e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.22:39050/0 (socket says 172.21.15.22:39050) 2024-05-21T13:35:57.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:57.946+0000 7f6b99d9b640 1 -- 172.21.15.22:0/2037640469 learned_addr learned my addr 172.21.15.22:0/2037640469 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:35:57.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:57.946+0000 7f6b9a59c640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f6b9c06df50 0x7f6b9c0c8760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.22:48164/0 (socket says 172.21.15.22:48164) 2024-05-21T13:35:57.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:57.946+0000 7f6b99d9b640 1 -- 172.21.15.22:0/2037640469 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6b9c0c5ac0 msgr2=0x7f6b9c0c5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:35:57.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:57.946+0000 7f6b99d9b640 1 --2- 172.21.15.22:0/2037640469 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6b9c0c5ac0 0x7f6b9c0c5ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:57.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:57.946+0000 7f6b99d9b640 1 -- 172.21.15.22:0/2037640469 >> v1:172.21.15.115:6789/0 conn(0x7f6b9c06df50 legacy=0x7f6b9c0c8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:57.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:57.946+0000 7f6b9959a640 1 -- 172.21.15.22:0/2037640469 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2290407465 0 0) 0x7f6b9c0c8f10 con 0x7f6b9c06df50 2024-05-21T13:35:57.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:57.946+0000 7f6b99d9b640 1 -- 172.21.15.22:0/2037640469 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b9c15bbb0 con 0x7f6b9c1588e0 2024-05-21T13:35:57.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:57.946+0000 7f6b9ad9d640 1 --2- 172.21.15.22:0/2037640469 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6b9c0c5ac0 0x7f6b9c0c5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-21T13:35:57.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:57.950+0000 7f6b99d9b640 1 --2- 172.21.15.22:0/2037640469 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6b9c1588e0 0x7f6b9c06e330 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6b90009870 tx=0x7f6b9001fe60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2102c3f1f511dd77 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:35:57.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:57.950+0000 7f6b9959a640 1 -- 172.21.15.22:0/2037640469 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b900b6070 con 0x7f6b9c1588e0 2024-05-21T13:35:57.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:57.950+0000 7f6b9959a640 1 -- 172.21.15.22:0/2037640469 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b900a9b60 con 0x7f6b9c1588e0 2024-05-21T13:35:57.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:57.950+0000 7f6b9959a640 1 -- 172.21.15.22:0/2037640469 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b900b1440 con 0x7f6b9c1588e0 2024-05-21T13:35:57.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:57.950+0000 7f6ba0acb640 1 -- 172.21.15.22:0/2037640469 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6b9c1588e0 msgr2=0x7f6b9c06e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:57.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:57.950+0000 7f6ba0acb640 1 --2- 172.21.15.22:0/2037640469 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6b9c1588e0 0x7f6b9c06e330 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6b90009870 tx=0x7f6b9001fe60 comp rx=0 tx=0).stop 2024-05-21T13:35:57.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:57.950+0000 7f6ba0acb640 1 -- 172.21.15.22:0/2037640469 shutdown_connections 2024-05-21T13:35:57.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:57.950+0000 7f6ba0acb640 1 --2- 172.21.15.22:0/2037640469 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6b9c0c5ac0 0x7f6b9c0c5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:57.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:57.950+0000 7f6ba0acb640 1 --2- 172.21.15.22:0/2037640469 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6b9c1588e0 0x7f6b9c06e330 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:57.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:57.950+0000 7f6ba0acb640 1 -- 172.21.15.22:0/2037640469 >> 172.21.15.22:0/2037640469 conn(0x7f6b9c06cc50 msgr2=0x7f6b9c0cd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:35:57.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:57.950+0000 7f6ba0acb640 1 -- 172.21.15.22:0/2037640469 shutdown_connections 2024-05-21T13:35:57.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:57.950+0000 7f6ba0acb640 1 -- 172.21.15.22:0/2037640469 wait complete. 2024-05-21T13:35:57.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:57.950+0000 7f6ba0acb640 1 Processor -- start 2024-05-21T13:35:57.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:57.950+0000 7f6ba0acb640 1 -- start start 2024-05-21T13:35:57.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:57.954+0000 7f6ba0acb640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6b9c06df50 0x7f6b9c1f3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:57.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:57.954+0000 7f6ba0acb640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6b9c0c5ac0 0x7f6b9c144650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:57.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:57.954+0000 7f6ba0acb640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6b9c1588e0 0x7f6b9c072570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:57.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:57.954+0000 7f6ba0acb640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6b9c0723f0 con 0x7f6b9c06df50 2024-05-21T13:35:57.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:57.954+0000 7f6ba0acb640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f6b9c158cf0 con 0x7f6b9c1588e0 2024-05-21T13:35:57.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:57.954+0000 7f6ba0acb640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f6b9c14ec10 con 0x7f6b9c0c5ac0 2024-05-21T13:35:57.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:57.954+0000 7f6b9a59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6b9c06df50 0x7f6b9c1f3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:57.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:57.954+0000 7f6b9a59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6b9c06df50 0x7f6b9c1f3550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37690/0 (socket says 172.21.15.22:37690) 2024-05-21T13:35:57.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:57.954+0000 7f6b9a59c640 1 -- 172.21.15.22:0/1208500038 learned_addr learned my addr 172.21.15.22:0/1208500038 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:35:57.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:57.954+0000 7f6b9ad9d640 1 --2- 172.21.15.22:0/1208500038 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6b9c1588e0 0x7f6b9c072570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:57.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:57.954+0000 7f6b99d9b640 1 --2- 172.21.15.22:0/1208500038 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6b9c0c5ac0 0x7f6b9c144650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:57.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:57.954+0000 7f6b9a59c640 1 -- 172.21.15.22:0/1208500038 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6b9c0c5ac0 msgr2=0x7f6b9c144650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:57.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:57.954+0000 7f6b9a59c640 1 --2- 172.21.15.22:0/1208500038 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6b9c0c5ac0 0x7f6b9c144650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:57.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:57.954+0000 7f6b9a59c640 1 -- 172.21.15.22:0/1208500038 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6b9c1588e0 msgr2=0x7f6b9c072570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:57.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:57.954+0000 7f6b9a59c640 1 --2- 172.21.15.22:0/1208500038 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6b9c1588e0 0x7f6b9c072570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:57.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:57.954+0000 7f6b9a59c640 1 -- 172.21.15.22:0/1208500038 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b9c073200 con 0x7f6b9c06df50 2024-05-21T13:35:57.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:57.954+0000 7f6b9ad9d640 1 --2- 172.21.15.22:0/1208500038 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6b9c1588e0 0x7f6b9c072570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T13:35:57.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:57.954+0000 7f6b9a59c640 1 --2- 172.21.15.22:0/1208500038 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6b9c06df50 0x7f6b9c1f3550 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c00c3f0 tx=0x7f6b8c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:35:57.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:57.954+0000 7f6b8affd640 1 -- 172.21.15.22:0/1208500038 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b8c0074e0 con 0x7f6b9c06df50 2024-05-21T13:35:57.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:57.954+0000 7f6b8affd640 1 -- 172.21.15.22:0/1208500038 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b8c0047f0 con 0x7f6b9c06df50 2024-05-21T13:35:57.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:57.954+0000 7f6ba0acb640 1 -- 172.21.15.22:0/1208500038 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b9c0cd8a0 con 0x7f6b9c06df50 2024-05-21T13:35:57.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:57.954+0000 7f6b8affd640 1 -- 172.21.15.22:0/1208500038 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b8c007680 con 0x7f6b9c06df50 2024-05-21T13:35:57.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:57.954+0000 7f6ba0acb640 1 -- 172.21.15.22:0/1208500038 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b9c0cde60 con 0x7f6b9c06df50 2024-05-21T13:35:57.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:57.954+0000 7f6ba0acb640 1 -- 172.21.15.22:0/1208500038 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b9c0766d0 con 0x7f6b9c06df50 2024-05-21T13:35:57.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:57.954+0000 7f6b8affd640 1 -- 172.21.15.22:0/1208500038 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f6b8c011070 con 0x7f6b9c06df50 2024-05-21T13:35:57.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:57.954+0000 7f6b8affd640 1 --2- 172.21.15.22:0/1208500038 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f6b7c06f400 0x7f6b7c0718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:57.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:57.958+0000 7f6b8affd640 1 -- 172.21.15.22:0/1208500038 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5709+0+0 (secure 0 0 0) 0x7f6b8c08eee0 con 0x7f6b9c06df50 2024-05-21T13:35:57.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:57.958+0000 7f6b99d9b640 1 --2- 172.21.15.22:0/1208500038 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f6b7c06f400 0x7f6b7c0718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:57.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:57.958+0000 7f6b99d9b640 1 --2- 172.21.15.22:0/1208500038 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f6b7c06f400 0x7f6b7c0718c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6b900b3000 tx=0x7f6b900ab070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:35:57.941 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:57.962+0000 7f6b8affd640 1 -- 172.21.15.22:0/1208500038 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f6b9c073200 con 0x7f6b9c06df50 2024-05-21T13:35:58.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:58.130+0000 7f6ba0acb640 1 -- 172.21.15.22:0/1208500038 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f6b9c077bb0 con 0x7f6b9c06df50 2024-05-21T13:35:58.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:58.746+0000 7f6b8affd640 1 -- 172.21.15.22:0/1208500038 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v21) ==== 157+0+0 (secure 0 0 0) 0x7f6b8c05bd30 con 0x7f6b9c06df50 2024-05-21T13:35:58.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:58.746+0000 7f6ba0acb640 1 -- 172.21.15.22:0/1208500038 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f6b7c06f400 msgr2=0x7f6b7c0718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:58.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:58.746+0000 7f6ba0acb640 1 --2- 172.21.15.22:0/1208500038 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f6b7c06f400 0x7f6b7c0718c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f6b900b3000 tx=0x7f6b900ab070 comp rx=0 tx=0).stop 2024-05-21T13:35:58.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:58.746+0000 7f6ba0acb640 1 -- 172.21.15.22:0/1208500038 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6b9c06df50 msgr2=0x7f6b9c1f3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:58.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:58.746+0000 7f6ba0acb640 1 --2- 172.21.15.22:0/1208500038 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6b9c06df50 0x7f6b9c1f3550 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c00c3f0 tx=0x7f6b8c00c8b0 comp rx=0 tx=0).stop 2024-05-21T13:35:58.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:58.746+0000 7f6ba0acb640 1 -- 172.21.15.22:0/1208500038 shutdown_connections 2024-05-21T13:35:58.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:58.746+0000 7f6ba0acb640 1 --2- 172.21.15.22:0/1208500038 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f6b7c06f400 0x7f6b7c0718c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:58.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:58.746+0000 7f6ba0acb640 1 --2- 172.21.15.22:0/1208500038 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6b9c1588e0 0x7f6b9c072570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:58.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:58.746+0000 7f6ba0acb640 1 --2- 172.21.15.22:0/1208500038 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6b9c0c5ac0 0x7f6b9c144650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:58.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:58.746+0000 7f6ba0acb640 1 --2- 172.21.15.22:0/1208500038 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6b9c06df50 0x7f6b9c1f3550 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:58.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:58.746+0000 7f6ba0acb640 1 -- 172.21.15.22:0/1208500038 >> 172.21.15.22:0/1208500038 conn(0x7f6b9c06cc50 msgr2=0x7f6b9c155d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:35:58.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:58.746+0000 7f6ba0acb640 1 -- 172.21.15.22:0/1208500038 shutdown_connections 2024-05-21T13:35:58.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:58.746+0000 7f6ba0acb640 1 -- 172.21.15.22:0/1208500038 wait complete. 2024-05-21T13:35:58.752 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-05-21T13:35:58.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:58.914+0000 7f358df23640 1 Processor -- start 2024-05-21T13:35:58.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:58.914+0000 7f358df23640 1 -- start start 2024-05-21T13:35:58.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:58.914+0000 7f358df23640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f35880c47f0 0x7f358815d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:58.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:58.914+0000 7f358df23640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3588159b20 con 0x7f358815d650 2024-05-21T13:35:58.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:58.914+0000 7f358df23640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35880c9a60 con 0x7f3588153b20 2024-05-21T13:35:58.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:58.914+0000 7f358df23640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f3588159da0 con 0x7f35880c47f0 2024-05-21T13:35:58.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:58.914+0000 7f3587fff640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f358815d650 0x7f358806df50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:51732/0 (socket says 172.21.15.22:51732) 2024-05-21T13:35:58.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:58.914+0000 7f3587fff640 1 -- 172.21.15.22:0/3628943354 learned_addr learned my addr 172.21.15.22:0/3628943354 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-21T13:35:58.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:58.914+0000 7f3586ffd640 1 --2- 172.21.15.22:0/3628943354 >> v2:172.21.15.22:3300/0 conn(0x7f35880c47f0 0x7f358815d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:58.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:58.914+0000 7f35867fc640 1 -- 172.21.15.22:0/3628943354 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 214289758 0 0) 0x7f35800014a0 con 0x7f358815d650 2024-05-21T13:35:58.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:58.914+0000 7f35867fc640 1 -- 172.21.15.22:0/3628943354 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3570003530 con 0x7f358815d650 2024-05-21T13:35:58.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:58.914+0000 7f35867fc640 1 -- 172.21.15.22:0/3628943354 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 498934567 0 0) 0x7f3570003530 con 0x7f358815d650 2024-05-21T13:35:58.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:58.914+0000 7f3586ffd640 1 -- 172.21.15.22:0/3628943354 >> v1:172.21.15.115:6789/0 conn(0x7f3588153b20 legacy=0x7f35880c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:58.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:58.914+0000 7f3586ffd640 1 -- 172.21.15.22:0/3628943354 >> v1:172.21.15.22:6789/0 conn(0x7f358815d650 legacy=0x7f358806df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:58.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:58.914+0000 7f3586ffd640 1 -- 172.21.15.22:0/3628943354 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f358815a080 con 0x7f35880c47f0 2024-05-21T13:35:58.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:58.918+0000 7f3586ffd640 1 --2- 172.21.15.22:0/3628943354 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f35880c47f0 0x7f358815d110 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f35780097c0 tx=0x7f357801ebb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2481e51985c8ee9e server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:35:58.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:58.918+0000 7f35867fc640 1 -- 172.21.15.22:0/3628943354 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35780b5070 con 0x7f35880c47f0 2024-05-21T13:35:58.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:58.918+0000 7f35867fc640 1 -- 172.21.15.22:0/3628943354 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35780a8630 con 0x7f35880c47f0 2024-05-21T13:35:58.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:58.918+0000 7f35867fc640 1 -- 172.21.15.22:0/3628943354 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3580001c50 con 0x7f35880c47f0 2024-05-21T13:35:58.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:58.918+0000 7f358df23640 1 -- 172.21.15.22:0/3628943354 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f35880c47f0 msgr2=0x7f358815d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:58.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:58.918+0000 7f358df23640 1 --2- 172.21.15.22:0/3628943354 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f35880c47f0 0x7f358815d110 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f35780097c0 tx=0x7f357801ebb0 comp rx=0 tx=0).stop 2024-05-21T13:35:58.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:58.918+0000 7f358df23640 1 -- 172.21.15.22:0/3628943354 shutdown_connections 2024-05-21T13:35:58.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:58.918+0000 7f358df23640 1 --2- 172.21.15.22:0/3628943354 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f35880c47f0 0x7f358815d110 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:58.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:58.918+0000 7f358df23640 1 -- 172.21.15.22:0/3628943354 >> 172.21.15.22:0/3628943354 conn(0x7f358806ce70 msgr2=0x7f35880cd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:35:58.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:58.918+0000 7f358df23640 1 -- 172.21.15.22:0/3628943354 shutdown_connections 2024-05-21T13:35:58.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:58.918+0000 7f358df23640 1 -- 172.21.15.22:0/3628943354 wait complete. 2024-05-21T13:35:58.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:58.922+0000 7f358df23640 1 Processor -- start 2024-05-21T13:35:58.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:58.922+0000 7f358df23640 1 -- start start 2024-05-21T13:35:58.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:58.922+0000 7f358df23640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f35880c47f0 0x7f3588073610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:58.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:58.922+0000 7f358df23640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3588153b20 0x7f35881f2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:58.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:58.922+0000 7f358df23640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f358815d650 0x7f3588146b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:58.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:58.922+0000 7f358df23640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f35880c9730 con 0x7f3588153b20 2024-05-21T13:35:58.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:58.922+0000 7f358df23640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f358815a640 con 0x7f358815d650 2024-05-21T13:35:58.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:58.922+0000 7f358df23640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f3588153f00 con 0x7f35880c47f0 2024-05-21T13:35:58.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:58.922+0000 7f3586ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3588153b20 0x7f35881f2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:58.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:58.922+0000 7f3586ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3588153b20 0x7f35881f2460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37720/0 (socket says 172.21.15.22:37720) 2024-05-21T13:35:58.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:58.922+0000 7f3586ffd640 1 -- 172.21.15.22:0/390524077 learned_addr learned my addr 172.21.15.22:0/390524077 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:35:58.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:58.922+0000 7f35877fe640 1 --2- 172.21.15.22:0/390524077 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f35880c47f0 0x7f3588073610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:58.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:58.922+0000 7f3587fff640 1 --2- 172.21.15.22:0/390524077 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f358815d650 0x7f3588146b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:58.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:58.922+0000 7f3586ffd640 1 -- 172.21.15.22:0/390524077 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f35880c47f0 msgr2=0x7f3588073610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:58.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:58.922+0000 7f3586ffd640 1 --2- 172.21.15.22:0/390524077 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f35880c47f0 0x7f3588073610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:58.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:58.922+0000 7f3586ffd640 1 -- 172.21.15.22:0/390524077 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f358815d650 msgr2=0x7f3588146b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:35:58.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:58.922+0000 7f3586ffd640 1 --2- 172.21.15.22:0/390524077 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f358815d650 0x7f3588146b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:35:58.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:58.922+0000 7f3586ffd640 1 -- 172.21.15.22:0/390524077 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35881532f0 con 0x7f3588153b20 2024-05-21T13:35:58.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:58.922+0000 7f3587fff640 1 --2- 172.21.15.22:0/390524077 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f358815d650 0x7f3588146b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:35:58.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:58.922+0000 7f3586ffd640 1 --2- 172.21.15.22:0/390524077 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3588153b20 0x7f35881f2460 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f35780097c0 tx=0x7f357801b950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:35:58.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:58.922+0000 7f356ffff640 1 -- 172.21.15.22:0/390524077 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35780b5040 con 0x7f3588153b20 2024-05-21T13:35:58.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:58.922+0000 7f356ffff640 1 -- 172.21.15.22:0/390524077 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35780bf070 con 0x7f3588153b20 2024-05-21T13:35:58.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:58.922+0000 7f356ffff640 1 -- 172.21.15.22:0/390524077 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35780b0840 con 0x7f3588153b20 2024-05-21T13:35:58.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:58.922+0000 7f358df23640 1 -- 172.21.15.22:0/390524077 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35880c93d0 con 0x7f3588153b20 2024-05-21T13:35:58.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:58.922+0000 7f358df23640 1 -- 172.21.15.22:0/390524077 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3588153010 con 0x7f3588153b20 2024-05-21T13:35:58.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:58.922+0000 7f358df23640 1 -- 172.21.15.22:0/390524077 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3588077bb0 con 0x7f3588153b20 2024-05-21T13:35:58.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:58.922+0000 7f356ffff640 1 -- 172.21.15.22:0/390524077 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f35780b09e0 con 0x7f3588153b20 2024-05-21T13:35:58.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:58.926+0000 7f356ffff640 1 --2- 172.21.15.22:0/390524077 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f357406f430 0x7f35740718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:35:58.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:58.926+0000 7f356ffff640 1 -- 172.21.15.22:0/390524077 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 6007+0+0 (secure 0 0 0) 0x7f357812c170 con 0x7f3588153b20 2024-05-21T13:35:58.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:58.926+0000 7f35877fe640 1 --2- 172.21.15.22:0/390524077 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f357406f430 0x7f35740718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:35:58.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:58.926+0000 7f35877fe640 1 --2- 172.21.15.22:0/390524077 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f357406f430 0x7f35740718f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f357c000f70 tx=0x7f357c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:35:58.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:58.930+0000 7f356ffff640 1 -- 172.21.15.22:0/390524077 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f35780c8020 con 0x7f3588153b20 2024-05-21T13:35:59.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:35:59.090+0000 7f358df23640 1 -- 172.21.15.22:0/390524077 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f35880c8810 con 0x7f3588153b20 2024-05-21T13:35:59.104 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-21T13:35:59.107 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-21T13:36:00.765 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:00.782+0000 7f356ffff640 1 -- 172.21.15.22:0/390524077 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v23) ==== 228+0+0 (secure 0 0 0) 0x7f3578018710 con 0x7f3588153b20 2024-05-21T13:36:00.765 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_data_ec' created 2024-05-21T13:36:00.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:00.786+0000 7f358df23640 1 -- 172.21.15.22:0/390524077 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f357406f430 msgr2=0x7f35740718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:00.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:00.786+0000 7f358df23640 1 --2- 172.21.15.22:0/390524077 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f357406f430 0x7f35740718f0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f357c000f70 tx=0x7f357c009040 comp rx=0 tx=0).stop 2024-05-21T13:36:00.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:00.786+0000 7f358df23640 1 -- 172.21.15.22:0/390524077 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3588153b20 msgr2=0x7f35881f2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:00.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:00.786+0000 7f358df23640 1 --2- 172.21.15.22:0/390524077 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3588153b20 0x7f35881f2460 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f35780097c0 tx=0x7f357801b950 comp rx=0 tx=0).stop 2024-05-21T13:36:00.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:00.786+0000 7f358df23640 1 -- 172.21.15.22:0/390524077 shutdown_connections 2024-05-21T13:36:00.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:00.786+0000 7f358df23640 1 --2- 172.21.15.22:0/390524077 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f357406f430 0x7f35740718f0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:00.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:00.786+0000 7f358df23640 1 --2- 172.21.15.22:0/390524077 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f358815d650 0x7f3588146b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:00.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:00.786+0000 7f358df23640 1 --2- 172.21.15.22:0/390524077 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3588153b20 0x7f35881f2460 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:00.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:00.786+0000 7f358df23640 1 --2- 172.21.15.22:0/390524077 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f35880c47f0 0x7f3588073610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:00.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:00.786+0000 7f358df23640 1 -- 172.21.15.22:0/390524077 >> 172.21.15.22:0/390524077 conn(0x7f358806ce70 msgr2=0x7f358806df50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:00.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:00.786+0000 7f358df23640 1 -- 172.21.15.22:0/390524077 shutdown_connections 2024-05-21T13:36:00.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:00.786+0000 7f358df23640 1 -- 172.21.15.22:0/390524077 wait complete. 2024-05-21T13:36:00.797 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-05-21T13:36:00.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:00.946+0000 7fe955ed8640 1 Processor -- start 2024-05-21T13:36:00.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:00.946+0000 7fe955ed8640 1 -- start start 2024-05-21T13:36:00.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:00.946+0000 7fe955ed8640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe950155ea0 0x7fe9500c72b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:00.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:00.946+0000 7fe955ed8640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe950156280 con 0x7fe9500c7e80 2024-05-21T13:36:00.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:00.946+0000 7fe955ed8640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9500c77f0 con 0x7fe95015baf0 2024-05-21T13:36:00.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:00.946+0000 7fe955ed8640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fe95015fcb0 con 0x7fe950155ea0 2024-05-21T13:36:00.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:00.946+0000 7fe94f7fe640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe950155ea0 0x7fe9500c72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:00.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:00.946+0000 7fe94effd640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fe9500c7e80 0x7fe95006df50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:51740/0 (socket says 172.21.15.22:51740) 2024-05-21T13:36:00.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:00.946+0000 7fe94effd640 1 -- 172.21.15.22:0/1670426686 learned_addr learned my addr 172.21.15.22:0/1670426686 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-21T13:36:00.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:00.946+0000 7fe94f7fe640 1 -- 172.21.15.22:0/1670426686 >> v1:172.21.15.115:6789/0 conn(0x7fe95015baf0 legacy=0x7fe950166470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:00.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:00.946+0000 7fe94f7fe640 1 -- 172.21.15.22:0/1670426686 >> v1:172.21.15.22:6789/0 conn(0x7fe9500c7e80 legacy=0x7fe95006df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:00.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:00.946+0000 7fe94f7fe640 1 -- 172.21.15.22:0/1670426686 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe95015f0e0 con 0x7fe950155ea0 2024-05-21T13:36:00.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:00.950+0000 7fe94f7fe640 1 --2- 172.21.15.22:0/1670426686 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe950155ea0 0x7fe9500c72b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe9400097c0 tx=0x7fe94001ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1796e4f408c76461 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:00.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:00.950+0000 7fe94e7fc640 1 -- 172.21.15.22:0/1670426686 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9400b5070 con 0x7fe950155ea0 2024-05-21T13:36:00.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:00.950+0000 7fe94e7fc640 1 -- 172.21.15.22:0/1670426686 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9400a8990 con 0x7fe950155ea0 2024-05-21T13:36:00.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:00.950+0000 7fe94e7fc640 1 -- 172.21.15.22:0/1670426686 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9400a8d60 con 0x7fe950155ea0 2024-05-21T13:36:00.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:00.950+0000 7fe955ed8640 1 -- 172.21.15.22:0/1670426686 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe950155ea0 msgr2=0x7fe9500c72b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:00.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:00.950+0000 7fe955ed8640 1 --2- 172.21.15.22:0/1670426686 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe950155ea0 0x7fe9500c72b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fe9400097c0 tx=0x7fe94001ec90 comp rx=0 tx=0).stop 2024-05-21T13:36:00.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:00.950+0000 7fe955ed8640 1 -- 172.21.15.22:0/1670426686 shutdown_connections 2024-05-21T13:36:00.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:00.950+0000 7fe955ed8640 1 --2- 172.21.15.22:0/1670426686 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe950155ea0 0x7fe9500c72b0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:00.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:00.950+0000 7fe955ed8640 1 -- 172.21.15.22:0/1670426686 >> 172.21.15.22:0/1670426686 conn(0x7fe95006cc50 msgr2=0x7fe9500cd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:00.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:00.950+0000 7fe955ed8640 1 -- 172.21.15.22:0/1670426686 shutdown_connections 2024-05-21T13:36:00.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:00.950+0000 7fe955ed8640 1 -- 172.21.15.22:0/1670426686 wait complete. 2024-05-21T13:36:00.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:00.950+0000 7fe955ed8640 1 Processor -- start 2024-05-21T13:36:00.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:00.950+0000 7fe955ed8640 1 -- start start 2024-05-21T13:36:00.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:00.954+0000 7fe955ed8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9500c7e80 0x7fe9501f25a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:00.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:00.954+0000 7fe955ed8640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe950155ea0 0x7fe9500cb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:00.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:00.954+0000 7fe955ed8640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe95015baf0 0x7fe9500c9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:00.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:00.954+0000 7fe955ed8640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe95015f660 con 0x7fe9500c7e80 2024-05-21T13:36:00.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:00.954+0000 7fe955ed8640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fe95015f380 con 0x7fe95015baf0 2024-05-21T13:36:00.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:00.954+0000 7fe955ed8640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7fe95015f940 con 0x7fe950155ea0 2024-05-21T13:36:00.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:00.954+0000 7fe94f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9500c7e80 0x7fe9501f25a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:00.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:00.954+0000 7fe94f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9500c7e80 0x7fe9501f25a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37736/0 (socket says 172.21.15.22:37736) 2024-05-21T13:36:00.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:00.954+0000 7fe94f7fe640 1 -- 172.21.15.22:0/1647122018 learned_addr learned my addr 172.21.15.22:0/1647122018 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:00.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:00.954+0000 7fe94ffff640 1 --2- 172.21.15.22:0/1647122018 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe95015baf0 0x7fe9500c9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:00.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:00.954+0000 7fe94f7fe640 1 -- 172.21.15.22:0/1647122018 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe950155ea0 msgr2=0x7fe9500cb0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:00.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:00.954+0000 7fe94effd640 1 --2- 172.21.15.22:0/1647122018 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe950155ea0 0x7fe9500cb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:00.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:00.954+0000 7fe94f7fe640 1 --2- 172.21.15.22:0/1647122018 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe950155ea0 0x7fe9500cb0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:00.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:00.954+0000 7fe94f7fe640 1 -- 172.21.15.22:0/1647122018 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe95015baf0 msgr2=0x7fe9500c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:00.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:00.954+0000 7fe94f7fe640 1 --2- 172.21.15.22:0/1647122018 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe95015baf0 0x7fe9500c9fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:00.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:00.954+0000 7fe94f7fe640 1 -- 172.21.15.22:0/1647122018 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9501f5820 con 0x7fe9500c7e80 2024-05-21T13:36:00.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:00.954+0000 7fe94ffff640 1 --2- 172.21.15.22:0/1647122018 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe95015baf0 0x7fe9500c9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:36:00.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:00.954+0000 7fe94f7fe640 1 --2- 172.21.15.22:0/1647122018 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9500c7e80 0x7fe9501f25a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe9400097c0 tx=0x7fe94001ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:00.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:00.954+0000 7fe937fff640 1 -- 172.21.15.22:0/1647122018 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9400bf070 con 0x7fe9500c7e80 2024-05-21T13:36:00.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:00.954+0000 7fe937fff640 1 -- 172.21.15.22:0/1647122018 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9400b0920 con 0x7fe9500c7e80 2024-05-21T13:36:00.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:00.954+0000 7fe955ed8640 1 -- 172.21.15.22:0/1647122018 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe95015b7e0 con 0x7fe9500c7e80 2024-05-21T13:36:00.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:00.954+0000 7fe937fff640 1 -- 172.21.15.22:0/1647122018 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9400b5040 con 0x7fe9500c7e80 2024-05-21T13:36:00.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:00.954+0000 7fe955ed8640 1 -- 172.21.15.22:0/1647122018 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9501f5da0 con 0x7fe9500c7e80 2024-05-21T13:36:00.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:00.954+0000 7fe955ed8640 1 -- 172.21.15.22:0/1647122018 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9500766d0 con 0x7fe9500c7e80 2024-05-21T13:36:00.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:00.954+0000 7fe937fff640 1 -- 172.21.15.22:0/1647122018 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fe9400c2070 con 0x7fe9500c7e80 2024-05-21T13:36:00.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:00.954+0000 7fe937fff640 1 --2- 172.21.15.22:0/1647122018 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fe93c06f400 0x7fe93c0718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:00.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:00.954+0000 7fe937fff640 1 -- 172.21.15.22:0/1647122018 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6500+0+0 (secure 0 0 0) 0x7fe94012bff0 con 0x7fe9500c7e80 2024-05-21T13:36:00.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:00.958+0000 7fe94effd640 1 --2- 172.21.15.22:0/1647122018 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fe93c06f400 0x7fe93c0718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:00.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:00.958+0000 7fe94effd640 1 --2- 172.21.15.22:0/1647122018 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fe93c06f400 0x7fe93c0718c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe9501ef5e0 tx=0x7fe944009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:00.941 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:00.958+0000 7fe937fff640 1 -- 172.21.15.22:0/1647122018 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fe9400187f0 con 0x7fe9500c7e80 2024-05-21T13:36:01.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:01.122+0000 7fe955ed8640 1 -- 172.21.15.22:0/1647122018 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7fe9500c89e0 con 0x7fe9500c7e80 2024-05-21T13:36:01.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:01.790+0000 7fe937fff640 1 -- 172.21.15.22:0/1647122018 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v24) ==== 169+0+0 (secure 0 0 0) 0x7fe9400f8c70 con 0x7fe9500c7e80 2024-05-21T13:36:01.774 INFO:teuthology.orchestra.run.smithi022.stderr:set pool 4 allow_ec_overwrites to true 2024-05-21T13:36:01.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:01.794+0000 7fe955ed8640 1 -- 172.21.15.22:0/1647122018 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fe93c06f400 msgr2=0x7fe93c0718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:01.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:01.794+0000 7fe955ed8640 1 --2- 172.21.15.22:0/1647122018 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fe93c06f400 0x7fe93c0718c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe9501ef5e0 tx=0x7fe944009040 comp rx=0 tx=0).stop 2024-05-21T13:36:01.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:01.794+0000 7fe955ed8640 1 -- 172.21.15.22:0/1647122018 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9500c7e80 msgr2=0x7fe9501f25a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:01.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:01.794+0000 7fe955ed8640 1 --2- 172.21.15.22:0/1647122018 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9500c7e80 0x7fe9501f25a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fe9400097c0 tx=0x7fe94001ba30 comp rx=0 tx=0).stop 2024-05-21T13:36:01.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:01.798+0000 7fe955ed8640 1 -- 172.21.15.22:0/1647122018 shutdown_connections 2024-05-21T13:36:01.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:01.798+0000 7fe955ed8640 1 --2- 172.21.15.22:0/1647122018 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fe93c06f400 0x7fe93c0718c0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:01.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:01.798+0000 7fe955ed8640 1 --2- 172.21.15.22:0/1647122018 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe95015baf0 0x7fe9500c9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:01.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:01.798+0000 7fe955ed8640 1 --2- 172.21.15.22:0/1647122018 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe950155ea0 0x7fe9500cb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:01.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:01.798+0000 7fe955ed8640 1 --2- 172.21.15.22:0/1647122018 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe9500c7e80 0x7fe9501f25a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:01.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:01.798+0000 7fe955ed8640 1 -- 172.21.15.22:0/1647122018 >> 172.21.15.22:0/1647122018 conn(0x7fe95006cc50 msgr2=0x7fe9500cd2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:01.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:01.798+0000 7fe955ed8640 1 -- 172.21.15.22:0/1647122018 shutdown_connections 2024-05-21T13:36:01.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:01.798+0000 7fe955ed8640 1 -- 172.21.15.22:0/1647122018 wait complete. 2024-05-21T13:36:01.821 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-05-21T13:36:01.949 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:01.966+0000 7f8911765640 1 Processor -- start 2024-05-21T13:36:01.949 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:01.966+0000 7f8911765640 1 -- start start 2024-05-21T13:36:01.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:01.970+0000 7f8911765640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f890c152b80 0x7f890c0c7580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:01.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:01.970+0000 7f8911765640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f890c0c8570 0x7f890c0c7ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:01.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:01.970+0000 7f8911765640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f890c074590 0x7f890c1588b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:01.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:01.970+0000 7f8911765640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f890c0c5d10 con 0x7f890c074590 2024-05-21T13:36:01.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:01.970+0000 7f8911765640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f890c073860 con 0x7f890c152b80 2024-05-21T13:36:01.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:01.970+0000 7f8911765640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f890c073b40 con 0x7f890c0c8570 2024-05-21T13:36:01.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:01.970+0000 7f890b7fe640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f890c074590 0x7f890c1588b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:01.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:01.970+0000 7f890b7fe640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f890c074590 0x7f890c1588b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37748/0 (socket says 172.21.15.22:37748) 2024-05-21T13:36:01.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:01.970+0000 7f890b7fe640 1 -- 172.21.15.22:0/1414846239 learned_addr learned my addr 172.21.15.22:0/1414846239 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:01.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:01.970+0000 7f890affd640 1 --2- 172.21.15.22:0/1414846239 >> v2:172.21.15.115:3300/0 conn(0x7f890c152b80 0x7f890c0c7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:01.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:01.970+0000 7f890a7fc640 1 --2- 172.21.15.22:0/1414846239 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f890c0c8570 0x7f890c0c7ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:01.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:01.970+0000 7f890b7fe640 1 -- 172.21.15.22:0/1414846239 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f890c0c8570 msgr2=0x7f890c0c7ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:01.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:01.970+0000 7f890b7fe640 1 --2- 172.21.15.22:0/1414846239 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f890c0c8570 0x7f890c0c7ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:01.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:01.970+0000 7f890b7fe640 1 -- 172.21.15.22:0/1414846239 >> v2:172.21.15.115:3300/0 conn(0x7f890c152b80 msgr2=0x7f890c0c7580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:01.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:01.970+0000 7f890b7fe640 1 --2- 172.21.15.22:0/1414846239 >> v2:172.21.15.115:3300/0 conn(0x7f890c152b80 0x7f890c0c7580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:01.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:01.970+0000 7f890b7fe640 1 -- 172.21.15.22:0/1414846239 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f890c0c59a0 con 0x7f890c074590 2024-05-21T13:36:01.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:01.970+0000 7f890a7fc640 1 --2- 172.21.15.22:0/1414846239 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f890c0c8570 0x7f890c0c7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:36:01.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:01.970+0000 7f890b7fe640 1 --2- 172.21.15.22:0/1414846239 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f890c074590 0x7f890c1588b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f890c0cb9b0 tx=0x7f890401c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53d6490de354a4a4 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:01.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:01.970+0000 7f8909ffb640 1 -- 172.21.15.22:0/1414846239 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89040a56f0 con 0x7f890c074590 2024-05-21T13:36:01.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:01.970+0000 7f8909ffb640 1 -- 172.21.15.22:0/1414846239 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89040a5890 con 0x7f890c074590 2024-05-21T13:36:01.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:01.970+0000 7f8909ffb640 1 -- 172.21.15.22:0/1414846239 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89040a5c60 con 0x7f890c074590 2024-05-21T13:36:01.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:01.970+0000 7f8911765640 1 -- 172.21.15.22:0/1414846239 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f890c074590 msgr2=0x7f890c1588b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:01.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:01.974+0000 7f8911765640 1 --2- 172.21.15.22:0/1414846239 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f890c074590 0x7f890c1588b0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f890c0cb9b0 tx=0x7f890401c960 comp rx=0 tx=0).stop 2024-05-21T13:36:01.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:01.974+0000 7f8911765640 1 -- 172.21.15.22:0/1414846239 shutdown_connections 2024-05-21T13:36:01.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:01.974+0000 7f8911765640 1 --2- 172.21.15.22:0/1414846239 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f890c0c8570 0x7f890c0c7ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:01.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:01.974+0000 7f8911765640 1 --2- 172.21.15.22:0/1414846239 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f890c074590 0x7f890c1588b0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:01.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:01.974+0000 7f8911765640 1 --2- 172.21.15.22:0/1414846239 >> v2:172.21.15.115:3300/0 conn(0x7f890c152b80 0x7f890c0c7580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:01.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:01.974+0000 7f8911765640 1 -- 172.21.15.22:0/1414846239 >> 172.21.15.22:0/1414846239 conn(0x7f890c0ce370 msgr2=0x7f890c0ce780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:01.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:01.974+0000 7f8911765640 1 -- 172.21.15.22:0/1414846239 shutdown_connections 2024-05-21T13:36:01.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:01.974+0000 7f8911765640 1 -- 172.21.15.22:0/1414846239 wait complete. 2024-05-21T13:36:01.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:01.974+0000 7f8911765640 1 Processor -- start 2024-05-21T13:36:01.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:01.974+0000 7f8911765640 1 -- start start 2024-05-21T13:36:01.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:01.974+0000 7f8911765640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f890c074590 0x7f890c14e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:01.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:01.974+0000 7f8911765640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f890c0c8570 0x7f890c150180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:01.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:01.974+0000 7f8911765640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f890c152b80 0x7f890c1506c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:01.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:01.974+0000 7f8911765640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f890c0ca220 con 0x7f890c152b80 2024-05-21T13:36:01.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:01.974+0000 7f8911765640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f890c0ca0a0 con 0x7f890c0c8570 2024-05-21T13:36:01.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:01.974+0000 7f8911765640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f890c0c8d70 con 0x7f890c074590 2024-05-21T13:36:01.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:01.974+0000 7f890b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f890c152b80 0x7f890c1506c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:01.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:01.974+0000 7f890b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f890c152b80 0x7f890c1506c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37762/0 (socket says 172.21.15.22:37762) 2024-05-21T13:36:01.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:01.974+0000 7f890b7fe640 1 -- 172.21.15.22:0/1594279102 learned_addr learned my addr 172.21.15.22:0/1594279102 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:01.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:01.974+0000 7f890affd640 1 --2- 172.21.15.22:0/1594279102 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f890c074590 0x7f890c14e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:01.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:01.974+0000 7f890a7fc640 1 --2- 172.21.15.22:0/1594279102 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f890c0c8570 0x7f890c150180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:01.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:01.974+0000 7f890b7fe640 1 -- 172.21.15.22:0/1594279102 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f890c074590 msgr2=0x7f890c14e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:01.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:01.974+0000 7f890b7fe640 1 --2- 172.21.15.22:0/1594279102 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f890c074590 0x7f890c14e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:01.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:01.974+0000 7f890b7fe640 1 -- 172.21.15.22:0/1594279102 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f890c0c8570 msgr2=0x7f890c150180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:01.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:01.974+0000 7f890b7fe640 1 --2- 172.21.15.22:0/1594279102 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f890c0c8570 0x7f890c150180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:01.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:01.974+0000 7f890b7fe640 1 -- 172.21.15.22:0/1594279102 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f890c1f4db0 con 0x7f890c152b80 2024-05-21T13:36:01.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:01.974+0000 7f890b7fe640 1 --2- 172.21.15.22:0/1594279102 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f890c152b80 0x7f890c1506c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f890401d200 tx=0x7f8904019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:01.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:01.974+0000 7f88f37fe640 1 -- 172.21.15.22:0/1594279102 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89040bc020 con 0x7f890c152b80 2024-05-21T13:36:01.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:01.974+0000 7f88f37fe640 1 -- 172.21.15.22:0/1594279102 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89040b8690 con 0x7f890c152b80 2024-05-21T13:36:01.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:01.974+0000 7f8911765640 1 -- 172.21.15.22:0/1594279102 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f890c1f5090 con 0x7f890c152b80 2024-05-21T13:36:01.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:01.974+0000 7f88f37fe640 1 -- 172.21.15.22:0/1594279102 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8904009510 con 0x7f890c152b80 2024-05-21T13:36:01.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:01.974+0000 7f8911765640 1 -- 172.21.15.22:0/1594279102 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f890c1f5650 con 0x7f890c152b80 2024-05-21T13:36:01.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:01.978+0000 7f8911765640 1 -- 172.21.15.22:0/1594279102 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f890c0766d0 con 0x7f890c152b80 2024-05-21T13:36:01.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:01.978+0000 7f88f37fe640 1 -- 172.21.15.22:0/1594279102 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f89040bf020 con 0x7f890c152b80 2024-05-21T13:36:01.960 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:01.978+0000 7f88f37fe640 1 --2- 172.21.15.22:0/1594279102 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f88f806f400 0x7f88f80718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:01.960 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:01.978+0000 7f88f37fe640 1 -- 172.21.15.22:0/1594279102 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6500+0+0 (secure 0 0 0) 0x7f890412a4b0 con 0x7f890c152b80 2024-05-21T13:36:01.960 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:01.978+0000 7f890affd640 1 --2- 172.21.15.22:0/1594279102 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f88f806f400 0x7f88f80718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:01.960 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:01.978+0000 7f890affd640 1 --2- 172.21.15.22:0/1594279102 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f88f806f400 0x7f88f80718c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f88fc00b9d0 tx=0x7f88fc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:01.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:01.982+0000 7f88f37fe640 1 -- 172.21.15.22:0/1594279102 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f89040c6030 con 0x7f890c152b80 2024-05-21T13:36:02.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:02.182+0000 7f8911765640 1 -- 172.21.15.22:0/1594279102 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7f890c1f5960 con 0x7f890c152b80 2024-05-21T13:36:02.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:02.802+0000 7f88f37fe640 1 -- 172.21.15.22:0/1594279102 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v5) ==== 137+0+0 (secure 0 0 0) 0x7f89040165e0 con 0x7f890c152b80 2024-05-21T13:36:02.786 INFO:teuthology.orchestra.run.smithi022.stderr:added data pool 4 to fsmap 2024-05-21T13:36:02.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:02.806+0000 7f8911765640 1 -- 172.21.15.22:0/1594279102 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f88f806f400 msgr2=0x7f88f80718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:02.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:02.806+0000 7f8911765640 1 --2- 172.21.15.22:0/1594279102 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f88f806f400 0x7f88f80718c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f88fc00b9d0 tx=0x7f88fc008040 comp rx=0 tx=0).stop 2024-05-21T13:36:02.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:02.806+0000 7f8911765640 1 -- 172.21.15.22:0/1594279102 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f890c152b80 msgr2=0x7f890c1506c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:02.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:02.806+0000 7f8911765640 1 --2- 172.21.15.22:0/1594279102 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f890c152b80 0x7f890c1506c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f890401d200 tx=0x7f8904019700 comp rx=0 tx=0).stop 2024-05-21T13:36:02.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:02.806+0000 7f8911765640 1 -- 172.21.15.22:0/1594279102 shutdown_connections 2024-05-21T13:36:02.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:02.806+0000 7f8911765640 1 --2- 172.21.15.22:0/1594279102 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f88f806f400 0x7f88f80718c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:02.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:02.806+0000 7f8911765640 1 --2- 172.21.15.22:0/1594279102 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f890c152b80 0x7f890c1506c0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:02.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:02.806+0000 7f8911765640 1 --2- 172.21.15.22:0/1594279102 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f890c0c8570 0x7f890c150180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:02.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:02.806+0000 7f8911765640 1 --2- 172.21.15.22:0/1594279102 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f890c074590 0x7f890c14e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:02.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:02.806+0000 7f8911765640 1 -- 172.21.15.22:0/1594279102 >> 172.21.15.22:0/1594279102 conn(0x7f890c0ce370 msgr2=0x7f890c0c7510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:02.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:02.806+0000 7f8911765640 1 -- 172.21.15.22:0/1594279102 shutdown_connections 2024-05-21T13:36:02.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:02.806+0000 7f8911765640 1 -- 172.21.15.22:0/1594279102 wait complete. 2024-05-21T13:36:02.811 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-21T13:36:02.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:02.958+0000 7fecca069640 1 Processor -- start 2024-05-21T13:36:02.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:02.962+0000 7fecca069640 1 -- start start 2024-05-21T13:36:02.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:02.962+0000 7fecca069640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fecc4152ae0 0x7fecc40c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:02.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:02.962+0000 7fecca069640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fecc40c8ee0 0x7fecc4074610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:02.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:02.962+0000 7fecca069640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fecc4073930 con 0x7fecc40caee0 2024-05-21T13:36:02.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:02.962+0000 7fecca069640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fecc4073eb0 con 0x7fecc4152ae0 2024-05-21T13:36:02.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:02.962+0000 7fecca069640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7fecc40c5970 con 0x7fecc40c8ee0 2024-05-21T13:36:02.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:02.962+0000 7fecc37fe640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fecc4152ae0 0x7fecc40c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:02.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:02.962+0000 7fecc37fe640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fecc4152ae0 0x7fecc40c84f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37764/0 (socket says 172.21.15.22:37764) 2024-05-21T13:36:02.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:02.962+0000 7fecc37fe640 1 -- 172.21.15.22:0/3769928726 learned_addr learned my addr 172.21.15.22:0/3769928726 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:02.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:02.962+0000 7fecc2ffd640 1 --2- 172.21.15.22:0/3769928726 >> v2:172.21.15.115:3300/0 conn(0x7fecc40c8ee0 0x7fecc4074610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:02.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:02.962+0000 7fecc37fe640 1 -- 172.21.15.22:0/3769928726 >> v2:172.21.15.115:3300/0 conn(0x7fecc40c8ee0 msgr2=0x7fecc4074610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:02.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:02.962+0000 7fecc37fe640 1 --2- 172.21.15.22:0/3769928726 >> v2:172.21.15.115:3300/0 conn(0x7fecc40c8ee0 0x7fecc4074610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:02.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:02.962+0000 7fecc37fe640 1 -- 172.21.15.22:0/3769928726 >> v1:172.21.15.115:6789/0 conn(0x7fecc40caee0 legacy=0x7fecc4158bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:02.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:02.962+0000 7fecc37fe640 1 -- 172.21.15.22:0/3769928726 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecc40c5c50 con 0x7fecc4152ae0 2024-05-21T13:36:02.948 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:02.966+0000 7fecc37fe640 1 --2- 172.21.15.22:0/3769928726 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fecc4152ae0 0x7fecc40c84f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fecc40c9400 tx=0x7fecb401cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b66f38aa26282776 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:02.948 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:02.966+0000 7fecc27fc640 1 -- 172.21.15.22:0/3769928726 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecb40aa430 con 0x7fecc4152ae0 2024-05-21T13:36:02.948 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:02.966+0000 7fecc27fc640 1 -- 172.21.15.22:0/3769928726 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecb40af070 con 0x7fecc4152ae0 2024-05-21T13:36:02.948 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:02.966+0000 7fecc27fc640 1 -- 172.21.15.22:0/3769928726 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecb40aa7f0 con 0x7fecc4152ae0 2024-05-21T13:36:02.949 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:02.966+0000 7fecca069640 1 -- 172.21.15.22:0/3769928726 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fecc4152ae0 msgr2=0x7fecc40c84f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:02.949 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:02.966+0000 7fecca069640 1 --2- 172.21.15.22:0/3769928726 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fecc4152ae0 0x7fecc40c84f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fecc40c9400 tx=0x7fecb401cf50 comp rx=0 tx=0).stop 2024-05-21T13:36:02.949 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:02.966+0000 7fecca069640 1 -- 172.21.15.22:0/3769928726 shutdown_connections 2024-05-21T13:36:02.949 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:02.966+0000 7fecca069640 1 --2- 172.21.15.22:0/3769928726 >> v2:172.21.15.115:3300/0 conn(0x7fecc40c8ee0 0x7fecc4074610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:02.949 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:02.966+0000 7fecca069640 1 --2- 172.21.15.22:0/3769928726 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fecc4152ae0 0x7fecc40c84f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:02.949 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:02.966+0000 7fecca069640 1 -- 172.21.15.22:0/3769928726 >> 172.21.15.22:0/3769928726 conn(0x7fecc406d600 msgr2=0x7fecc406da10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:02.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:02.966+0000 7fecca069640 1 -- 172.21.15.22:0/3769928726 shutdown_connections 2024-05-21T13:36:02.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:02.966+0000 7fecca069640 1 -- 172.21.15.22:0/3769928726 wait complete. 2024-05-21T13:36:02.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:02.966+0000 7fecca069640 1 Processor -- start 2024-05-21T13:36:02.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:02.966+0000 7fecca069640 1 -- start start 2024-05-21T13:36:02.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:02.966+0000 7fecca069640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fecc40c8ee0 0x7fecc414d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:02.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:02.966+0000 7fecca069640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fecc40caee0 0x7fecc4155a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:02.956 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:02.966+0000 7fecca069640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fecc4152ae0 0x7fecc40cdcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:02.956 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:02.966+0000 7fecca069640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fecc40c60b0 con 0x7fecc4152ae0 2024-05-21T13:36:02.956 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:02.966+0000 7fecca069640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fecc40c5f30 con 0x7fecc40c8ee0 2024-05-21T13:36:02.956 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:02.966+0000 7fecca069640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7fecc4165910 con 0x7fecc40caee0 2024-05-21T13:36:02.956 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:02.970+0000 7fecc3fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fecc4152ae0 0x7fecc40cdcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:02.956 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:02.970+0000 7fecc3fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fecc4152ae0 0x7fecc40cdcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37768/0 (socket says 172.21.15.22:37768) 2024-05-21T13:36:02.956 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:02.970+0000 7fecc3fff640 1 -- 172.21.15.22:0/2573956287 learned_addr learned my addr 172.21.15.22:0/2573956287 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:02.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:02.970+0000 7fecc37fe640 1 --2- 172.21.15.22:0/2573956287 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fecc40c8ee0 0x7fecc414d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:02.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:02.970+0000 7fecc2ffd640 1 --2- 172.21.15.22:0/2573956287 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fecc40caee0 0x7fecc4155a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:02.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:02.970+0000 7fecc3fff640 1 -- 172.21.15.22:0/2573956287 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fecc40caee0 msgr2=0x7fecc4155a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:02.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:02.970+0000 7fecc3fff640 1 --2- 172.21.15.22:0/2573956287 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fecc40caee0 0x7fecc4155a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:02.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:02.970+0000 7fecc3fff640 1 -- 172.21.15.22:0/2573956287 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fecc40c8ee0 msgr2=0x7fecc414d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:02.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:02.970+0000 7fecc3fff640 1 --2- 172.21.15.22:0/2573956287 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fecc40c8ee0 0x7fecc414d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:02.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:02.970+0000 7fecc3fff640 1 -- 172.21.15.22:0/2573956287 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecc414dd00 con 0x7fecc4152ae0 2024-05-21T13:36:02.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:02.970+0000 7fecc3fff640 1 --2- 172.21.15.22:0/2573956287 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fecc4152ae0 0x7fecc40cdcd0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fecbc00c7b0 tx=0x7fecbc00cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:02.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:02.970+0000 7fecabfff640 1 -- 172.21.15.22:0/2573956287 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecbc004b70 con 0x7fecc4152ae0 2024-05-21T13:36:02.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:02.970+0000 7fecabfff640 1 -- 172.21.15.22:0/2573956287 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecbc004d10 con 0x7fecc4152ae0 2024-05-21T13:36:02.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:02.970+0000 7fecca069640 1 -- 172.21.15.22:0/2573956287 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecc4155fa0 con 0x7fecc4152ae0 2024-05-21T13:36:02.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:02.970+0000 7fecabfff640 1 -- 172.21.15.22:0/2573956287 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecbc00aa90 con 0x7fecc4152ae0 2024-05-21T13:36:02.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:02.970+0000 7fecca069640 1 -- 172.21.15.22:0/2573956287 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecc41f3560 con 0x7fecc4152ae0 2024-05-21T13:36:02.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:02.970+0000 7fecca069640 1 -- 172.21.15.22:0/2573956287 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecc40697d0 con 0x7fecc4152ae0 2024-05-21T13:36:02.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:02.970+0000 7fecabfff640 1 -- 172.21.15.22:0/2573956287 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fecbc00ac30 con 0x7fecc4152ae0 2024-05-21T13:36:02.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:02.970+0000 7fecabfff640 1 --2- 172.21.15.22:0/2573956287 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fecb006f400 0x7fecb00718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:02.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:02.970+0000 7fecabfff640 1 -- 172.21.15.22:0/2573956287 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fecbc08f760 con 0x7fecc4152ae0 2024-05-21T13:36:02.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:02.970+0000 7fecc37fe640 1 --2- 172.21.15.22:0/2573956287 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fecb006f400 0x7fecb00718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:02.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:02.974+0000 7fecc37fe640 1 --2- 172.21.15.22:0/2573956287 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fecb006f400 0x7fecb00718c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fecb40ae000 tx=0x7fecb4004740 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:02.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:02.974+0000 7fecabfff640 1 -- 172.21.15.22:0/2573956287 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fecbc020070 con 0x7fecc4152ae0 2024-05-21T13:36:03.155 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.174+0000 7fecca069640 1 -- 172.21.15.22:0/2573956287 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fecc40c80c0 con 0x7fecc4152ae0 2024-05-21T13:36:03.156 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.174+0000 7fecabfff640 1 -- 172.21.15.22:0/2573956287 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+6826 (secure 0 0 0) 0x7fecbc05c430 con 0x7fecc4152ae0 2024-05-21T13:36:03.157 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-21T13:36:03.157 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4224,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/355756580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":355756580},{"type":"v1","addr":"172.21.15.22:6833","nonce":355756580}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4230,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3277017116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":3277017116},{"type":"v1","addr":"172.21.15.22:6835","nonce":3277017116}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4233,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3840772609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3840772609},{"type":"v1","addr":"172.21.15.22:6837","nonce":3840772609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4248,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/2009761279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":2009761279},{"type":"v1","addr":"172.21.15.115:6837","nonce":2009761279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/3894678097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3894678097},{"type":"v1","addr":"172.21.15.115:6835","nonce":3894678097}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-21T13:35:57.106892+0000","modified":"2024-05-21T13:36:02.191001+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"f","rank":0,"incarnation":4,"state":"up:creating","state_seq":1,"addr":"172.21.15.115:6839/1525097577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6838","nonce":1525097577},{"type":"v1","addr":"172.21.15.115:6839","nonce":1525097577}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-05-21T13:36:03.157 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 5 2024-05-21T13:36:03.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.178+0000 7fecca069640 1 -- 172.21.15.22:0/2573956287 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fecb006f400 msgr2=0x7fecb00718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:03.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.178+0000 7fecca069640 1 --2- 172.21.15.22:0/2573956287 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fecb006f400 0x7fecb00718c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fecb40ae000 tx=0x7fecb4004740 comp rx=0 tx=0).stop 2024-05-21T13:36:03.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.178+0000 7fecca069640 1 -- 172.21.15.22:0/2573956287 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fecc4152ae0 msgr2=0x7fecc40cdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:03.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.178+0000 7fecca069640 1 --2- 172.21.15.22:0/2573956287 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fecc4152ae0 0x7fecc40cdcd0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fecbc00c7b0 tx=0x7fecbc00cc70 comp rx=0 tx=0).stop 2024-05-21T13:36:03.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.178+0000 7fecca069640 1 -- 172.21.15.22:0/2573956287 shutdown_connections 2024-05-21T13:36:03.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.178+0000 7fecca069640 1 --2- 172.21.15.22:0/2573956287 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fecb006f400 0x7fecb00718c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:03.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.178+0000 7fecca069640 1 --2- 172.21.15.22:0/2573956287 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fecc4152ae0 0x7fecc40cdcd0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:03.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.178+0000 7fecca069640 1 --2- 172.21.15.22:0/2573956287 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fecc40caee0 0x7fecc4155a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:03.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.178+0000 7fecca069640 1 --2- 172.21.15.22:0/2573956287 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fecc40c8ee0 0x7fecc414d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:03.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.178+0000 7fecca069640 1 -- 172.21.15.22:0/2573956287 >> 172.21.15.22:0/2573956287 conn(0x7fecc406d600 msgr2=0x7fecc4142910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:03.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.178+0000 7fecca069640 1 -- 172.21.15.22:0/2573956287 shutdown_connections 2024-05-21T13:36:03.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.178+0000 7fecca069640 1 -- 172.21.15.22:0/2573956287 wait complete. 2024-05-21T13:36:03.175 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-21T13:36:03.291 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.310+0000 7f8d80575640 1 Processor -- start 2024-05-21T13:36:03.291 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.310+0000 7f8d80575640 1 -- start start 2024-05-21T13:36:03.292 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.310+0000 7f8d80575640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8d780c48f0 0x7f8d780c7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:03.292 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.310+0000 7f8d80575640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8d780c4d00 0x7f8d780c83e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:03.293 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.310+0000 7f8d80575640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d78159cf0 con 0x7f8d78153cb0 2024-05-21T13:36:03.293 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.310+0000 7f8d80575640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f8d780c9c60 con 0x7f8d780c4d00 2024-05-21T13:36:03.293 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.310+0000 7f8d80575640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f8d78159fd0 con 0x7f8d780c48f0 2024-05-21T13:36:03.293 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.310+0000 7f8d7eb12640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8d780c4d00 0x7f8d780c83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:03.293 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.310+0000 7f8d7eb12640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8d780c4d00 0x7f8d780c83e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37776/0 (socket says 172.21.15.22:37776) 2024-05-21T13:36:03.293 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.310+0000 7f8d7eb12640 1 -- 172.21.15.22:0/339960277 learned_addr learned my addr 172.21.15.22:0/339960277 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:03.293 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.310+0000 7f8d7db10640 1 --2- 172.21.15.22:0/339960277 >> v2:172.21.15.115:3300/0 conn(0x7f8d780c48f0 0x7f8d780c7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:03.293 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.310+0000 7f8d7eb12640 1 -- 172.21.15.22:0/339960277 >> v2:172.21.15.115:3300/0 conn(0x7f8d780c48f0 msgr2=0x7f8d780c7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:03.293 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.310+0000 7f8d7eb12640 1 --2- 172.21.15.22:0/339960277 >> v2:172.21.15.115:3300/0 conn(0x7f8d780c48f0 0x7f8d780c7ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:03.293 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.310+0000 7f8d7eb12640 1 -- 172.21.15.22:0/339960277 >> v1:172.21.15.115:6789/0 conn(0x7f8d78153cb0 legacy=0x7f8d780c9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:03.293 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.310+0000 7f8d7eb12640 1 -- 172.21.15.22:0/339960277 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d7815a2b0 con 0x7f8d780c4d00 2024-05-21T13:36:03.293 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.310+0000 7f8d7db10640 1 --2- 172.21.15.22:0/339960277 >> v2:172.21.15.115:3300/0 conn(0x7f8d780c48f0 0x7f8d780c7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T13:36:03.295 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.314+0000 7f8d7eb12640 1 --2- 172.21.15.22:0/339960277 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d780c4d00 0x7f8d780c83e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8d7806e1b0 tx=0x7f8d7001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a6e76c32ab5c25f server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:03.295 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.314+0000 7f8d7d30f640 1 -- 172.21.15.22:0/339960277 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d700ab610 con 0x7f8d780c4d00 2024-05-21T13:36:03.295 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.314+0000 7f8d7d30f640 1 -- 172.21.15.22:0/339960277 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d700b0070 con 0x7f8d780c4d00 2024-05-21T13:36:03.295 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.314+0000 7f8d7d30f640 1 -- 172.21.15.22:0/339960277 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d700ab9d0 con 0x7f8d780c4d00 2024-05-21T13:36:03.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.314+0000 7f8d80575640 1 -- 172.21.15.22:0/339960277 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d780c4d00 msgr2=0x7f8d780c83e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:03.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.314+0000 7f8d80575640 1 --2- 172.21.15.22:0/339960277 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d780c4d00 0x7f8d780c83e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f8d7806e1b0 tx=0x7f8d7001c520 comp rx=0 tx=0).stop 2024-05-21T13:36:03.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.314+0000 7f8d80575640 1 -- 172.21.15.22:0/339960277 shutdown_connections 2024-05-21T13:36:03.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.314+0000 7f8d80575640 1 --2- 172.21.15.22:0/339960277 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d780c4d00 0x7f8d780c83e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:03.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.314+0000 7f8d80575640 1 --2- 172.21.15.22:0/339960277 >> v2:172.21.15.115:3300/0 conn(0x7f8d780c48f0 0x7f8d780c7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:03.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.314+0000 7f8d80575640 1 -- 172.21.15.22:0/339960277 >> 172.21.15.22:0/339960277 conn(0x7f8d7806ea10 msgr2=0x7f8d7806ff50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:03.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.314+0000 7f8d80575640 1 -- 172.21.15.22:0/339960277 shutdown_connections 2024-05-21T13:36:03.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.314+0000 7f8d80575640 1 -- 172.21.15.22:0/339960277 wait complete. 2024-05-21T13:36:03.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.314+0000 7f8d80575640 1 Processor -- start 2024-05-21T13:36:03.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.314+0000 7f8d80575640 1 -- start start 2024-05-21T13:36:03.299 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.318+0000 7f8d80575640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8d780c48f0 0x7f8d78149e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:03.299 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.318+0000 7f8d80575640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8d780c4d00 0x7f8d7815c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:03.299 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.318+0000 7f8d80575640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d78153cb0 0x7f8d78142a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:03.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.318+0000 7f8d80575640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8d781665f0 con 0x7f8d78153cb0 2024-05-21T13:36:03.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.318+0000 7f8d80575640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f8d78166470 con 0x7f8d780c4d00 2024-05-21T13:36:03.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.318+0000 7f8d80575640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f8d78166770 con 0x7f8d780c48f0 2024-05-21T13:36:03.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.318+0000 7f8d7eb12640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d78153cb0 0x7f8d78142a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:03.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.318+0000 7f8d7eb12640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d78153cb0 0x7f8d78142a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37786/0 (socket says 172.21.15.22:37786) 2024-05-21T13:36:03.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.318+0000 7f8d7eb12640 1 -- 172.21.15.22:0/123744957 learned_addr learned my addr 172.21.15.22:0/123744957 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:03.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.318+0000 7f8d7e311640 1 --2- 172.21.15.22:0/123744957 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8d780c48f0 0x7f8d78149e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:03.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.318+0000 7f8d7db10640 1 --2- 172.21.15.22:0/123744957 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8d780c4d00 0x7f8d7815c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:03.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.318+0000 7f8d7eb12640 1 -- 172.21.15.22:0/123744957 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8d780c48f0 msgr2=0x7f8d78149e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:03.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.318+0000 7f8d7eb12640 1 --2- 172.21.15.22:0/123744957 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8d780c48f0 0x7f8d78149e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:03.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.318+0000 7f8d7eb12640 1 -- 172.21.15.22:0/123744957 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8d780c4d00 msgr2=0x7f8d7815c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:03.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.318+0000 7f8d7eb12640 1 --2- 172.21.15.22:0/123744957 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8d780c4d00 0x7f8d7815c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:03.301 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.318+0000 7f8d7eb12640 1 -- 172.21.15.22:0/123744957 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d7815cdc0 con 0x7f8d78153cb0 2024-05-21T13:36:03.301 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.318+0000 7f8d7eb12640 1 --2- 172.21.15.22:0/123744957 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d78153cb0 0x7f8d78142a60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8d7001a150 tx=0x7f8d7001ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:03.301 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.318+0000 7f8d6effd640 1 -- 172.21.15.22:0/123744957 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d700be5f0 con 0x7f8d78153cb0 2024-05-21T13:36:03.301 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.318+0000 7f8d6effd640 1 -- 172.21.15.22:0/123744957 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d700be790 con 0x7f8d78153cb0 2024-05-21T13:36:03.301 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.318+0000 7f8d80575640 1 -- 172.21.15.22:0/123744957 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d7814f470 con 0x7f8d78153cb0 2024-05-21T13:36:03.301 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.318+0000 7f8d6effd640 1 -- 172.21.15.22:0/123744957 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d700beb80 con 0x7f8d78153cb0 2024-05-21T13:36:03.301 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.318+0000 7f8d80575640 1 -- 172.21.15.22:0/123744957 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d7814fa30 con 0x7f8d78153cb0 2024-05-21T13:36:03.301 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.318+0000 7f8d80575640 1 -- 172.21.15.22:0/123744957 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d78077bb0 con 0x7f8d78153cb0 2024-05-21T13:36:03.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.318+0000 7f8d6effd640 1 -- 172.21.15.22:0/123744957 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f8d700b43f0 con 0x7f8d78153cb0 2024-05-21T13:36:03.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.318+0000 7f8d6effd640 1 --2- 172.21.15.22:0/123744957 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f8d5c06f400 0x7f8d5c0718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:03.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.318+0000 7f8d6effd640 1 -- 172.21.15.22:0/123744957 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f8d7012a210 con 0x7f8d78153cb0 2024-05-21T13:36:03.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.318+0000 7f8d7e311640 1 --2- 172.21.15.22:0/123744957 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f8d5c06f400 0x7f8d5c0718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:03.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.322+0000 7f8d7e311640 1 --2- 172.21.15.22:0/123744957 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f8d5c06f400 0x7f8d5c0718c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8d74001cf0 tx=0x7f8d74009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:03.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.322+0000 7f8d6effd640 1 -- 172.21.15.22:0/123744957 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f8d700c4060 con 0x7f8d78153cb0 2024-05-21T13:36:03.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.490+0000 7f8d80575640 1 -- 172.21.15.22:0/123744957 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8d780c89c0 con 0x7f8d78153cb0 2024-05-21T13:36:03.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.490+0000 7f8d6effd640 1 -- 172.21.15.22:0/123744957 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18458 (secure 0 0 0) 0x7f8d700a8050 con 0x7f8d78153cb0 2024-05-21T13:36:03.472 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-21T13:36:03.472 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":25,"fsid":"f2c96204-e240-4e7f-8a76-927b4f80f534","created":"2024-05-21T13:35:33.827005+0000","modified":"2024-05-21T13:36:02.190808+0000","last_up_change":"2024-05-21T13:35:44.542324+0000","last_in_change":"2024-05-21T13:35:36.061492+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-21T13:35:44.536105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-21T13:35:54.972996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-21T13:35:56.065755+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-21T13:35:59.791448+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"09157d4a-9443-4e10-bbb3-cf8ed7c42cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":222752954},{"type":"v1","addr":"172.21.15.22:6801","nonce":222752954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":222752954},{"type":"v1","addr":"172.21.15.22:6803","nonce":222752954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":222752954},{"type":"v1","addr":"172.21.15.22:6807","nonce":222752954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":222752954},{"type":"v1","addr":"172.21.15.22:6805","nonce":222752954}]},"public_addr":"172.21.15.22:6801/222752954","cluster_addr":"172.21.15.22:6803/222752954","heartbeat_back_addr":"172.21.15.22:6807/222752954","heartbeat_front_addr":"172.21.15.22:6805/222752954","state":["exists","up"]},{"osd":1,"uuid":"2a6a87c0-01ad-4a98-a538-c0a8e865b05d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":685426272},{"type":"v1","addr":"172.21.15.22:6809","nonce":685426272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":685426272},{"type":"v1","addr":"172.21.15.22:6811","nonce":685426272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":685426272},{"type":"v1","addr":"172.21.15.22:6815","nonce":685426272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":685426272},{"type":"v1","addr":"172.21.15.22:6813","nonce":685426272}]},"public_addr":"172.21.15.22:6809/685426272","cluster_addr":"172.21.15.22:6811/685426272","heartbeat_back_addr":"172.21.15.22:6815/685426272","heartbeat_front_addr":"172.21.15.22:6813/685426272","state":["exists","up"]},{"osd":2,"uuid":"4c18f931-40a4-46ac-a752-0d1be35b01a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":2092224336},{"type":"v1","addr":"172.21.15.22:6817","nonce":2092224336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":2092224336},{"type":"v1","addr":"172.21.15.22:6819","nonce":2092224336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":2092224336},{"type":"v1","addr":"172.21.15.22:6823","nonce":2092224336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":2092224336},{"type":"v1","addr":"172.21.15.22:6821","nonce":2092224336}]},"public_addr":"172.21.15.22:6817/2092224336","cluster_addr":"172.21.15.22:6819/2092224336","heartbeat_back_addr":"172.21.15.22:6823/2092224336","heartbeat_front_addr":"172.21.15.22:6821/2092224336","state":["exists","up"]},{"osd":3,"uuid":"d57ee7fd-b73e-41ec-8e3b-e62fb8898128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":1232311110},{"type":"v1","addr":"172.21.15.22:6825","nonce":1232311110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":1232311110},{"type":"v1","addr":"172.21.15.22:6827","nonce":1232311110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":1232311110},{"type":"v1","addr":"172.21.15.22:6831","nonce":1232311110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":1232311110},{"type":"v1","addr":"172.21.15.22:6829","nonce":1232311110}]},"public_addr":"172.21.15.22:6825/1232311110","cluster_addr":"172.21.15.22:6827/1232311110","heartbeat_back_addr":"172.21.15.22:6831/1232311110","heartbeat_front_addr":"172.21.15.22:6829/1232311110","state":["exists","up"]},{"osd":4,"uuid":"43c6494f-352b-42a7-b6a9-fe7e3573fab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":832695158},{"type":"v1","addr":"172.21.15.115:6801","nonce":832695158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":832695158},{"type":"v1","addr":"172.21.15.115:6803","nonce":832695158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":832695158},{"type":"v1","addr":"172.21.15.115:6807","nonce":832695158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":832695158},{"type":"v1","addr":"172.21.15.115:6805","nonce":832695158}]},"public_addr":"172.21.15.115:6801/832695158","cluster_addr":"172.21.15.115:6803/832695158","heartbeat_back_addr":"172.21.15.115:6807/832695158","heartbeat_front_addr":"172.21.15.115:6805/832695158","state":["exists","up"]},{"osd":5,"uuid":"25fc861c-593d-4d49-942a-c75c19f25994","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":1504764223},{"type":"v1","addr":"172.21.15.115:6815","nonce":1504764223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":1504764223},{"type":"v1","addr":"172.21.15.115:6823","nonce":1504764223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":1504764223},{"type":"v1","addr":"172.21.15.115:6830","nonce":1504764223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6825","nonce":1504764223},{"type":"v1","addr":"172.21.15.115:6827","nonce":1504764223}]},"public_addr":"172.21.15.115:6815/1504764223","cluster_addr":"172.21.15.115:6823/1504764223","heartbeat_back_addr":"172.21.15.115:6830/1504764223","heartbeat_front_addr":"172.21.15.115:6827/1504764223","state":["exists","up"]},{"osd":6,"uuid":"2e7fb0b8-1162-497f-bffc-e2c02b9b9ef4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":959292720},{"type":"v1","addr":"172.21.15.115:6809","nonce":959292720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":959292720},{"type":"v1","addr":"172.21.15.115:6813","nonce":959292720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":959292720},{"type":"v1","addr":"172.21.15.115:6822","nonce":959292720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":959292720},{"type":"v1","addr":"172.21.15.115:6818","nonce":959292720}]},"public_addr":"172.21.15.115:6809/959292720","cluster_addr":"172.21.15.115:6813/959292720","heartbeat_back_addr":"172.21.15.115:6822/959292720","heartbeat_front_addr":"172.21.15.115:6818/959292720","state":["exists","up"]},{"osd":7,"uuid":"a97df0dc-e370-45ce-8742-25ae31e2212e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6811","nonce":20268513},{"type":"v1","addr":"172.21.15.115:6814","nonce":20268513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":20268513},{"type":"v1","addr":"172.21.15.115:6821","nonce":20268513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6829","nonce":20268513},{"type":"v1","addr":"172.21.15.115:6831","nonce":20268513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":20268513},{"type":"v1","addr":"172.21.15.115:6826","nonce":20268513}]},"public_addr":"172.21.15.115:6814/20268513","cluster_addr":"172.21.15.115:6821/20268513","heartbeat_back_addr":"172.21.15.115:6831/20268513","heartbeat_front_addr":"172.21.15.115:6826/20268513","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.692890+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.545577+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.712724+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.681944+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.492954+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.553222+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.597022+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.601698+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-21T13:36:03.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.494+0000 7f8d80575640 1 -- 172.21.15.22:0/123744957 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f8d5c06f400 msgr2=0x7f8d5c0718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:03.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.494+0000 7f8d80575640 1 --2- 172.21.15.22:0/123744957 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f8d5c06f400 0x7f8d5c0718c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8d74001cf0 tx=0x7f8d74009040 comp rx=0 tx=0).stop 2024-05-21T13:36:03.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.494+0000 7f8d80575640 1 -- 172.21.15.22:0/123744957 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d78153cb0 msgr2=0x7f8d78142a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:03.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.494+0000 7f8d80575640 1 --2- 172.21.15.22:0/123744957 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d78153cb0 0x7f8d78142a60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f8d7001a150 tx=0x7f8d7001ad60 comp rx=0 tx=0).stop 2024-05-21T13:36:03.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.494+0000 7f8d80575640 1 -- 172.21.15.22:0/123744957 shutdown_connections 2024-05-21T13:36:03.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.494+0000 7f8d80575640 1 --2- 172.21.15.22:0/123744957 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f8d5c06f400 0x7f8d5c0718c0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:03.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.494+0000 7f8d80575640 1 --2- 172.21.15.22:0/123744957 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8d78153cb0 0x7f8d78142a60 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:03.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.494+0000 7f8d80575640 1 --2- 172.21.15.22:0/123744957 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8d780c4d00 0x7f8d7815c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:03.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.494+0000 7f8d80575640 1 --2- 172.21.15.22:0/123744957 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8d780c48f0 0x7f8d78149e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:03.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.494+0000 7f8d80575640 1 -- 172.21.15.22:0/123744957 >> 172.21.15.22:0/123744957 conn(0x7f8d7806ea10 msgr2=0x7f8d78152f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:03.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.494+0000 7f8d80575640 1 -- 172.21.15.22:0/123744957 shutdown_connections 2024-05-21T13:36:03.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.494+0000 7f8d80575640 1 -- 172.21.15.22:0/123744957 wait complete. 2024-05-21T13:36:03.492 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-21T13:36:03.618 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.638+0000 7f74e1919640 1 Processor -- start 2024-05-21T13:36:03.618 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.638+0000 7f74e1919640 1 -- start start 2024-05-21T13:36:03.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.638+0000 7f74e1919640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f74dc153cb0 0x7f74dc0c9440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:03.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.638+0000 7f74e1919640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f74dc0c48f0 0x7f74dc0c7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:03.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.638+0000 7f74e1919640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f74dc0c4cf0 0x7f74dc0c83e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:03.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.638+0000 7f74e1919640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f74dc0c9c60 con 0x7f74dc0c4cf0 2024-05-21T13:36:03.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.638+0000 7f74e1919640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f74dc159cf0 con 0x7f74dc0c48f0 2024-05-21T13:36:03.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.638+0000 7f74e1919640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f74dc159fd0 con 0x7f74dc153cb0 2024-05-21T13:36:03.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.638+0000 7f74db7fe640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f74dc0c4cf0 0x7f74dc0c83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:03.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.638+0000 7f74db7fe640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f74dc0c4cf0 0x7f74dc0c83e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37790/0 (socket says 172.21.15.22:37790) 2024-05-21T13:36:03.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.638+0000 7f74db7fe640 1 -- 172.21.15.22:0/1394745791 learned_addr learned my addr 172.21.15.22:0/1394745791 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:03.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.638+0000 7f74d3fff640 1 --2- 172.21.15.22:0/1394745791 >> v2:172.21.15.115:3300/0 conn(0x7f74dc0c48f0 0x7f74dc0c7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:03.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.638+0000 7f74daffd640 1 --2- 172.21.15.22:0/1394745791 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f74dc153cb0 0x7f74dc0c9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:03.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.638+0000 7f74db7fe640 1 -- 172.21.15.22:0/1394745791 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f74dc153cb0 msgr2=0x7f74dc0c9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:03.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.638+0000 7f74db7fe640 1 --2- 172.21.15.22:0/1394745791 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f74dc153cb0 0x7f74dc0c9440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:03.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.638+0000 7f74db7fe640 1 -- 172.21.15.22:0/1394745791 >> v2:172.21.15.115:3300/0 conn(0x7f74dc0c48f0 msgr2=0x7f74dc0c7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:03.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.638+0000 7f74db7fe640 1 --2- 172.21.15.22:0/1394745791 >> v2:172.21.15.115:3300/0 conn(0x7f74dc0c48f0 0x7f74dc0c7ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:03.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.638+0000 7f74db7fe640 1 -- 172.21.15.22:0/1394745791 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74dc15a2b0 con 0x7f74dc0c4cf0 2024-05-21T13:36:03.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.642+0000 7f74db7fe640 1 --2- 172.21.15.22:0/1394745791 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f74dc0c4cf0 0x7f74dc0c83e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f74dc06d610 tx=0x7f74d401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f0f86d2cc7c49b0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:03.623 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.642+0000 7f74da7fc640 1 -- 172.21.15.22:0/1394745791 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74d40a5760 con 0x7f74dc0c4cf0 2024-05-21T13:36:03.623 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.642+0000 7f74da7fc640 1 -- 172.21.15.22:0/1394745791 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74d40a5900 con 0x7f74dc0c4cf0 2024-05-21T13:36:03.623 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.642+0000 7f74da7fc640 1 -- 172.21.15.22:0/1394745791 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74d40a5cd0 con 0x7f74dc0c4cf0 2024-05-21T13:36:03.624 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.642+0000 7f74e1919640 1 -- 172.21.15.22:0/1394745791 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f74dc0c4cf0 msgr2=0x7f74dc0c83e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:03.624 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.642+0000 7f74e1919640 1 --2- 172.21.15.22:0/1394745791 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f74dc0c4cf0 0x7f74dc0c83e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f74dc06d610 tx=0x7f74d401c9f0 comp rx=0 tx=0).stop 2024-05-21T13:36:03.624 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.642+0000 7f74e1919640 1 -- 172.21.15.22:0/1394745791 shutdown_connections 2024-05-21T13:36:03.624 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.642+0000 7f74e1919640 1 --2- 172.21.15.22:0/1394745791 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f74dc0c4cf0 0x7f74dc0c83e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:03.624 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.642+0000 7f74e1919640 1 --2- 172.21.15.22:0/1394745791 >> v2:172.21.15.115:3300/0 conn(0x7f74dc0c48f0 0x7f74dc0c7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:03.624 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.642+0000 7f74e1919640 1 --2- 172.21.15.22:0/1394745791 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f74dc153cb0 0x7f74dc0c9440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:03.625 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.642+0000 7f74e1919640 1 -- 172.21.15.22:0/1394745791 >> 172.21.15.22:0/1394745791 conn(0x7f74dc06ea10 msgr2=0x7f74dc06ff50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:03.625 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.642+0000 7f74e1919640 1 -- 172.21.15.22:0/1394745791 shutdown_connections 2024-05-21T13:36:03.625 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.642+0000 7f74e1919640 1 -- 172.21.15.22:0/1394745791 wait complete. 2024-05-21T13:36:03.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.642+0000 7f74e1919640 1 Processor -- start 2024-05-21T13:36:03.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.642+0000 7f74e1919640 1 -- start start 2024-05-21T13:36:03.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.646+0000 7f74e1919640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f74dc0c48f0 0x7f74dc15c160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:03.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.646+0000 7f74e1919640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f74dc0c4cf0 0x7f74dc14ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:03.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.646+0000 7f74e1919640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f74dc153cb0 0x7f74dc14f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:03.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.646+0000 7f74e1919640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f74dc154210 con 0x7f74dc0c48f0 2024-05-21T13:36:03.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.646+0000 7f74e1919640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f74dc154090 con 0x7f74dc153cb0 2024-05-21T13:36:03.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.646+0000 7f74e1919640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f74dc06c4f0 con 0x7f74dc0c4cf0 2024-05-21T13:36:03.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.646+0000 7f74daffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f74dc0c48f0 0x7f74dc15c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:03.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.646+0000 7f74daffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f74dc0c48f0 0x7f74dc15c160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37794/0 (socket says 172.21.15.22:37794) 2024-05-21T13:36:03.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.646+0000 7f74daffd640 1 -- 172.21.15.22:0/499651281 learned_addr learned my addr 172.21.15.22:0/499651281 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:03.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.646+0000 7f74daffd640 1 -- 172.21.15.22:0/499651281 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f74dc0c4cf0 msgr2=0x7f74dc14ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:03.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.646+0000 7f74daffd640 1 --2- 172.21.15.22:0/499651281 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f74dc0c4cf0 0x7f74dc14ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:03.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.646+0000 7f74daffd640 1 -- 172.21.15.22:0/499651281 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f74dc153cb0 msgr2=0x7f74dc14f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:03.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.646+0000 7f74db7fe640 1 --2- 172.21.15.22:0/499651281 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f74dc153cb0 0x7f74dc14f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:03.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.646+0000 7f74daffd640 1 --2- 172.21.15.22:0/499651281 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f74dc153cb0 0x7f74dc14f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:03.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.646+0000 7f74daffd640 1 -- 172.21.15.22:0/499651281 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74dc145e80 con 0x7f74dc0c48f0 2024-05-21T13:36:03.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.646+0000 7f74daffd640 1 --2- 172.21.15.22:0/499651281 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f74dc0c48f0 0x7f74dc15c160 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f74cc00d5f0 tx=0x7f74cc00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:03.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.646+0000 7f74d8ff9640 1 -- 172.21.15.22:0/499651281 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74cc0125f0 con 0x7f74dc0c48f0 2024-05-21T13:36:03.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.646+0000 7f74d8ff9640 1 -- 172.21.15.22:0/499651281 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74cc019070 con 0x7f74dc0c48f0 2024-05-21T13:36:03.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.646+0000 7f74e1919640 1 -- 172.21.15.22:0/499651281 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74dc146120 con 0x7f74dc0c48f0 2024-05-21T13:36:03.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.646+0000 7f74d8ff9640 1 -- 172.21.15.22:0/499651281 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74cc0129b0 con 0x7f74dc0c48f0 2024-05-21T13:36:03.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.646+0000 7f74e1919640 1 -- 172.21.15.22:0/499651281 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74dc1466e0 con 0x7f74dc0c48f0 2024-05-21T13:36:03.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.646+0000 7f74e1919640 1 -- 172.21.15.22:0/499651281 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74dc077bb0 con 0x7f74dc0c48f0 2024-05-21T13:36:03.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.646+0000 7f74d8ff9640 1 -- 172.21.15.22:0/499651281 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f74cc012b50 con 0x7f74dc0c48f0 2024-05-21T13:36:03.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.646+0000 7f74d8ff9640 1 --2- 172.21.15.22:0/499651281 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f74bc06f400 0x7f74bc0718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:03.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.646+0000 7f74d8ff9640 1 -- 172.21.15.22:0/499651281 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f74cc08fa80 con 0x7f74dc0c48f0 2024-05-21T13:36:03.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.646+0000 7f74d3fff640 1 --2- 172.21.15.22:0/499651281 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f74bc06f400 0x7f74bc0718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:03.630 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.650+0000 7f74d3fff640 1 --2- 172.21.15.22:0/499651281 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f74bc06f400 0x7f74bc0718c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f74dc1473d0 tx=0x7f74c4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:03.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.650+0000 7f74d8ff9640 1 -- 172.21.15.22:0/499651281 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f74cc05c630 con 0x7f74dc0c48f0 2024-05-21T13:36:03.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.814+0000 7f74e1919640 1 -- 172.21.15.22:0/499651281 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f74dc0c8600 con 0x7f74dc0c48f0 2024-05-21T13:36:03.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.818+0000 7f74d8ff9640 1 -- 172.21.15.22:0/499651281 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18458 (secure 0 0 0) 0x7f74cc05bf30 con 0x7f74dc0c48f0 2024-05-21T13:36:03.800 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-21T13:36:03.801 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":25,"fsid":"f2c96204-e240-4e7f-8a76-927b4f80f534","created":"2024-05-21T13:35:33.827005+0000","modified":"2024-05-21T13:36:02.190808+0000","last_up_change":"2024-05-21T13:35:44.542324+0000","last_in_change":"2024-05-21T13:35:36.061492+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-21T13:35:44.536105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-21T13:35:54.972996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-21T13:35:56.065755+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-21T13:35:59.791448+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"09157d4a-9443-4e10-bbb3-cf8ed7c42cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":222752954},{"type":"v1","addr":"172.21.15.22:6801","nonce":222752954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":222752954},{"type":"v1","addr":"172.21.15.22:6803","nonce":222752954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":222752954},{"type":"v1","addr":"172.21.15.22:6807","nonce":222752954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":222752954},{"type":"v1","addr":"172.21.15.22:6805","nonce":222752954}]},"public_addr":"172.21.15.22:6801/222752954","cluster_addr":"172.21.15.22:6803/222752954","heartbeat_back_addr":"172.21.15.22:6807/222752954","heartbeat_front_addr":"172.21.15.22:6805/222752954","state":["exists","up"]},{"osd":1,"uuid":"2a6a87c0-01ad-4a98-a538-c0a8e865b05d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":685426272},{"type":"v1","addr":"172.21.15.22:6809","nonce":685426272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":685426272},{"type":"v1","addr":"172.21.15.22:6811","nonce":685426272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":685426272},{"type":"v1","addr":"172.21.15.22:6815","nonce":685426272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":685426272},{"type":"v1","addr":"172.21.15.22:6813","nonce":685426272}]},"public_addr":"172.21.15.22:6809/685426272","cluster_addr":"172.21.15.22:6811/685426272","heartbeat_back_addr":"172.21.15.22:6815/685426272","heartbeat_front_addr":"172.21.15.22:6813/685426272","state":["exists","up"]},{"osd":2,"uuid":"4c18f931-40a4-46ac-a752-0d1be35b01a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":2092224336},{"type":"v1","addr":"172.21.15.22:6817","nonce":2092224336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":2092224336},{"type":"v1","addr":"172.21.15.22:6819","nonce":2092224336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":2092224336},{"type":"v1","addr":"172.21.15.22:6823","nonce":2092224336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":2092224336},{"type":"v1","addr":"172.21.15.22:6821","nonce":2092224336}]},"public_addr":"172.21.15.22:6817/2092224336","cluster_addr":"172.21.15.22:6819/2092224336","heartbeat_back_addr":"172.21.15.22:6823/2092224336","heartbeat_front_addr":"172.21.15.22:6821/2092224336","state":["exists","up"]},{"osd":3,"uuid":"d57ee7fd-b73e-41ec-8e3b-e62fb8898128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":1232311110},{"type":"v1","addr":"172.21.15.22:6825","nonce":1232311110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":1232311110},{"type":"v1","addr":"172.21.15.22:6827","nonce":1232311110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":1232311110},{"type":"v1","addr":"172.21.15.22:6831","nonce":1232311110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":1232311110},{"type":"v1","addr":"172.21.15.22:6829","nonce":1232311110}]},"public_addr":"172.21.15.22:6825/1232311110","cluster_addr":"172.21.15.22:6827/1232311110","heartbeat_back_addr":"172.21.15.22:6831/1232311110","heartbeat_front_addr":"172.21.15.22:6829/1232311110","state":["exists","up"]},{"osd":4,"uuid":"43c6494f-352b-42a7-b6a9-fe7e3573fab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":832695158},{"type":"v1","addr":"172.21.15.115:6801","nonce":832695158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":832695158},{"type":"v1","addr":"172.21.15.115:6803","nonce":832695158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":832695158},{"type":"v1","addr":"172.21.15.115:6807","nonce":832695158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":832695158},{"type":"v1","addr":"172.21.15.115:6805","nonce":832695158}]},"public_addr":"172.21.15.115:6801/832695158","cluster_addr":"172.21.15.115:6803/832695158","heartbeat_back_addr":"172.21.15.115:6807/832695158","heartbeat_front_addr":"172.21.15.115:6805/832695158","state":["exists","up"]},{"osd":5,"uuid":"25fc861c-593d-4d49-942a-c75c19f25994","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":1504764223},{"type":"v1","addr":"172.21.15.115:6815","nonce":1504764223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":1504764223},{"type":"v1","addr":"172.21.15.115:6823","nonce":1504764223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":1504764223},{"type":"v1","addr":"172.21.15.115:6830","nonce":1504764223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6825","nonce":1504764223},{"type":"v1","addr":"172.21.15.115:6827","nonce":1504764223}]},"public_addr":"172.21.15.115:6815/1504764223","cluster_addr":"172.21.15.115:6823/1504764223","heartbeat_back_addr":"172.21.15.115:6830/1504764223","heartbeat_front_addr":"172.21.15.115:6827/1504764223","state":["exists","up"]},{"osd":6,"uuid":"2e7fb0b8-1162-497f-bffc-e2c02b9b9ef4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":959292720},{"type":"v1","addr":"172.21.15.115:6809","nonce":959292720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":959292720},{"type":"v1","addr":"172.21.15.115:6813","nonce":959292720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":959292720},{"type":"v1","addr":"172.21.15.115:6822","nonce":959292720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":959292720},{"type":"v1","addr":"172.21.15.115:6818","nonce":959292720}]},"public_addr":"172.21.15.115:6809/959292720","cluster_addr":"172.21.15.115:6813/959292720","heartbeat_back_addr":"172.21.15.115:6822/959292720","heartbeat_front_addr":"172.21.15.115:6818/959292720","state":["exists","up"]},{"osd":7,"uuid":"a97df0dc-e370-45ce-8742-25ae31e2212e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6811","nonce":20268513},{"type":"v1","addr":"172.21.15.115:6814","nonce":20268513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":20268513},{"type":"v1","addr":"172.21.15.115:6821","nonce":20268513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6829","nonce":20268513},{"type":"v1","addr":"172.21.15.115:6831","nonce":20268513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":20268513},{"type":"v1","addr":"172.21.15.115:6826","nonce":20268513}]},"public_addr":"172.21.15.115:6814/20268513","cluster_addr":"172.21.15.115:6821/20268513","heartbeat_back_addr":"172.21.15.115:6831/20268513","heartbeat_front_addr":"172.21.15.115:6826/20268513","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.692890+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.545577+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.712724+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.681944+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.492954+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.553222+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.597022+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.601698+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-21T13:36:03.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.822+0000 7f74e1919640 1 -- 172.21.15.22:0/499651281 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f74bc06f400 msgr2=0x7f74bc0718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:03.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.822+0000 7f74e1919640 1 --2- 172.21.15.22:0/499651281 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f74bc06f400 0x7f74bc0718c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f74dc1473d0 tx=0x7f74c4008040 comp rx=0 tx=0).stop 2024-05-21T13:36:03.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.822+0000 7f74e1919640 1 -- 172.21.15.22:0/499651281 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f74dc0c48f0 msgr2=0x7f74dc15c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:03.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.822+0000 7f74e1919640 1 --2- 172.21.15.22:0/499651281 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f74dc0c48f0 0x7f74dc15c160 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f74cc00d5f0 tx=0x7f74cc00dab0 comp rx=0 tx=0).stop 2024-05-21T13:36:03.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.822+0000 7f74e1919640 1 -- 172.21.15.22:0/499651281 shutdown_connections 2024-05-21T13:36:03.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.822+0000 7f74e1919640 1 --2- 172.21.15.22:0/499651281 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f74bc06f400 0x7f74bc0718c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:03.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.822+0000 7f74e1919640 1 --2- 172.21.15.22:0/499651281 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f74dc153cb0 0x7f74dc14f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:03.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.822+0000 7f74e1919640 1 --2- 172.21.15.22:0/499651281 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f74dc0c4cf0 0x7f74dc14ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:03.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.822+0000 7f74e1919640 1 --2- 172.21.15.22:0/499651281 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f74dc0c48f0 0x7f74dc15c160 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:03.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.822+0000 7f74e1919640 1 -- 172.21.15.22:0/499651281 >> 172.21.15.22:0/499651281 conn(0x7f74dc06ea10 msgr2=0x7f74dc147920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:03.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.822+0000 7f74e1919640 1 -- 172.21.15.22:0/499651281 shutdown_connections 2024-05-21T13:36:03.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.822+0000 7f74e1919640 1 -- 172.21.15.22:0/499651281 wait complete. 2024-05-21T13:36:03.844 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-21T13:36:03.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.978+0000 7efc179b6640 1 Processor -- start 2024-05-21T13:36:03.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.978+0000 7efc179b6640 1 -- start start 2024-05-21T13:36:03.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.982+0000 7efc179b6640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc100c48f0 0x7efc100c7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:03.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.982+0000 7efc179b6640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc10159cf0 con 0x7efc100c4d20 2024-05-21T13:36:03.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.982+0000 7efc179b6640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc10159fd0 con 0x7efc10153cb0 2024-05-21T13:36:03.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.982+0000 7efc179b6640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7efc100c9c60 con 0x7efc100c48f0 2024-05-21T13:36:03.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.982+0000 7efc15f53640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7efc100c4d20 0x7efc1015d1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:51756/0 (socket says 172.21.15.22:51756) 2024-05-21T13:36:03.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.982+0000 7efc15f53640 1 -- 172.21.15.22:0/568952270 learned_addr learned my addr 172.21.15.22:0/568952270 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-21T13:36:03.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.982+0000 7efc14f51640 1 --2- 172.21.15.22:0/568952270 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc100c48f0 0x7efc100c7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:03.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.982+0000 7efc07fff640 1 -- 172.21.15.22:0/568952270 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3440908094 0 0) 0x7efc10159cf0 con 0x7efc100c4d20 2024-05-21T13:36:03.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.982+0000 7efc07fff640 1 -- 172.21.15.22:0/568952270 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efbfc003530 con 0x7efc100c4d20 2024-05-21T13:36:03.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.982+0000 7efc07fff640 1 -- 172.21.15.22:0/568952270 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3379449156 0 0) 0x7efbfc003530 con 0x7efc100c4d20 2024-05-21T13:36:03.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.982+0000 7efc07fff640 1 -- 172.21.15.22:0/568952270 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc100c48f0 msgr2=0x7efc100c7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:03.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.982+0000 7efc07fff640 1 --2- 172.21.15.22:0/568952270 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc100c48f0 0x7efc100c7ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:03.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.982+0000 7efc07fff640 1 -- 172.21.15.22:0/568952270 >> v1:172.21.15.115:6789/0 conn(0x7efc10153cb0 legacy=0x7efc100c9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:03.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.982+0000 7efc07fff640 1 -- 172.21.15.22:0/568952270 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc1015a2b0 con 0x7efc100c4d20 2024-05-21T13:36:03.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.982+0000 7efc07fff640 1 -- 172.21.15.22:0/568952270 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2684847062 0 0) 0x7efc08001a80 con 0x7efc100c4d20 2024-05-21T13:36:03.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.982+0000 7efc07fff640 1 -- 172.21.15.22:0/568952270 >> v1:172.21.15.22:6789/0 conn(0x7efc100c4d20 legacy=0x7efc1015d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:03.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.982+0000 7efc07fff640 1 --2- 172.21.15.22:0/568952270 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc100c48f0 0x7efbfc003a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:03.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.982+0000 7efc07fff640 1 --2- 172.21.15.22:0/568952270 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efbfc004010 0x7efbfc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:03.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.982+0000 7efc07fff640 1 --2- 172.21.15.22:0/568952270 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efbfc004d50 0x7efbfc0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:03.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.982+0000 7efc07fff640 1 -- 172.21.15.22:0/568952270 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7efc100c9c60 con 0x7efbfc004d50 2024-05-21T13:36:03.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.982+0000 7efc07fff640 1 -- 172.21.15.22:0/568952270 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7efbfc00bb60 con 0x7efbfc004010 2024-05-21T13:36:03.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.982+0000 7efc07fff640 1 -- 172.21.15.22:0/568952270 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7efbfc00bd60 con 0x7efc100c48f0 2024-05-21T13:36:03.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.982+0000 7efc15f53640 1 --2- 172.21.15.22:0/568952270 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efbfc004d50 0x7efbfc0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:03.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.982+0000 7efc14f51640 1 --2- 172.21.15.22:0/568952270 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efbfc004010 0x7efbfc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:03.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.982+0000 7efc15752640 1 --2- 172.21.15.22:0/568952270 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc100c48f0 0x7efbfc003a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:03.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.982+0000 7efc15f53640 1 -- 172.21.15.22:0/568952270 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc100c48f0 msgr2=0x7efbfc003a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:03.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.982+0000 7efc15f53640 1 --2- 172.21.15.22:0/568952270 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc100c48f0 0x7efbfc003a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:03.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.982+0000 7efc15f53640 1 -- 172.21.15.22:0/568952270 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efbfc004010 msgr2=0x7efbfc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:03.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.982+0000 7efc15f53640 1 --2- 172.21.15.22:0/568952270 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efbfc004010 0x7efbfc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:03.966 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.982+0000 7efc15f53640 1 -- 172.21.15.22:0/568952270 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efbfc003530 con 0x7efbfc004d50 2024-05-21T13:36:03.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.986+0000 7efc15f53640 1 --2- 172.21.15.22:0/568952270 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efbfc004d50 0x7efbfc0051d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7efc0800a830 tx=0x7efc0801d2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec78d5fcb071d52f server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:03.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.986+0000 7efc07fff640 1 -- 172.21.15.22:0/568952270 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc0800a450 con 0x7efbfc004d50 2024-05-21T13:36:03.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.986+0000 7efc07fff640 1 -- 172.21.15.22:0/568952270 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc080072d0 con 0x7efbfc004d50 2024-05-21T13:36:03.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.986+0000 7efc07fff640 1 -- 172.21.15.22:0/568952270 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc080076c0 con 0x7efbfc004d50 2024-05-21T13:36:03.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.986+0000 7efc179b6640 1 -- 172.21.15.22:0/568952270 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efbfc004d50 msgr2=0x7efbfc0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:03.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.986+0000 7efc179b6640 1 --2- 172.21.15.22:0/568952270 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efbfc004d50 0x7efbfc0051d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7efc0800a830 tx=0x7efc0801d2c0 comp rx=0 tx=0).stop 2024-05-21T13:36:03.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.986+0000 7efc15f53640 1 -- 172.21.15.22:0/568952270 reap_dead start 2024-05-21T13:36:03.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.986+0000 7efc179b6640 1 -- 172.21.15.22:0/568952270 shutdown_connections 2024-05-21T13:36:03.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.986+0000 7efc179b6640 1 -- 172.21.15.22:0/568952270 >> 172.21.15.22:0/568952270 conn(0x7efc1006ea10 msgr2=0x7efc1006ff50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:03.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.986+0000 7efc179b6640 1 -- 172.21.15.22:0/568952270 shutdown_connections 2024-05-21T13:36:03.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.986+0000 7efc179b6640 1 -- 172.21.15.22:0/568952270 wait complete. 2024-05-21T13:36:03.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.986+0000 7efc179b6640 1 Processor -- start 2024-05-21T13:36:03.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.986+0000 7efc179b6640 1 -- start start 2024-05-21T13:36:03.971 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.986+0000 7efc179b6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efbfc004d50 0x7efc10144410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:03.971 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.986+0000 7efc179b6640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc101efd60 0x7efc10156ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:03.971 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.986+0000 7efc179b6640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc10145300 0x7efc10148ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:03.971 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.986+0000 7efc179b6640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7efc10154090 con 0x7efbfc004d50 2024-05-21T13:36:03.971 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.986+0000 7efc179b6640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7efc1015a870 con 0x7efc101efd60 2024-05-21T13:36:03.971 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.986+0000 7efc179b6640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7efc10154210 con 0x7efc10145300 2024-05-21T13:36:03.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.986+0000 7efc15752640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efbfc004d50 0x7efc10144410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:03.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.986+0000 7efc15752640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efbfc004d50 0x7efc10144410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37816/0 (socket says 172.21.15.22:37816) 2024-05-21T13:36:03.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.986+0000 7efc15752640 1 -- 172.21.15.22:0/3144080025 learned_addr learned my addr 172.21.15.22:0/3144080025 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:03.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.986+0000 7efc14f51640 1 --2- 172.21.15.22:0/3144080025 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc101efd60 0x7efc10156ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:03.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.986+0000 7efc15f53640 1 --2- 172.21.15.22:0/3144080025 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc10145300 0x7efc10148ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:03.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.986+0000 7efc15752640 1 -- 172.21.15.22:0/3144080025 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc10145300 msgr2=0x7efc10148ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:03.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.986+0000 7efc15752640 1 --2- 172.21.15.22:0/3144080025 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc10145300 0x7efc10148ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:03.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.986+0000 7efc15752640 1 -- 172.21.15.22:0/3144080025 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc101efd60 msgr2=0x7efc10156ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:03.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.986+0000 7efc15752640 1 --2- 172.21.15.22:0/3144080025 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc101efd60 0x7efc10156ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:03.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.986+0000 7efc15752640 1 -- 172.21.15.22:0/3144080025 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc10144aa0 con 0x7efbfc004d50 2024-05-21T13:36:03.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.986+0000 7efc15752640 1 --2- 172.21.15.22:0/3144080025 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efbfc004d50 0x7efc10144410 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7efc0c00d800 tx=0x7efc0c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:03.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.986+0000 7efc05ffb640 1 -- 172.21.15.22:0/3144080025 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc0c005270 con 0x7efbfc004d50 2024-05-21T13:36:03.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.986+0000 7efc179b6640 1 -- 172.21.15.22:0/3144080025 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc10144d60 con 0x7efbfc004d50 2024-05-21T13:36:03.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.986+0000 7efc05ffb640 1 -- 172.21.15.22:0/3144080025 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc0c017070 con 0x7efbfc004d50 2024-05-21T13:36:03.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.986+0000 7efc05ffb640 1 -- 172.21.15.22:0/3144080025 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc0c00b650 con 0x7efbfc004d50 2024-05-21T13:36:03.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.986+0000 7efc179b6640 1 -- 172.21.15.22:0/3144080025 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc101f2ca0 con 0x7efbfc004d50 2024-05-21T13:36:03.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.990+0000 7efc179b6640 1 -- 172.21.15.22:0/3144080025 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc10077bb0 con 0x7efbfc004d50 2024-05-21T13:36:03.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.990+0000 7efc05ffb640 1 -- 172.21.15.22:0/3144080025 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7efc0c00b7f0 con 0x7efbfc004d50 2024-05-21T13:36:03.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.990+0000 7efc05ffb640 1 --2- 172.21.15.22:0/3144080025 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7efbf406f430 0x7efbf40718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:03.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.990+0000 7efc05ffb640 1 -- 172.21.15.22:0/3144080025 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7efc0c08f0c0 con 0x7efbfc004d50 2024-05-21T13:36:03.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.990+0000 7efc14f51640 1 --2- 172.21.15.22:0/3144080025 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7efbf406f430 0x7efbf40718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:03.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.990+0000 7efc14f51640 1 --2- 172.21.15.22:0/3144080025 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7efbf406f430 0x7efbf40718f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7efc100cca90 tx=0x7efc00008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:03.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:03.994+0000 7efc05ffb640 1 -- 172.21.15.22:0/3144080025 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7efc0c05bbe0 con 0x7efbfc004d50 2024-05-21T13:36:04.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:04.190+0000 7efc179b6640 1 -- 172.21.15.22:0/3144080025 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efc100c89c0 con 0x7efbfc004d50 2024-05-21T13:36:04.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:04.190+0000 7efc05ffb640 1 -- 172.21.15.22:0/3144080025 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+6831 (secure 0 0 0) 0x7efc0c05b4e0 con 0x7efbfc004d50 2024-05-21T13:36:04.173 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-21T13:36:04.173 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4224,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/355756580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":355756580},{"type":"v1","addr":"172.21.15.22:6833","nonce":355756580}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4230,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3277017116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":3277017116},{"type":"v1","addr":"172.21.15.22:6835","nonce":3277017116}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4233,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3840772609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3840772609},{"type":"v1","addr":"172.21.15.22:6837","nonce":3840772609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4248,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/2009761279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":2009761279},{"type":"v1","addr":"172.21.15.115:6837","nonce":2009761279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4294,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6835/3894678097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3894678097},{"type":"v1","addr":"172.21.15.115:6835","nonce":3894678097}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-21T13:35:57.106892+0000","modified":"2024-05-21T13:36:03.552422+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4300},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4300":{"gid":4300,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.115:6839/1525097577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6838","nonce":1525097577},{"type":"v1","addr":"172.21.15.115:6839","nonce":1525097577}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4300,"qdb_cluster":[4300]},"id":1}]} 2024-05-21T13:36:04.173 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 6 2024-05-21T13:36:04.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:04.194+0000 7efc179b6640 1 -- 172.21.15.22:0/3144080025 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7efbf406f430 msgr2=0x7efbf40718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:04.175 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:04.194+0000 7efc179b6640 1 --2- 172.21.15.22:0/3144080025 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7efbf406f430 0x7efbf40718f0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7efc100cca90 tx=0x7efc00008040 comp rx=0 tx=0).stop 2024-05-21T13:36:04.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:04.194+0000 7efc179b6640 1 -- 172.21.15.22:0/3144080025 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efbfc004d50 msgr2=0x7efc10144410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:04.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:04.194+0000 7efc179b6640 1 --2- 172.21.15.22:0/3144080025 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efbfc004d50 0x7efc10144410 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7efc0c00d800 tx=0x7efc0c00dcc0 comp rx=0 tx=0).stop 2024-05-21T13:36:04.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:04.194+0000 7efc179b6640 1 -- 172.21.15.22:0/3144080025 shutdown_connections 2024-05-21T13:36:04.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:04.194+0000 7efc179b6640 1 --2- 172.21.15.22:0/3144080025 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7efbf406f430 0x7efbf40718f0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:04.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:04.194+0000 7efc179b6640 1 --2- 172.21.15.22:0/3144080025 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc10145300 0x7efc10148ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:04.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:04.194+0000 7efc179b6640 1 --2- 172.21.15.22:0/3144080025 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc101efd60 0x7efc10156ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:04.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:04.194+0000 7efc179b6640 1 --2- 172.21.15.22:0/3144080025 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efbfc004d50 0x7efc10144410 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:04.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:04.194+0000 7efc179b6640 1 -- 172.21.15.22:0/3144080025 >> 172.21.15.22:0/3144080025 conn(0x7efc1006ea10 msgr2=0x7efc10152640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:04.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:04.194+0000 7efc179b6640 1 -- 172.21.15.22:0/3144080025 shutdown_connections 2024-05-21T13:36:04.178 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:04.194+0000 7efc179b6640 1 -- 172.21.15.22:0/3144080025 wait complete. 2024-05-21T13:36:04.191 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-21T13:36:04.314 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:04.334+0000 7fb6ec5a3640 1 Processor -- start 2024-05-21T13:36:04.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:04.334+0000 7fb6ec5a3640 1 -- start start 2024-05-21T13:36:04.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:04.334+0000 7fb6ec5a3640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb6e4153ee0 0x7fb6e40cc1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:04.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:04.334+0000 7fb6ec5a3640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6e40ca7b0 con 0x7fb6e40cb200 2024-05-21T13:36:04.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:04.334+0000 7fb6ec5a3640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6e40c4550 con 0x7fb6e40cacb0 2024-05-21T13:36:04.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:04.334+0000 7fb6ec5a3640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fb6e40ca560 con 0x7fb6e4153ee0 2024-05-21T13:36:04.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:04.334+0000 7fb6ea33f640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb6e4153ee0 0x7fb6e40cc1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:04.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:04.334+0000 7fb6e9b3e640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fb6e40cb200 0x7fb6e4159a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:51768/0 (socket says 172.21.15.22:51768) 2024-05-21T13:36:04.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:04.334+0000 7fb6e9b3e640 1 -- 172.21.15.22:0/3935662228 learned_addr learned my addr 172.21.15.22:0/3935662228 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-21T13:36:04.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:04.334+0000 7fb6ea33f640 1 -- 172.21.15.22:0/3935662228 >> v1:172.21.15.115:6789/0 conn(0x7fb6e40cacb0 legacy=0x7fb6e4164330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:04.316 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:04.334+0000 7fb6ea33f640 1 -- 172.21.15.22:0/3935662228 >> v1:172.21.15.22:6789/0 conn(0x7fb6e40cb200 legacy=0x7fb6e4159a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:04.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:04.334+0000 7fb6ea33f640 1 -- 172.21.15.22:0/3935662228 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6e40c4830 con 0x7fb6e4153ee0 2024-05-21T13:36:04.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:04.334+0000 7fb6e933d640 1 -- 172.21.15.22:0/3935662228 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3233214434 0 0) 0x7fb6e40ca7b0 con 0x7fb6e40cb200 2024-05-21T13:36:04.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:04.338+0000 7fb6ea33f640 1 --2- 172.21.15.22:0/3935662228 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6e4153ee0 0x7fb6e40cc1b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb6e00097c0 tx=0x7fb6e001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d33bbe8421c60751 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:04.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:04.338+0000 7fb6e933d640 1 -- 172.21.15.22:0/3935662228 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6e00b0070 con 0x7fb6e4153ee0 2024-05-21T13:36:04.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:04.338+0000 7fb6e933d640 1 -- 172.21.15.22:0/3935662228 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6e00ab600 con 0x7fb6e4153ee0 2024-05-21T13:36:04.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:04.338+0000 7fb6e933d640 1 -- 172.21.15.22:0/3935662228 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6e00ab9d0 con 0x7fb6e4153ee0 2024-05-21T13:36:04.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:04.338+0000 7fb6ec5a3640 1 -- 172.21.15.22:0/3935662228 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6e4153ee0 msgr2=0x7fb6e40cc1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:04.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:04.338+0000 7fb6ec5a3640 1 --2- 172.21.15.22:0/3935662228 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6e4153ee0 0x7fb6e40cc1b0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fb6e00097c0 tx=0x7fb6e001c410 comp rx=0 tx=0).stop 2024-05-21T13:36:04.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:04.338+0000 7fb6ec5a3640 1 -- 172.21.15.22:0/3935662228 shutdown_connections 2024-05-21T13:36:04.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:04.338+0000 7fb6ec5a3640 1 --2- 172.21.15.22:0/3935662228 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6e4153ee0 0x7fb6e40cc1b0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:04.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:04.338+0000 7fb6ec5a3640 1 -- 172.21.15.22:0/3935662228 >> 172.21.15.22:0/3935662228 conn(0x7fb6e4070750 msgr2=0x7fb6e406c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:04.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:04.338+0000 7fb6ec5a3640 1 -- 172.21.15.22:0/3935662228 shutdown_connections 2024-05-21T13:36:04.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:04.338+0000 7fb6ec5a3640 1 -- 172.21.15.22:0/3935662228 wait complete. 2024-05-21T13:36:04.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:04.338+0000 7fb6ec5a3640 1 Processor -- start 2024-05-21T13:36:04.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:04.338+0000 7fb6ec5a3640 1 -- start start 2024-05-21T13:36:04.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:04.342+0000 7fb6ec5a3640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb6e40cacb0 0x7fb6e414bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:04.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:04.342+0000 7fb6ec5a3640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb6e40cb200 0x7fb6e41f50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:04.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:04.342+0000 7fb6ec5a3640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6e4153ee0 0x7fb6e41f5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:04.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:04.342+0000 7fb6ec5a3640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb6e40cca80 con 0x7fb6e4153ee0 2024-05-21T13:36:04.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:04.342+0000 7fb6ec5a3640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fb6e40cc900 con 0x7fb6e40cacb0 2024-05-21T13:36:04.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:04.342+0000 7fb6ec5a3640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7fb6e40caa90 con 0x7fb6e40cb200 2024-05-21T13:36:04.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:04.342+0000 7fb6eab40640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6e4153ee0 0x7fb6e41f5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:04.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:04.342+0000 7fb6eab40640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6e4153ee0 0x7fb6e41f5600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37830/0 (socket says 172.21.15.22:37830) 2024-05-21T13:36:04.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:04.342+0000 7fb6eab40640 1 -- 172.21.15.22:0/3804263970 learned_addr learned my addr 172.21.15.22:0/3804263970 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:04.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:04.342+0000 7fb6ea33f640 1 --2- 172.21.15.22:0/3804263970 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb6e40cacb0 0x7fb6e414bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:04.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:04.342+0000 7fb6e9b3e640 1 --2- 172.21.15.22:0/3804263970 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb6e40cb200 0x7fb6e41f50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:04.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:04.342+0000 7fb6eab40640 1 -- 172.21.15.22:0/3804263970 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb6e40cb200 msgr2=0x7fb6e41f50c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:04.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:04.342+0000 7fb6eab40640 1 --2- 172.21.15.22:0/3804263970 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb6e40cb200 0x7fb6e41f50c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:04.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:04.342+0000 7fb6eab40640 1 -- 172.21.15.22:0/3804263970 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb6e40cacb0 msgr2=0x7fb6e414bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:04.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:04.342+0000 7fb6eab40640 1 --2- 172.21.15.22:0/3804263970 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb6e40cacb0 0x7fb6e414bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:04.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:04.342+0000 7fb6eab40640 1 -- 172.21.15.22:0/3804263970 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6e41f6e20 con 0x7fb6e4153ee0 2024-05-21T13:36:04.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:04.342+0000 7fb6eab40640 1 --2- 172.21.15.22:0/3804263970 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6e4153ee0 0x7fb6e41f5600 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb6dc00c710 tx=0x7fb6dc00cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:04.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:04.342+0000 7fb6daffd640 1 -- 172.21.15.22:0/3804263970 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6dc003b80 con 0x7fb6e4153ee0 2024-05-21T13:36:04.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:04.342+0000 7fb6daffd640 1 -- 172.21.15.22:0/3804263970 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6dc003d20 con 0x7fb6e4153ee0 2024-05-21T13:36:04.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:04.342+0000 7fb6daffd640 1 -- 172.21.15.22:0/3804263970 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6dc00aa90 con 0x7fb6e4153ee0 2024-05-21T13:36:04.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:04.342+0000 7fb6ec5a3640 1 -- 172.21.15.22:0/3804263970 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6e40cc1a0 con 0x7fb6e4153ee0 2024-05-21T13:36:04.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:04.342+0000 7fb6ec5a3640 1 -- 172.21.15.22:0/3804263970 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6e41f4ba0 con 0x7fb6e4153ee0 2024-05-21T13:36:04.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:04.342+0000 7fb6ec5a3640 1 -- 172.21.15.22:0/3804263970 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6e41f4da0 con 0x7fb6e4153ee0 2024-05-21T13:36:04.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:04.342+0000 7fb6daffd640 1 -- 172.21.15.22:0/3804263970 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fb6dc00ac30 con 0x7fb6e4153ee0 2024-05-21T13:36:04.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:04.342+0000 7fb6daffd640 1 --2- 172.21.15.22:0/3804263970 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fb6c806f400 0x7fb6c80718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:04.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:04.346+0000 7fb6daffd640 1 -- 172.21.15.22:0/3804263970 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb6dc08f3d0 con 0x7fb6e4153ee0 2024-05-21T13:36:04.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:04.346+0000 7fb6ea33f640 1 --2- 172.21.15.22:0/3804263970 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fb6c806f400 0x7fb6c80718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:04.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:04.346+0000 7fb6ea33f640 1 --2- 172.21.15.22:0/3804263970 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fb6c806f400 0x7fb6c80718c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb6e00ad000 tx=0x7fb6e00a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:04.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:04.350+0000 7fb6daffd640 1 -- 172.21.15.22:0/3804263970 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fb6e41f4da0 con 0x7fb6e4153ee0 2024-05-21T13:36:04.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:04.506+0000 7fb6ec5a3640 1 -- 172.21.15.22:0/3804263970 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb6e40697d0 con 0x7fb6e4153ee0 2024-05-21T13:36:04.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:04.506+0000 7fb6daffd640 1 -- 172.21.15.22:0/3804263970 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18458 (secure 0 0 0) 0x7fb6dc00ce20 con 0x7fb6e4153ee0 2024-05-21T13:36:04.489 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-21T13:36:04.490 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":25,"fsid":"f2c96204-e240-4e7f-8a76-927b4f80f534","created":"2024-05-21T13:35:33.827005+0000","modified":"2024-05-21T13:36:02.190808+0000","last_up_change":"2024-05-21T13:35:44.542324+0000","last_in_change":"2024-05-21T13:35:36.061492+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-21T13:35:44.536105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-21T13:35:54.972996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-21T13:35:56.065755+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-21T13:35:59.791448+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"09157d4a-9443-4e10-bbb3-cf8ed7c42cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":222752954},{"type":"v1","addr":"172.21.15.22:6801","nonce":222752954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":222752954},{"type":"v1","addr":"172.21.15.22:6803","nonce":222752954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":222752954},{"type":"v1","addr":"172.21.15.22:6807","nonce":222752954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":222752954},{"type":"v1","addr":"172.21.15.22:6805","nonce":222752954}]},"public_addr":"172.21.15.22:6801/222752954","cluster_addr":"172.21.15.22:6803/222752954","heartbeat_back_addr":"172.21.15.22:6807/222752954","heartbeat_front_addr":"172.21.15.22:6805/222752954","state":["exists","up"]},{"osd":1,"uuid":"2a6a87c0-01ad-4a98-a538-c0a8e865b05d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":685426272},{"type":"v1","addr":"172.21.15.22:6809","nonce":685426272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":685426272},{"type":"v1","addr":"172.21.15.22:6811","nonce":685426272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":685426272},{"type":"v1","addr":"172.21.15.22:6815","nonce":685426272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":685426272},{"type":"v1","addr":"172.21.15.22:6813","nonce":685426272}]},"public_addr":"172.21.15.22:6809/685426272","cluster_addr":"172.21.15.22:6811/685426272","heartbeat_back_addr":"172.21.15.22:6815/685426272","heartbeat_front_addr":"172.21.15.22:6813/685426272","state":["exists","up"]},{"osd":2,"uuid":"4c18f931-40a4-46ac-a752-0d1be35b01a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":2092224336},{"type":"v1","addr":"172.21.15.22:6817","nonce":2092224336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":2092224336},{"type":"v1","addr":"172.21.15.22:6819","nonce":2092224336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":2092224336},{"type":"v1","addr":"172.21.15.22:6823","nonce":2092224336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":2092224336},{"type":"v1","addr":"172.21.15.22:6821","nonce":2092224336}]},"public_addr":"172.21.15.22:6817/2092224336","cluster_addr":"172.21.15.22:6819/2092224336","heartbeat_back_addr":"172.21.15.22:6823/2092224336","heartbeat_front_addr":"172.21.15.22:6821/2092224336","state":["exists","up"]},{"osd":3,"uuid":"d57ee7fd-b73e-41ec-8e3b-e62fb8898128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":1232311110},{"type":"v1","addr":"172.21.15.22:6825","nonce":1232311110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":1232311110},{"type":"v1","addr":"172.21.15.22:6827","nonce":1232311110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":1232311110},{"type":"v1","addr":"172.21.15.22:6831","nonce":1232311110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":1232311110},{"type":"v1","addr":"172.21.15.22:6829","nonce":1232311110}]},"public_addr":"172.21.15.22:6825/1232311110","cluster_addr":"172.21.15.22:6827/1232311110","heartbeat_back_addr":"172.21.15.22:6831/1232311110","heartbeat_front_addr":"172.21.15.22:6829/1232311110","state":["exists","up"]},{"osd":4,"uuid":"43c6494f-352b-42a7-b6a9-fe7e3573fab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":832695158},{"type":"v1","addr":"172.21.15.115:6801","nonce":832695158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":832695158},{"type":"v1","addr":"172.21.15.115:6803","nonce":832695158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":832695158},{"type":"v1","addr":"172.21.15.115:6807","nonce":832695158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":832695158},{"type":"v1","addr":"172.21.15.115:6805","nonce":832695158}]},"public_addr":"172.21.15.115:6801/832695158","cluster_addr":"172.21.15.115:6803/832695158","heartbeat_back_addr":"172.21.15.115:6807/832695158","heartbeat_front_addr":"172.21.15.115:6805/832695158","state":["exists","up"]},{"osd":5,"uuid":"25fc861c-593d-4d49-942a-c75c19f25994","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":1504764223},{"type":"v1","addr":"172.21.15.115:6815","nonce":1504764223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":1504764223},{"type":"v1","addr":"172.21.15.115:6823","nonce":1504764223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":1504764223},{"type":"v1","addr":"172.21.15.115:6830","nonce":1504764223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6825","nonce":1504764223},{"type":"v1","addr":"172.21.15.115:6827","nonce":1504764223}]},"public_addr":"172.21.15.115:6815/1504764223","cluster_addr":"172.21.15.115:6823/1504764223","heartbeat_back_addr":"172.21.15.115:6830/1504764223","heartbeat_front_addr":"172.21.15.115:6827/1504764223","state":["exists","up"]},{"osd":6,"uuid":"2e7fb0b8-1162-497f-bffc-e2c02b9b9ef4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":959292720},{"type":"v1","addr":"172.21.15.115:6809","nonce":959292720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":959292720},{"type":"v1","addr":"172.21.15.115:6813","nonce":959292720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":959292720},{"type":"v1","addr":"172.21.15.115:6822","nonce":959292720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":959292720},{"type":"v1","addr":"172.21.15.115:6818","nonce":959292720}]},"public_addr":"172.21.15.115:6809/959292720","cluster_addr":"172.21.15.115:6813/959292720","heartbeat_back_addr":"172.21.15.115:6822/959292720","heartbeat_front_addr":"172.21.15.115:6818/959292720","state":["exists","up"]},{"osd":7,"uuid":"a97df0dc-e370-45ce-8742-25ae31e2212e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6811","nonce":20268513},{"type":"v1","addr":"172.21.15.115:6814","nonce":20268513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":20268513},{"type":"v1","addr":"172.21.15.115:6821","nonce":20268513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6829","nonce":20268513},{"type":"v1","addr":"172.21.15.115:6831","nonce":20268513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":20268513},{"type":"v1","addr":"172.21.15.115:6826","nonce":20268513}]},"public_addr":"172.21.15.115:6814/20268513","cluster_addr":"172.21.15.115:6821/20268513","heartbeat_back_addr":"172.21.15.115:6831/20268513","heartbeat_front_addr":"172.21.15.115:6826/20268513","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.692890+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.545577+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.712724+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.681944+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.492954+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.553222+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.597022+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.601698+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-21T13:36:04.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:04.510+0000 7fb6ec5a3640 1 -- 172.21.15.22:0/3804263970 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fb6c806f400 msgr2=0x7fb6c80718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:04.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:04.510+0000 7fb6ec5a3640 1 --2- 172.21.15.22:0/3804263970 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fb6c806f400 0x7fb6c80718c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb6e00ad000 tx=0x7fb6e00a6000 comp rx=0 tx=0).stop 2024-05-21T13:36:04.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:04.510+0000 7fb6ec5a3640 1 -- 172.21.15.22:0/3804263970 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6e4153ee0 msgr2=0x7fb6e41f5600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:04.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:04.510+0000 7fb6ec5a3640 1 --2- 172.21.15.22:0/3804263970 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6e4153ee0 0x7fb6e41f5600 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb6dc00c710 tx=0x7fb6dc00cbd0 comp rx=0 tx=0).stop 2024-05-21T13:36:04.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:04.510+0000 7fb6ec5a3640 1 -- 172.21.15.22:0/3804263970 shutdown_connections 2024-05-21T13:36:04.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:04.510+0000 7fb6ec5a3640 1 --2- 172.21.15.22:0/3804263970 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fb6c806f400 0x7fb6c80718c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:04.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:04.510+0000 7fb6ec5a3640 1 --2- 172.21.15.22:0/3804263970 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6e4153ee0 0x7fb6e41f5600 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:04.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:04.510+0000 7fb6ec5a3640 1 --2- 172.21.15.22:0/3804263970 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb6e40cb200 0x7fb6e41f50c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:04.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:04.510+0000 7fb6ec5a3640 1 --2- 172.21.15.22:0/3804263970 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb6e40cacb0 0x7fb6e414bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:04.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:04.510+0000 7fb6ec5a3640 1 -- 172.21.15.22:0/3804263970 >> 172.21.15.22:0/3804263970 conn(0x7fb6e4070750 msgr2=0x7fb6e40c6d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:04.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:04.510+0000 7fb6ec5a3640 1 -- 172.21.15.22:0/3804263970 shutdown_connections 2024-05-21T13:36:04.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:04.510+0000 7fb6ec5a3640 1 -- 172.21.15.22:0/3804263970 wait complete. 2024-05-21T13:36:05.111 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-21T13:35:57.106892+0000', 'modified': '2024-05-21T13:36:03.552422+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4300}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4300': {'gid': 4300, 'name': 'f', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.115:6839/1525097577', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6838', 'nonce': 1525097577}, {'type': 'v1', 'addr': '172.21.15.115:6839', 'nonce': 1525097577}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4300, 'qdb_cluster': [4300]} 2024-05-21T13:36:05.111 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-05-21T13:36:05.111 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2024-05-21T13:36:05.247 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.270+0000 7f2d89dde640 1 Processor -- start 2024-05-21T13:36:05.247 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.270+0000 7f2d89dde640 1 -- start start 2024-05-21T13:36:05.248 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.270+0000 7f2d89dde640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2d84153b20 0x7f2d840c9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:05.248 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.270+0000 7f2d89dde640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2d840c9560 0x7f2d8415d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:05.248 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.270+0000 7f2d89dde640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d84159b20 con 0x7f2d840c47f0 2024-05-21T13:36:05.248 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.270+0000 7f2d89dde640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f2d840c9a60 con 0x7f2d84153b20 2024-05-21T13:36:05.249 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.270+0000 7f2d89dde640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f2d84159da0 con 0x7f2d840c9560 2024-05-21T13:36:05.249 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.270+0000 7f2d83fff640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f2d840c47f0 0x7f2d8406df50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:51780/0 (socket says 172.21.15.22:51780) 2024-05-21T13:36:05.249 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.270+0000 7f2d83fff640 1 -- 172.21.15.22:0/1192074878 learned_addr learned my addr 172.21.15.22:0/1192074878 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-21T13:36:05.250 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.270+0000 7f2d82ffd640 1 -- 172.21.15.22:0/1192074878 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2292242527 0 0) 0x7f2d7c0014a0 con 0x7f2d840c47f0 2024-05-21T13:36:05.250 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.270+0000 7f2d837fe640 1 --2- 172.21.15.22:0/1192074878 >> v2:172.21.15.115:3300/0 conn(0x7f2d84153b20 0x7f2d840c9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:05.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.270+0000 7f2d7affd640 1 --2- 172.21.15.22:0/1192074878 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2d840c9560 0x7f2d8415d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:05.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.270+0000 7f2d82ffd640 1 -- 172.21.15.22:0/1192074878 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d70003530 con 0x7f2d840c47f0 2024-05-21T13:36:05.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.270+0000 7f2d82ffd640 1 -- 172.21.15.22:0/1192074878 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2741475147 0 0) 0x7f2d70003530 con 0x7f2d840c47f0 2024-05-21T13:36:05.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.270+0000 7f2d82ffd640 1 -- 172.21.15.22:0/1192074878 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2d840c9560 msgr2=0x7f2d8415d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:05.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.270+0000 7f2d82ffd640 1 --2- 172.21.15.22:0/1192074878 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2d840c9560 0x7f2d8415d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:05.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.270+0000 7f2d82ffd640 1 -- 172.21.15.22:0/1192074878 >> v2:172.21.15.115:3300/0 conn(0x7f2d84153b20 msgr2=0x7f2d840c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:05.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.270+0000 7f2d82ffd640 1 --2- 172.21.15.22:0/1192074878 >> v2:172.21.15.115:3300/0 conn(0x7f2d84153b20 0x7f2d840c9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:05.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.270+0000 7f2d82ffd640 1 -- 172.21.15.22:0/1192074878 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d8415a080 con 0x7f2d840c47f0 2024-05-21T13:36:05.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.270+0000 7f2d82ffd640 1 -- 172.21.15.22:0/1192074878 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2684847062 0 0) 0x7f2d7c001c50 con 0x7f2d840c47f0 2024-05-21T13:36:05.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.270+0000 7f2d82ffd640 1 -- 172.21.15.22:0/1192074878 >> v1:172.21.15.22:6789/0 conn(0x7f2d840c47f0 legacy=0x7f2d8406df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:05.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.270+0000 7f2d82ffd640 1 --2- 172.21.15.22:0/1192074878 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2d70003a60 0x7f2d70003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:05.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.270+0000 7f2d82ffd640 1 --2- 172.21.15.22:0/1192074878 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2d840c9560 0x7f2d70004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:05.251 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.270+0000 7f2d82ffd640 1 --2- 172.21.15.22:0/1192074878 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d70004d50 0x7f2d700051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:05.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.270+0000 7f2d82ffd640 1 -- 172.21.15.22:0/1192074878 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f2d840c9a60 con 0x7f2d70003a60 2024-05-21T13:36:05.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.270+0000 7f2d82ffd640 1 -- 172.21.15.22:0/1192074878 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f2d84159da0 con 0x7f2d70004d50 2024-05-21T13:36:05.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.270+0000 7f2d82ffd640 1 -- 172.21.15.22:0/1192074878 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f2d7000ba90 con 0x7f2d840c9560 2024-05-21T13:36:05.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.270+0000 7f2d837fe640 1 --2- 172.21.15.22:0/1192074878 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2d70003a60 0x7f2d70003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:05.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.270+0000 7f2d83fff640 1 --2- 172.21.15.22:0/1192074878 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d70004d50 0x7f2d700051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:05.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.270+0000 7f2d7affd640 1 --2- 172.21.15.22:0/1192074878 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2d840c9560 0x7f2d70004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:05.252 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.270+0000 7f2d837fe640 1 -- 172.21.15.22:0/1192074878 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2d840c9560 msgr2=0x7f2d70004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:05.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.270+0000 7f2d837fe640 1 --2- 172.21.15.22:0/1192074878 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2d840c9560 0x7f2d70004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:05.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.270+0000 7f2d837fe640 1 -- 172.21.15.22:0/1192074878 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d70004d50 msgr2=0x7f2d700051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:05.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.270+0000 7f2d837fe640 1 --2- 172.21.15.22:0/1192074878 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d70004d50 0x7f2d700051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:05.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.270+0000 7f2d837fe640 1 -- 172.21.15.22:0/1192074878 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d70003530 con 0x7f2d70003a60 2024-05-21T13:36:05.254 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.270+0000 7f2d7affd640 1 --2- 172.21.15.22:0/1192074878 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2d840c9560 0x7f2d70004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:36:05.256 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.270+0000 7f2d837fe640 1 --2- 172.21.15.22:0/1192074878 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2d70003a60 0x7f2d70003e80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2d74009ae0 tx=0x7f2d7401cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=738211ae72a726ab server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:05.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.270+0000 7f2d82ffd640 1 -- 172.21.15.22:0/1192074878 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d740b2070 con 0x7f2d70003a60 2024-05-21T13:36:05.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.270+0000 7f2d82ffd640 1 -- 172.21.15.22:0/1192074878 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d740a56a0 con 0x7f2d70003a60 2024-05-21T13:36:05.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.270+0000 7f2d82ffd640 1 -- 172.21.15.22:0/1192074878 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d740096b0 con 0x7f2d70003a60 2024-05-21T13:36:05.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.270+0000 7f2d89dde640 1 -- 172.21.15.22:0/1192074878 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2d70003a60 msgr2=0x7f2d70003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:05.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.270+0000 7f2d89dde640 1 --2- 172.21.15.22:0/1192074878 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2d70003a60 0x7f2d70003e80 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2d74009ae0 tx=0x7f2d7401cab0 comp rx=0 tx=0).stop 2024-05-21T13:36:05.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.270+0000 7f2d83fff640 1 -- 172.21.15.22:0/1192074878 reap_dead start 2024-05-21T13:36:05.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.270+0000 7f2d89dde640 1 -- 172.21.15.22:0/1192074878 shutdown_connections 2024-05-21T13:36:05.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.270+0000 7f2d89dde640 1 -- 172.21.15.22:0/1192074878 >> 172.21.15.22:0/1192074878 conn(0x7f2d8406ce70 msgr2=0x7f2d840cd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:05.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.270+0000 7f2d89dde640 1 -- 172.21.15.22:0/1192074878 shutdown_connections 2024-05-21T13:36:05.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.270+0000 7f2d89dde640 1 -- 172.21.15.22:0/1192074878 wait complete. 2024-05-21T13:36:05.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.274+0000 7f2d89dde640 1 Processor -- start 2024-05-21T13:36:05.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.274+0000 7f2d89dde640 1 -- start start 2024-05-21T13:36:05.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.274+0000 7f2d89dde640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2d70003a60 0x7f2d84154fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:05.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.274+0000 7f2d89dde640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d84155e90 0x7f2d84156470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:05.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.274+0000 7f2d89dde640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2d84155940 0x7f2d841569b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:05.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.274+0000 7f2d89dde640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f2d84153f00 con 0x7f2d84155940 2024-05-21T13:36:05.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.274+0000 7f2d89dde640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f2d8415a640 con 0x7f2d84155e90 2024-05-21T13:36:05.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.274+0000 7f2d89dde640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f2d8406e660 con 0x7f2d70003a60 2024-05-21T13:36:05.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.274+0000 7f2d83fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2d84155940 0x7f2d841569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:05.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.274+0000 7f2d83fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2d84155940 0x7f2d841569b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37854/0 (socket says 172.21.15.22:37854) 2024-05-21T13:36:05.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.274+0000 7f2d83fff640 1 -- 172.21.15.22:0/1488894256 learned_addr learned my addr 172.21.15.22:0/1488894256 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:05.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.274+0000 7f2d7affd640 1 --2- 172.21.15.22:0/1488894256 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d84155e90 0x7f2d84156470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:05.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.274+0000 7f2d837fe640 1 --2- 172.21.15.22:0/1488894256 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2d70003a60 0x7f2d84154fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:05.258 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.274+0000 7f2d83fff640 1 -- 172.21.15.22:0/1488894256 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2d70003a60 msgr2=0x7f2d84154fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:05.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.274+0000 7f2d83fff640 1 --2- 172.21.15.22:0/1488894256 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2d70003a60 0x7f2d84154fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:05.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.274+0000 7f2d83fff640 1 -- 172.21.15.22:0/1488894256 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d84155e90 msgr2=0x7f2d84156470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:05.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.274+0000 7f2d83fff640 1 --2- 172.21.15.22:0/1488894256 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d84155e90 0x7f2d84156470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:05.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.274+0000 7f2d83fff640 1 -- 172.21.15.22:0/1488894256 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d840cc600 con 0x7f2d84155940 2024-05-21T13:36:05.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.274+0000 7f2d83fff640 1 --2- 172.21.15.22:0/1488894256 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2d84155940 0x7f2d841569b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2d8406da80 tx=0x7f2d7c011890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:05.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.274+0000 7f2d80ff9640 1 -- 172.21.15.22:0/1488894256 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d7c01c070 con 0x7f2d84155940 2024-05-21T13:36:05.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.274+0000 7f2d80ff9640 1 -- 172.21.15.22:0/1488894256 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d7c0137e0 con 0x7f2d84155940 2024-05-21T13:36:05.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.274+0000 7f2d89dde640 1 -- 172.21.15.22:0/1488894256 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d840cc320 con 0x7f2d84155940 2024-05-21T13:36:05.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.274+0000 7f2d80ff9640 1 -- 172.21.15.22:0/1488894256 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d7c010040 con 0x7f2d84155940 2024-05-21T13:36:05.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.274+0000 7f2d89dde640 1 -- 172.21.15.22:0/1488894256 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d841f0940 con 0x7f2d84155940 2024-05-21T13:36:05.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.274+0000 7f2d80ff9640 1 -- 172.21.15.22:0/1488894256 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f2d7c01f070 con 0x7f2d84155940 2024-05-21T13:36:05.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.278+0000 7f2d80ff9640 1 --2- 172.21.15.22:0/1488894256 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f2d6406f400 0x7f2d640718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:05.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.278+0000 7f2d80ff9640 1 -- 172.21.15.22:0/1488894256 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f2d7c091e20 con 0x7f2d84155940 2024-05-21T13:36:05.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.278+0000 7f2d837fe640 1 --2- 172.21.15.22:0/1488894256 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f2d6406f400 0x7f2d640718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:05.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.278+0000 7f2d8cf69000 1 Processor -- start 2024-05-21T13:36:05.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.278+0000 7f2d8cf69000 1 -- start start 2024-05-21T13:36:05.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.278+0000 7f2d837fe640 1 --2- 172.21.15.22:0/1488894256 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f2d6406f400 0x7f2d640718c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2d740af000 tx=0x7f2d740046d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:05.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.278+0000 7f2d8cf69000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5583f73e74a0 0x5583f73b0200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:05.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.278+0000 7f2d8cf69000 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5583f73b0740 0x5583f73cf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:05.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.278+0000 7f2d8cf69000 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5583f73cfef0 0x5583f73d02d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:05.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.278+0000 7f2d8cf69000 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5583f72046d0 con 0x5583f73b0740 2024-05-21T13:36:05.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.278+0000 7f2d8cf69000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5583f71f4270 con 0x5583f73e74a0 2024-05-21T13:36:05.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.278+0000 7f2d8cf69000 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x5583f71f82b0 con 0x5583f73cfef0 2024-05-21T13:36:05.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.278+0000 7f2d7affd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5583f73b0740 0x5583f73cf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:05.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.278+0000 7f2d7affd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5583f73b0740 0x5583f73cf9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37868/0 (socket says 172.21.15.22:37868) 2024-05-21T13:36:05.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.278+0000 7f2d7affd640 1 -- 172.21.15.22:0/1958614108 learned_addr learned my addr 172.21.15.22:0/1958614108 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:05.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.278+0000 7f2d837fe640 1 --2- 172.21.15.22:0/1958614108 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5583f73e74a0 0x5583f73b0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:05.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.278+0000 7f2d83fff640 1 --2- 172.21.15.22:0/1958614108 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5583f73cfef0 0x5583f73d02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:05.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.278+0000 7f2d7affd640 1 -- 172.21.15.22:0/1958614108 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5583f73cfef0 msgr2=0x5583f73d02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:05.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.278+0000 7f2d7affd640 1 --2- 172.21.15.22:0/1958614108 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5583f73cfef0 0x5583f73d02d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:05.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.278+0000 7f2d7affd640 1 -- 172.21.15.22:0/1958614108 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5583f73e74a0 msgr2=0x5583f73b0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:05.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.278+0000 7f2d7affd640 1 --2- 172.21.15.22:0/1958614108 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5583f73e74a0 0x5583f73b0200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:05.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.278+0000 7f2d7affd640 1 -- 172.21.15.22:0/1958614108 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583f71d2bf0 con 0x5583f73b0740 2024-05-21T13:36:05.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.278+0000 7f2d837fe640 1 --2- 172.21.15.22:0/1958614108 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5583f73e74a0 0x5583f73b0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:36:05.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.278+0000 7f2d7affd640 1 --2- 172.21.15.22:0/1958614108 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5583f73b0740 0x5583f73cf9b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c009b70 tx=0x7f2d6c009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9d88d1c68d221be server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:05.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.278+0000 7f2d797fa640 1 -- 172.21.15.22:0/1958614108 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d6c019070 con 0x5583f73b0740 2024-05-21T13:36:05.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.278+0000 7f2d797fa640 1 -- 172.21.15.22:0/1958614108 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d6c009c60 con 0x5583f73b0740 2024-05-21T13:36:05.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.278+0000 7f2d797fa640 1 -- 172.21.15.22:0/1958614108 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d6c00f040 con 0x5583f73b0740 2024-05-21T13:36:05.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.278+0000 7f2d8cf69000 1 -- 172.21.15.22:0/1958614108 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5583f73b0740 msgr2=0x5583f73cf9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:05.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.278+0000 7f2d8cf69000 1 --2- 172.21.15.22:0/1958614108 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5583f73b0740 0x5583f73cf9b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c009b70 tx=0x7f2d6c009190 comp rx=0 tx=0).stop 2024-05-21T13:36:05.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.278+0000 7f2d8cf69000 1 -- 172.21.15.22:0/1958614108 shutdown_connections 2024-05-21T13:36:05.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.278+0000 7f2d8cf69000 1 --2- 172.21.15.22:0/1958614108 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5583f73cfef0 0x5583f73d02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:05.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.278+0000 7f2d8cf69000 1 --2- 172.21.15.22:0/1958614108 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5583f73b0740 0x5583f73cf9b0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:05.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.278+0000 7f2d8cf69000 1 --2- 172.21.15.22:0/1958614108 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5583f73e74a0 0x5583f73b0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:05.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.278+0000 7f2d8cf69000 1 -- 172.21.15.22:0/1958614108 >> 172.21.15.22:0/1958614108 conn(0x5583f728fef0 msgr2=0x5583f73e6b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:05.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.278+0000 7f2d8cf69000 1 -- 172.21.15.22:0/1958614108 shutdown_connections 2024-05-21T13:36:05.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.278+0000 7f2d8cf69000 1 -- 172.21.15.22:0/1958614108 wait complete. 2024-05-21T13:36:05.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.278+0000 7f2d8cf69000 1 -- start start 2024-05-21T13:36:05.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.278+0000 7f2d8cf69000 1 Processor -- start 2024-05-21T13:36:05.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.282+0000 7f2d8cf69000 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5583f73b0740 0x5583f73f4050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:05.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.282+0000 7f2d8cf69000 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5583f73cfef0 0x5583f73f4590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:05.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.282+0000 7f2d8cf69000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5583f73e74a0 0x5583f73abc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:05.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.282+0000 7f2d8cf69000 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5583f71b7630 con 0x5583f73cfef0 2024-05-21T13:36:05.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.282+0000 7f2d8cf69000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5583f7278570 con 0x5583f73e74a0 2024-05-21T13:36:05.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.282+0000 7f2d8cf69000 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x5583f72034a0 con 0x5583f73b0740 2024-05-21T13:36:05.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.282+0000 7f2d8cf69000 10 client.0 _ll_register_callbacks cb 0x5583f7393540 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-21T13:36:05.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.282+0000 7f2d7affd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5583f73cfef0 0x5583f73f4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:05.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.282+0000 7f2d7affd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5583f73cfef0 0x5583f73f4590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:37880/0 (socket says 172.21.15.22:37880) 2024-05-21T13:36:05.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.282+0000 7f2d7affd640 1 -- 172.21.15.22:0/36332689 learned_addr learned my addr 172.21.15.22:0/36332689 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:05.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.282+0000 7f2d837fe640 1 --2- 172.21.15.22:0/36332689 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5583f73b0740 0x5583f73f4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:05.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.282+0000 7f2d83fff640 1 --2- 172.21.15.22:0/36332689 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5583f73e74a0 0x5583f73abc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:05.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.282+0000 7f2d7affd640 1 -- 172.21.15.22:0/36332689 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5583f73b0740 msgr2=0x5583f73f4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:05.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.282+0000 7f2d7affd640 1 --2- 172.21.15.22:0/36332689 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5583f73b0740 0x5583f73f4050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:05.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.282+0000 7f2d7affd640 1 -- 172.21.15.22:0/36332689 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5583f73e74a0 msgr2=0x5583f73abc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:05.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.282+0000 7f2d7affd640 1 --2- 172.21.15.22:0/36332689 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5583f73e74a0 0x5583f73abc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:05.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.282+0000 7f2d7affd640 1 -- 172.21.15.22:0/36332689 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583f723c9b0 con 0x5583f73cfef0 2024-05-21T13:36:05.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.282+0000 7f2d7affd640 1 --2- 172.21.15.22:0/36332689 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5583f73cfef0 0x5583f73f4590 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x5583f72ada10 tx=0x7f2d6c0046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=535d1b45bde01058 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:05.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.282+0000 7f2d627fc640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-05-21T13:36:05.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.282+0000 7f2d627fc640 1 -- 172.21.15.22:0/36332689 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d6c019070 con 0x5583f73cfef0 2024-05-21T13:36:05.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.282+0000 7f2d627fc640 1 -- 172.21.15.22:0/36332689 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f2d6c005cb0 con 0x5583f73cfef0 2024-05-21T13:36:05.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.282+0000 7f2d8cf69000 1 -- 172.21.15.22:0/36332689 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2d6c009c60 con 0x5583f73cfef0 2024-05-21T13:36:05.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.282+0000 7f2d627fc640 1 -- 172.21.15.22:0/36332689 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f2d6c02f050 con 0x5583f73cfef0 2024-05-21T13:36:05.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.282+0000 7f2d8cf69000 10 client.4365 fetch_fsmap learned FSMap version 6 2024-05-21T13:36:05.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.282+0000 7f2d8cf69000 1 -- 172.21.15.22:0/36332689 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x5583f71cf510 con 0x5583f73cfef0 2024-05-21T13:36:05.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.282+0000 7f2d627fc640 1 -- 172.21.15.22:0/36332689 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d6c009c60 con 0x5583f73cfef0 2024-05-21T13:36:05.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.282+0000 7f2d627fc640 1 -- 172.21.15.22:0/36332689 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 6) ==== 4712+0+0 (secure 0 0 0) 0x7f2d6c032020 con 0x5583f73cfef0 2024-05-21T13:36:05.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.282+0000 7f2d8cf69000 10 client.4365 fetch_fsmap finished waiting for FSMap version 6 2024-05-21T13:36:05.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.282+0000 7f2d8cf69000 10 client.4365 resolve_mds: resolved name 'f' to daemon mds.f 2024-05-21T13:36:05.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.282+0000 7f2d8cf69000 20 client.4365 populate_metadata read hostname 'smithi022' 2024-05-21T13:36:05.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.282+0000 7f2d8cf69000 1 --2- 172.21.15.22:0/36332689 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x5583f73ac910 0x5583f73accf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:05.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.282+0000 7f2d8cf69000 4 client.4365 mds_command: new command op to 4300 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-21T13:36:05.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.282+0000 7f2d8cf69000 1 -- 172.21.15.22:0/36332689 --> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5583f718fbc0 con 0x5583f73ac910 2024-05-21T13:36:05.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.282+0000 7f2d837fe640 1 --2- 172.21.15.22:0/36332689 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x5583f73ac910 0x5583f73accf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:05.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.282+0000 7f2d627fc640 10 client.4365 ms_handle_connect on v2:172.21.15.115:6838/1525097577 2024-05-21T13:36:05.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:05.282+0000 7f2d837fe640 1 --2- 172.21.15.22:0/36332689 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x5583f73ac910 0x5583f73accf0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a9f2383912cc26fd server_cookie=a67f239daffc9c00 in_seq=0 out_seq=0 2024-05-21T13:36:08.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.558+0000 7f2d627fc640 1 -- 172.21.15.22:0/36332689 <== mds.0 v2:172.21.15.115:6838/1525097577 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x5583f718fbc0 con 0x5583f73ac910 2024-05-21T13:36:08.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.558+0000 7f2d627fc640 10 client.4365 handle_command_reply: tid=0 2024-05-21T13:36:08.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.558+0000 7f2d8cf69000 1 client.4365 shutdown 2024-05-21T13:36:08.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.558+0000 7f2d8cf69000 1 -- 172.21.15.22:0/36332689 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5583f73cfef0 msgr2=0x5583f73f4590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:08.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.558+0000 7f2d8cf69000 1 --2- 172.21.15.22:0/36332689 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5583f73cfef0 0x5583f73f4590 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x5583f72ada10 tx=0x7f2d6c0046d0 comp rx=0 tx=0).stop 2024-05-21T13:36:08.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.558+0000 7f2d8cf69000 1 -- 172.21.15.22:0/36332689 shutdown_connections 2024-05-21T13:36:08.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.558+0000 7f2d8cf69000 1 --2- 172.21.15.22:0/36332689 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x5583f73ac910 0x5583f73accf0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:08.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.558+0000 7f2d8cf69000 1 --2- 172.21.15.22:0/36332689 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5583f73e74a0 0x5583f73abc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:08.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.558+0000 7f2d8cf69000 1 --2- 172.21.15.22:0/36332689 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5583f73cfef0 0x5583f73f4590 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:08.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.558+0000 7f2d8cf69000 1 --2- 172.21.15.22:0/36332689 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5583f73b0740 0x5583f73f4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:08.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.558+0000 7f2d8cf69000 1 -- 172.21.15.22:0/36332689 >> 172.21.15.22:0/36332689 conn(0x5583f728fef0 msgr2=0x5583f73a68e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:08.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.558+0000 7f2d627fc640 0 client.4365 ms_handle_reset on v2:172.21.15.115:6838/1525097577 2024-05-21T13:36:08.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.558+0000 7f2d8cf69000 1 -- 172.21.15.22:0/36332689 shutdown_connections 2024-05-21T13:36:08.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.558+0000 7f2d8cf69000 1 -- 172.21.15.22:0/36332689 wait complete. 2024-05-21T13:36:08.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.558+0000 7f2d8cf69000 20 client.4365 trim_cache size 0 max 16384 2024-05-21T13:36:08.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.590+0000 7f2d8cf69000 1 Processor -- start 2024-05-21T13:36:08.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.590+0000 7f2d8cf69000 1 -- start start 2024-05-21T13:36:08.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.594+0000 7f2d8cf69000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5583f73b0740 0x5583f73cf6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:08.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.594+0000 7f2d8cf69000 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5583f73cfef0 0x5583f73aa980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:08.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.594+0000 7f2d8cf69000 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5583f73e74a0 0x5583f73aaec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:08.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.594+0000 7f2d8cf69000 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5583f7191200 con 0x5583f73cfef0 2024-05-21T13:36:08.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.594+0000 7f2d8cf69000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5583f718c7b0 con 0x5583f73b0740 2024-05-21T13:36:08.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.594+0000 7f2d8cf69000 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x5583f71f75c0 con 0x5583f73e74a0 2024-05-21T13:36:08.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.594+0000 7f2d7affd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5583f73cfef0 0x5583f73aa980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:08.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.594+0000 7f2d7affd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5583f73cfef0 0x5583f73aa980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50688/0 (socket says 172.21.15.22:50688) 2024-05-21T13:36:08.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.594+0000 7f2d7affd640 1 -- 172.21.15.22:0/2958392893 learned_addr learned my addr 172.21.15.22:0/2958392893 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:08.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.594+0000 7f2d83fff640 1 --2- 172.21.15.22:0/2958392893 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5583f73e74a0 0x5583f73aaec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:08.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.594+0000 7f2d837fe640 1 --2- 172.21.15.22:0/2958392893 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5583f73b0740 0x5583f73cf6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:08.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.594+0000 7f2d7affd640 1 -- 172.21.15.22:0/2958392893 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5583f73e74a0 msgr2=0x5583f73aaec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:08.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.594+0000 7f2d7affd640 1 --2- 172.21.15.22:0/2958392893 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5583f73e74a0 0x5583f73aaec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:08.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.594+0000 7f2d7affd640 1 -- 172.21.15.22:0/2958392893 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5583f73b0740 msgr2=0x5583f73cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:08.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.594+0000 7f2d7affd640 1 --2- 172.21.15.22:0/2958392893 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5583f73b0740 0x5583f73cf6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:08.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.594+0000 7f2d7affd640 1 -- 172.21.15.22:0/2958392893 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583f7195860 con 0x5583f73cfef0 2024-05-21T13:36:08.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.594+0000 7f2d83fff640 1 --2- 172.21.15.22:0/2958392893 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5583f73e74a0 0x5583f73aaec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T13:36:08.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.594+0000 7f2d837fe640 1 --2- 172.21.15.22:0/2958392893 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5583f73b0740 0x5583f73cf6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T13:36:08.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.594+0000 7f2d7affd640 1 --2- 172.21.15.22:0/2958392893 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5583f73cfef0 0x5583f73aa980 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c02d040 tx=0x7f2d6c023000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffe9750a70640d2c server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:08.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.594+0000 7f2d78ff9640 1 -- 172.21.15.22:0/2958392893 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d6c009e60 con 0x5583f73cfef0 2024-05-21T13:36:08.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.594+0000 7f2d78ff9640 1 -- 172.21.15.22:0/2958392893 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d6c000e50 con 0x5583f73cfef0 2024-05-21T13:36:08.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.594+0000 7f2d78ff9640 1 -- 172.21.15.22:0/2958392893 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d6c005cb0 con 0x5583f73cfef0 2024-05-21T13:36:08.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.594+0000 7f2d8cf69000 1 -- 172.21.15.22:0/2958392893 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5583f73cfef0 msgr2=0x5583f73aa980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:08.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.594+0000 7f2d8cf69000 1 --2- 172.21.15.22:0/2958392893 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5583f73cfef0 0x5583f73aa980 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c02d040 tx=0x7f2d6c023000 comp rx=0 tx=0).stop 2024-05-21T13:36:08.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.594+0000 7f2d8cf69000 1 -- 172.21.15.22:0/2958392893 shutdown_connections 2024-05-21T13:36:08.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.594+0000 7f2d8cf69000 1 --2- 172.21.15.22:0/2958392893 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5583f73e74a0 0x5583f73aaec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:08.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.594+0000 7f2d8cf69000 1 --2- 172.21.15.22:0/2958392893 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5583f73cfef0 0x5583f73aa980 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:08.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.594+0000 7f2d8cf69000 1 --2- 172.21.15.22:0/2958392893 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5583f73b0740 0x5583f73cf6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:08.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.594+0000 7f2d8cf69000 1 -- 172.21.15.22:0/2958392893 >> 172.21.15.22:0/2958392893 conn(0x5583f728fef0 msgr2=0x5583f73aba40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:08.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.594+0000 7f2d8cf69000 1 -- 172.21.15.22:0/2958392893 shutdown_connections 2024-05-21T13:36:08.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.594+0000 7f2d8cf69000 1 -- 172.21.15.22:0/2958392893 wait complete. 2024-05-21T13:36:08.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.598+0000 7f2d8cf69000 1 -- start start 2024-05-21T13:36:08.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.598+0000 7f2d8cf69000 1 Processor -- start 2024-05-21T13:36:08.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.598+0000 7f2d8cf69000 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5583f73b0740 0x5583f7404620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:08.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.598+0000 7f2d8cf69000 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5583f73cfef0 0x5583f745fa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:08.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.598+0000 7f2d8cf69000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5583f73e74a0 0x5583f745ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:08.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.598+0000 7f2d8cf69000 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5583f7178b10 con 0x5583f73b0740 2024-05-21T13:36:08.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.598+0000 7f2d8cf69000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5583f71fc8e0 con 0x5583f73e74a0 2024-05-21T13:36:08.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.598+0000 7f2d8cf69000 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x5583f7198c40 con 0x5583f73cfef0 2024-05-21T13:36:08.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.598+0000 7f2d8cf69000 10 client.0 _ll_register_callbacks cb 0x7f2d6c0099c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-21T13:36:08.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.598+0000 7f2d837fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5583f73b0740 0x5583f7404620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:08.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.598+0000 7f2d837fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5583f73b0740 0x5583f7404620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50696/0 (socket says 172.21.15.22:50696) 2024-05-21T13:36:08.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.598+0000 7f2d837fe640 1 -- 172.21.15.22:0/107199992 learned_addr learned my addr 172.21.15.22:0/107199992 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:08.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.598+0000 7f2d7affd640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5583f73cfef0 0x5583f745fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:08.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.598+0000 7f2d83fff640 1 --2- 172.21.15.22:0/107199992 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5583f73e74a0 0x5583f745ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:08.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.598+0000 7f2d837fe640 1 -- 172.21.15.22:0/107199992 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5583f73cfef0 msgr2=0x5583f745fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:08.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.598+0000 7f2d837fe640 1 --2- 172.21.15.22:0/107199992 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5583f73cfef0 0x5583f745fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:08.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.598+0000 7f2d837fe640 1 -- 172.21.15.22:0/107199992 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5583f73e74a0 msgr2=0x5583f745ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:08.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.598+0000 7f2d837fe640 1 --2- 172.21.15.22:0/107199992 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5583f73e74a0 0x5583f745ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:08.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.598+0000 7f2d837fe640 1 -- 172.21.15.22:0/107199992 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583f71abe80 con 0x5583f73b0740 2024-05-21T13:36:08.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.598+0000 7f2d83fff640 1 --2- 172.21.15.22:0/107199992 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5583f73e74a0 0x5583f745ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T13:36:08.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.598+0000 7f2d837fe640 1 --2- 172.21.15.22:0/107199992 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5583f73b0740 0x5583f7404620 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2d74000c10 tx=0x7f2d74019850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bc3f7c8ee722b4b server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:08.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.598+0000 7f2d627fc640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-05-21T13:36:08.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.598+0000 7f2d627fc640 1 -- 172.21.15.22:0/107199992 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d740b2040 con 0x5583f73b0740 2024-05-21T13:36:08.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.598+0000 7f2d627fc640 1 -- 172.21.15.22:0/107199992 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f2d740a5a20 con 0x5583f73b0740 2024-05-21T13:36:08.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.598+0000 7f2d8cf69000 1 -- 172.21.15.22:0/107199992 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2d6c000e50 con 0x5583f73b0740 2024-05-21T13:36:08.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.598+0000 7f2d627fc640 1 -- 172.21.15.22:0/107199992 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7f2d740a5c20 con 0x5583f73b0740 2024-05-21T13:36:08.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.598+0000 7f2d8cf69000 10 client.4371 fetch_fsmap learned FSMap version 6 2024-05-21T13:36:08.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.598+0000 7f2d8cf69000 1 -- 172.21.15.22:0/107199992 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x5583f7278a00 con 0x5583f73b0740 2024-05-21T13:36:08.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.602+0000 7f2d627fc640 1 -- 172.21.15.22:0/107199992 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d6c000e50 con 0x5583f73b0740 2024-05-21T13:36:08.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.602+0000 7f2d627fc640 1 -- 172.21.15.22:0/107199992 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 6) ==== 4712+0+0 (secure 0 0 0) 0x7f2d740d1700 con 0x5583f73b0740 2024-05-21T13:36:08.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.602+0000 7f2d8cf69000 10 client.4371 fetch_fsmap finished waiting for FSMap version 6 2024-05-21T13:36:08.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.602+0000 7f2d8cf69000 10 client.4371 resolve_mds: resolved name 'f' to daemon mds.f 2024-05-21T13:36:08.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.602+0000 7f2d8cf69000 20 client.4371 populate_metadata read hostname 'smithi022' 2024-05-21T13:36:08.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.602+0000 7f2d8cf69000 1 --2- 172.21.15.22:0/107199992 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x5583f745e610 0x5583f745e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:08.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.602+0000 7f2d8cf69000 4 client.4371 mds_command: new command op to 4300 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-21T13:36:08.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.602+0000 7f2d8cf69000 1 -- 172.21.15.22:0/107199992 --> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] -- command(tid 0: {"prefix": "status"}) -- 0x5583f7193dc0 con 0x5583f745e610 2024-05-21T13:36:08.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.602+0000 7f2d7affd640 1 --2- 172.21.15.22:0/107199992 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x5583f745e610 0x5583f745e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:08.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.602+0000 7f2d627fc640 10 client.4371 ms_handle_connect on v2:172.21.15.115:6838/1525097577 2024-05-21T13:36:08.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.602+0000 7f2d7affd640 1 --2- 172.21.15.22:0/107199992 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x5583f745e610 0x5583f745e9f0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=327bda757897fd8c server_cookie=13f67b38e64e1f9b in_seq=0 out_seq=0 2024-05-21T13:36:08.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.602+0000 7f2d7affd640 1 -- 172.21.15.22:0/107199992 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x5583f745e610 msgr2=0x5583f745e9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 19 2024-05-21T13:36:08.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.602+0000 7f2d7affd640 1 -- 172.21.15.22:0/107199992 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x5583f745e610 msgr2=0x5583f745e9f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-05-21T13:36:08.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.602+0000 7f2d7affd640 1 --2- 172.21.15.22:0/107199992 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x5583f745e610 0x5583f745e9f0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-21T13:36:08.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.602+0000 7f2d7affd640 1 --2- 172.21.15.22:0/107199992 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x5583f745e610 0x5583f745e9f0 unknown :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault initiating reconnect 2024-05-21T13:36:08.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.602+0000 7f2d7affd640 1 --2- 172.21.15.22:0/107199992 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x5583f745e610 0x5583f745e9f0 unknown :-1 s=BANNER_CONNECTING pgs=14 cs=1 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:08.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.602+0000 7f2d7affd640 1 --2- 172.21.15.22:0/107199992 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x5583f745e610 0x5583f745e9f0 crc :-1 s=READY pgs=14 cs=1 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=327bda757897fd8c server_cookie=13f67b38e64e1f9b in_seq=0 out_seq=1 2024-05-21T13:36:08.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.602+0000 7f2d627fc640 10 client.4371 ms_handle_connect on v2:172.21.15.115:6838/1525097577 2024-05-21T13:36:08.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.602+0000 7f2d627fc640 1 -- 172.21.15.22:0/107199992 <== mds.0 v2:172.21.15.115:6838/1525097577 1 ==== command_reply(tid 0: 0 ) ==== 8+0+330 (crc 0 0 0) 0x5583f7193dc0 con 0x5583f745e610 2024-05-21T13:36:08.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.602+0000 7f2d627fc640 10 client.4371 handle_command_reply: tid=0 2024-05-21T13:36:08.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.602+0000 7f2d8cf69000 1 client.4371 shutdown 2024-05-21T13:36:08.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.602+0000 7f2d8cf69000 1 -- 172.21.15.22:0/107199992 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5583f73b0740 msgr2=0x5583f7404620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:08.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.602+0000 7f2d8cf69000 1 --2- 172.21.15.22:0/107199992 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5583f73b0740 0x5583f7404620 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2d74000c10 tx=0x7f2d74019850 comp rx=0 tx=0).stop 2024-05-21T13:36:08.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.602+0000 7f2d8cf69000 1 -- 172.21.15.22:0/107199992 shutdown_connections 2024-05-21T13:36:08.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.602+0000 7f2d8cf69000 1 --2- 172.21.15.22:0/107199992 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x5583f745e610 0x5583f745e9f0 crc :-1 s=READY pgs=14 cs=1 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:08.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.602+0000 7f2d8cf69000 1 --2- 172.21.15.22:0/107199992 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x5583f73e74a0 0x5583f745ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:08.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.602+0000 7f2d8cf69000 1 --2- 172.21.15.22:0/107199992 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x5583f73cfef0 0x5583f745fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:08.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.602+0000 7f2d8cf69000 1 --2- 172.21.15.22:0/107199992 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x5583f73b0740 0x5583f7404620 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:08.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.602+0000 7f2d627fc640 0 client.4371 ms_handle_reset on v2:172.21.15.115:6838/1525097577 2024-05-21T13:36:08.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.602+0000 7f2d8cf69000 1 -- 172.21.15.22:0/107199992 >> 172.21.15.22:0/107199992 conn(0x5583f728fef0 msgr2=0x5583f73ce6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:08.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.602+0000 7f2d8cf69000 1 -- 172.21.15.22:0/107199992 shutdown_connections 2024-05-21T13:36:08.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.602+0000 7f2d8cf69000 1 -- 172.21.15.22:0/107199992 wait complete. 2024-05-21T13:36:08.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.602+0000 7f2d8cf69000 20 client.4371 trim_cache size 0 max 16384 2024-05-21T13:36:08.584 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-05-21T13:36:08.584 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_fsid": "f2c96204-e240-4e7f-8a76-927b4f80f534", 2024-05-21T13:36:08.584 INFO:teuthology.orchestra.run.smithi022.stdout: "whoami": 0, 2024-05-21T13:36:08.584 INFO:teuthology.orchestra.run.smithi022.stdout: "id": 4300, 2024-05-21T13:36:08.584 INFO:teuthology.orchestra.run.smithi022.stdout: "want_state": "up:active", 2024-05-21T13:36:08.584 INFO:teuthology.orchestra.run.smithi022.stdout: "state": "up:active", 2024-05-21T13:36:08.585 INFO:teuthology.orchestra.run.smithi022.stdout: "fs_name": "cephfs", 2024-05-21T13:36:08.585 INFO:teuthology.orchestra.run.smithi022.stdout: "rank_uptime": 10.827716669000001, 2024-05-21T13:36:08.585 INFO:teuthology.orchestra.run.smithi022.stdout: "mdsmap_epoch": 6, 2024-05-21T13:36:08.585 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch": 25, 2024-05-21T13:36:08.585 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch_barrier": 25, 2024-05-21T13:36:08.585 INFO:teuthology.orchestra.run.smithi022.stdout: "uptime": 16.896023209999999 2024-05-21T13:36:08.585 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-05-21T13:36:08.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.606+0000 7f2d89dde640 1 -- 172.21.15.22:0/1488894256 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f2d6406f400 msgr2=0x7f2d640718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:08.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.606+0000 7f2d89dde640 1 --2- 172.21.15.22:0/1488894256 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f2d6406f400 0x7f2d640718c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f2d740af000 tx=0x7f2d740046d0 comp rx=0 tx=0).stop 2024-05-21T13:36:08.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.606+0000 7f2d89dde640 1 -- 172.21.15.22:0/1488894256 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2d84155940 msgr2=0x7f2d841569b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:08.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.606+0000 7f2d89dde640 1 --2- 172.21.15.22:0/1488894256 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2d84155940 0x7f2d841569b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2d8406da80 tx=0x7f2d7c011890 comp rx=0 tx=0).stop 2024-05-21T13:36:08.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.606+0000 7f2d89dde640 1 -- 172.21.15.22:0/1488894256 shutdown_connections 2024-05-21T13:36:08.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.606+0000 7f2d89dde640 1 --2- 172.21.15.22:0/1488894256 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f2d6406f400 0x7f2d640718c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:08.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.606+0000 7f2d89dde640 1 --2- 172.21.15.22:0/1488894256 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2d84155940 0x7f2d841569b0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:08.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.606+0000 7f2d89dde640 1 --2- 172.21.15.22:0/1488894256 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2d84155e90 0x7f2d84156470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:08.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.606+0000 7f2d89dde640 1 --2- 172.21.15.22:0/1488894256 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2d70003a60 0x7f2d84154fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:08.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.606+0000 7f2d89dde640 1 -- 172.21.15.22:0/1488894256 >> 172.21.15.22:0/1488894256 conn(0x7f2d8406ce70 msgr2=0x7f2d84145e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:08.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.606+0000 7f2d89dde640 1 -- 172.21.15.22:0/1488894256 shutdown_connections 2024-05-21T13:36:08.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.606+0000 7f2d89dde640 1 -- 172.21.15.22:0/1488894256 wait complete. 2024-05-21T13:36:08.603 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-21T13:36:08.603 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-05-21T13:36:08.604 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-21T13:36:08.685 INFO:tasks.ceph.mds.f.smithi115.stderr:2024-05-21T13:36:08.711+0000 7f8149317640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-05-21T13:36:08.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.750+0000 7f8b20d68640 1 Processor -- start 2024-05-21T13:36:08.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.750+0000 7f8b20d68640 1 -- start start 2024-05-21T13:36:08.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.750+0000 7f8b20d68640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8b1c0c7de0 0x7f8b1c073ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:08.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.750+0000 7f8b20d68640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8b1c0c81c0 0x7f8b1c15a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:08.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.750+0000 7f8b20d68640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b1c153790 0x7f8b1c153c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:08.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.750+0000 7f8b20d68640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f8b1c0c9a60 con 0x7f8b1c0c81c0 2024-05-21T13:36:08.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.750+0000 7f8b20d68640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f8b1c159d00 con 0x7f8b1c0c7de0 2024-05-21T13:36:08.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.750+0000 7f8b20d68640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f8b1c0c91e0 con 0x7f8b1c153790 2024-05-21T13:36:08.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.750+0000 7f8b13fff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8b1c0c81c0 0x7f8b1c15a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:08.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.750+0000 7f8b13fff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8b1c0c81c0 0x7f8b1c15a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50712/0 (socket says 172.21.15.22:50712) 2024-05-21T13:36:08.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.750+0000 7f8b13fff640 1 -- 172.21.15.22:0/4177665258 learned_addr learned my addr 172.21.15.22:0/4177665258 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:08.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.750+0000 7f8b1a59c640 1 --2- 172.21.15.22:0/4177665258 >> v2:172.21.15.115:3300/0 conn(0x7f8b1c0c7de0 0x7f8b1c073ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:08.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.750+0000 7f8b1ad9d640 1 --2- 172.21.15.22:0/4177665258 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b1c153790 0x7f8b1c153c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:08.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.750+0000 7f8b13fff640 1 -- 172.21.15.22:0/4177665258 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b1c153790 msgr2=0x7f8b1c153c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:08.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.750+0000 7f8b13fff640 1 --2- 172.21.15.22:0/4177665258 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b1c153790 0x7f8b1c153c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:08.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.750+0000 7f8b13fff640 1 -- 172.21.15.22:0/4177665258 >> v2:172.21.15.115:3300/0 conn(0x7f8b1c0c7de0 msgr2=0x7f8b1c073ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:08.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.750+0000 7f8b13fff640 1 --2- 172.21.15.22:0/4177665258 >> v2:172.21.15.115:3300/0 conn(0x7f8b1c0c7de0 0x7f8b1c073ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:08.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.750+0000 7f8b13fff640 1 -- 172.21.15.22:0/4177665258 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b1c0c94a0 con 0x7f8b1c0c81c0 2024-05-21T13:36:08.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.754+0000 7f8b13fff640 1 --2- 172.21.15.22:0/4177665258 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b1c0c81c0 0x7f8b1c15a4c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8b04009870 tx=0x7f8b0401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a606a9f166e62a27 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:08.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.754+0000 7f8b19d9b640 1 -- 172.21.15.22:0/4177665258 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b040b1070 con 0x7f8b1c0c81c0 2024-05-21T13:36:08.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.754+0000 7f8b19d9b640 1 -- 172.21.15.22:0/4177665258 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b040ac410 con 0x7f8b1c0c81c0 2024-05-21T13:36:08.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.754+0000 7f8b19d9b640 1 -- 172.21.15.22:0/4177665258 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b040ac7e0 con 0x7f8b1c0c81c0 2024-05-21T13:36:08.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.754+0000 7f8b20d68640 1 -- 172.21.15.22:0/4177665258 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b1c0c81c0 msgr2=0x7f8b1c15a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:08.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.754+0000 7f8b20d68640 1 --2- 172.21.15.22:0/4177665258 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b1c0c81c0 0x7f8b1c15a4c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8b04009870 tx=0x7f8b0401c520 comp rx=0 tx=0).stop 2024-05-21T13:36:08.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.754+0000 7f8b20d68640 1 -- 172.21.15.22:0/4177665258 shutdown_connections 2024-05-21T13:36:08.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.754+0000 7f8b20d68640 1 --2- 172.21.15.22:0/4177665258 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b1c153790 0x7f8b1c153c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:08.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.754+0000 7f8b20d68640 1 --2- 172.21.15.22:0/4177665258 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b1c0c81c0 0x7f8b1c15a4c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:08.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.754+0000 7f8b20d68640 1 --2- 172.21.15.22:0/4177665258 >> v2:172.21.15.115:3300/0 conn(0x7f8b1c0c7de0 0x7f8b1c073ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:08.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.754+0000 7f8b20d68640 1 -- 172.21.15.22:0/4177665258 >> 172.21.15.22:0/4177665258 conn(0x7f8b1c06fc40 msgr2=0x7f8b1c0710d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:08.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.754+0000 7f8b20d68640 1 -- 172.21.15.22:0/4177665258 shutdown_connections 2024-05-21T13:36:08.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.754+0000 7f8b20d68640 1 -- 172.21.15.22:0/4177665258 wait complete. 2024-05-21T13:36:08.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.754+0000 7f8b20d68640 1 Processor -- start 2024-05-21T13:36:08.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.754+0000 7f8b20d68640 1 -- start start 2024-05-21T13:36:08.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.754+0000 7f8b20d68640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b1c0c7de0 0x7f8b1c0cec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:08.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.754+0000 7f8b20d68640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b1c0c81c0 0x7f8b1c1f7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:08.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.754+0000 7f8b20d68640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b1c153790 0x7f8b1c0cdf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:08.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.758+0000 7f8b20d68640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8b1c0c8e70 con 0x7f8b1c153790 2024-05-21T13:36:08.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.758+0000 7f8b20d68640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f8b1c15aa00 con 0x7f8b1c0c7de0 2024-05-21T13:36:08.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.758+0000 7f8b20d68640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f8b1c0744f0 con 0x7f8b1c0c81c0 2024-05-21T13:36:08.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.758+0000 7f8b1ad9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b1c153790 0x7f8b1c0cdf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:08.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.758+0000 7f8b1ad9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b1c153790 0x7f8b1c0cdf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50726/0 (socket says 172.21.15.22:50726) 2024-05-21T13:36:08.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.758+0000 7f8b1ad9d640 1 -- 172.21.15.22:0/2730880492 learned_addr learned my addr 172.21.15.22:0/2730880492 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:08.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.758+0000 7f8b1a59c640 1 --2- 172.21.15.22:0/2730880492 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b1c0c7de0 0x7f8b1c0cec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:08.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.758+0000 7f8b13fff640 1 --2- 172.21.15.22:0/2730880492 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b1c0c81c0 0x7f8b1c1f7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:08.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.758+0000 7f8b1ad9d640 1 -- 172.21.15.22:0/2730880492 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b1c0c81c0 msgr2=0x7f8b1c1f7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:08.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.758+0000 7f8b1ad9d640 1 --2- 172.21.15.22:0/2730880492 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b1c0c81c0 0x7f8b1c1f7e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:08.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.758+0000 7f8b1ad9d640 1 -- 172.21.15.22:0/2730880492 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b1c0c7de0 msgr2=0x7f8b1c0cec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:08.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.758+0000 7f8b1ad9d640 1 --2- 172.21.15.22:0/2730880492 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b1c0c7de0 0x7f8b1c0cec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:08.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.758+0000 7f8b1ad9d640 1 -- 172.21.15.22:0/2730880492 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b1c0cd360 con 0x7f8b1c153790 2024-05-21T13:36:08.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.758+0000 7f8b1ad9d640 1 --2- 172.21.15.22:0/2730880492 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b1c153790 0x7f8b1c0cdf60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8b14007e40 tx=0x7f8b1400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:08.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.758+0000 7f8b12ffd640 1 -- 172.21.15.22:0/2730880492 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b14014620 con 0x7f8b1c153790 2024-05-21T13:36:08.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.758+0000 7f8b12ffd640 1 -- 172.21.15.22:0/2730880492 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b14019070 con 0x7f8b1c153790 2024-05-21T13:36:08.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.758+0000 7f8b20d68640 1 -- 172.21.15.22:0/2730880492 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b1c0712c0 con 0x7f8b1c153790 2024-05-21T13:36:08.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.758+0000 7f8b12ffd640 1 -- 172.21.15.22:0/2730880492 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b14014a20 con 0x7f8b1c153790 2024-05-21T13:36:08.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.758+0000 7f8b20d68640 1 -- 172.21.15.22:0/2730880492 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b1c0cd600 con 0x7f8b1c153790 2024-05-21T13:36:08.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.758+0000 7f8b20d68640 1 -- 172.21.15.22:0/2730880492 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b1c077bb0 con 0x7f8b1c153790 2024-05-21T13:36:08.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.758+0000 7f8b12ffd640 1 -- 172.21.15.22:0/2730880492 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f8b14014bc0 con 0x7f8b1c153790 2024-05-21T13:36:08.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.758+0000 7f8b12ffd640 1 --2- 172.21.15.22:0/2730880492 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f8afc06f400 0x7f8afc0718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:08.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.758+0000 7f8b12ffd640 1 -- 172.21.15.22:0/2730880492 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f8b1408fdd0 con 0x7f8b1c153790 2024-05-21T13:36:08.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.758+0000 7f8b1a59c640 1 --2- 172.21.15.22:0/2730880492 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f8afc06f400 0x7f8afc0718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:08.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.762+0000 7f8b1a59c640 1 --2- 172.21.15.22:0/2730880492 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f8afc06f400 0x7f8afc0718c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c00b990 tx=0x7f8b0c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:08.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.762+0000 7f8b12ffd640 1 -- 172.21.15.22:0/2730880492 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f8b1405caa0 con 0x7f8b1c153790 2024-05-21T13:36:08.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.970+0000 7f8b20d68640 1 -- 172.21.15.22:0/2730880492 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f8b1c0c8780 con 0x7f8b1c153790 2024-05-21T13:36:08.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.970+0000 7f8b12ffd640 1 -- 172.21.15.22:0/2730880492 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+88 (secure 0 0 0) 0x7f8b14091070 con 0x7f8b1c153790 2024-05-21T13:36:08.948 INFO:teuthology.orchestra.run.smithi022.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-05-21T13:36:08.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.970+0000 7f8b20d68640 1 -- 172.21.15.22:0/2730880492 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f8afc06f400 msgr2=0x7f8afc0718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:08.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.970+0000 7f8b20d68640 1 --2- 172.21.15.22:0/2730880492 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f8afc06f400 0x7f8afc0718c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8b0c00b990 tx=0x7f8b0c008040 comp rx=0 tx=0).stop 2024-05-21T13:36:08.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.970+0000 7f8b20d68640 1 -- 172.21.15.22:0/2730880492 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b1c153790 msgr2=0x7f8b1c0cdf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:08.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.970+0000 7f8b20d68640 1 --2- 172.21.15.22:0/2730880492 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b1c153790 0x7f8b1c0cdf60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f8b14007e40 tx=0x7f8b1400e4b0 comp rx=0 tx=0).stop 2024-05-21T13:36:08.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.970+0000 7f8b20d68640 1 -- 172.21.15.22:0/2730880492 shutdown_connections 2024-05-21T13:36:08.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.970+0000 7f8b20d68640 1 --2- 172.21.15.22:0/2730880492 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f8afc06f400 0x7f8afc0718c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:08.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.970+0000 7f8b20d68640 1 --2- 172.21.15.22:0/2730880492 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8b1c153790 0x7f8b1c0cdf60 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:08.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.970+0000 7f8b20d68640 1 --2- 172.21.15.22:0/2730880492 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8b1c0c81c0 0x7f8b1c1f7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:08.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.970+0000 7f8b20d68640 1 --2- 172.21.15.22:0/2730880492 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8b1c0c7de0 0x7f8b1c0cec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:08.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.970+0000 7f8b20d68640 1 -- 172.21.15.22:0/2730880492 >> 172.21.15.22:0/2730880492 conn(0x7f8b1c06fc40 msgr2=0x7f8b1c1469f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:08.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.970+0000 7f8b20d68640 1 -- 172.21.15.22:0/2730880492 shutdown_connections 2024-05-21T13:36:08.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:08.970+0000 7f8b20d68640 1 -- 172.21.15.22:0/2730880492 wait complete. 2024-05-21T13:36:08.966 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-05-21T13:36:08.966 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-21T13:36:08.966 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi022.front.sepia.ceph.com 2024-05-21T13:36:08.966 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-05-21T13:36:08.966 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-05-21T13:36:08.966 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-05-21T13:36:08.966 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-21T13:36:08.966 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-21T13:36:08.966 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-05-21T13:36:08.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-21T13:36:08.967 DEBUG:teuthology.orchestra.run.smithi022:> ip addr 2024-05-21T13:36:08.972 INFO:teuthology.orchestra.run.smithi022.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-21T13:36:08.972 INFO:teuthology.orchestra.run.smithi022.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-21T13:36:08.972 INFO:teuthology.orchestra.run.smithi022.stdout: inet 127.0.0.1/8 scope host lo 2024-05-21T13:36:08.972 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2024-05-21T13:36:08.972 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 ::1/128 scope host 2024-05-21T13:36:08.972 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2024-05-21T13:36:08.972 INFO:teuthology.orchestra.run.smithi022.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-21T13:36:08.972 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:6b:fd:9a brd ff:ff:ff:ff:ff:ff 2024-05-21T13:36:08.973 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp7s0f0 2024-05-21T13:36:08.973 INFO:teuthology.orchestra.run.smithi022.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-21T13:36:08.973 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:6b:fd:9b brd ff:ff:ff:ff:ff:ff 2024-05-21T13:36:08.973 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp7s0f1 2024-05-21T13:36:08.973 INFO:teuthology.orchestra.run.smithi022.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-21T13:36:08.973 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:59:5d:e4 brd ff:ff:ff:ff:ff:ff 2024-05-21T13:36:08.973 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp1s0f0 2024-05-21T13:36:08.973 INFO:teuthology.orchestra.run.smithi022.stdout: inet 172.21.15.22/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-05-21T13:36:08.973 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft 42522sec preferred_lft 42522sec 2024-05-21T13:36:08.973 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::ec4:7aff:fe59:5de4/64 scope link 2024-05-21T13:36:08.973 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2024-05-21T13:36:08.973 INFO:teuthology.orchestra.run.smithi022.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-21T13:36:08.973 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:59:5d:e5 brd ff:ff:ff:ff:ff:ff 2024-05-21T13:36:08.974 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp1s0f1 2024-05-21T13:36:08.974 INFO:teuthology.orchestra.run.smithi022.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-05-21T13:36:08.974 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 02:42:c2:aa:29:b9 brd ff:ff:ff:ff:ff:ff 2024-05-21T13:36:08.974 INFO:teuthology.orchestra.run.smithi022.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-05-21T13:36:08.974 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2024-05-21T13:36:08.974 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-21T13:36:08.975 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-21T13:36:08.975 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2024-05-21T13:36:08.975 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link add name ceph-brx type bridge 2024-05-21T13:36:08.975 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip addr flush dev ceph-brx 2024-05-21T13:36:08.975 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link set ceph-brx up 2024-05-21T13:36:08.975 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-21T13:36:08.975 DEBUG:teuthology.orchestra.run.smithi022:> ') 2024-05-21T13:36:09.059 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-21T13:36:09.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-21T13:36:09.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-21T13:36:09.101 DEBUG:teuthology.orchestra.run.smithi022:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-21T13:36:09.110 INFO:teuthology.orchestra.run.smithi022.stdout:1 2024-05-21T13:36:09.112 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-21T13:36:09.112 DEBUG:teuthology.orchestra.run.smithi022:> route 2024-05-21T13:36:09.186 INFO:teuthology.orchestra.run.smithi022.stdout:Kernel IP routing table 2024-05-21T13:36:09.186 INFO:teuthology.orchestra.run.smithi022.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-21T13:36:09.187 INFO:teuthology.orchestra.run.smithi022.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-05-21T13:36:09.187 INFO:teuthology.orchestra.run.smithi022.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-05-21T13:36:09.187 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-05-21T13:36:09.187 INFO:teuthology.orchestra.run.smithi022.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-21T13:36:09.187 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-21T13:36:09.187 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2024-05-21T13:36:09.187 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-21T13:36:09.188 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-21T13:36:09.188 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-21T13:36:09.188 DEBUG:teuthology.orchestra.run.smithi022:> ') 2024-05-21T13:36:09.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-21T13:36:09.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-21T13:36:09.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-21T13:36:09.317 DEBUG:teuthology.orchestra.run.smithi022:> ip netns list 2024-05-21T13:36:09.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-21T13:36:09.323 DEBUG:teuthology.orchestra.run.smithi022:> ip netns list-id 2024-05-21T13:36:09.371 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-21T13:36:09.371 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2024-05-21T13:36:09.371 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-21T13:36:09.371 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-05-21T13:36:09.371 DEBUG:teuthology.orchestra.run.smithi022:> ') 2024-05-21T13:36:09.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-21T13:36:09.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-21T13:36:09.489 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-05-21T13:36:09.489 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-21T13:36:09.490 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2024-05-21T13:36:09.490 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-05-21T13:36:09.490 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-21T13:36:09.490 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-05-21T13:36:09.490 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-05-21T13:36:09.490 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-05-21T13:36:09.490 DEBUG:teuthology.orchestra.run.smithi022:> ') 2024-05-21T13:36:09.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-21T13:36:09.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-21T13:36:09.595 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-21T13:36:09.596 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2024-05-21T13:36:09.596 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link set brx.0 up 2024-05-21T13:36:09.596 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link set dev brx.0 master ceph-brx 2024-05-21T13:36:09.596 DEBUG:teuthology.orchestra.run.smithi022:> ') 2024-05-21T13:36:09.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-21T13:36:09.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-21T13:36:09.701 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-05-21T13:36:09.701 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-21T13:36:09.701 DEBUG:teuthology.orchestra.run.smithi022:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-05-21T13:36:09.746 INFO:teuthology.orchestra.run.smithi022.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-05-21T13:36:09.746 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-21T13:36:09.746 DEBUG:teuthology.orchestra.run.smithi022:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-05-21T13:36:09.797 DEBUG:teuthology.orchestra.run.smithi022:> sudo modprobe fuse 2024-05-21T13:36:09.856 DEBUG:teuthology.orchestra.run.smithi022:> cat /proc/self/mounts | awk '{print $2}' 2024-05-21T13:36:09.907 INFO:teuthology.orchestra.run.smithi022.stdout:/sys 2024-05-21T13:36:09.907 INFO:teuthology.orchestra.run.smithi022.stdout:/proc 2024-05-21T13:36:09.908 INFO:teuthology.orchestra.run.smithi022.stdout:/dev 2024-05-21T13:36:09.908 INFO:teuthology.orchestra.run.smithi022.stdout:/dev/pts 2024-05-21T13:36:09.908 INFO:teuthology.orchestra.run.smithi022.stdout:/run 2024-05-21T13:36:09.908 INFO:teuthology.orchestra.run.smithi022.stdout:/ 2024-05-21T13:36:09.908 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/kernel/security 2024-05-21T13:36:09.908 INFO:teuthology.orchestra.run.smithi022.stdout:/dev/shm 2024-05-21T13:36:09.908 INFO:teuthology.orchestra.run.smithi022.stdout:/run/lock 2024-05-21T13:36:09.908 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/fs/cgroup 2024-05-21T13:36:09.908 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/fs/pstore 2024-05-21T13:36:09.908 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/fs/bpf 2024-05-21T13:36:09.908 INFO:teuthology.orchestra.run.smithi022.stdout:/proc/sys/fs/binfmt_misc 2024-05-21T13:36:09.909 INFO:teuthology.orchestra.run.smithi022.stdout:/dev/hugepages 2024-05-21T13:36:09.909 INFO:teuthology.orchestra.run.smithi022.stdout:/dev/mqueue 2024-05-21T13:36:09.909 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/kernel/debug 2024-05-21T13:36:09.909 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/kernel/tracing 2024-05-21T13:36:09.909 INFO:teuthology.orchestra.run.smithi022.stdout:/proc/fs/nfsd 2024-05-21T13:36:09.909 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/fs/fuse/connections 2024-05-21T13:36:09.909 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/kernel/config 2024-05-21T13:36:09.909 INFO:teuthology.orchestra.run.smithi022.stdout:/run/credentials/systemd-sysusers.service 2024-05-21T13:36:09.909 INFO:teuthology.orchestra.run.smithi022.stdout:/run/rpc_pipefs 2024-05-21T13:36:09.909 INFO:teuthology.orchestra.run.smithi022.stdout:/run/user/1000 2024-05-21T13:36:09.909 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/ceph 2024-05-21T13:36:09.910 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/ceph/osd/ceph-0 2024-05-21T13:36:09.910 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/ceph/osd/ceph-1 2024-05-21T13:36:09.910 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/ceph/osd/ceph-2 2024-05-21T13:36:09.910 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/ceph/osd/ceph-3 2024-05-21T13:36:09.910 INFO:teuthology.orchestra.run.smithi022.stdout:/run/netns 2024-05-21T13:36:09.910 INFO:teuthology.orchestra.run.smithi022.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-21T13:36:09.910 INFO:teuthology.orchestra.run.smithi022.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-21T13:36:09.911 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-21T13:36:09.911 DEBUG:teuthology.orchestra.run.smithi022:> ls /sys/fs/fuse/connections 2024-05-21T13:36:09.958 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-21T13:36:09.959 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-05-21T13:36:10.003 DEBUG:teuthology.orchestra.run.smithi022:> sudo modprobe fuse 2024-05-21T13:36:10.017 DEBUG:teuthology.orchestra.run.smithi022:> cat /proc/self/mounts | awk '{print $2}' 2024-05-21T13:36:10.066 INFO:teuthology.orchestra.run.smithi022.stdout:/sys 2024-05-21T13:36:10.066 INFO:teuthology.orchestra.run.smithi022.stdout:/proc 2024-05-21T13:36:10.066 INFO:teuthology.orchestra.run.smithi022.stdout:/dev 2024-05-21T13:36:10.066 INFO:teuthology.orchestra.run.smithi022.stdout:/dev/pts 2024-05-21T13:36:10.066 INFO:teuthology.orchestra.run.smithi022.stdout:/run 2024-05-21T13:36:10.066 INFO:teuthology.orchestra.run.smithi022.stdout:/ 2024-05-21T13:36:10.066 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/kernel/security 2024-05-21T13:36:10.067 INFO:teuthology.orchestra.run.smithi022.stdout:/dev/shm 2024-05-21T13:36:10.067 INFO:teuthology.orchestra.run.smithi022.stdout:/run/lock 2024-05-21T13:36:10.067 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/fs/cgroup 2024-05-21T13:36:10.067 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/fs/pstore 2024-05-21T13:36:10.067 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/fs/bpf 2024-05-21T13:36:10.067 INFO:teuthology.orchestra.run.smithi022.stdout:/proc/sys/fs/binfmt_misc 2024-05-21T13:36:10.067 INFO:teuthology.orchestra.run.smithi022.stdout:/dev/hugepages 2024-05-21T13:36:10.067 INFO:teuthology.orchestra.run.smithi022.stdout:/dev/mqueue 2024-05-21T13:36:10.067 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/kernel/debug 2024-05-21T13:36:10.067 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/kernel/tracing 2024-05-21T13:36:10.067 INFO:teuthology.orchestra.run.smithi022.stdout:/proc/fs/nfsd 2024-05-21T13:36:10.067 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/fs/fuse/connections 2024-05-21T13:36:10.067 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/kernel/config 2024-05-21T13:36:10.067 INFO:teuthology.orchestra.run.smithi022.stdout:/run/credentials/systemd-sysusers.service 2024-05-21T13:36:10.068 INFO:teuthology.orchestra.run.smithi022.stdout:/run/rpc_pipefs 2024-05-21T13:36:10.068 INFO:teuthology.orchestra.run.smithi022.stdout:/run/user/1000 2024-05-21T13:36:10.068 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/ceph 2024-05-21T13:36:10.068 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/ceph/osd/ceph-0 2024-05-21T13:36:10.068 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/ceph/osd/ceph-1 2024-05-21T13:36:10.068 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/ceph/osd/ceph-2 2024-05-21T13:36:10.068 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/ceph/osd/ceph-3 2024-05-21T13:36:10.068 INFO:teuthology.orchestra.run.smithi022.stdout:/run/netns 2024-05-21T13:36:10.068 INFO:teuthology.orchestra.run.smithi022.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-21T13:36:10.068 INFO:teuthology.orchestra.run.smithi022.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-21T13:36:10.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-21T13:36:10.069 DEBUG:teuthology.orchestra.run.smithi022:> ls /sys/fs/fuse/connections 2024-05-21T13:36:10.085 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi022.stderr:2024-05-21T13:36:10.106+0000 7efcffc4d580 -1 init, newargv = 0x5651d320e0f0 newargc=15 2024-05-21T13:36:10.085 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi022.stderr:ceph-fuse[31857]: starting ceph client 2024-05-21T13:36:10.094 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi022.stderr:ceph-fuse[31857]: starting fuse 2024-05-21T13:36:11.191 DEBUG:teuthology.orchestra.run.smithi022:> sudo modprobe fuse 2024-05-21T13:36:11.208 DEBUG:teuthology.orchestra.run.smithi022:> cat /proc/self/mounts | awk '{print $2}' 2024-05-21T13:36:11.257 INFO:teuthology.orchestra.run.smithi022.stdout:/sys 2024-05-21T13:36:11.257 INFO:teuthology.orchestra.run.smithi022.stdout:/proc 2024-05-21T13:36:11.257 INFO:teuthology.orchestra.run.smithi022.stdout:/dev 2024-05-21T13:36:11.257 INFO:teuthology.orchestra.run.smithi022.stdout:/dev/pts 2024-05-21T13:36:11.257 INFO:teuthology.orchestra.run.smithi022.stdout:/run 2024-05-21T13:36:11.257 INFO:teuthology.orchestra.run.smithi022.stdout:/ 2024-05-21T13:36:11.257 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/kernel/security 2024-05-21T13:36:11.257 INFO:teuthology.orchestra.run.smithi022.stdout:/dev/shm 2024-05-21T13:36:11.257 INFO:teuthology.orchestra.run.smithi022.stdout:/run/lock 2024-05-21T13:36:11.258 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/fs/cgroup 2024-05-21T13:36:11.258 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/fs/pstore 2024-05-21T13:36:11.258 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/fs/bpf 2024-05-21T13:36:11.258 INFO:teuthology.orchestra.run.smithi022.stdout:/proc/sys/fs/binfmt_misc 2024-05-21T13:36:11.258 INFO:teuthology.orchestra.run.smithi022.stdout:/dev/hugepages 2024-05-21T13:36:11.258 INFO:teuthology.orchestra.run.smithi022.stdout:/dev/mqueue 2024-05-21T13:36:11.258 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/kernel/debug 2024-05-21T13:36:11.258 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/kernel/tracing 2024-05-21T13:36:11.258 INFO:teuthology.orchestra.run.smithi022.stdout:/proc/fs/nfsd 2024-05-21T13:36:11.259 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/fs/fuse/connections 2024-05-21T13:36:11.259 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/kernel/config 2024-05-21T13:36:11.259 INFO:teuthology.orchestra.run.smithi022.stdout:/run/credentials/systemd-sysusers.service 2024-05-21T13:36:11.259 INFO:teuthology.orchestra.run.smithi022.stdout:/run/rpc_pipefs 2024-05-21T13:36:11.259 INFO:teuthology.orchestra.run.smithi022.stdout:/run/user/1000 2024-05-21T13:36:11.259 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/ceph 2024-05-21T13:36:11.259 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/ceph/osd/ceph-0 2024-05-21T13:36:11.259 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/ceph/osd/ceph-1 2024-05-21T13:36:11.259 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/ceph/osd/ceph-2 2024-05-21T13:36:11.259 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/ceph/osd/ceph-3 2024-05-21T13:36:11.259 INFO:teuthology.orchestra.run.smithi022.stdout:/run/netns 2024-05-21T13:36:11.259 INFO:teuthology.orchestra.run.smithi022.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-21T13:36:11.259 INFO:teuthology.orchestra.run.smithi022.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-21T13:36:11.260 INFO:teuthology.orchestra.run.smithi022.stdout:/home/ubuntu/cephtest/mnt.admin 2024-05-21T13:36:11.260 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-21T13:36:11.260 DEBUG:teuthology.orchestra.run.smithi022:> ls /sys/fs/fuse/connections 2024-05-21T13:36:11.311 INFO:teuthology.orchestra.run.smithi022.stdout:45 2024-05-21T13:36:11.311 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-05-21T13:36:11.311 DEBUG:teuthology.orchestra.run.smithi022:> sudo stdin-killer -- python3 -c ' 2024-05-21T13:36:11.311 DEBUG:teuthology.orchestra.run.smithi022:> import glob 2024-05-21T13:36:11.311 DEBUG:teuthology.orchestra.run.smithi022:> import re 2024-05-21T13:36:11.311 DEBUG:teuthology.orchestra.run.smithi022:> import os 2024-05-21T13:36:11.311 DEBUG:teuthology.orchestra.run.smithi022:> import subprocess 2024-05-21T13:36:11.312 DEBUG:teuthology.orchestra.run.smithi022:> 2024-05-21T13:36:11.312 DEBUG:teuthology.orchestra.run.smithi022:> def _find_admin_socket(client_name): 2024-05-21T13:36:11.312 DEBUG:teuthology.orchestra.run.smithi022:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-05-21T13:36:11.312 DEBUG:teuthology.orchestra.run.smithi022:> files = glob.glob(asok_path) 2024-05-21T13:36:11.312 DEBUG:teuthology.orchestra.run.smithi022:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-05-21T13:36:11.312 DEBUG:teuthology.orchestra.run.smithi022:> 2024-05-21T13:36:11.312 DEBUG:teuthology.orchestra.run.smithi022:> # Given a non-glob path, it better be there 2024-05-21T13:36:11.312 DEBUG:teuthology.orchestra.run.smithi022:> if "*" not in asok_path: 2024-05-21T13:36:11.312 DEBUG:teuthology.orchestra.run.smithi022:> assert(len(files) == 1) 2024-05-21T13:36:11.312 DEBUG:teuthology.orchestra.run.smithi022:> return files[0] 2024-05-21T13:36:11.312 DEBUG:teuthology.orchestra.run.smithi022:> 2024-05-21T13:36:11.312 DEBUG:teuthology.orchestra.run.smithi022:> for f in files: 2024-05-21T13:36:11.312 DEBUG:teuthology.orchestra.run.smithi022:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-21T13:36:11.312 DEBUG:teuthology.orchestra.run.smithi022:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-21T13:36:11.312 DEBUG:teuthology.orchestra.run.smithi022:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-21T13:36:11.312 DEBUG:teuthology.orchestra.run.smithi022:> contents = proc_f.read() 2024-05-21T13:36:11.313 DEBUG:teuthology.orchestra.run.smithi022:> if mountpoint in contents: 2024-05-21T13:36:11.313 DEBUG:teuthology.orchestra.run.smithi022:> return f 2024-05-21T13:36:11.313 DEBUG:teuthology.orchestra.run.smithi022:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-21T13:36:11.313 DEBUG:teuthology.orchestra.run.smithi022:> 2024-05-21T13:36:11.313 DEBUG:teuthology.orchestra.run.smithi022:> print(_find_admin_socket("client.admin")) 2024-05-21T13:36:11.313 DEBUG:teuthology.orchestra.run.smithi022:> ' 2024-05-21T13:36:11.442 INFO:teuthology.orchestra.run.smithi022.stdout:/var/run/ceph/ceph-client.admin.31857.asok 2024-05-21T13:36:11.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-21T13:36:11.454 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.31857.asok 2024-05-21T13:36:11.454 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-21T13:36:11.454 DEBUG:teuthology.orchestra.run.smithi022:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.31857.asok status 2024-05-21T13:36:11.617 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-05-21T13:36:11.618 INFO:teuthology.orchestra.run.smithi022.stdout: "metadata": { 2024-05-21T13:36:11.618 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_sha1": "7956b5e965f6ee5669688b5643c11d881b72442c", 2024-05-21T13:36:11.618 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_version": "ceph version 19.0.0-3857-g7956b5e9 (7956b5e965f6ee5669688b5643c11d881b72442c) squid (dev)", 2024-05-21T13:36:11.618 INFO:teuthology.orchestra.run.smithi022.stdout: "entity_id": "admin", 2024-05-21T13:36:11.619 INFO:teuthology.orchestra.run.smithi022.stdout: "hostname": "smithi022", 2024-05-21T13:36:11.619 INFO:teuthology.orchestra.run.smithi022.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-05-21T13:36:11.619 INFO:teuthology.orchestra.run.smithi022.stdout: "pid": "31857", 2024-05-21T13:36:11.619 INFO:teuthology.orchestra.run.smithi022.stdout: "root": "/" 2024-05-21T13:36:11.619 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-05-21T13:36:11.619 INFO:teuthology.orchestra.run.smithi022.stdout: "dentry_count": 0, 2024-05-21T13:36:11.620 INFO:teuthology.orchestra.run.smithi022.stdout: "dentry_pinned_count": 0, 2024-05-21T13:36:11.620 INFO:teuthology.orchestra.run.smithi022.stdout: "id": 4386, 2024-05-21T13:36:11.620 INFO:teuthology.orchestra.run.smithi022.stdout: "inst": { 2024-05-21T13:36:11.620 INFO:teuthology.orchestra.run.smithi022.stdout: "name": { 2024-05-21T13:36:11.620 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "client", 2024-05-21T13:36:11.620 INFO:teuthology.orchestra.run.smithi022.stdout: "num": 4386 2024-05-21T13:36:11.621 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-05-21T13:36:11.621 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": { 2024-05-21T13:36:11.621 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-05-21T13:36:11.621 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "192.168.0.1:0", 2024-05-21T13:36:11.621 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 4112233535 2024-05-21T13:36:11.621 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-05-21T13:36:11.621 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-05-21T13:36:11.621 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": { 2024-05-21T13:36:11.622 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-05-21T13:36:11.622 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "192.168.0.1:0", 2024-05-21T13:36:11.622 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 4112233535 2024-05-21T13:36:11.622 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-05-21T13:36:11.622 INFO:teuthology.orchestra.run.smithi022.stdout: "inst_str": "client.4386 192.168.0.1:0/4112233535", 2024-05-21T13:36:11.622 INFO:teuthology.orchestra.run.smithi022.stdout: "addr_str": "192.168.0.1:0/4112233535", 2024-05-21T13:36:11.622 INFO:teuthology.orchestra.run.smithi022.stdout: "inode_count": 1, 2024-05-21T13:36:11.622 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_epoch": 6, 2024-05-21T13:36:11.622 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_epoch": 25, 2024-05-21T13:36:11.622 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_epoch_barrier": 0, 2024-05-21T13:36:11.622 INFO:teuthology.orchestra.run.smithi022.stdout: "blocklisted": false, 2024-05-21T13:36:11.622 INFO:teuthology.orchestra.run.smithi022.stdout: "fs_name": "cephfs" 2024-05-21T13:36:11.622 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-05-21T13:36:11.631 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-21T13:36:11.632 DEBUG:teuthology.orchestra.run.smithi022:> stat --file-system '--printf=%T 2024-05-21T13:36:11.632 DEBUG:teuthology.orchestra.run.smithi022:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-05-21T13:36:11.638 INFO:teuthology.orchestra.run.smithi022.stdout:fuseblk 2024-05-21T13:36:11.638 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-05-21T13:36:11.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-21T13:36:11.639 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-05-21T13:36:11.693 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-05-21T13:36:12.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-05-21T13:36:12.160 INFO:teuthology.orchestra.run.smithi022.stdout:# file: . 2024-05-21T13:36:12.161 INFO:teuthology.orchestra.run.smithi022.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-05-21T13:36:12.161 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-21T13:36:12.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-21T13:36:12.171 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-05-21T13:36:12.171 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-21T13:36:12.178 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-21T13:36:12.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.382+0000 7f5dd1c09640 1 Processor -- start 2024-05-21T13:36:12.358 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.382+0000 7f5dd1c09640 1 -- start start 2024-05-21T13:36:12.359 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.382+0000 7f5dd1c09640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5dcc0cbfd0 0x7f5dcc072090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:12.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.382+0000 7f5dd1c09640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5dcc0cc3f0 con 0x7f5dcc153ee0 2024-05-21T13:36:12.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.382+0000 7f5dd1c09640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5dcc0c6630 con 0x7f5dcc0725d0 2024-05-21T13:36:12.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.382+0000 7f5dd1c09640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f5dcc1542c0 con 0x7f5dcc0cbfd0 2024-05-21T13:36:12.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.382+0000 7f5dcb7fe640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f5dcc153ee0 0x7f5dcc0c4670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:50380/0 (socket says 172.21.15.22:50380) 2024-05-21T13:36:12.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.382+0000 7f5dcb7fe640 1 -- 172.21.15.22:0/4225177289 learned_addr learned my addr 172.21.15.22:0/4225177289 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-21T13:36:12.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.382+0000 7f5dca7fc640 1 -- 172.21.15.22:0/4225177289 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3067218054 0 0) 0x7f5dcc0cc3f0 con 0x7f5dcc153ee0 2024-05-21T13:36:12.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.382+0000 7f5dcaffd640 1 --2- 172.21.15.22:0/4225177289 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5dcc0cbfd0 0x7f5dcc072090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:12.360 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.382+0000 7f5dca7fc640 1 -- 172.21.15.22:0/4225177289 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5db4003530 con 0x7f5dcc153ee0 2024-05-21T13:36:12.361 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.382+0000 7f5dca7fc640 1 -- 172.21.15.22:0/4225177289 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1428405765 0 0) 0x7f5db4003530 con 0x7f5dcc153ee0 2024-05-21T13:36:12.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.382+0000 7f5dca7fc640 1 -- 172.21.15.22:0/4225177289 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5dcc0cbfd0 msgr2=0x7f5dcc072090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:12.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.382+0000 7f5dca7fc640 1 --2- 172.21.15.22:0/4225177289 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5dcc0cbfd0 0x7f5dcc072090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:12.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.382+0000 7f5dca7fc640 1 -- 172.21.15.22:0/4225177289 >> v1:172.21.15.115:6789/0 conn(0x7f5dcc0725d0 legacy=0x7f5dcc15d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:12.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.382+0000 7f5dca7fc640 1 -- 172.21.15.22:0/4225177289 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dcc0cb450 con 0x7f5dcc153ee0 2024-05-21T13:36:12.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.382+0000 7f5dca7fc640 1 -- 172.21.15.22:0/4225177289 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2684847062 0 0) 0x7f5dbc001700 con 0x7f5dcc153ee0 2024-05-21T13:36:12.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.382+0000 7f5dca7fc640 1 -- 172.21.15.22:0/4225177289 >> v1:172.21.15.22:6789/0 conn(0x7f5dcc153ee0 legacy=0x7f5dcc0c4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:12.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.382+0000 7f5dca7fc640 1 --2- 172.21.15.22:0/4225177289 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5db4003a40 0x7f5db4003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:12.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.382+0000 7f5dca7fc640 1 --2- 172.21.15.22:0/4225177289 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5db4004810 0x7f5db4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:12.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.382+0000 7f5dca7fc640 1 --2- 172.21.15.22:0/4225177289 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5dcc0cbfd0 0x7f5db4005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:12.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.382+0000 7f5dca7fc640 1 -- 172.21.15.22:0/4225177289 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5dcc1542c0 con 0x7f5db4004810 2024-05-21T13:36:12.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.382+0000 7f5dca7fc640 1 -- 172.21.15.22:0/4225177289 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f5db400bb90 con 0x7f5db4003a40 2024-05-21T13:36:12.362 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.382+0000 7f5dca7fc640 1 -- 172.21.15.22:0/4225177289 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f5db400bd90 con 0x7f5dcc0cbfd0 2024-05-21T13:36:12.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.382+0000 7f5dcaffd640 1 --2- 172.21.15.22:0/4225177289 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5db4004810 0x7f5db4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:12.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.382+0000 7f5dcb7fe640 1 --2- 172.21.15.22:0/4225177289 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5db4003a40 0x7f5db4003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:12.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.382+0000 7f5dcaffd640 1 -- 172.21.15.22:0/4225177289 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5dcc0cbfd0 msgr2=0x7f5db4005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:12.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.382+0000 7f5dcaffd640 1 --2- 172.21.15.22:0/4225177289 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5dcc0cbfd0 0x7f5db4005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:12.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.382+0000 7f5dcaffd640 1 -- 172.21.15.22:0/4225177289 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5db4003a40 msgr2=0x7f5db4003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:12.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.382+0000 7f5dcaffd640 1 --2- 172.21.15.22:0/4225177289 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5db4003a40 0x7f5db4003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:12.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.382+0000 7f5dcaffd640 1 -- 172.21.15.22:0/4225177289 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5db4003530 con 0x7f5db4004810 2024-05-21T13:36:12.363 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.382+0000 7f5dcb7fe640 1 --2- 172.21.15.22:0/4225177289 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5db4003a40 0x7f5db4003e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:36:12.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.386+0000 7f5dcaffd640 1 --2- 172.21.15.22:0/4225177289 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5db4004810 0x7f5db4004c90 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5dc0009ae0 tx=0x7f5dc001cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bb687560a04d0ff server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:12.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.386+0000 7f5dca7fc640 1 -- 172.21.15.22:0/4225177289 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc00b2070 con 0x7f5db4004810 2024-05-21T13:36:12.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.386+0000 7f5dca7fc640 1 -- 172.21.15.22:0/4225177289 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dc00a56a0 con 0x7f5db4004810 2024-05-21T13:36:12.364 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.386+0000 7f5dca7fc640 1 -- 172.21.15.22:0/4225177289 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc00096b0 con 0x7f5db4004810 2024-05-21T13:36:12.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.386+0000 7f5dd1c09640 1 -- 172.21.15.22:0/4225177289 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5db4004810 msgr2=0x7f5db4004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:12.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.386+0000 7f5dd1c09640 1 --2- 172.21.15.22:0/4225177289 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5db4004810 0x7f5db4004c90 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f5dc0009ae0 tx=0x7f5dc001cab0 comp rx=0 tx=0).stop 2024-05-21T13:36:12.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.386+0000 7f5dcbfff640 1 -- 172.21.15.22:0/4225177289 reap_dead start 2024-05-21T13:36:12.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.386+0000 7f5dd1c09640 1 -- 172.21.15.22:0/4225177289 shutdown_connections 2024-05-21T13:36:12.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.386+0000 7f5dd1c09640 1 -- 172.21.15.22:0/4225177289 >> 172.21.15.22:0/4225177289 conn(0x7f5dcc0706c0 msgr2=0x7f5dcc06f810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:12.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.386+0000 7f5dd1c09640 1 -- 172.21.15.22:0/4225177289 shutdown_connections 2024-05-21T13:36:12.365 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.386+0000 7f5dd1c09640 1 -- 172.21.15.22:0/4225177289 wait complete. 2024-05-21T13:36:12.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.386+0000 7f5dd1c09640 1 Processor -- start 2024-05-21T13:36:12.366 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.390+0000 7f5dd1c09640 1 -- start start 2024-05-21T13:36:12.367 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.390+0000 7f5dd1c09640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5db4004810 0x7f5dcc1e4630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:12.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.390+0000 7f5dd1c09640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5dcc1e39d0 0x7f5dcc14e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:12.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.390+0000 7f5dd1c09640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5dcc14ea90 0x7f5dcc140b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:12.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.390+0000 7f5dd1c09640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5dcc0cb6f0 con 0x7f5db4004810 2024-05-21T13:36:12.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.390+0000 7f5dd1c09640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f5dcc0cbd40 con 0x7f5dcc14ea90 2024-05-21T13:36:12.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.390+0000 7f5dd1c09640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f5dcc0cb9d0 con 0x7f5dcc1e39d0 2024-05-21T13:36:12.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.390+0000 7f5dcb7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5db4004810 0x7f5dcc1e4630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:12.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.390+0000 7f5dcb7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5db4004810 0x7f5dcc1e4630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50732/0 (socket says 172.21.15.22:50732) 2024-05-21T13:36:12.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.390+0000 7f5dcb7fe640 1 -- 172.21.15.22:0/1543435497 learned_addr learned my addr 172.21.15.22:0/1543435497 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:12.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.390+0000 7f5dcaffd640 1 --2- 172.21.15.22:0/1543435497 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5dcc1e39d0 0x7f5dcc14e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:12.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.390+0000 7f5dcbfff640 1 --2- 172.21.15.22:0/1543435497 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5dcc14ea90 0x7f5dcc140b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:12.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.390+0000 7f5dcb7fe640 1 -- 172.21.15.22:0/1543435497 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5dcc1e39d0 msgr2=0x7f5dcc14e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:12.368 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.390+0000 7f5dcb7fe640 1 --2- 172.21.15.22:0/1543435497 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5dcc1e39d0 0x7f5dcc14e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:12.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.390+0000 7f5dcb7fe640 1 -- 172.21.15.22:0/1543435497 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5dcc14ea90 msgr2=0x7f5dcc140b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:12.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.390+0000 7f5dcb7fe640 1 --2- 172.21.15.22:0/1543435497 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5dcc14ea90 0x7f5dcc140b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:12.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.390+0000 7f5dcb7fe640 1 -- 172.21.15.22:0/1543435497 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dcc152390 con 0x7f5db4004810 2024-05-21T13:36:12.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.390+0000 7f5dcbfff640 1 --2- 172.21.15.22:0/1543435497 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5dcc14ea90 0x7f5dcc140b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:36:12.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.390+0000 7f5dcb7fe640 1 --2- 172.21.15.22:0/1543435497 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5db4004810 0x7f5dcc1e4630 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc00d840 tx=0x7f5dbc00dd00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:12.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.390+0000 7f5db3fff640 1 -- 172.21.15.22:0/1543435497 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dbc0074e0 con 0x7f5db4004810 2024-05-21T13:36:12.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.390+0000 7f5db3fff640 1 -- 172.21.15.22:0/1543435497 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5dbc0047f0 con 0x7f5db4004810 2024-05-21T13:36:12.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.390+0000 7f5dd1c09640 1 -- 172.21.15.22:0/1543435497 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dcc152610 con 0x7f5db4004810 2024-05-21T13:36:12.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.390+0000 7f5db3fff640 1 -- 172.21.15.22:0/1543435497 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dbc007680 con 0x7f5db4004810 2024-05-21T13:36:12.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.390+0000 7f5dd1c09640 1 -- 172.21.15.22:0/1543435497 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dcc152b90 con 0x7f5db4004810 2024-05-21T13:36:12.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.390+0000 7f5dd1c09640 1 -- 172.21.15.22:0/1543435497 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5dcc0697d0 con 0x7f5db4004810 2024-05-21T13:36:12.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.390+0000 7f5db3fff640 1 -- 172.21.15.22:0/1543435497 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f5dbc01b020 con 0x7f5db4004810 2024-05-21T13:36:12.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.394+0000 7f5db3fff640 1 --2- 172.21.15.22:0/1543435497 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f5db806f430 0x7f5db80718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:12.370 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.394+0000 7f5db3fff640 1 -- 172.21.15.22:0/1543435497 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f5dbc08fc50 con 0x7f5db4004810 2024-05-21T13:36:12.371 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.394+0000 7f5dcaffd640 1 --2- 172.21.15.22:0/1543435497 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f5db806f430 0x7f5db80718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:12.371 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.394+0000 7f5dcaffd640 1 --2- 172.21.15.22:0/1543435497 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f5db806f430 0x7f5db80718f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5dc00af000 tx=0x7f5dc00046d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:12.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.394+0000 7f5db3fff640 1 -- 172.21.15.22:0/1543435497 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f5dbc022070 con 0x7f5db4004810 2024-05-21T13:36:12.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.570+0000 7f5dd1c09640 1 -- 172.21.15.22:0/1543435497 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f5dcc14ee70 con 0x7f5db4004810 2024-05-21T13:36:12.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.570+0000 7f5db3fff640 1 -- 172.21.15.22:0/1543435497 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7f5dcc152390 con 0x7f5db4004810 2024-05-21T13:36:12.548 INFO:teuthology.orchestra.run.smithi022.stderr:listed 0 entries 2024-05-21T13:36:12.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.574+0000 7f5dd1c09640 1 -- 172.21.15.22:0/1543435497 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f5db806f430 msgr2=0x7f5db80718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:12.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.574+0000 7f5dd1c09640 1 --2- 172.21.15.22:0/1543435497 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f5db806f430 0x7f5db80718f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5dc00af000 tx=0x7f5dc00046d0 comp rx=0 tx=0).stop 2024-05-21T13:36:12.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.574+0000 7f5dd1c09640 1 -- 172.21.15.22:0/1543435497 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5db4004810 msgr2=0x7f5dcc1e4630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:12.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.574+0000 7f5dd1c09640 1 --2- 172.21.15.22:0/1543435497 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5db4004810 0x7f5dcc1e4630 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc00d840 tx=0x7f5dbc00dd00 comp rx=0 tx=0).stop 2024-05-21T13:36:12.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.574+0000 7f5dd1c09640 1 -- 172.21.15.22:0/1543435497 shutdown_connections 2024-05-21T13:36:12.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.574+0000 7f5dd1c09640 1 --2- 172.21.15.22:0/1543435497 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f5db806f430 0x7f5db80718f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:12.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.574+0000 7f5dd1c09640 1 --2- 172.21.15.22:0/1543435497 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5dcc14ea90 0x7f5dcc140b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:12.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.574+0000 7f5dd1c09640 1 --2- 172.21.15.22:0/1543435497 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5dcc1e39d0 0x7f5dcc14e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:12.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.574+0000 7f5dd1c09640 1 --2- 172.21.15.22:0/1543435497 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5db4004810 0x7f5dcc1e4630 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:12.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.574+0000 7f5dd1c09640 1 -- 172.21.15.22:0/1543435497 >> 172.21.15.22:0/1543435497 conn(0x7f5dcc0706c0 msgr2=0x7f5dcc149d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:12.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.574+0000 7f5dd1c09640 1 -- 172.21.15.22:0/1543435497 shutdown_connections 2024-05-21T13:36:12.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.574+0000 7f5dd1c09640 1 -- 172.21.15.22:0/1543435497 wait complete. 2024-05-21T13:36:12.567 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-05-21T13:36:12.567 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-21T13:36:12.572 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-21T13:36:12.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.754+0000 7fa97ae35640 1 Processor -- start 2024-05-21T13:36:12.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.754+0000 7fa97ae35640 1 -- start start 2024-05-21T13:36:12.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.754+0000 7fa97ae35640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa974155d70 0x7fa9740cd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:12.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.754+0000 7fa97ae35640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa97415be90 0x7fa9740ce3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:12.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.754+0000 7fa97ae35640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa974156150 con 0x7fa97415ba70 2024-05-21T13:36:12.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.754+0000 7fa97ae35640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fa9740cdf20 con 0x7fa97415be90 2024-05-21T13:36:12.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.754+0000 7fa97ae35640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7fa97415c3e0 con 0x7fa974155d70 2024-05-21T13:36:12.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.754+0000 7fa9793d2640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa97415be90 0x7fa9740ce3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:12.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.754+0000 7fa9793d2640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa97415be90 0x7fa9740ce3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50734/0 (socket says 172.21.15.22:50734) 2024-05-21T13:36:12.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.754+0000 7fa9793d2640 1 -- 172.21.15.22:0/3516604633 learned_addr learned my addr 172.21.15.22:0/3516604633 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:12.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.754+0000 7fa973fff640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fa97415ba70 0x7fa9740cbff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:50386/0 (socket says 172.21.15.22:50386) 2024-05-21T13:36:12.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.758+0000 7fa978bd1640 1 --2- 172.21.15.22:0/3516604633 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa974155d70 0x7fa9740cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:12.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.758+0000 7fa9793d2640 1 -- 172.21.15.22:0/3516604633 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa974155d70 msgr2=0x7fa9740cd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:12.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.758+0000 7fa9793d2640 1 --2- 172.21.15.22:0/3516604633 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa974155d70 0x7fa9740cd010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:12.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.758+0000 7fa9793d2640 1 -- 172.21.15.22:0/3516604633 >> v1:172.21.15.22:6789/0 conn(0x7fa97415ba70 legacy=0x7fa9740cbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:12.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.758+0000 7fa9793d2640 1 -- 172.21.15.22:0/3516604633 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa97415c6c0 con 0x7fa97415be90 2024-05-21T13:36:12.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.758+0000 7fa978bd1640 1 --2- 172.21.15.22:0/3516604633 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa974155d70 0x7fa9740cd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:36:12.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.758+0000 7fa9793d2640 1 --2- 172.21.15.22:0/3516604633 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa97415be90 0x7fa9740ce3b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa96c009e50 tx=0x7fa96c01ca00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c2f5469dde10334 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:12.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.758+0000 7fa9737fe640 1 -- 172.21.15.22:0/3516604633 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa96c0a57e0 con 0x7fa97415be90 2024-05-21T13:36:12.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.758+0000 7fa9737fe640 1 -- 172.21.15.22:0/3516604633 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa96c0a5980 con 0x7fa97415be90 2024-05-21T13:36:12.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.758+0000 7fa9737fe640 1 -- 172.21.15.22:0/3516604633 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa96c0a5d50 con 0x7fa97415be90 2024-05-21T13:36:12.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.758+0000 7fa97ae35640 1 -- 172.21.15.22:0/3516604633 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa97415be90 msgr2=0x7fa9740ce3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:12.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.758+0000 7fa97ae35640 1 --2- 172.21.15.22:0/3516604633 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa97415be90 0x7fa9740ce3b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa96c009e50 tx=0x7fa96c01ca00 comp rx=0 tx=0).stop 2024-05-21T13:36:12.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.758+0000 7fa97ae35640 1 -- 172.21.15.22:0/3516604633 shutdown_connections 2024-05-21T13:36:12.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.758+0000 7fa97ae35640 1 --2- 172.21.15.22:0/3516604633 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa97415be90 0x7fa9740ce3b0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:12.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.758+0000 7fa97ae35640 1 --2- 172.21.15.22:0/3516604633 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa974155d70 0x7fa9740cd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:12.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.758+0000 7fa97ae35640 1 -- 172.21.15.22:0/3516604633 >> 172.21.15.22:0/3516604633 conn(0x7fa97406f3b0 msgr2=0x7fa97406d430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:12.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.758+0000 7fa97ae35640 1 -- 172.21.15.22:0/3516604633 shutdown_connections 2024-05-21T13:36:12.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.758+0000 7fa97ae35640 1 -- 172.21.15.22:0/3516604633 wait complete. 2024-05-21T13:36:12.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.762+0000 7fa97ae35640 1 Processor -- start 2024-05-21T13:36:12.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.762+0000 7fa97ae35640 1 -- start start 2024-05-21T13:36:12.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.762+0000 7fa97ae35640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa974155d70 0x7fa9740b6800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:12.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.762+0000 7fa97ae35640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa97415ba70 0x7fa97415cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:12.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.762+0000 7fa97ae35640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa97415be90 0x7fa97415d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:12.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.762+0000 7fa97ae35640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa9740cc700 con 0x7fa97415ba70 2024-05-21T13:36:12.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.762+0000 7fa97ae35640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fa9740cd550 con 0x7fa974155d70 2024-05-21T13:36:12.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.762+0000 7fa97ae35640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7fa9740cc880 con 0x7fa97415be90 2024-05-21T13:36:12.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.762+0000 7fa973fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa97415ba70 0x7fa97415cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:12.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.762+0000 7fa973fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa97415ba70 0x7fa97415cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50742/0 (socket says 172.21.15.22:50742) 2024-05-21T13:36:12.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.762+0000 7fa973fff640 1 -- 172.21.15.22:0/513894851 learned_addr learned my addr 172.21.15.22:0/513894851 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:12.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.762+0000 7fa978bd1640 1 --2- 172.21.15.22:0/513894851 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa974155d70 0x7fa9740b6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:12.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.762+0000 7fa9793d2640 1 --2- 172.21.15.22:0/513894851 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa97415be90 0x7fa97415d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:12.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.762+0000 7fa973fff640 1 -- 172.21.15.22:0/513894851 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa97415be90 msgr2=0x7fa97415d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:12.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.762+0000 7fa973fff640 1 --2- 172.21.15.22:0/513894851 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa97415be90 0x7fa97415d170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:12.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.762+0000 7fa973fff640 1 -- 172.21.15.22:0/513894851 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa974155d70 msgr2=0x7fa9740b6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:12.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.762+0000 7fa973fff640 1 --2- 172.21.15.22:0/513894851 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa974155d70 0x7fa9740b6800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:12.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.762+0000 7fa973fff640 1 -- 172.21.15.22:0/513894851 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa9741f9440 con 0x7fa97415ba70 2024-05-21T13:36:12.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.762+0000 7fa978bd1640 1 --2- 172.21.15.22:0/513894851 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa974155d70 0x7fa9740b6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:36:12.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.762+0000 7fa973fff640 1 --2- 172.21.15.22:0/513894851 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa97415ba70 0x7fa97415cc30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa96800c4b0 tx=0x7fa96800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:12.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.762+0000 7fa9717fa640 1 -- 172.21.15.22:0/513894851 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa968018070 con 0x7fa97415ba70 2024-05-21T13:36:12.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.762+0000 7fa9717fa640 1 -- 172.21.15.22:0/513894851 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa968007480 con 0x7fa97415ba70 2024-05-21T13:36:12.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.762+0000 7fa9717fa640 1 -- 172.21.15.22:0/513894851 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9680047f0 con 0x7fa97415ba70 2024-05-21T13:36:12.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.762+0000 7fa97ae35640 1 -- 172.21.15.22:0/513894851 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa9741f85e0 con 0x7fa97415ba70 2024-05-21T13:36:12.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.762+0000 7fa97ae35640 1 -- 172.21.15.22:0/513894851 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9741f8ba0 con 0x7fa97415ba70 2024-05-21T13:36:12.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.762+0000 7fa97ae35640 1 -- 172.21.15.22:0/513894851 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa974077bb0 con 0x7fa97415ba70 2024-05-21T13:36:12.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.766+0000 7fa9717fa640 1 -- 172.21.15.22:0/513894851 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fa968004990 con 0x7fa97415ba70 2024-05-21T13:36:12.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.766+0000 7fa9717fa640 1 --2- 172.21.15.22:0/513894851 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fa96006f400 0x7fa9600718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:12.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.766+0000 7fa9717fa640 1 -- 172.21.15.22:0/513894851 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fa96808e7f0 con 0x7fa97415ba70 2024-05-21T13:36:12.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.766+0000 7fa978bd1640 1 --2- 172.21.15.22:0/513894851 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fa96006f400 0x7fa9600718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:12.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.766+0000 7fa978bd1640 1 --2- 172.21.15.22:0/513894851 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fa96006f400 0x7fa9600718c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa964008930 tx=0x7fa964008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:12.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.770+0000 7fa9717fa640 1 -- 172.21.15.22:0/513894851 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fa96805b430 con 0x7fa97415ba70 2024-05-21T13:36:12.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.942+0000 7fa97ae35640 1 -- 172.21.15.22:0/513894851 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa9741ed9b0 con 0x7fa97415ba70 2024-05-21T13:36:12.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.942+0000 7fa9717fa640 1 -- 172.21.15.22:0/513894851 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) ==== 80+0+0 (secure 0 0 0) 0x7fa968063420 con 0x7fa97415ba70 2024-05-21T13:36:12.919 INFO:teuthology.orchestra.run.smithi022.stderr:listed 0 entries 2024-05-21T13:36:12.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.946+0000 7fa97ae35640 1 -- 172.21.15.22:0/513894851 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fa96006f400 msgr2=0x7fa9600718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:12.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.946+0000 7fa97ae35640 1 --2- 172.21.15.22:0/513894851 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fa96006f400 0x7fa9600718c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa964008930 tx=0x7fa964008040 comp rx=0 tx=0).stop 2024-05-21T13:36:12.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.946+0000 7fa97ae35640 1 -- 172.21.15.22:0/513894851 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa97415ba70 msgr2=0x7fa97415cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:12.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.946+0000 7fa97ae35640 1 --2- 172.21.15.22:0/513894851 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa97415ba70 0x7fa97415cc30 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fa96800c4b0 tx=0x7fa96800c970 comp rx=0 tx=0).stop 2024-05-21T13:36:12.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.946+0000 7fa97ae35640 1 -- 172.21.15.22:0/513894851 shutdown_connections 2024-05-21T13:36:12.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.946+0000 7fa97ae35640 1 --2- 172.21.15.22:0/513894851 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fa96006f400 0x7fa9600718c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:12.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.946+0000 7fa97ae35640 1 --2- 172.21.15.22:0/513894851 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa97415be90 0x7fa97415d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:12.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.946+0000 7fa97ae35640 1 --2- 172.21.15.22:0/513894851 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa97415ba70 0x7fa97415cc30 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:12.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.946+0000 7fa97ae35640 1 --2- 172.21.15.22:0/513894851 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa974155d70 0x7fa9740b6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:12.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.946+0000 7fa97ae35640 1 -- 172.21.15.22:0/513894851 >> 172.21.15.22:0/513894851 conn(0x7fa97406f3b0 msgr2=0x7fa9740d13b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:12.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.946+0000 7fa97ae35640 1 -- 172.21.15.22:0/513894851 shutdown_connections 2024-05-21T13:36:12.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:12.946+0000 7fa97ae35640 1 -- 172.21.15.22:0/513894851 wait complete. 2024-05-21T13:36:12.939 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi022.front.sepia.ceph.com... 2024-05-21T13:36:12.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-21T13:36:12.940 DEBUG:teuthology.orchestra.run.smithi022:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-05-21T13:36:12.960 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi022.stderr:ceph-fuse[31857]: fuse finished with error 0 and tester_r 0 2024-05-21T13:36:12.962 INFO:teuthology.orchestra.run:waiting for 300 2024-05-21T13:36:19.064 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi022.front.sepia.ceph.com 2024-05-21T13:36:19.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-21T13:36:19.064 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-05-21T13:36:19.082 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-21T13:36:19.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.286+0000 7f91577c7640 1 Processor -- start 2024-05-21T13:36:19.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.286+0000 7f91577c7640 1 -- start start 2024-05-21T13:36:19.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.290+0000 7f91577c7640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9150156250 0x7f91500cc1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:19.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.290+0000 7f91577c7640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f915015bd20 0x7f91500cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:19.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.290+0000 7f91577c7640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91500ca890 con 0x7f9150155e70 2024-05-21T13:36:19.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.290+0000 7f91577c7640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f915015f310 con 0x7f915015bd20 2024-05-21T13:36:19.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.290+0000 7f91577c7640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f915015c280 con 0x7f9150156250 2024-05-21T13:36:19.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.290+0000 7f9154d62640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9150156250 0x7f91500cc1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:19.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.290+0000 7f9155d64640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f915015bd20 0x7f91500cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:19.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.290+0000 7f9154d62640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9150156250 0x7f91500cc1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.22:46634/0 (socket says 172.21.15.22:46634) 2024-05-21T13:36:19.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.290+0000 7f9154d62640 1 -- 172.21.15.22:0/1111152347 learned_addr learned my addr 172.21.15.22:0/1111152347 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:19.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.290+0000 7f9154d62640 1 -- 172.21.15.22:0/1111152347 >> v2:172.21.15.115:3300/0 conn(0x7f915015bd20 msgr2=0x7f91500cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:19.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.290+0000 7f9154d62640 1 --2- 172.21.15.22:0/1111152347 >> v2:172.21.15.115:3300/0 conn(0x7f915015bd20 0x7f91500cc6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:19.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.290+0000 7f9154d62640 1 -- 172.21.15.22:0/1111152347 >> v1:172.21.15.115:6789/0 conn(0x7f9150155e70 legacy=0x7f915015fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:19.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.290+0000 7f9154d62640 1 -- 172.21.15.22:0/1111152347 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f915015c560 con 0x7f9150156250 2024-05-21T13:36:19.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.290+0000 7f9155d64640 1 --2- 172.21.15.22:0/1111152347 >> v2:172.21.15.115:3300/0 conn(0x7f915015bd20 0x7f91500cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-21T13:36:19.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.294+0000 7f9154d62640 1 --2- 172.21.15.22:0/1111152347 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9150156250 0x7f91500cc1b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9140009870 tx=0x7f914001c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7def24cac6f64d1a server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:19.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.294+0000 7f9147fff640 1 -- 172.21.15.22:0/1111152347 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91400b1070 con 0x7f9150156250 2024-05-21T13:36:19.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.294+0000 7f9147fff640 1 -- 172.21.15.22:0/1111152347 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91400ac620 con 0x7f9150156250 2024-05-21T13:36:19.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.294+0000 7f9147fff640 1 -- 172.21.15.22:0/1111152347 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91400ac9f0 con 0x7f9150156250 2024-05-21T13:36:19.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.294+0000 7f91577c7640 1 -- 172.21.15.22:0/1111152347 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9150156250 msgr2=0x7f91500cc1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:19.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.294+0000 7f91577c7640 1 --2- 172.21.15.22:0/1111152347 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9150156250 0x7f91500cc1b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f9140009870 tx=0x7f914001c4d0 comp rx=0 tx=0).stop 2024-05-21T13:36:19.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.294+0000 7f91577c7640 1 -- 172.21.15.22:0/1111152347 shutdown_connections 2024-05-21T13:36:19.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.294+0000 7f91577c7640 1 --2- 172.21.15.22:0/1111152347 >> v2:172.21.15.115:3300/0 conn(0x7f915015bd20 0x7f91500cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:19.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.294+0000 7f91577c7640 1 --2- 172.21.15.22:0/1111152347 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9150156250 0x7f91500cc1b0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:19.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.294+0000 7f91577c7640 1 -- 172.21.15.22:0/1111152347 >> 172.21.15.22:0/1111152347 conn(0x7f9150070750 msgr2=0x7f915006c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:19.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.294+0000 7f91577c7640 1 -- 172.21.15.22:0/1111152347 shutdown_connections 2024-05-21T13:36:19.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.294+0000 7f91577c7640 1 -- 172.21.15.22:0/1111152347 wait complete. 2024-05-21T13:36:19.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.294+0000 7f91577c7640 1 Processor -- start 2024-05-21T13:36:19.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.294+0000 7f91577c7640 1 -- start start 2024-05-21T13:36:19.274 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.294+0000 7f91577c7640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9150155e70 0x7f91500cf8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:19.274 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.294+0000 7f91577c7640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9150156250 0x7f915014a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:19.274 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.294+0000 7f91577c7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f915015bd20 0x7f91500c4d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:19.274 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.294+0000 7f91577c7640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9150168830 con 0x7f915015bd20 2024-05-21T13:36:19.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.294+0000 7f91577c7640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f91501686b0 con 0x7f9150155e70 2024-05-21T13:36:19.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.294+0000 7f91577c7640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f91501689b0 con 0x7f9150156250 2024-05-21T13:36:19.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.294+0000 7f9155d64640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f915015bd20 0x7f91500c4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:19.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.294+0000 7f9155d64640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f915015bd20 0x7f91500c4d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36558/0 (socket says 172.21.15.22:36558) 2024-05-21T13:36:19.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.294+0000 7f9155d64640 1 -- 172.21.15.22:0/1302769114 learned_addr learned my addr 172.21.15.22:0/1302769114 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:19.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.294+0000 7f9154d62640 1 --2- 172.21.15.22:0/1302769114 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9150156250 0x7f915014a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:19.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.294+0000 7f9155563640 1 --2- 172.21.15.22:0/1302769114 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9150155e70 0x7f91500cf8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:19.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.294+0000 7f9155d64640 1 -- 172.21.15.22:0/1302769114 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9150156250 msgr2=0x7f915014a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:19.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.294+0000 7f9155d64640 1 --2- 172.21.15.22:0/1302769114 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9150156250 0x7f915014a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:19.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.294+0000 7f9155d64640 1 -- 172.21.15.22:0/1302769114 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9150155e70 msgr2=0x7f91500cf8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:19.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.294+0000 7f9155d64640 1 --2- 172.21.15.22:0/1302769114 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9150155e70 0x7f91500cf8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:19.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.294+0000 7f9155d64640 1 -- 172.21.15.22:0/1302769114 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f915014b4c0 con 0x7f915015bd20 2024-05-21T13:36:19.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.294+0000 7f9155d64640 1 --2- 172.21.15.22:0/1302769114 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f915015bd20 0x7f91500c4d50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f914800efc0 tx=0x7f914800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:19.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.298+0000 7f9145ffb640 1 -- 172.21.15.22:0/1302769114 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9148018030 con 0x7f915015bd20 2024-05-21T13:36:19.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.298+0000 7f9145ffb640 1 -- 172.21.15.22:0/1302769114 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f914800cdf0 con 0x7f915015bd20 2024-05-21T13:36:19.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.298+0000 7f91577c7640 1 -- 172.21.15.22:0/1302769114 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91501f5b10 con 0x7f915015bd20 2024-05-21T13:36:19.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.298+0000 7f9145ffb640 1 -- 172.21.15.22:0/1302769114 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9148003bc0 con 0x7f915015bd20 2024-05-21T13:36:19.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.298+0000 7f91577c7640 1 -- 172.21.15.22:0/1302769114 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f915014b1e0 con 0x7f915015bd20 2024-05-21T13:36:19.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.298+0000 7f91577c7640 1 -- 172.21.15.22:0/1302769114 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91500697d0 con 0x7f915015bd20 2024-05-21T13:36:19.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.298+0000 7f9145ffb640 1 -- 172.21.15.22:0/1302769114 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f914801b070 con 0x7f915015bd20 2024-05-21T13:36:19.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.298+0000 7f9145ffb640 1 --2- 172.21.15.22:0/1302769114 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f913406f430 0x7f91340718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:19.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.298+0000 7f9145ffb640 1 -- 172.21.15.22:0/1302769114 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f91480903a0 con 0x7f915015bd20 2024-05-21T13:36:19.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.298+0000 7f9155563640 1 --2- 172.21.15.22:0/1302769114 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f913406f430 0x7f91340718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:19.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.298+0000 7f9155563640 1 --2- 172.21.15.22:0/1302769114 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f913406f430 0x7f91340718f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f914c007fd0 tx=0x7f914c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:19.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.302+0000 7f9145ffb640 1 -- 172.21.15.22:0/1302769114 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f9148010040 con 0x7f915015bd20 2024-05-21T13:36:19.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.466+0000 7f91577c7640 1 -- 172.21.15.22:0/1302769114 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f91500cccf0 con 0x7f915015bd20 2024-05-21T13:36:19.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.466+0000 7f9145ffb640 1 -- 172.21.15.22:0/1302769114 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18458 (secure 0 0 0) 0x7f9148065140 con 0x7f915015bd20 2024-05-21T13:36:19.445 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-21T13:36:19.446 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":25,"fsid":"f2c96204-e240-4e7f-8a76-927b4f80f534","created":"2024-05-21T13:35:33.827005+0000","modified":"2024-05-21T13:36:02.190808+0000","last_up_change":"2024-05-21T13:35:44.542324+0000","last_in_change":"2024-05-21T13:35:36.061492+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-21T13:35:44.536105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-21T13:35:54.972996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-21T13:35:56.065755+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-21T13:35:59.791448+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"09157d4a-9443-4e10-bbb3-cf8ed7c42cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":222752954},{"type":"v1","addr":"172.21.15.22:6801","nonce":222752954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":222752954},{"type":"v1","addr":"172.21.15.22:6803","nonce":222752954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":222752954},{"type":"v1","addr":"172.21.15.22:6807","nonce":222752954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":222752954},{"type":"v1","addr":"172.21.15.22:6805","nonce":222752954}]},"public_addr":"172.21.15.22:6801/222752954","cluster_addr":"172.21.15.22:6803/222752954","heartbeat_back_addr":"172.21.15.22:6807/222752954","heartbeat_front_addr":"172.21.15.22:6805/222752954","state":["exists","up"]},{"osd":1,"uuid":"2a6a87c0-01ad-4a98-a538-c0a8e865b05d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":685426272},{"type":"v1","addr":"172.21.15.22:6809","nonce":685426272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":685426272},{"type":"v1","addr":"172.21.15.22:6811","nonce":685426272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":685426272},{"type":"v1","addr":"172.21.15.22:6815","nonce":685426272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":685426272},{"type":"v1","addr":"172.21.15.22:6813","nonce":685426272}]},"public_addr":"172.21.15.22:6809/685426272","cluster_addr":"172.21.15.22:6811/685426272","heartbeat_back_addr":"172.21.15.22:6815/685426272","heartbeat_front_addr":"172.21.15.22:6813/685426272","state":["exists","up"]},{"osd":2,"uuid":"4c18f931-40a4-46ac-a752-0d1be35b01a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":2092224336},{"type":"v1","addr":"172.21.15.22:6817","nonce":2092224336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":2092224336},{"type":"v1","addr":"172.21.15.22:6819","nonce":2092224336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":2092224336},{"type":"v1","addr":"172.21.15.22:6823","nonce":2092224336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":2092224336},{"type":"v1","addr":"172.21.15.22:6821","nonce":2092224336}]},"public_addr":"172.21.15.22:6817/2092224336","cluster_addr":"172.21.15.22:6819/2092224336","heartbeat_back_addr":"172.21.15.22:6823/2092224336","heartbeat_front_addr":"172.21.15.22:6821/2092224336","state":["exists","up"]},{"osd":3,"uuid":"d57ee7fd-b73e-41ec-8e3b-e62fb8898128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":1232311110},{"type":"v1","addr":"172.21.15.22:6825","nonce":1232311110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":1232311110},{"type":"v1","addr":"172.21.15.22:6827","nonce":1232311110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":1232311110},{"type":"v1","addr":"172.21.15.22:6831","nonce":1232311110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":1232311110},{"type":"v1","addr":"172.21.15.22:6829","nonce":1232311110}]},"public_addr":"172.21.15.22:6825/1232311110","cluster_addr":"172.21.15.22:6827/1232311110","heartbeat_back_addr":"172.21.15.22:6831/1232311110","heartbeat_front_addr":"172.21.15.22:6829/1232311110","state":["exists","up"]},{"osd":4,"uuid":"43c6494f-352b-42a7-b6a9-fe7e3573fab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":832695158},{"type":"v1","addr":"172.21.15.115:6801","nonce":832695158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":832695158},{"type":"v1","addr":"172.21.15.115:6803","nonce":832695158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":832695158},{"type":"v1","addr":"172.21.15.115:6807","nonce":832695158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":832695158},{"type":"v1","addr":"172.21.15.115:6805","nonce":832695158}]},"public_addr":"172.21.15.115:6801/832695158","cluster_addr":"172.21.15.115:6803/832695158","heartbeat_back_addr":"172.21.15.115:6807/832695158","heartbeat_front_addr":"172.21.15.115:6805/832695158","state":["exists","up"]},{"osd":5,"uuid":"25fc861c-593d-4d49-942a-c75c19f25994","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":1504764223},{"type":"v1","addr":"172.21.15.115:6815","nonce":1504764223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":1504764223},{"type":"v1","addr":"172.21.15.115:6823","nonce":1504764223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":1504764223},{"type":"v1","addr":"172.21.15.115:6830","nonce":1504764223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6825","nonce":1504764223},{"type":"v1","addr":"172.21.15.115:6827","nonce":1504764223}]},"public_addr":"172.21.15.115:6815/1504764223","cluster_addr":"172.21.15.115:6823/1504764223","heartbeat_back_addr":"172.21.15.115:6830/1504764223","heartbeat_front_addr":"172.21.15.115:6827/1504764223","state":["exists","up"]},{"osd":6,"uuid":"2e7fb0b8-1162-497f-bffc-e2c02b9b9ef4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":959292720},{"type":"v1","addr":"172.21.15.115:6809","nonce":959292720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":959292720},{"type":"v1","addr":"172.21.15.115:6813","nonce":959292720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":959292720},{"type":"v1","addr":"172.21.15.115:6822","nonce":959292720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":959292720},{"type":"v1","addr":"172.21.15.115:6818","nonce":959292720}]},"public_addr":"172.21.15.115:6809/959292720","cluster_addr":"172.21.15.115:6813/959292720","heartbeat_back_addr":"172.21.15.115:6822/959292720","heartbeat_front_addr":"172.21.15.115:6818/959292720","state":["exists","up"]},{"osd":7,"uuid":"a97df0dc-e370-45ce-8742-25ae31e2212e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6811","nonce":20268513},{"type":"v1","addr":"172.21.15.115:6814","nonce":20268513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":20268513},{"type":"v1","addr":"172.21.15.115:6821","nonce":20268513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6829","nonce":20268513},{"type":"v1","addr":"172.21.15.115:6831","nonce":20268513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":20268513},{"type":"v1","addr":"172.21.15.115:6826","nonce":20268513}]},"public_addr":"172.21.15.115:6814/20268513","cluster_addr":"172.21.15.115:6821/20268513","heartbeat_back_addr":"172.21.15.115:6831/20268513","heartbeat_front_addr":"172.21.15.115:6826/20268513","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.692890+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.545577+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.712724+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.681944+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.492954+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.553222+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.597022+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.601698+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-21T13:36:19.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.470+0000 7f91577c7640 1 -- 172.21.15.22:0/1302769114 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f913406f430 msgr2=0x7f91340718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:19.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.470+0000 7f91577c7640 1 --2- 172.21.15.22:0/1302769114 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f913406f430 0x7f91340718f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f914c007fd0 tx=0x7f914c009040 comp rx=0 tx=0).stop 2024-05-21T13:36:19.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.470+0000 7f91577c7640 1 -- 172.21.15.22:0/1302769114 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f915015bd20 msgr2=0x7f91500c4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:19.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.470+0000 7f91577c7640 1 --2- 172.21.15.22:0/1302769114 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f915015bd20 0x7f91500c4d50 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f914800efc0 tx=0x7f914800c490 comp rx=0 tx=0).stop 2024-05-21T13:36:19.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.470+0000 7f91577c7640 1 -- 172.21.15.22:0/1302769114 shutdown_connections 2024-05-21T13:36:19.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.470+0000 7f91577c7640 1 --2- 172.21.15.22:0/1302769114 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f913406f430 0x7f91340718f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:19.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.470+0000 7f91577c7640 1 --2- 172.21.15.22:0/1302769114 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f915015bd20 0x7f91500c4d50 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:19.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.470+0000 7f91577c7640 1 --2- 172.21.15.22:0/1302769114 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9150156250 0x7f915014a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:19.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.470+0000 7f91577c7640 1 --2- 172.21.15.22:0/1302769114 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9150155e70 0x7f91500cf8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:19.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.470+0000 7f91577c7640 1 -- 172.21.15.22:0/1302769114 >> 172.21.15.22:0/1302769114 conn(0x7f9150070750 msgr2=0x7f915006c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:19.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.470+0000 7f91577c7640 1 -- 172.21.15.22:0/1302769114 shutdown_connections 2024-05-21T13:36:19.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.470+0000 7f91577c7640 1 -- 172.21.15.22:0/1302769114 wait complete. 2024-05-21T13:36:19.465 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-21T13:36:19.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.606+0000 7fd886d3d640 1 Processor -- start 2024-05-21T13:36:19.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.606+0000 7fd886d3d640 1 -- start start 2024-05-21T13:36:19.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.610+0000 7fd886d3d640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd880153d10 0x7fd880070630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:19.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.610+0000 7fd886d3d640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd8800ca670 0x7fd8800cf470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:19.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.610+0000 7fd886d3d640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd8800c4520 0x7fd8800cf9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:19.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.610+0000 7fd886d3d640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fd8800cbce0 con 0x7fd880153d10 2024-05-21T13:36:19.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.610+0000 7fd886d3d640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7fd880070b70 con 0x7fd8800c4520 2024-05-21T13:36:19.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.610+0000 7fd886d3d640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7fd8800cb6d0 con 0x7fd8800ca670 2024-05-21T13:36:19.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.610+0000 7fd884ad9640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd880153d10 0x7fd880070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:19.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.610+0000 7fd884ad9640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd880153d10 0x7fd880070630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36572/0 (socket says 172.21.15.22:36572) 2024-05-21T13:36:19.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.610+0000 7fd884ad9640 1 -- 172.21.15.22:0/2418543078 learned_addr learned my addr 172.21.15.22:0/2418543078 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:19.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.610+0000 7fd8852da640 1 --2- 172.21.15.22:0/2418543078 >> v2:172.21.15.115:3300/0 conn(0x7fd8800c4520 0x7fd8800cf9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:19.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.610+0000 7fd884ad9640 1 -- 172.21.15.22:0/2418543078 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd8800ca670 msgr2=0x7fd8800cf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:19.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.610+0000 7fd87ffff640 1 --2- 172.21.15.22:0/2418543078 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd8800ca670 0x7fd8800cf470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:19.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.610+0000 7fd884ad9640 1 --2- 172.21.15.22:0/2418543078 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd8800ca670 0x7fd8800cf470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:19.589 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.610+0000 7fd884ad9640 1 -- 172.21.15.22:0/2418543078 >> v2:172.21.15.115:3300/0 conn(0x7fd8800c4520 msgr2=0x7fd8800cf9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:19.589 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.610+0000 7fd884ad9640 1 --2- 172.21.15.22:0/2418543078 >> v2:172.21.15.115:3300/0 conn(0x7fd8800c4520 0x7fd8800cf9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:19.589 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.610+0000 7fd884ad9640 1 -- 172.21.15.22:0/2418543078 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd88015db20 con 0x7fd880153d10 2024-05-21T13:36:19.589 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.610+0000 7fd8852da640 1 --2- 172.21.15.22:0/2418543078 >> v2:172.21.15.115:3300/0 conn(0x7fd8800c4520 0x7fd8800cf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:36:19.589 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.610+0000 7fd884ad9640 1 --2- 172.21.15.22:0/2418543078 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd880153d10 0x7fd880070630 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd8800cd3b0 tx=0x7fd87001ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fd9041f41d7b1ed server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:19.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.610+0000 7fd87f7fe640 1 -- 172.21.15.22:0/2418543078 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8700b5070 con 0x7fd880153d10 2024-05-21T13:36:19.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.614+0000 7fd87f7fe640 1 -- 172.21.15.22:0/2418543078 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd8700a89d0 con 0x7fd880153d10 2024-05-21T13:36:19.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.614+0000 7fd87f7fe640 1 -- 172.21.15.22:0/2418543078 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8700a8da0 con 0x7fd880153d10 2024-05-21T13:36:19.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.614+0000 7fd886d3d640 1 -- 172.21.15.22:0/2418543078 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd880153d10 msgr2=0x7fd880070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:19.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.614+0000 7fd886d3d640 1 --2- 172.21.15.22:0/2418543078 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd880153d10 0x7fd880070630 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd8800cd3b0 tx=0x7fd87001ed10 comp rx=0 tx=0).stop 2024-05-21T13:36:19.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.614+0000 7fd886d3d640 1 -- 172.21.15.22:0/2418543078 shutdown_connections 2024-05-21T13:36:19.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.614+0000 7fd886d3d640 1 --2- 172.21.15.22:0/2418543078 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd8800ca670 0x7fd8800cf470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:19.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.614+0000 7fd886d3d640 1 --2- 172.21.15.22:0/2418543078 >> v2:172.21.15.115:3300/0 conn(0x7fd8800c4520 0x7fd8800cf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:19.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.614+0000 7fd886d3d640 1 --2- 172.21.15.22:0/2418543078 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd880153d10 0x7fd880070630 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:19.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.614+0000 7fd886d3d640 1 -- 172.21.15.22:0/2418543078 >> 172.21.15.22:0/2418543078 conn(0x7fd88006c8f0 msgr2=0x7fd880068260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:19.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.614+0000 7fd886d3d640 1 -- 172.21.15.22:0/2418543078 shutdown_connections 2024-05-21T13:36:19.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.614+0000 7fd886d3d640 1 -- 172.21.15.22:0/2418543078 wait complete. 2024-05-21T13:36:19.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.614+0000 7fd886d3d640 1 Processor -- start 2024-05-21T13:36:19.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.614+0000 7fd886d3d640 1 -- start start 2024-05-21T13:36:19.594 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.614+0000 7fd886d3d640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd8800c4520 0x7fd8801f37a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:19.594 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.614+0000 7fd886d3d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd8800ca670 0x7fd880156e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:19.594 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.614+0000 7fd886d3d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd880153d10 0x7fd880154ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:19.594 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.614+0000 7fd886d3d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd8801540f0 con 0x7fd8800ca670 2024-05-21T13:36:19.594 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.614+0000 7fd886d3d640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fd88015de00 con 0x7fd880153d10 2024-05-21T13:36:19.594 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.614+0000 7fd886d3d640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7fd8800cb330 con 0x7fd8800c4520 2024-05-21T13:36:19.594 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.614+0000 7fd87ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd8800ca670 0x7fd880156e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:19.594 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.614+0000 7fd87ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd8800ca670 0x7fd880156e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36574/0 (socket says 172.21.15.22:36574) 2024-05-21T13:36:19.594 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.614+0000 7fd87ffff640 1 -- 172.21.15.22:0/774549135 learned_addr learned my addr 172.21.15.22:0/774549135 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:19.594 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.614+0000 7fd884ad9640 1 --2- 172.21.15.22:0/774549135 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd8800c4520 0x7fd8801f37a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:19.594 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.614+0000 7fd8852da640 1 --2- 172.21.15.22:0/774549135 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd880153d10 0x7fd880154ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:19.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.614+0000 7fd87ffff640 1 -- 172.21.15.22:0/774549135 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd8800c4520 msgr2=0x7fd8801f37a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:19.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.614+0000 7fd87ffff640 1 --2- 172.21.15.22:0/774549135 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd8800c4520 0x7fd8801f37a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:19.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.614+0000 7fd87ffff640 1 -- 172.21.15.22:0/774549135 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd880153d10 msgr2=0x7fd880154ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:19.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.614+0000 7fd87ffff640 1 --2- 172.21.15.22:0/774549135 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd880153d10 0x7fd880154ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:19.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.614+0000 7fd87ffff640 1 -- 172.21.15.22:0/774549135 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8801f3ce0 con 0x7fd8800ca670 2024-05-21T13:36:19.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.614+0000 7fd884ad9640 1 --2- 172.21.15.22:0/774549135 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd8800c4520 0x7fd8801f37a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T13:36:19.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.614+0000 7fd87ffff640 1 --2- 172.21.15.22:0/774549135 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd8800ca670 0x7fd880156e80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd87400c7f0 tx=0x7fd87400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:19.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.614+0000 7fd87d7fa640 1 -- 172.21.15.22:0/774549135 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd874015070 con 0x7fd8800ca670 2024-05-21T13:36:19.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.614+0000 7fd87d7fa640 1 -- 172.21.15.22:0/774549135 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd874004240 con 0x7fd8800ca670 2024-05-21T13:36:19.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.614+0000 7fd886d3d640 1 -- 172.21.15.22:0/774549135 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd88014ae60 con 0x7fd8800ca670 2024-05-21T13:36:19.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.614+0000 7fd87d7fa640 1 -- 172.21.15.22:0/774549135 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd874003620 con 0x7fd8800ca670 2024-05-21T13:36:19.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.614+0000 7fd886d3d640 1 -- 172.21.15.22:0/774549135 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd88014b420 con 0x7fd8800ca670 2024-05-21T13:36:19.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.618+0000 7fd886d3d640 1 -- 172.21.15.22:0/774549135 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd880077bb0 con 0x7fd8800ca670 2024-05-21T13:36:19.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.618+0000 7fd87d7fa640 1 -- 172.21.15.22:0/774549135 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fd8740039d0 con 0x7fd8800ca670 2024-05-21T13:36:19.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.618+0000 7fd87d7fa640 1 --2- 172.21.15.22:0/774549135 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fd86c06f430 0x7fd86c0718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:19.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.618+0000 7fd87d7fa640 1 -- 172.21.15.22:0/774549135 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd87408f5e0 con 0x7fd8800ca670 2024-05-21T13:36:19.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.618+0000 7fd884ad9640 1 --2- 172.21.15.22:0/774549135 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fd86c06f430 0x7fd86c0718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:19.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.618+0000 7fd884ad9640 1 --2- 172.21.15.22:0/774549135 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fd86c06f430 0x7fd86c0718f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd8700b2000 tx=0x7fd870008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:19.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.622+0000 7fd87d7fa640 1 -- 172.21.15.22:0/774549135 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fd8801f3ce0 con 0x7fd8800ca670 2024-05-21T13:36:19.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.782+0000 7fd886d3d640 1 -- 172.21.15.22:0/774549135 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd880070d30 con 0x7fd8800ca670 2024-05-21T13:36:19.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.786+0000 7fd87d7fa640 1 -- 172.21.15.22:0/774549135 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18458 (secure 0 0 0) 0x7fd87405c220 con 0x7fd8800ca670 2024-05-21T13:36:19.765 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-21T13:36:19.765 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":25,"fsid":"f2c96204-e240-4e7f-8a76-927b4f80f534","created":"2024-05-21T13:35:33.827005+0000","modified":"2024-05-21T13:36:02.190808+0000","last_up_change":"2024-05-21T13:35:44.542324+0000","last_in_change":"2024-05-21T13:35:36.061492+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-21T13:35:44.536105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-21T13:35:54.972996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-21T13:35:56.065755+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-21T13:35:59.791448+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"09157d4a-9443-4e10-bbb3-cf8ed7c42cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":222752954},{"type":"v1","addr":"172.21.15.22:6801","nonce":222752954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":222752954},{"type":"v1","addr":"172.21.15.22:6803","nonce":222752954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":222752954},{"type":"v1","addr":"172.21.15.22:6807","nonce":222752954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":222752954},{"type":"v1","addr":"172.21.15.22:6805","nonce":222752954}]},"public_addr":"172.21.15.22:6801/222752954","cluster_addr":"172.21.15.22:6803/222752954","heartbeat_back_addr":"172.21.15.22:6807/222752954","heartbeat_front_addr":"172.21.15.22:6805/222752954","state":["exists","up"]},{"osd":1,"uuid":"2a6a87c0-01ad-4a98-a538-c0a8e865b05d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":685426272},{"type":"v1","addr":"172.21.15.22:6809","nonce":685426272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":685426272},{"type":"v1","addr":"172.21.15.22:6811","nonce":685426272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":685426272},{"type":"v1","addr":"172.21.15.22:6815","nonce":685426272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":685426272},{"type":"v1","addr":"172.21.15.22:6813","nonce":685426272}]},"public_addr":"172.21.15.22:6809/685426272","cluster_addr":"172.21.15.22:6811/685426272","heartbeat_back_addr":"172.21.15.22:6815/685426272","heartbeat_front_addr":"172.21.15.22:6813/685426272","state":["exists","up"]},{"osd":2,"uuid":"4c18f931-40a4-46ac-a752-0d1be35b01a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":2092224336},{"type":"v1","addr":"172.21.15.22:6817","nonce":2092224336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":2092224336},{"type":"v1","addr":"172.21.15.22:6819","nonce":2092224336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":2092224336},{"type":"v1","addr":"172.21.15.22:6823","nonce":2092224336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":2092224336},{"type":"v1","addr":"172.21.15.22:6821","nonce":2092224336}]},"public_addr":"172.21.15.22:6817/2092224336","cluster_addr":"172.21.15.22:6819/2092224336","heartbeat_back_addr":"172.21.15.22:6823/2092224336","heartbeat_front_addr":"172.21.15.22:6821/2092224336","state":["exists","up"]},{"osd":3,"uuid":"d57ee7fd-b73e-41ec-8e3b-e62fb8898128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":1232311110},{"type":"v1","addr":"172.21.15.22:6825","nonce":1232311110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":1232311110},{"type":"v1","addr":"172.21.15.22:6827","nonce":1232311110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":1232311110},{"type":"v1","addr":"172.21.15.22:6831","nonce":1232311110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":1232311110},{"type":"v1","addr":"172.21.15.22:6829","nonce":1232311110}]},"public_addr":"172.21.15.22:6825/1232311110","cluster_addr":"172.21.15.22:6827/1232311110","heartbeat_back_addr":"172.21.15.22:6831/1232311110","heartbeat_front_addr":"172.21.15.22:6829/1232311110","state":["exists","up"]},{"osd":4,"uuid":"43c6494f-352b-42a7-b6a9-fe7e3573fab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":832695158},{"type":"v1","addr":"172.21.15.115:6801","nonce":832695158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":832695158},{"type":"v1","addr":"172.21.15.115:6803","nonce":832695158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":832695158},{"type":"v1","addr":"172.21.15.115:6807","nonce":832695158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":832695158},{"type":"v1","addr":"172.21.15.115:6805","nonce":832695158}]},"public_addr":"172.21.15.115:6801/832695158","cluster_addr":"172.21.15.115:6803/832695158","heartbeat_back_addr":"172.21.15.115:6807/832695158","heartbeat_front_addr":"172.21.15.115:6805/832695158","state":["exists","up"]},{"osd":5,"uuid":"25fc861c-593d-4d49-942a-c75c19f25994","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":1504764223},{"type":"v1","addr":"172.21.15.115:6815","nonce":1504764223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":1504764223},{"type":"v1","addr":"172.21.15.115:6823","nonce":1504764223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":1504764223},{"type":"v1","addr":"172.21.15.115:6830","nonce":1504764223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6825","nonce":1504764223},{"type":"v1","addr":"172.21.15.115:6827","nonce":1504764223}]},"public_addr":"172.21.15.115:6815/1504764223","cluster_addr":"172.21.15.115:6823/1504764223","heartbeat_back_addr":"172.21.15.115:6830/1504764223","heartbeat_front_addr":"172.21.15.115:6827/1504764223","state":["exists","up"]},{"osd":6,"uuid":"2e7fb0b8-1162-497f-bffc-e2c02b9b9ef4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":959292720},{"type":"v1","addr":"172.21.15.115:6809","nonce":959292720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":959292720},{"type":"v1","addr":"172.21.15.115:6813","nonce":959292720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":959292720},{"type":"v1","addr":"172.21.15.115:6822","nonce":959292720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":959292720},{"type":"v1","addr":"172.21.15.115:6818","nonce":959292720}]},"public_addr":"172.21.15.115:6809/959292720","cluster_addr":"172.21.15.115:6813/959292720","heartbeat_back_addr":"172.21.15.115:6822/959292720","heartbeat_front_addr":"172.21.15.115:6818/959292720","state":["exists","up"]},{"osd":7,"uuid":"a97df0dc-e370-45ce-8742-25ae31e2212e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6811","nonce":20268513},{"type":"v1","addr":"172.21.15.115:6814","nonce":20268513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":20268513},{"type":"v1","addr":"172.21.15.115:6821","nonce":20268513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6829","nonce":20268513},{"type":"v1","addr":"172.21.15.115:6831","nonce":20268513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":20268513},{"type":"v1","addr":"172.21.15.115:6826","nonce":20268513}]},"public_addr":"172.21.15.115:6814/20268513","cluster_addr":"172.21.15.115:6821/20268513","heartbeat_back_addr":"172.21.15.115:6831/20268513","heartbeat_front_addr":"172.21.15.115:6826/20268513","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.692890+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.545577+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.712724+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.681944+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.492954+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.553222+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.597022+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.601698+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-21T13:36:19.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.790+0000 7fd886d3d640 1 -- 172.21.15.22:0/774549135 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fd86c06f430 msgr2=0x7fd86c0718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:19.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.790+0000 7fd886d3d640 1 --2- 172.21.15.22:0/774549135 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fd86c06f430 0x7fd86c0718f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd8700b2000 tx=0x7fd870008040 comp rx=0 tx=0).stop 2024-05-21T13:36:19.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.790+0000 7fd886d3d640 1 -- 172.21.15.22:0/774549135 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd8800ca670 msgr2=0x7fd880156e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:19.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.790+0000 7fd886d3d640 1 --2- 172.21.15.22:0/774549135 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd8800ca670 0x7fd880156e80 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd87400c7f0 tx=0x7fd87400ccb0 comp rx=0 tx=0).stop 2024-05-21T13:36:19.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.790+0000 7fd886d3d640 1 -- 172.21.15.22:0/774549135 shutdown_connections 2024-05-21T13:36:19.767 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.790+0000 7fd886d3d640 1 --2- 172.21.15.22:0/774549135 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fd86c06f430 0x7fd86c0718f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:19.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.790+0000 7fd886d3d640 1 --2- 172.21.15.22:0/774549135 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd880153d10 0x7fd880154ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:19.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.790+0000 7fd886d3d640 1 --2- 172.21.15.22:0/774549135 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd8800ca670 0x7fd880156e80 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:19.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.790+0000 7fd886d3d640 1 --2- 172.21.15.22:0/774549135 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd8800c4520 0x7fd8801f37a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:19.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.790+0000 7fd886d3d640 1 -- 172.21.15.22:0/774549135 >> 172.21.15.22:0/774549135 conn(0x7fd88006c8f0 msgr2=0x7fd880151c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:19.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.790+0000 7fd886d3d640 1 -- 172.21.15.22:0/774549135 shutdown_connections 2024-05-21T13:36:19.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.790+0000 7fd886d3d640 1 -- 172.21.15.22:0/774549135 wait complete. 2024-05-21T13:36:19.783 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-05-21T13:36:19.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.922+0000 7f903226a640 1 Processor -- start 2024-05-21T13:36:19.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.922+0000 7f903226a640 1 -- start start 2024-05-21T13:36:19.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.926+0000 7f903226a640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f902c150400 0x7f902c0c47f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:19.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.926+0000 7f903226a640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f902c0c9990 0x7f902c0c5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:19.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.926+0000 7f903226a640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f902c0c7ed0 con 0x7f902c0c7440 2024-05-21T13:36:19.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.926+0000 7f903226a640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f902c0c81b0 con 0x7f902c150400 2024-05-21T13:36:19.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.926+0000 7f903226a640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f902c0c52a0 con 0x7f902c0c9990 2024-05-21T13:36:19.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.926+0000 7f902bfff640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f902c150400 0x7f902c0c47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:19.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.926+0000 7f902b7fe640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f902c0c9990 0x7f902c0c5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:19.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.926+0000 7f902b7fe640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f902c0c9990 0x7f902c0c5aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.22:46674/0 (socket says 172.21.15.22:46674) 2024-05-21T13:36:19.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.926+0000 7f902bfff640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f902c150400 0x7f902c0c47f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.22:52624/0 (socket says 172.21.15.22:52624) 2024-05-21T13:36:19.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.926+0000 7f902b7fe640 1 -- 172.21.15.22:0/3414254251 learned_addr learned my addr 172.21.15.22:0/3414254251 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:19.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.926+0000 7f9030807640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f902c0c7440 0x7f902c06df50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.22:48852/0 (socket says 172.21.15.22:48852) 2024-05-21T13:36:19.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.926+0000 7f902b7fe640 1 -- 172.21.15.22:0/3414254251 >> v2:172.21.15.115:3300/0 conn(0x7f902c150400 msgr2=0x7f902c0c47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:19.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.926+0000 7f902b7fe640 1 --2- 172.21.15.22:0/3414254251 >> v2:172.21.15.115:3300/0 conn(0x7f902c150400 0x7f902c0c47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:19.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.926+0000 7f902b7fe640 1 -- 172.21.15.22:0/3414254251 >> v1:172.21.15.115:6789/0 conn(0x7f902c0c7440 legacy=0x7f902c06df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:19.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.926+0000 7f902b7fe640 1 -- 172.21.15.22:0/3414254251 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f902c0c5580 con 0x7f902c0c9990 2024-05-21T13:36:19.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.930+0000 7f902b7fe640 1 --2- 172.21.15.22:0/3414254251 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f902c0c9990 0x7f902c0c5aa0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9020009870 tx=0x7f902001ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1481a5944536bb1 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:19.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.930+0000 7f902affd640 1 -- 172.21.15.22:0/3414254251 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90200b5070 con 0x7f902c0c9990 2024-05-21T13:36:19.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.930+0000 7f902affd640 1 -- 172.21.15.22:0/3414254251 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90200a8a50 con 0x7f902c0c9990 2024-05-21T13:36:19.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.930+0000 7f902affd640 1 -- 172.21.15.22:0/3414254251 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90200a8e20 con 0x7f902c0c9990 2024-05-21T13:36:19.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.930+0000 7f903226a640 1 -- 172.21.15.22:0/3414254251 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f902c0c9990 msgr2=0x7f902c0c5aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:19.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.930+0000 7f903226a640 1 --2- 172.21.15.22:0/3414254251 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f902c0c9990 0x7f902c0c5aa0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f9020009870 tx=0x7f902001ed50 comp rx=0 tx=0).stop 2024-05-21T13:36:19.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.930+0000 7f903226a640 1 -- 172.21.15.22:0/3414254251 shutdown_connections 2024-05-21T13:36:19.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.930+0000 7f903226a640 1 --2- 172.21.15.22:0/3414254251 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f902c0c9990 0x7f902c0c5aa0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:19.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.930+0000 7f903226a640 1 --2- 172.21.15.22:0/3414254251 >> v2:172.21.15.115:3300/0 conn(0x7f902c150400 0x7f902c0c47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:19.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.930+0000 7f903226a640 1 -- 172.21.15.22:0/3414254251 >> 172.21.15.22:0/3414254251 conn(0x7f902c06cc50 msgr2=0x7f902c0cd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:19.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.930+0000 7f903226a640 1 -- 172.21.15.22:0/3414254251 shutdown_connections 2024-05-21T13:36:19.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.930+0000 7f903226a640 1 -- 172.21.15.22:0/3414254251 wait complete. 2024-05-21T13:36:19.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.930+0000 7f903226a640 1 Processor -- start 2024-05-21T13:36:19.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.930+0000 7f903226a640 1 -- start start 2024-05-21T13:36:19.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.934+0000 7f903226a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f902c0c7440 0x7f902c0738a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:19.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.934+0000 7f903226a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f902c0c9990 0x7f902c14baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:19.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.934+0000 7f903226a640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f902c150400 0x7f902c14c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:19.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.934+0000 7f903226a640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f902c1599b0 con 0x7f902c0c7440 2024-05-21T13:36:19.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.934+0000 7f903226a640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f902c159830 con 0x7f902c0c9990 2024-05-21T13:36:19.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.934+0000 7f903226a640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f902c159b30 con 0x7f902c150400 2024-05-21T13:36:19.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.934+0000 7f902bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f902c0c7440 0x7f902c0738a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:19.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.934+0000 7f902bfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f902c0c7440 0x7f902c0738a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36580/0 (socket says 172.21.15.22:36580) 2024-05-21T13:36:19.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.934+0000 7f902bfff640 1 -- 172.21.15.22:0/3725493618 learned_addr learned my addr 172.21.15.22:0/3725493618 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:19.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.934+0000 7f902b7fe640 1 --2- 172.21.15.22:0/3725493618 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f902c0c9990 0x7f902c14baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:19.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.934+0000 7f9030807640 1 --2- 172.21.15.22:0/3725493618 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f902c150400 0x7f902c14c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:19.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.934+0000 7f902bfff640 1 -- 172.21.15.22:0/3725493618 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f902c150400 msgr2=0x7f902c14c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:19.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.934+0000 7f902bfff640 1 --2- 172.21.15.22:0/3725493618 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f902c150400 0x7f902c14c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:19.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.934+0000 7f902bfff640 1 -- 172.21.15.22:0/3725493618 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f902c0c9990 msgr2=0x7f902c14baf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:19.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.934+0000 7f902bfff640 1 --2- 172.21.15.22:0/3725493618 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f902c0c9990 0x7f902c14baf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:19.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.934+0000 7f902bfff640 1 -- 172.21.15.22:0/3725493618 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f902c072710 con 0x7f902c0c7440 2024-05-21T13:36:19.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.934+0000 7f902b7fe640 1 --2- 172.21.15.22:0/3725493618 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f902c0c9990 0x7f902c14baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T13:36:19.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.934+0000 7f902bfff640 1 --2- 172.21.15.22:0/3725493618 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f902c0c7440 0x7f902c0738a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f901c00e870 tx=0x7f901c00ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:19.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.934+0000 7f9028ff9640 1 -- 172.21.15.22:0/3725493618 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f901c017070 con 0x7f902c0c7440 2024-05-21T13:36:19.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.934+0000 7f9028ff9640 1 -- 172.21.15.22:0/3725493618 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f901c00c940 con 0x7f902c0c7440 2024-05-21T13:36:19.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.934+0000 7f9028ff9640 1 -- 172.21.15.22:0/3725493618 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f901c00ccf0 con 0x7f902c0c7440 2024-05-21T13:36:19.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.934+0000 7f903226a640 1 -- 172.21.15.22:0/3725493618 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f902c074320 con 0x7f902c0c7440 2024-05-21T13:36:19.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.934+0000 7f903226a640 1 -- 172.21.15.22:0/3725493618 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f902c0c3dd0 con 0x7f902c0c7440 2024-05-21T13:36:19.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.934+0000 7f903226a640 1 -- 172.21.15.22:0/3725493618 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f902c0766d0 con 0x7f902c0c7440 2024-05-21T13:36:19.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.934+0000 7f9028ff9640 1 -- 172.21.15.22:0/3725493618 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f901c01a070 con 0x7f902c0c7440 2024-05-21T13:36:19.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.934+0000 7f9028ff9640 1 --2- 172.21.15.22:0/3725493618 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f901806f400 0x7f90180718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:19.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.934+0000 7f9028ff9640 1 -- 172.21.15.22:0/3725493618 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f901c08f4a0 con 0x7f902c0c7440 2024-05-21T13:36:19.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.938+0000 7f902b7fe640 1 --2- 172.21.15.22:0/3725493618 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f901806f400 0x7f90180718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:19.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.938+0000 7f902b7fe640 1 --2- 172.21.15.22:0/3725493618 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f901806f400 0x7f90180718c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f90200b2000 tx=0x7f9020008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:19.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:19.942+0000 7f9028ff9640 1 -- 172.21.15.22:0/3725493618 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f902c072710 con 0x7f902c0c7440 2024-05-21T13:36:20.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:20.134+0000 7f903226a640 1 -- 172.21.15.22:0/3725493618 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f902c077bb0 con 0x7f902c0c7440 2024-05-21T13:36:20.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:20.862+0000 7f9028ff9640 1 -- 172.21.15.22:0/3725493618 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) ==== 118+0+0 (secure 0 0 0) 0x7f901c05c0e0 con 0x7f902c0c7440 2024-05-21T13:36:20.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:20.866+0000 7f903226a640 1 -- 172.21.15.22:0/3725493618 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f901806f400 msgr2=0x7f90180718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:20.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:20.866+0000 7f903226a640 1 --2- 172.21.15.22:0/3725493618 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f901806f400 0x7f90180718c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f90200b2000 tx=0x7f9020008040 comp rx=0 tx=0).stop 2024-05-21T13:36:20.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:20.866+0000 7f903226a640 1 -- 172.21.15.22:0/3725493618 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f902c0c7440 msgr2=0x7f902c0738a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:20.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:20.866+0000 7f903226a640 1 --2- 172.21.15.22:0/3725493618 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f902c0c7440 0x7f902c0738a0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f901c00e870 tx=0x7f901c00ec70 comp rx=0 tx=0).stop 2024-05-21T13:36:20.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:20.866+0000 7f903226a640 1 -- 172.21.15.22:0/3725493618 shutdown_connections 2024-05-21T13:36:20.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:20.866+0000 7f903226a640 1 --2- 172.21.15.22:0/3725493618 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f901806f400 0x7f90180718c0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:20.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:20.866+0000 7f903226a640 1 --2- 172.21.15.22:0/3725493618 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f902c150400 0x7f902c14c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:20.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:20.866+0000 7f903226a640 1 --2- 172.21.15.22:0/3725493618 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f902c0c9990 0x7f902c14baf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:20.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:20.866+0000 7f903226a640 1 --2- 172.21.15.22:0/3725493618 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f902c0c7440 0x7f902c0738a0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:20.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:20.866+0000 7f903226a640 1 -- 172.21.15.22:0/3725493618 >> 172.21.15.22:0/3725493618 conn(0x7f902c06cc50 msgr2=0x7f902c0c8f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:20.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:20.866+0000 7f903226a640 1 -- 172.21.15.22:0/3725493618 shutdown_connections 2024-05-21T13:36:20.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:20.866+0000 7f903226a640 1 -- 172.21.15.22:0/3725493618 wait complete. 2024-05-21T13:36:20.868 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300} 2024-05-21T13:36:20.868 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 3 2024-05-21T13:36:21.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:21.026+0000 7f7cd7146640 1 Processor -- start 2024-05-21T13:36:21.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:21.026+0000 7f7cd7146640 1 -- start start 2024-05-21T13:36:21.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:21.026+0000 7f7cd7146640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f7cd0155e80 0x7f7cd006c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:21.004 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:21.026+0000 7f7cd7146640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7cd00708b0 0x7f7cd0070d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:21.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:21.026+0000 7f7cd7146640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7cd00c97a0 con 0x7f7cd00c80b0 2024-05-21T13:36:21.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:21.026+0000 7f7cd7146640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f7cd006ca30 con 0x7f7cd0155e80 2024-05-21T13:36:21.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:21.026+0000 7f7cd7146640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f7cd015c930 con 0x7f7cd00708b0 2024-05-21T13:36:21.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:21.026+0000 7f7cd4ee2640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f7cd0155e80 0x7f7cd006c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:21.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:21.026+0000 7f7ccffff640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f7cd00c80b0 0x7f7cd00cad90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:43816/0 (socket says 172.21.15.22:43816) 2024-05-21T13:36:21.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:21.026+0000 7f7ccffff640 1 -- 172.21.15.22:0/1931800454 learned_addr learned my addr 172.21.15.22:0/1931800454 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-21T13:36:21.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:21.026+0000 7f7cd4ee2640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f7cd0155e80 0x7f7cd006c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36590/0 (socket says 172.21.15.22:36590) 2024-05-21T13:36:21.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:21.026+0000 7f7cd56e3640 1 --2- 172.21.15.22:0/1931800454 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7cd00708b0 0x7f7cd0070d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:21.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:21.026+0000 7f7cd4ee2640 1 -- 172.21.15.22:0/1931800454 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7cd00708b0 msgr2=0x7f7cd0070d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:21.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:21.026+0000 7f7cd4ee2640 1 --2- 172.21.15.22:0/1931800454 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7cd00708b0 0x7f7cd0070d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:21.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:21.026+0000 7f7cd4ee2640 1 -- 172.21.15.22:0/1931800454 >> v1:172.21.15.22:6789/0 conn(0x7f7cd00c80b0 legacy=0x7f7cd00cad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:21.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:21.026+0000 7f7cd4ee2640 1 -- 172.21.15.22:0/1931800454 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cd0071260 con 0x7f7cd0155e80 2024-05-21T13:36:21.005 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:21.026+0000 7f7cd56e3640 1 --2- 172.21.15.22:0/1931800454 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7cd00708b0 0x7f7cd0070d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:36:21.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:21.026+0000 7f7ccf7fe640 1 -- 172.21.15.22:0/1931800454 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2948995980 0 0) 0x7f7cd00c97a0 con 0x7f7cd00c80b0 2024-05-21T13:36:21.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:21.030+0000 7f7cd4ee2640 1 --2- 172.21.15.22:0/1931800454 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7cd0155e80 0x7f7cd006c4f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7cc00097c0 tx=0x7f7cc001ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa277a518304e2ca server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:21.006 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:21.030+0000 7f7ccf7fe640 1 -- 172.21.15.22:0/1931800454 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cc00b5070 con 0x7f7cd0155e80 2024-05-21T13:36:21.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:21.030+0000 7f7ccf7fe640 1 -- 172.21.15.22:0/1931800454 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cc00a8990 con 0x7f7cd0155e80 2024-05-21T13:36:21.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:21.030+0000 7f7ccf7fe640 1 -- 172.21.15.22:0/1931800454 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cc00a8d60 con 0x7f7cd0155e80 2024-05-21T13:36:21.007 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:21.030+0000 7f7cd7146640 1 -- 172.21.15.22:0/1931800454 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7cd0155e80 msgr2=0x7f7cd006c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:21.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:21.030+0000 7f7cd7146640 1 --2- 172.21.15.22:0/1931800454 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7cd0155e80 0x7f7cd006c4f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f7cc00097c0 tx=0x7f7cc001ec90 comp rx=0 tx=0).stop 2024-05-21T13:36:21.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:21.030+0000 7f7cd7146640 1 -- 172.21.15.22:0/1931800454 shutdown_connections 2024-05-21T13:36:21.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:21.030+0000 7f7cd7146640 1 --2- 172.21.15.22:0/1931800454 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7cd00708b0 0x7f7cd0070d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:21.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:21.030+0000 7f7cd7146640 1 --2- 172.21.15.22:0/1931800454 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7cd0155e80 0x7f7cd006c4f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:21.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:21.030+0000 7f7cd7146640 1 -- 172.21.15.22:0/1931800454 >> 172.21.15.22:0/1931800454 conn(0x7f7cd006f260 msgr2=0x7f7cd006f670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:21.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:21.030+0000 7f7cd7146640 1 -- 172.21.15.22:0/1931800454 shutdown_connections 2024-05-21T13:36:21.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:21.030+0000 7f7cd7146640 1 -- 172.21.15.22:0/1931800454 wait complete. 2024-05-21T13:36:21.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:21.030+0000 7f7cd7146640 1 Processor -- start 2024-05-21T13:36:21.009 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:21.030+0000 7f7cd7146640 1 -- start start 2024-05-21T13:36:21.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:21.030+0000 7f7cd7146640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7cd00708b0 0x7f7cd0156d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:21.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:21.030+0000 7f7cd7146640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7cd00c80b0 0x7f7cd01f4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:21.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:21.030+0000 7f7cd7146640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7cd0155e80 0x7f7cd01483e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:21.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:21.030+0000 7f7cd7146640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7cd015c000 con 0x7f7cd0155e80 2024-05-21T13:36:21.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:21.030+0000 7f7cd7146640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f7cd0156260 con 0x7f7cd00708b0 2024-05-21T13:36:21.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:21.030+0000 7f7cd7146640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f7cd015c2e0 con 0x7f7cd00c80b0 2024-05-21T13:36:21.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:21.030+0000 7f7cd56e3640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7cd0155e80 0x7f7cd01483e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:21.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:21.030+0000 7f7cd56e3640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7cd0155e80 0x7f7cd01483e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36592/0 (socket says 172.21.15.22:36592) 2024-05-21T13:36:21.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:21.030+0000 7f7cd56e3640 1 -- 172.21.15.22:0/4139381113 learned_addr learned my addr 172.21.15.22:0/4139381113 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:21.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:21.030+0000 7f7ccffff640 1 --2- 172.21.15.22:0/4139381113 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7cd00c80b0 0x7f7cd01f4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:21.011 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:21.030+0000 7f7cd4ee2640 1 --2- 172.21.15.22:0/4139381113 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7cd00708b0 0x7f7cd0156d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:21.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:21.030+0000 7f7cd56e3640 1 -- 172.21.15.22:0/4139381113 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7cd00c80b0 msgr2=0x7f7cd01f4970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:21.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:21.030+0000 7f7cd56e3640 1 --2- 172.21.15.22:0/4139381113 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7cd00c80b0 0x7f7cd01f4970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:21.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:21.030+0000 7f7cd56e3640 1 -- 172.21.15.22:0/4139381113 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7cd00708b0 msgr2=0x7f7cd0156d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:21.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:21.030+0000 7f7cd56e3640 1 --2- 172.21.15.22:0/4139381113 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7cd00708b0 0x7f7cd0156d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:21.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:21.030+0000 7f7cd56e3640 1 -- 172.21.15.22:0/4139381113 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cd01f52b0 con 0x7f7cd0155e80 2024-05-21T13:36:21.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:21.030+0000 7f7cd4ee2640 1 --2- 172.21.15.22:0/4139381113 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7cd00708b0 0x7f7cd0156d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:36:21.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:21.034+0000 7f7cd56e3640 1 --2- 172.21.15.22:0/4139381113 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7cd0155e80 0x7f7cd01483e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7cc800cef0 tx=0x7f7cc800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:21.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:21.034+0000 7f7ccd7fa640 1 -- 172.21.15.22:0/4139381113 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cc801a070 con 0x7f7cd0155e80 2024-05-21T13:36:21.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:21.034+0000 7f7ccd7fa640 1 -- 172.21.15.22:0/4139381113 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7cc800d860 con 0x7f7cd0155e80 2024-05-21T13:36:21.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:21.034+0000 7f7cd7146640 1 -- 172.21.15.22:0/4139381113 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cd01f5590 con 0x7f7cd0155e80 2024-05-21T13:36:21.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:21.034+0000 7f7ccd7fa640 1 -- 172.21.15.22:0/4139381113 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cc800dc50 con 0x7f7cd0155e80 2024-05-21T13:36:21.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:21.034+0000 7f7cd7146640 1 -- 172.21.15.22:0/4139381113 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cd014e5d0 con 0x7f7cd0155e80 2024-05-21T13:36:21.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:21.034+0000 7f7cd7146640 1 -- 172.21.15.22:0/4139381113 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cd00697d0 con 0x7f7cd0155e80 2024-05-21T13:36:21.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:21.034+0000 7f7ccd7fa640 1 -- 172.21.15.22:0/4139381113 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f7cc801d070 con 0x7f7cd0155e80 2024-05-21T13:36:21.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:21.034+0000 7f7ccd7fa640 1 --2- 172.21.15.22:0/4139381113 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f7cbc06f400 0x7f7cbc0718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:21.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:21.034+0000 7f7ccd7fa640 1 -- 172.21.15.22:0/4139381113 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f7cc808fd90 con 0x7f7cd0155e80 2024-05-21T13:36:21.014 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:21.034+0000 7f7cd4ee2640 1 --2- 172.21.15.22:0/4139381113 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f7cbc06f400 0x7f7cbc0718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:21.014 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:21.034+0000 7f7cd4ee2640 1 --2- 172.21.15.22:0/4139381113 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f7cbc06f400 0x7f7cbc0718c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7cc00b2000 tx=0x7f7cc00aa070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:21.016 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:21.038+0000 7f7ccd7fa640 1 -- 172.21.15.22:0/4139381113 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f7cc805cb20 con 0x7f7cd0155e80 2024-05-21T13:36:21.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:21.238+0000 7f7cd7146640 1 -- 172.21.15.22:0/4139381113 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7f7cd00ca3d0 con 0x7f7cd0155e80 2024-05-21T13:36:21.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:21.874+0000 7f7ccd7fa640 1 -- 172.21.15.22:0/4139381113 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v8) ==== 105+0+0 (secure 0 0 0) 0x7f7cc805c420 con 0x7f7cd0155e80 2024-05-21T13:36:21.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:21.878+0000 7f7cd7146640 1 -- 172.21.15.22:0/4139381113 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f7cbc06f400 msgr2=0x7f7cbc0718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:21.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:21.878+0000 7f7cd7146640 1 --2- 172.21.15.22:0/4139381113 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f7cbc06f400 0x7f7cbc0718c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7cc00b2000 tx=0x7f7cc00aa070 comp rx=0 tx=0).stop 2024-05-21T13:36:21.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:21.878+0000 7f7cd7146640 1 -- 172.21.15.22:0/4139381113 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7cd0155e80 msgr2=0x7f7cd01483e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:21.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:21.878+0000 7f7cd7146640 1 --2- 172.21.15.22:0/4139381113 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7cd0155e80 0x7f7cd01483e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7cc800cef0 tx=0x7f7cc800a710 comp rx=0 tx=0).stop 2024-05-21T13:36:21.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:21.878+0000 7f7cd7146640 1 -- 172.21.15.22:0/4139381113 shutdown_connections 2024-05-21T13:36:21.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:21.878+0000 7f7cd7146640 1 --2- 172.21.15.22:0/4139381113 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f7cbc06f400 0x7f7cbc0718c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:21.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:21.878+0000 7f7cd7146640 1 --2- 172.21.15.22:0/4139381113 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7cd0155e80 0x7f7cd01483e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:21.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:21.878+0000 7f7cd7146640 1 --2- 172.21.15.22:0/4139381113 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7cd00c80b0 0x7f7cd01f4970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:21.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:21.878+0000 7f7cd7146640 1 --2- 172.21.15.22:0/4139381113 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7cd00708b0 0x7f7cd0156d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:21.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:21.878+0000 7f7cd7146640 1 -- 172.21.15.22:0/4139381113 >> 172.21.15.22:0/4139381113 conn(0x7f7cd006f260 msgr2=0x7f7cd01535f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:21.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:21.878+0000 7f7cd7146640 1 -- 172.21.15.22:0/4139381113 shutdown_connections 2024-05-21T13:36:21.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:21.878+0000 7f7cd7146640 1 -- 172.21.15.22:0/4139381113 wait complete. 2024-05-21T13:36:21.880 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-05-21T13:36:22.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:22.038+0000 7f2278144640 1 Processor -- start 2024-05-21T13:36:22.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:22.038+0000 7f2278144640 1 -- start start 2024-05-21T13:36:22.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:22.038+0000 7f2278144640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f2270155b40 0x7f2270071700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:22.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:22.038+0000 7f2278144640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22700c54e0 0x7f227015ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:22.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:22.038+0000 7f2278144640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2270155f20 con 0x7f22700c9f00 2024-05-21T13:36:22.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:22.038+0000 7f2278144640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f2270070ce0 con 0x7f2270155b40 2024-05-21T13:36:22.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:22.038+0000 7f2278144640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f2270070f30 con 0x7f22700c54e0 2024-05-21T13:36:22.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:22.038+0000 7f2275ee0640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f2270155b40 0x7f2270071700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:22.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:22.038+0000 7f22756df640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f22700c9f00 0x7f22700c4dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:43830/0 (socket says 172.21.15.22:43830) 2024-05-21T13:36:22.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:22.038+0000 7f22756df640 1 -- 172.21.15.22:0/3308997903 learned_addr learned my addr 172.21.15.22:0/3308997903 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-21T13:36:22.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:22.038+0000 7f22766e1640 1 --2- 172.21.15.22:0/3308997903 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22700c54e0 0x7f227015ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:22.018 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:22.038+0000 7f2274ede640 1 -- 172.21.15.22:0/3308997903 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3311551952 0 0) 0x7f2270155f20 con 0x7f22700c9f00 2024-05-21T13:36:22.018 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:22.038+0000 7f2274ede640 1 -- 172.21.15.22:0/3308997903 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f225c003530 con 0x7f22700c9f00 2024-05-21T13:36:22.018 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:22.038+0000 7f2275ee0640 1 -- 172.21.15.22:0/3308997903 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22700c54e0 msgr2=0x7f227015ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:22.018 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:22.038+0000 7f2275ee0640 1 --2- 172.21.15.22:0/3308997903 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22700c54e0 0x7f227015ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:22.018 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:22.038+0000 7f2275ee0640 1 -- 172.21.15.22:0/3308997903 >> v1:172.21.15.22:6789/0 conn(0x7f22700c9f00 legacy=0x7f22700c4dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:22.018 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:22.038+0000 7f2275ee0640 1 -- 172.21.15.22:0/3308997903 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f227006e020 con 0x7f2270155b40 2024-05-21T13:36:22.018 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:22.038+0000 7f22766e1640 1 --2- 172.21.15.22:0/3308997903 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22700c54e0 0x7f227015ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T13:36:22.020 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:22.042+0000 7f2275ee0640 1 --2- 172.21.15.22:0/3308997903 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2270155b40 0x7f2270071700 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2268009d90 tx=0x7f226801f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65ee2bffd75e2727 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:22.020 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:22.042+0000 7f2274ede640 1 -- 172.21.15.22:0/3308997903 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22680b4070 con 0x7f2270155b40 2024-05-21T13:36:22.020 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:22.042+0000 7f2274ede640 1 -- 172.21.15.22:0/3308997903 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22680af600 con 0x7f2270155b40 2024-05-21T13:36:22.020 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:22.042+0000 7f2274ede640 1 -- 172.21.15.22:0/3308997903 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22680af9b0 con 0x7f2270155b40 2024-05-21T13:36:22.021 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:22.042+0000 7f2278144640 1 -- 172.21.15.22:0/3308997903 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2270155b40 msgr2=0x7f2270071700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:22.021 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:22.042+0000 7f2278144640 1 --2- 172.21.15.22:0/3308997903 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2270155b40 0x7f2270071700 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2268009d90 tx=0x7f226801f150 comp rx=0 tx=0).stop 2024-05-21T13:36:22.021 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:22.042+0000 7f2278144640 1 -- 172.21.15.22:0/3308997903 shutdown_connections 2024-05-21T13:36:22.021 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:22.042+0000 7f2278144640 1 --2- 172.21.15.22:0/3308997903 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22700c54e0 0x7f227015ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:22.021 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:22.042+0000 7f2278144640 1 --2- 172.21.15.22:0/3308997903 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2270155b40 0x7f2270071700 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:22.021 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:22.042+0000 7f2278144640 1 -- 172.21.15.22:0/3308997903 >> 172.21.15.22:0/3308997903 conn(0x7f2270072090 msgr2=0x7f22700724a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:22.021 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:22.042+0000 7f2278144640 1 -- 172.21.15.22:0/3308997903 shutdown_connections 2024-05-21T13:36:22.021 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:22.042+0000 7f2278144640 1 -- 172.21.15.22:0/3308997903 wait complete. 2024-05-21T13:36:22.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:22.046+0000 7f2278144640 1 Processor -- start 2024-05-21T13:36:22.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:22.046+0000 7f2278144640 1 -- start start 2024-05-21T13:36:22.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:22.046+0000 7f2278144640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22700c54e0 0x7f2270157740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:22.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:22.046+0000 7f2278144640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f22700c9f00 0x7f2270158100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:22.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:22.046+0000 7f2278144640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2270155b40 0x7f22701f16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:22.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:22.046+0000 7f2278144640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f227015bfb0 con 0x7f22700c9f00 2024-05-21T13:36:22.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:22.046+0000 7f2278144640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f2270071210 con 0x7f2270155b40 2024-05-21T13:36:22.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:22.046+0000 7f2278144640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f227015c130 con 0x7f22700c54e0 2024-05-21T13:36:22.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:22.046+0000 7f22756df640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f22700c9f00 0x7f2270158100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:22.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:22.046+0000 7f22756df640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f22700c9f00 0x7f2270158100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36604/0 (socket says 172.21.15.22:36604) 2024-05-21T13:36:22.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:22.046+0000 7f22756df640 1 -- 172.21.15.22:0/654820333 learned_addr learned my addr 172.21.15.22:0/654820333 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:22.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:22.046+0000 7f2275ee0640 1 --2- 172.21.15.22:0/654820333 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22700c54e0 0x7f2270157740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:22.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:22.046+0000 7f22766e1640 1 --2- 172.21.15.22:0/654820333 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2270155b40 0x7f22701f16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:22.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:22.046+0000 7f22756df640 1 -- 172.21.15.22:0/654820333 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22700c54e0 msgr2=0x7f2270157740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:22.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:22.046+0000 7f22756df640 1 --2- 172.21.15.22:0/654820333 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22700c54e0 0x7f2270157740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:22.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:22.046+0000 7f22756df640 1 -- 172.21.15.22:0/654820333 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2270155b40 msgr2=0x7f22701f16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:22.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:22.046+0000 7f22756df640 1 --2- 172.21.15.22:0/654820333 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2270155b40 0x7f22701f16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:22.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:22.046+0000 7f22756df640 1 -- 172.21.15.22:0/654820333 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22701560d0 con 0x7f22700c9f00 2024-05-21T13:36:22.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:22.046+0000 7f22766e1640 1 --2- 172.21.15.22:0/654820333 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2270155b40 0x7f22701f16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:36:22.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:22.046+0000 7f2275ee0640 1 --2- 172.21.15.22:0/654820333 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22700c54e0 0x7f2270157740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:36:22.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:22.046+0000 7f22756df640 1 --2- 172.21.15.22:0/654820333 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f22700c9f00 0x7f2270158100 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f226000c4b0 tx=0x7f226000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:22.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:22.046+0000 7f22667fc640 1 -- 172.21.15.22:0/654820333 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2260017070 con 0x7f22700c9f00 2024-05-21T13:36:22.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:22.046+0000 7f22667fc640 1 -- 172.21.15.22:0/654820333 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2260005cf0 con 0x7f22700c9f00 2024-05-21T13:36:22.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:22.046+0000 7f2278144640 1 -- 172.21.15.22:0/654820333 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22701e4ec0 con 0x7f22700c9f00 2024-05-21T13:36:22.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:22.046+0000 7f22667fc640 1 -- 172.21.15.22:0/654820333 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2260007270 con 0x7f22700c9f00 2024-05-21T13:36:22.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:22.046+0000 7f2278144640 1 -- 172.21.15.22:0/654820333 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22701e5180 con 0x7f22700c9f00 2024-05-21T13:36:22.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:22.046+0000 7f2278144640 1 -- 172.21.15.22:0/654820333 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22700697d0 con 0x7f22700c9f00 2024-05-21T13:36:22.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:22.046+0000 7f22667fc640 1 -- 172.21.15.22:0/654820333 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f226001a070 con 0x7f22700c9f00 2024-05-21T13:36:22.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:22.050+0000 7f22667fc640 1 --2- 172.21.15.22:0/654820333 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f225406f400 0x7f22540718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:22.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:22.050+0000 7f22667fc640 1 -- 172.21.15.22:0/654820333 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f226008e850 con 0x7f22700c9f00 2024-05-21T13:36:22.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:22.050+0000 7f2275ee0640 1 --2- 172.21.15.22:0/654820333 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f225406f400 0x7f22540718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:22.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:22.050+0000 7f2275ee0640 1 --2- 172.21.15.22:0/654820333 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f225406f400 0x7f22540718c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f22680b1000 tx=0x7f22680aa000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:22.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:22.054+0000 7f22667fc640 1 -- 172.21.15.22:0/654820333 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f226005adb0 con 0x7f22700c9f00 2024-05-21T13:36:22.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:22.254+0000 7f2278144640 1 -- 172.21.15.22:0/654820333 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f22700b5630 con 0x7f22700c9f00 2024-05-21T13:36:22.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:22.894+0000 7f22667fc640 1 -- 172.21.15.22:0/654820333 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7f226005f0b0 con 0x7f22700c9f00 2024-05-21T13:36:22.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:22.894+0000 7f2278144640 1 -- 172.21.15.22:0/654820333 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f225406f400 msgr2=0x7f22540718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:22.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:22.894+0000 7f2278144640 1 --2- 172.21.15.22:0/654820333 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f225406f400 0x7f22540718c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f22680b1000 tx=0x7f22680aa000 comp rx=0 tx=0).stop 2024-05-21T13:36:22.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:22.894+0000 7f2278144640 1 -- 172.21.15.22:0/654820333 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f22700c9f00 msgr2=0x7f2270158100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:22.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:22.894+0000 7f2278144640 1 --2- 172.21.15.22:0/654820333 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f22700c9f00 0x7f2270158100 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f226000c4b0 tx=0x7f226000c970 comp rx=0 tx=0).stop 2024-05-21T13:36:22.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:22.894+0000 7f2278144640 1 -- 172.21.15.22:0/654820333 shutdown_connections 2024-05-21T13:36:22.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:22.894+0000 7f2278144640 1 --2- 172.21.15.22:0/654820333 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f225406f400 0x7f22540718c0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:22.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:22.894+0000 7f2278144640 1 --2- 172.21.15.22:0/654820333 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2270155b40 0x7f22701f16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:22.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:22.894+0000 7f2278144640 1 --2- 172.21.15.22:0/654820333 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f22700c9f00 0x7f2270158100 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:22.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:22.894+0000 7f2278144640 1 --2- 172.21.15.22:0/654820333 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22700c54e0 0x7f2270157740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:22.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:22.894+0000 7f2278144640 1 -- 172.21.15.22:0/654820333 >> 172.21.15.22:0/654820333 conn(0x7f2270072090 msgr2=0x7f22700c4cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:22.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:22.894+0000 7f2278144640 1 -- 172.21.15.22:0/654820333 shutdown_connections 2024-05-21T13:36:22.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:22.894+0000 7f2278144640 1 -- 172.21.15.22:0/654820333 wait complete. 2024-05-21T13:36:22.892 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-05-21T13:36:23.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:23.050+0000 7f0e99373640 1 Processor -- start 2024-05-21T13:36:23.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:23.050+0000 7f0e99373640 1 -- start start 2024-05-21T13:36:23.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:23.050+0000 7f0e99373640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f0e940c7440 0x7f0e940c47f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:23.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:23.050+0000 7f0e99373640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e940c7ed0 con 0x7f0e94150400 2024-05-21T13:36:23.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:23.050+0000 7f0e99373640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e940c81b0 con 0x7f0e940c9990 2024-05-21T13:36:23.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:23.050+0000 7f0e99373640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f0e940c52a0 con 0x7f0e940c7440 2024-05-21T13:36:23.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:23.050+0000 7f0e92ffd640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f0e94150400 0x7f0e9406df50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:43834/0 (socket says 172.21.15.22:43834) 2024-05-21T13:36:23.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:23.050+0000 7f0e92ffd640 1 -- 172.21.15.22:0/786375380 learned_addr learned my addr 172.21.15.22:0/786375380 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-21T13:36:23.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:23.050+0000 7f0e937fe640 1 --2- 172.21.15.22:0/786375380 >> v2:172.21.15.22:3300/0 conn(0x7f0e940c7440 0x7f0e940c47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:23.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:23.050+0000 7f0e937fe640 1 -- 172.21.15.22:0/786375380 >> v1:172.21.15.115:6789/0 conn(0x7f0e940c9990 legacy=0x7f0e941621a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:23.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:23.050+0000 7f0e937fe640 1 -- 172.21.15.22:0/786375380 >> v1:172.21.15.22:6789/0 conn(0x7f0e94150400 legacy=0x7f0e9406df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:23.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:23.050+0000 7f0e937fe640 1 -- 172.21.15.22:0/786375380 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e940c5580 con 0x7f0e940c7440 2024-05-21T13:36:23.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:23.050+0000 7f0e91ffb640 1 -- 172.21.15.22:0/786375380 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 832495466 0 0) 0x7f0e940c7ed0 con 0x7f0e94150400 2024-05-21T13:36:23.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:23.054+0000 7f0e937fe640 1 --2- 172.21.15.22:0/786375380 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e940c7440 0x7f0e940c47f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c009d90 tx=0x7f0e8c01c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d32105336d384471 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:23.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:23.054+0000 7f0e91ffb640 1 -- 172.21.15.22:0/786375380 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e8c0b2070 con 0x7f0e940c7440 2024-05-21T13:36:23.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:23.054+0000 7f0e91ffb640 1 -- 172.21.15.22:0/786375380 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e8c0a5720 con 0x7f0e940c7440 2024-05-21T13:36:23.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:23.054+0000 7f0e91ffb640 1 -- 172.21.15.22:0/786375380 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e8c0a5af0 con 0x7f0e940c7440 2024-05-21T13:36:23.032 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:23.054+0000 7f0e99373640 1 -- 172.21.15.22:0/786375380 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e940c7440 msgr2=0x7f0e940c47f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:23.032 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:23.054+0000 7f0e99373640 1 --2- 172.21.15.22:0/786375380 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e940c7440 0x7f0e940c47f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c009d90 tx=0x7f0e8c01c970 comp rx=0 tx=0).stop 2024-05-21T13:36:23.032 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:23.054+0000 7f0e99373640 1 -- 172.21.15.22:0/786375380 shutdown_connections 2024-05-21T13:36:23.032 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:23.054+0000 7f0e99373640 1 --2- 172.21.15.22:0/786375380 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e940c7440 0x7f0e940c47f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:23.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:23.054+0000 7f0e99373640 1 -- 172.21.15.22:0/786375380 >> 172.21.15.22:0/786375380 conn(0x7f0e9406cc50 msgr2=0x7f0e940cd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:23.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:23.054+0000 7f0e99373640 1 -- 172.21.15.22:0/786375380 shutdown_connections 2024-05-21T13:36:23.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:23.054+0000 7f0e99373640 1 -- 172.21.15.22:0/786375380 wait complete. 2024-05-21T13:36:23.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:23.054+0000 7f0e99373640 1 Processor -- start 2024-05-21T13:36:23.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:23.054+0000 7f0e99373640 1 -- start start 2024-05-21T13:36:23.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:23.058+0000 7f0e99373640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e940c7440 0x7f0e941423d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:23.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:23.058+0000 7f0e99373640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e940c9990 0x7f0e9415c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:23.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:23.058+0000 7f0e99373640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e94150400 0x7f0e94144e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:23.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:23.058+0000 7f0e99373640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f0e94168270 con 0x7f0e94150400 2024-05-21T13:36:23.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:23.058+0000 7f0e99373640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f0e941680f0 con 0x7f0e940c9990 2024-05-21T13:36:23.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:23.058+0000 7f0e99373640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f0e941683f0 con 0x7f0e940c7440 2024-05-21T13:36:23.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:23.058+0000 7f0e937fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e94150400 0x7f0e94144e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:23.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:23.058+0000 7f0e937fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e94150400 0x7f0e94144e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36620/0 (socket says 172.21.15.22:36620) 2024-05-21T13:36:23.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:23.058+0000 7f0e937fe640 1 -- 172.21.15.22:0/3994171516 learned_addr learned my addr 172.21.15.22:0/3994171516 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:23.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:23.058+0000 7f0e92ffd640 1 --2- 172.21.15.22:0/3994171516 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e940c7440 0x7f0e941423d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:23.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:23.058+0000 7f0e927fc640 1 --2- 172.21.15.22:0/3994171516 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e940c9990 0x7f0e9415c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:23.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:23.058+0000 7f0e937fe640 1 -- 172.21.15.22:0/3994171516 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e940c7440 msgr2=0x7f0e941423d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:23.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:23.058+0000 7f0e937fe640 1 --2- 172.21.15.22:0/3994171516 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e940c7440 0x7f0e941423d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:23.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:23.058+0000 7f0e937fe640 1 -- 172.21.15.22:0/3994171516 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e940c9990 msgr2=0x7f0e9415c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:23.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:23.058+0000 7f0e937fe640 1 --2- 172.21.15.22:0/3994171516 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e940c9990 0x7f0e9415c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:23.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:23.058+0000 7f0e937fe640 1 -- 172.21.15.22:0/3994171516 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e9413dbb0 con 0x7f0e94150400 2024-05-21T13:36:23.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:23.058+0000 7f0e92ffd640 1 --2- 172.21.15.22:0/3994171516 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e940c7440 0x7f0e941423d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:36:23.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:23.058+0000 7f0e927fc640 1 --2- 172.21.15.22:0/3994171516 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e940c9990 0x7f0e9415c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:36:23.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:23.058+0000 7f0e937fe640 1 --2- 172.21.15.22:0/3994171516 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e94150400 0x7f0e94144e90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c0b0040 tx=0x7f0e8c019710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:23.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:23.058+0000 7f0e7b7fe640 1 -- 172.21.15.22:0/3994171516 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e8c0b2050 con 0x7f0e94150400 2024-05-21T13:36:23.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:23.058+0000 7f0e7b7fe640 1 -- 172.21.15.22:0/3994171516 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0e8c0be070 con 0x7f0e94150400 2024-05-21T13:36:23.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:23.058+0000 7f0e99373640 1 -- 172.21.15.22:0/3994171516 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e9413de90 con 0x7f0e94150400 2024-05-21T13:36:23.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:23.058+0000 7f0e7b7fe640 1 -- 172.21.15.22:0/3994171516 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e8c0ada90 con 0x7f0e94150400 2024-05-21T13:36:23.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:23.058+0000 7f0e99373640 1 -- 172.21.15.22:0/3994171516 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e9413e450 con 0x7f0e94150400 2024-05-21T13:36:23.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:23.058+0000 7f0e99373640 1 -- 172.21.15.22:0/3994171516 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e940766d0 con 0x7f0e94150400 2024-05-21T13:36:23.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:23.058+0000 7f0e7b7fe640 1 -- 172.21.15.22:0/3994171516 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f0e8c0adc30 con 0x7f0e94150400 2024-05-21T13:36:23.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:23.058+0000 7f0e7b7fe640 1 --2- 172.21.15.22:0/3994171516 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f0e8006f400 0x7f0e800718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:23.039 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:23.058+0000 7f0e7b7fe640 1 -- 172.21.15.22:0/3994171516 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f0e8c12a720 con 0x7f0e94150400 2024-05-21T13:36:23.039 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:23.058+0000 7f0e92ffd640 1 --2- 172.21.15.22:0/3994171516 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f0e8006f400 0x7f0e800718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:23.039 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:23.062+0000 7f0e92ffd640 1 --2- 172.21.15.22:0/3994171516 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f0e8006f400 0x7f0e800718c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0e84000f70 tx=0x7f0e84009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:23.041 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:23.062+0000 7f0e7b7fe640 1 -- 172.21.15.22:0/3994171516 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f0e8c016560 con 0x7f0e94150400 2024-05-21T13:36:23.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:23.262+0000 7f0e99373640 1 -- 172.21.15.22:0/3994171516 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f0e94077bb0 con 0x7f0e94150400 2024-05-21T13:36:23.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:23.894+0000 7f0e7b7fe640 1 -- 172.21.15.22:0/3994171516 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v11) ==== 115+0+0 (secure 0 0 0) 0x7f0e8c0f7390 con 0x7f0e94150400 2024-05-21T13:36:23.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:23.898+0000 7f0e99373640 1 -- 172.21.15.22:0/3994171516 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f0e8006f400 msgr2=0x7f0e800718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:23.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:23.898+0000 7f0e99373640 1 --2- 172.21.15.22:0/3994171516 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f0e8006f400 0x7f0e800718c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0e84000f70 tx=0x7f0e84009040 comp rx=0 tx=0).stop 2024-05-21T13:36:23.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:23.898+0000 7f0e99373640 1 -- 172.21.15.22:0/3994171516 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e94150400 msgr2=0x7f0e94144e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:23.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:23.898+0000 7f0e99373640 1 --2- 172.21.15.22:0/3994171516 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e94150400 0x7f0e94144e90 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f0e8c0b0040 tx=0x7f0e8c019710 comp rx=0 tx=0).stop 2024-05-21T13:36:23.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:23.898+0000 7f0e99373640 1 -- 172.21.15.22:0/3994171516 shutdown_connections 2024-05-21T13:36:23.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:23.898+0000 7f0e99373640 1 --2- 172.21.15.22:0/3994171516 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f0e8006f400 0x7f0e800718c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:23.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:23.898+0000 7f0e99373640 1 --2- 172.21.15.22:0/3994171516 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0e94150400 0x7f0e94144e90 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:23.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:23.898+0000 7f0e99373640 1 --2- 172.21.15.22:0/3994171516 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0e940c9990 0x7f0e9415c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:23.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:23.898+0000 7f0e99373640 1 --2- 172.21.15.22:0/3994171516 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0e940c7440 0x7f0e941423d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:23.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:23.898+0000 7f0e99373640 1 -- 172.21.15.22:0/3994171516 >> 172.21.15.22:0/3994171516 conn(0x7f0e9406cc50 msgr2=0x7f0e94158ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:23.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:23.898+0000 7f0e99373640 1 -- 172.21.15.22:0/3994171516 shutdown_connections 2024-05-21T13:36:23.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:23.898+0000 7f0e99373640 1 -- 172.21.15.22:0/3994171516 wait complete. 2024-05-21T13:36:23.898 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-05-21T13:36:23.898 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-21T13:36:24.019 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.042+0000 7f26bb745640 1 Processor -- start 2024-05-21T13:36:24.019 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.042+0000 7f26bb745640 1 -- start start 2024-05-21T13:36:24.021 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.042+0000 7f26bb745640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f26b40ca670 0x7f26b4070630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:24.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.042+0000 7f26bb745640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26b40cb6d0 con 0x7f26b40c4520 2024-05-21T13:36:24.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.042+0000 7f26bb745640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26b415db20 con 0x7f26b4153d10 2024-05-21T13:36:24.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.042+0000 7f26bb745640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f26b40cbce0 con 0x7f26b40ca670 2024-05-21T13:36:24.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.042+0000 7f26b9ce2640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f26b40c4520 0x7f26b41642a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:43840/0 (socket says 172.21.15.22:43840) 2024-05-21T13:36:24.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.042+0000 7f26b9ce2640 1 -- 172.21.15.22:0/3454574365 learned_addr learned my addr 172.21.15.22:0/3454574365 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-21T13:36:24.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.042+0000 7f26b8ce0640 1 --2- 172.21.15.22:0/3454574365 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f26b40ca670 0x7f26b4070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:24.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.042+0000 7f26abfff640 1 -- 172.21.15.22:0/3454574365 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2664592117 0 0) 0x7f26b40cb6d0 con 0x7f26b40c4520 2024-05-21T13:36:24.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.042+0000 7f26abfff640 1 -- 172.21.15.22:0/3454574365 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f26a0003530 con 0x7f26b40c4520 2024-05-21T13:36:24.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.042+0000 7f26abfff640 1 -- 172.21.15.22:0/3454574365 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1079729194 0 0) 0x7f26a0003530 con 0x7f26b40c4520 2024-05-21T13:36:24.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.042+0000 7f26abfff640 1 -- 172.21.15.22:0/3454574365 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f26b40ca670 msgr2=0x7f26b4070630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:24.022 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.042+0000 7f26abfff640 1 --2- 172.21.15.22:0/3454574365 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f26b40ca670 0x7f26b4070630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:24.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.042+0000 7f26abfff640 1 -- 172.21.15.22:0/3454574365 >> v1:172.21.15.115:6789/0 conn(0x7f26b4153d10 legacy=0x7f26b40cf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:24.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.042+0000 7f26abfff640 1 -- 172.21.15.22:0/3454574365 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26b40cb970 con 0x7f26b40c4520 2024-05-21T13:36:24.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.042+0000 7f26abfff640 1 -- 172.21.15.22:0/3454574365 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2684847062 0 0) 0x7f26ac001a80 con 0x7f26b40c4520 2024-05-21T13:36:24.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.042+0000 7f26abfff640 1 -- 172.21.15.22:0/3454574365 >> v1:172.21.15.22:6789/0 conn(0x7f26b40c4520 legacy=0x7f26b41642a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:24.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.042+0000 7f26abfff640 1 --2- 172.21.15.22:0/3454574365 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26a0003a40 0x7f26a0003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:24.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.042+0000 7f26abfff640 1 --2- 172.21.15.22:0/3454574365 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f26b40ca670 0x7f26a0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:24.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.042+0000 7f26abfff640 1 --2- 172.21.15.22:0/3454574365 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26a0004d50 0x7f26a00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:24.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.042+0000 7f26abfff640 1 -- 172.21.15.22:0/3454574365 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f26b40cbce0 con 0x7f26a0003a40 2024-05-21T13:36:24.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.042+0000 7f26abfff640 1 -- 172.21.15.22:0/3454574365 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f26a000bb90 con 0x7f26a0004d50 2024-05-21T13:36:24.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.042+0000 7f26abfff640 1 -- 172.21.15.22:0/3454574365 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f26a000bd90 con 0x7f26b40ca670 2024-05-21T13:36:24.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.042+0000 7f26b94e1640 1 --2- 172.21.15.22:0/3454574365 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26a0003a40 0x7f26a0003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:24.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.042+0000 7f26b9ce2640 1 --2- 172.21.15.22:0/3454574365 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26a0004d50 0x7f26a00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:24.024 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.042+0000 7f26b8ce0640 1 --2- 172.21.15.22:0/3454574365 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f26b40ca670 0x7f26a0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:24.024 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.042+0000 7f26b94e1640 1 -- 172.21.15.22:0/3454574365 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f26b40ca670 msgr2=0x7f26a0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:24.024 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.042+0000 7f26b94e1640 1 --2- 172.21.15.22:0/3454574365 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f26b40ca670 0x7f26a0004810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:24.024 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.042+0000 7f26b94e1640 1 -- 172.21.15.22:0/3454574365 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26a0004d50 msgr2=0x7f26a00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:24.024 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.042+0000 7f26b94e1640 1 --2- 172.21.15.22:0/3454574365 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26a0004d50 0x7f26a00051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:24.024 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.042+0000 7f26b94e1640 1 -- 172.21.15.22:0/3454574365 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26a0003530 con 0x7f26a0003a40 2024-05-21T13:36:24.025 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.046+0000 7f26b94e1640 1 --2- 172.21.15.22:0/3454574365 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26a0003a40 0x7f26a0003e60 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f26b0001790 tx=0x7f26b001c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=950a407053f29671 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:24.025 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.046+0000 7f26abfff640 1 -- 172.21.15.22:0/3454574365 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26b00013e0 con 0x7f26a0003a40 2024-05-21T13:36:24.026 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.046+0000 7f26abfff640 1 -- 172.21.15.22:0/3454574365 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26b00052d0 con 0x7f26a0003a40 2024-05-21T13:36:24.026 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.046+0000 7f26abfff640 1 -- 172.21.15.22:0/3454574365 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26b0003820 con 0x7f26a0003a40 2024-05-21T13:36:24.026 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.046+0000 7f26bb745640 1 -- 172.21.15.22:0/3454574365 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26a0003a40 msgr2=0x7f26a0003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:24.026 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.046+0000 7f26bb745640 1 --2- 172.21.15.22:0/3454574365 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26a0003a40 0x7f26a0003e60 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f26b0001790 tx=0x7f26b001c310 comp rx=0 tx=0).stop 2024-05-21T13:36:24.026 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.046+0000 7f26b9ce2640 1 -- 172.21.15.22:0/3454574365 reap_dead start 2024-05-21T13:36:24.026 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.046+0000 7f26bb745640 1 -- 172.21.15.22:0/3454574365 shutdown_connections 2024-05-21T13:36:24.026 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.046+0000 7f26bb745640 1 -- 172.21.15.22:0/3454574365 >> 172.21.15.22:0/3454574365 conn(0x7f26b406c8f0 msgr2=0x7f26b4068260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:24.026 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.046+0000 7f26bb745640 1 -- 172.21.15.22:0/3454574365 shutdown_connections 2024-05-21T13:36:24.026 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.046+0000 7f26bb745640 1 -- 172.21.15.22:0/3454574365 wait complete. 2024-05-21T13:36:24.026 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.046+0000 7f26bb745640 1 Processor -- start 2024-05-21T13:36:24.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.046+0000 7f26bb745640 1 -- start start 2024-05-21T13:36:24.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.050+0000 7f26bb745640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26a0003a40 0x7f26b4156e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:24.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.050+0000 7f26bb745640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26b40c9310 0x7f26b4157ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:24.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.050+0000 7f26bb745640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f26b41531c0 0x7f26b414eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:24.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.050+0000 7f26bb745640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f26b40cb330 con 0x7f26a0003a40 2024-05-21T13:36:24.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.050+0000 7f26bb745640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f26b41540f0 con 0x7f26b40c9310 2024-05-21T13:36:24.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.050+0000 7f26bb745640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f26b40cfb80 con 0x7f26b41531c0 2024-05-21T13:36:24.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.050+0000 7f26b94e1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26a0003a40 0x7f26b4156e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:24.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.050+0000 7f26b94e1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26a0003a40 0x7f26b4156e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36636/0 (socket says 172.21.15.22:36636) 2024-05-21T13:36:24.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.050+0000 7f26b94e1640 1 -- 172.21.15.22:0/3819186896 learned_addr learned my addr 172.21.15.22:0/3819186896 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:24.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.050+0000 7f26b9ce2640 1 --2- 172.21.15.22:0/3819186896 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f26b41531c0 0x7f26b414eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:24.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.050+0000 7f26b94e1640 1 -- 172.21.15.22:0/3819186896 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f26b41531c0 msgr2=0x7f26b414eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:24.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.050+0000 7f26b94e1640 1 --2- 172.21.15.22:0/3819186896 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f26b41531c0 0x7f26b414eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:24.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.050+0000 7f26b8ce0640 1 --2- 172.21.15.22:0/3819186896 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26b40c9310 0x7f26b4157ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:24.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.050+0000 7f26b94e1640 1 -- 172.21.15.22:0/3819186896 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26b40c9310 msgr2=0x7f26b4157ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:24.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.050+0000 7f26b94e1640 1 --2- 172.21.15.22:0/3819186896 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26b40c9310 0x7f26b4157ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:24.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.050+0000 7f26b94e1640 1 -- 172.21.15.22:0/3819186896 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26b41f26a0 con 0x7f26a0003a40 2024-05-21T13:36:24.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.050+0000 7f26b94e1640 1 --2- 172.21.15.22:0/3819186896 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26a0003a40 0x7f26b4156e50 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f26b0005040 tx=0x7f26a0005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:24.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.050+0000 7f26a9ffb640 1 -- 172.21.15.22:0/3819186896 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26b00be070 con 0x7f26a0003a40 2024-05-21T13:36:24.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.050+0000 7f26a9ffb640 1 -- 172.21.15.22:0/3819186896 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26b0005480 con 0x7f26a0003a40 2024-05-21T13:36:24.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.050+0000 7f26bb745640 1 -- 172.21.15.22:0/3819186896 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26b40c9ac0 con 0x7f26a0003a40 2024-05-21T13:36:24.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.050+0000 7f26a9ffb640 1 -- 172.21.15.22:0/3819186896 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26b0007a60 con 0x7f26a0003a40 2024-05-21T13:36:24.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.050+0000 7f26bb745640 1 -- 172.21.15.22:0/3819186896 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26b40c97e0 con 0x7f26a0003a40 2024-05-21T13:36:24.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.050+0000 7f26bb745640 1 -- 172.21.15.22:0/3819186896 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26b4077bb0 con 0x7f26a0003a40 2024-05-21T13:36:24.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.050+0000 7f26a9ffb640 1 -- 172.21.15.22:0/3819186896 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f26b00c1070 con 0x7f26a0003a40 2024-05-21T13:36:24.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.050+0000 7f26a9ffb640 1 --2- 172.21.15.22:0/3819186896 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f269806f400 0x7f26980718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:24.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.050+0000 7f26a9ffb640 1 -- 172.21.15.22:0/3819186896 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f26b01296d0 con 0x7f26a0003a40 2024-05-21T13:36:24.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.050+0000 7f26b8ce0640 1 --2- 172.21.15.22:0/3819186896 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f269806f400 0x7f26980718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:24.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.054+0000 7f26b8ce0640 1 --2- 172.21.15.22:0/3819186896 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f269806f400 0x7f26980718c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f26b40c9710 tx=0x7f26a4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:24.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.054+0000 7f26a9ffb640 1 -- 172.21.15.22:0/3819186896 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f26b0016070 con 0x7f26a0003a40 2024-05-21T13:36:24.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.250+0000 7f26bb745640 1 -- 172.21.15.22:0/3819186896 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f26b40c6250 con 0x7f26a0003a40 2024-05-21T13:36:24.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.250+0000 7f26a9ffb640 1 -- 172.21.15.22:0/3819186896 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+6850 (secure 0 0 0) 0x7f26b00f61e0 con 0x7f26a0003a40 2024-05-21T13:36:24.228 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-21T13:36:24.228 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":11,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4224,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/355756580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":355756580},{"type":"v1","addr":"172.21.15.22:6833","nonce":355756580}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4230,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3277017116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":3277017116},{"type":"v1","addr":"172.21.15.22:6835","nonce":3277017116}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4233,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3840772609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3840772609},{"type":"v1","addr":"172.21.15.22:6837","nonce":3840772609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4248,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.115:6837/2009761279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":2009761279},{"type":"v1","addr":"172.21.15.115:6837","nonce":2009761279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-21T13:35:57.106892+0000","modified":"2024-05-21T13:36:23.266395+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1],"up":{"mds_0":4300,"mds_1":4294},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4294":{"gid":4294,"name":"b","rank":1,"incarnation":9,"state":"up:creating","state_seq":1,"addr":"172.21.15.115:6835/3894678097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3894678097},{"type":"v1","addr":"172.21.15.115:6835","nonce":3894678097}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4300":{"gid":4300,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.115:6839/1525097577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6838","nonce":1525097577},{"type":"v1","addr":"172.21.15.115:6839","nonce":1525097577}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4300,"qdb_cluster":[4300]},"id":1}]} 2024-05-21T13:36:24.228 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 11 2024-05-21T13:36:24.230 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.250+0000 7f26bb745640 1 -- 172.21.15.22:0/3819186896 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f269806f400 msgr2=0x7f26980718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:24.230 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.250+0000 7f26bb745640 1 --2- 172.21.15.22:0/3819186896 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f269806f400 0x7f26980718c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f26b40c9710 tx=0x7f26a4008040 comp rx=0 tx=0).stop 2024-05-21T13:36:24.230 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.250+0000 7f26bb745640 1 -- 172.21.15.22:0/3819186896 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26a0003a40 msgr2=0x7f26b4156e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:24.230 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.250+0000 7f26bb745640 1 --2- 172.21.15.22:0/3819186896 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26a0003a40 0x7f26b4156e50 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f26b0005040 tx=0x7f26a0005840 comp rx=0 tx=0).stop 2024-05-21T13:36:24.230 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.250+0000 7f26bb745640 1 -- 172.21.15.22:0/3819186896 shutdown_connections 2024-05-21T13:36:24.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.250+0000 7f26bb745640 1 --2- 172.21.15.22:0/3819186896 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f269806f400 0x7f26980718c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:24.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.250+0000 7f26bb745640 1 --2- 172.21.15.22:0/3819186896 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f26b41531c0 0x7f26b414eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:24.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.250+0000 7f26bb745640 1 --2- 172.21.15.22:0/3819186896 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26b40c9310 0x7f26b4157ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:24.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.250+0000 7f26bb745640 1 --2- 172.21.15.22:0/3819186896 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26a0003a40 0x7f26b4156e50 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:24.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.250+0000 7f26bb745640 1 -- 172.21.15.22:0/3819186896 >> 172.21.15.22:0/3819186896 conn(0x7f26b406c8f0 msgr2=0x7f26b415cfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:24.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.254+0000 7f26bb745640 1 -- 172.21.15.22:0/3819186896 shutdown_connections 2024-05-21T13:36:24.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.254+0000 7f26bb745640 1 -- 172.21.15.22:0/3819186896 wait complete. 2024-05-21T13:36:24.245 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-21T13:36:24.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.390+0000 7fc834a32640 1 Processor -- start 2024-05-21T13:36:24.369 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.390+0000 7fc834a32640 1 -- start start 2024-05-21T13:36:24.371 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.394+0000 7fc834a32640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc830152680 0x7fc8300cbf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:24.371 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.394+0000 7fc834a32640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc8300ccd00 0x7fc8300cd190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:24.371 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.394+0000 7fc834a32640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc8300cc6c0 con 0x7fc8300c6540 2024-05-21T13:36:24.371 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.394+0000 7fc834a32640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7fc83015c9f0 con 0x7fc8300ccd00 2024-05-21T13:36:24.371 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.394+0000 7fc834a32640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7fc83015bc30 con 0x7fc830152680 2024-05-21T13:36:24.371 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.394+0000 7fc82ed9d640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc8300ccd00 0x7fc8300cd190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:24.371 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.394+0000 7fc82e59c640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc830152680 0x7fc8300cbf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:24.371 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.394+0000 7fc82ed9d640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fc8300ccd00 0x7fc8300cd190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.22:52694/0 (socket says 172.21.15.22:52694) 2024-05-21T13:36:24.371 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.394+0000 7fc82ed9d640 1 -- 172.21.15.22:0/582936410 learned_addr learned my addr 172.21.15.22:0/582936410 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:24.371 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.394+0000 7fc82dd9b640 1 --1- 172.21.15.22:0/582936410 >> v1:172.21.15.115:6789/0 conn(0x7fc8300c6540 0x7fc8300c6d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.22:48886/0 (socket says 172.21.15.22:48886) 2024-05-21T13:36:24.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.394+0000 7fc82e59c640 1 -- 172.21.15.22:0/582936410 >> v2:172.21.15.115:3300/0 conn(0x7fc8300ccd00 msgr2=0x7fc8300cd190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:24.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.394+0000 7fc82e59c640 1 --2- 172.21.15.22:0/582936410 >> v2:172.21.15.115:3300/0 conn(0x7fc8300ccd00 0x7fc8300cd190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:24.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.394+0000 7fc82e59c640 1 -- 172.21.15.22:0/582936410 >> v1:172.21.15.115:6789/0 conn(0x7fc8300c6540 legacy=0x7fc8300c6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:24.372 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.394+0000 7fc82e59c640 1 -- 172.21.15.22:0/582936410 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc83015bf10 con 0x7fc830152680 2024-05-21T13:36:24.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.394+0000 7fc82e59c640 1 --2- 172.21.15.22:0/582936410 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc830152680 0x7fc8300cbf80 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc820009d90 tx=0x7fc82001f150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=61822d2bccbffd56 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:24.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.394+0000 7fc82d59a640 1 -- 172.21.15.22:0/582936410 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8200b4070 con 0x7fc830152680 2024-05-21T13:36:24.373 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.394+0000 7fc82d59a640 1 -- 172.21.15.22:0/582936410 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8200af600 con 0x7fc830152680 2024-05-21T13:36:24.374 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.394+0000 7fc82d59a640 1 -- 172.21.15.22:0/582936410 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8200af9d0 con 0x7fc830152680 2024-05-21T13:36:24.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.398+0000 7fc834a32640 1 -- 172.21.15.22:0/582936410 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc830152680 msgr2=0x7fc8300cbf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:24.375 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.398+0000 7fc834a32640 1 --2- 172.21.15.22:0/582936410 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc830152680 0x7fc8300cbf80 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fc820009d90 tx=0x7fc82001f150 comp rx=0 tx=0).stop 2024-05-21T13:36:24.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.398+0000 7fc834a32640 1 -- 172.21.15.22:0/582936410 shutdown_connections 2024-05-21T13:36:24.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.398+0000 7fc834a32640 1 --2- 172.21.15.22:0/582936410 >> v2:172.21.15.115:3300/0 conn(0x7fc8300ccd00 0x7fc8300cd190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:24.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.398+0000 7fc834a32640 1 --2- 172.21.15.22:0/582936410 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc830152680 0x7fc8300cbf80 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:24.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.398+0000 7fc834a32640 1 -- 172.21.15.22:0/582936410 >> 172.21.15.22:0/582936410 conn(0x7fc83006f3b0 msgr2=0x7fc83006d430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:24.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.398+0000 7fc834a32640 1 -- 172.21.15.22:0/582936410 shutdown_connections 2024-05-21T13:36:24.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.398+0000 7fc834a32640 1 -- 172.21.15.22:0/582936410 wait complete. 2024-05-21T13:36:24.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.398+0000 7fc834a32640 1 Processor -- start 2024-05-21T13:36:24.376 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.398+0000 7fc834a32640 1 -- start start 2024-05-21T13:36:24.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.398+0000 7fc834a32640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc8300c6540 0x7fc8301e6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:24.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.398+0000 7fc834a32640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc8300ccd00 0x7fc8301e7440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:24.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.398+0000 7fc834a32640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc830152680 0x7fc8301e7980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:24.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.398+0000 7fc834a32640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fc8300b43e0 con 0x7fc830152680 2024-05-21T13:36:24.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.398+0000 7fc834a32640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fc83015c4d0 con 0x7fc8300c6540 2024-05-21T13:36:24.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.398+0000 7fc834a32640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7fc8300c7450 con 0x7fc8300ccd00 2024-05-21T13:36:24.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.398+0000 7fc82ed9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc830152680 0x7fc8301e7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:24.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.398+0000 7fc82ed9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc830152680 0x7fc8301e7980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36646/0 (socket says 172.21.15.22:36646) 2024-05-21T13:36:24.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.398+0000 7fc82ed9d640 1 -- 172.21.15.22:0/829047553 learned_addr learned my addr 172.21.15.22:0/829047553 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:24.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.398+0000 7fc82dd9b640 1 --2- 172.21.15.22:0/829047553 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc8300ccd00 0x7fc8301e7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:24.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.398+0000 7fc82e59c640 1 --2- 172.21.15.22:0/829047553 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc8300c6540 0x7fc8301e6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:24.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.398+0000 7fc82ed9d640 1 -- 172.21.15.22:0/829047553 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc8300ccd00 msgr2=0x7fc8301e7440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:24.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.398+0000 7fc82ed9d640 1 --2- 172.21.15.22:0/829047553 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc8300ccd00 0x7fc8301e7440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:24.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.398+0000 7fc82ed9d640 1 -- 172.21.15.22:0/829047553 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc8300c6540 msgr2=0x7fc8301e6a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:24.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.398+0000 7fc82ed9d640 1 --2- 172.21.15.22:0/829047553 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc8300c6540 0x7fc8301e6a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:24.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.398+0000 7fc82ed9d640 1 -- 172.21.15.22:0/829047553 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8301e5b20 con 0x7fc830152680 2024-05-21T13:36:24.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.398+0000 7fc82ed9d640 1 --2- 172.21.15.22:0/829047553 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc830152680 0x7fc8301e7980 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc82800e8b0 tx=0x7fc82800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:24.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.398+0000 7fc81effd640 1 -- 172.21.15.22:0/829047553 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc828017070 con 0x7fc830152680 2024-05-21T13:36:24.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.398+0000 7fc81effd640 1 -- 172.21.15.22:0/829047553 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc82800c940 con 0x7fc830152680 2024-05-21T13:36:24.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.398+0000 7fc834a32640 1 -- 172.21.15.22:0/829047553 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc83015a900 con 0x7fc830152680 2024-05-21T13:36:24.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.398+0000 7fc81effd640 1 -- 172.21.15.22:0/829047553 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc82800cd30 con 0x7fc830152680 2024-05-21T13:36:24.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.398+0000 7fc834a32640 1 -- 172.21.15.22:0/829047553 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc83015aec0 con 0x7fc830152680 2024-05-21T13:36:24.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.402+0000 7fc834a32640 1 -- 172.21.15.22:0/829047553 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc830077bb0 con 0x7fc830152680 2024-05-21T13:36:24.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.402+0000 7fc81effd640 1 -- 172.21.15.22:0/829047553 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fc82801a070 con 0x7fc830152680 2024-05-21T13:36:24.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.402+0000 7fc81effd640 1 --2- 172.21.15.22:0/829047553 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fc81006f400 0x7fc8100718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:24.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.402+0000 7fc81effd640 1 -- 172.21.15.22:0/829047553 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fc82808f830 con 0x7fc830152680 2024-05-21T13:36:24.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.402+0000 7fc82e59c640 1 --2- 172.21.15.22:0/829047553 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fc81006f400 0x7fc8100718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:24.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.402+0000 7fc82e59c640 1 --2- 172.21.15.22:0/829047553 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fc81006f400 0x7fc8100718c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc8200b1000 tx=0x7fc8200aa000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:24.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.406+0000 7fc81effd640 1 -- 172.21.15.22:0/829047553 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fc82805be30 con 0x7fc830152680 2024-05-21T13:36:24.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.566+0000 7fc834a32640 1 -- 172.21.15.22:0/829047553 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc8301f1470 con 0x7fc830152680 2024-05-21T13:36:24.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.570+0000 7fc81effd640 1 -- 172.21.15.22:0/829047553 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18458 (secure 0 0 0) 0x7fc828060130 con 0x7fc830152680 2024-05-21T13:36:24.548 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-21T13:36:24.548 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":25,"fsid":"f2c96204-e240-4e7f-8a76-927b4f80f534","created":"2024-05-21T13:35:33.827005+0000","modified":"2024-05-21T13:36:02.190808+0000","last_up_change":"2024-05-21T13:35:44.542324+0000","last_in_change":"2024-05-21T13:35:36.061492+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-21T13:35:44.536105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-21T13:35:54.972996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-21T13:35:56.065755+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-21T13:35:59.791448+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"09157d4a-9443-4e10-bbb3-cf8ed7c42cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":222752954},{"type":"v1","addr":"172.21.15.22:6801","nonce":222752954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":222752954},{"type":"v1","addr":"172.21.15.22:6803","nonce":222752954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":222752954},{"type":"v1","addr":"172.21.15.22:6807","nonce":222752954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":222752954},{"type":"v1","addr":"172.21.15.22:6805","nonce":222752954}]},"public_addr":"172.21.15.22:6801/222752954","cluster_addr":"172.21.15.22:6803/222752954","heartbeat_back_addr":"172.21.15.22:6807/222752954","heartbeat_front_addr":"172.21.15.22:6805/222752954","state":["exists","up"]},{"osd":1,"uuid":"2a6a87c0-01ad-4a98-a538-c0a8e865b05d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":685426272},{"type":"v1","addr":"172.21.15.22:6809","nonce":685426272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":685426272},{"type":"v1","addr":"172.21.15.22:6811","nonce":685426272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":685426272},{"type":"v1","addr":"172.21.15.22:6815","nonce":685426272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":685426272},{"type":"v1","addr":"172.21.15.22:6813","nonce":685426272}]},"public_addr":"172.21.15.22:6809/685426272","cluster_addr":"172.21.15.22:6811/685426272","heartbeat_back_addr":"172.21.15.22:6815/685426272","heartbeat_front_addr":"172.21.15.22:6813/685426272","state":["exists","up"]},{"osd":2,"uuid":"4c18f931-40a4-46ac-a752-0d1be35b01a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":2092224336},{"type":"v1","addr":"172.21.15.22:6817","nonce":2092224336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":2092224336},{"type":"v1","addr":"172.21.15.22:6819","nonce":2092224336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":2092224336},{"type":"v1","addr":"172.21.15.22:6823","nonce":2092224336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":2092224336},{"type":"v1","addr":"172.21.15.22:6821","nonce":2092224336}]},"public_addr":"172.21.15.22:6817/2092224336","cluster_addr":"172.21.15.22:6819/2092224336","heartbeat_back_addr":"172.21.15.22:6823/2092224336","heartbeat_front_addr":"172.21.15.22:6821/2092224336","state":["exists","up"]},{"osd":3,"uuid":"d57ee7fd-b73e-41ec-8e3b-e62fb8898128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":1232311110},{"type":"v1","addr":"172.21.15.22:6825","nonce":1232311110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":1232311110},{"type":"v1","addr":"172.21.15.22:6827","nonce":1232311110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":1232311110},{"type":"v1","addr":"172.21.15.22:6831","nonce":1232311110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":1232311110},{"type":"v1","addr":"172.21.15.22:6829","nonce":1232311110}]},"public_addr":"172.21.15.22:6825/1232311110","cluster_addr":"172.21.15.22:6827/1232311110","heartbeat_back_addr":"172.21.15.22:6831/1232311110","heartbeat_front_addr":"172.21.15.22:6829/1232311110","state":["exists","up"]},{"osd":4,"uuid":"43c6494f-352b-42a7-b6a9-fe7e3573fab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":832695158},{"type":"v1","addr":"172.21.15.115:6801","nonce":832695158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":832695158},{"type":"v1","addr":"172.21.15.115:6803","nonce":832695158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":832695158},{"type":"v1","addr":"172.21.15.115:6807","nonce":832695158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":832695158},{"type":"v1","addr":"172.21.15.115:6805","nonce":832695158}]},"public_addr":"172.21.15.115:6801/832695158","cluster_addr":"172.21.15.115:6803/832695158","heartbeat_back_addr":"172.21.15.115:6807/832695158","heartbeat_front_addr":"172.21.15.115:6805/832695158","state":["exists","up"]},{"osd":5,"uuid":"25fc861c-593d-4d49-942a-c75c19f25994","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":1504764223},{"type":"v1","addr":"172.21.15.115:6815","nonce":1504764223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":1504764223},{"type":"v1","addr":"172.21.15.115:6823","nonce":1504764223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":1504764223},{"type":"v1","addr":"172.21.15.115:6830","nonce":1504764223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6825","nonce":1504764223},{"type":"v1","addr":"172.21.15.115:6827","nonce":1504764223}]},"public_addr":"172.21.15.115:6815/1504764223","cluster_addr":"172.21.15.115:6823/1504764223","heartbeat_back_addr":"172.21.15.115:6830/1504764223","heartbeat_front_addr":"172.21.15.115:6827/1504764223","state":["exists","up"]},{"osd":6,"uuid":"2e7fb0b8-1162-497f-bffc-e2c02b9b9ef4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":959292720},{"type":"v1","addr":"172.21.15.115:6809","nonce":959292720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":959292720},{"type":"v1","addr":"172.21.15.115:6813","nonce":959292720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":959292720},{"type":"v1","addr":"172.21.15.115:6822","nonce":959292720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":959292720},{"type":"v1","addr":"172.21.15.115:6818","nonce":959292720}]},"public_addr":"172.21.15.115:6809/959292720","cluster_addr":"172.21.15.115:6813/959292720","heartbeat_back_addr":"172.21.15.115:6822/959292720","heartbeat_front_addr":"172.21.15.115:6818/959292720","state":["exists","up"]},{"osd":7,"uuid":"a97df0dc-e370-45ce-8742-25ae31e2212e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6811","nonce":20268513},{"type":"v1","addr":"172.21.15.115:6814","nonce":20268513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":20268513},{"type":"v1","addr":"172.21.15.115:6821","nonce":20268513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6829","nonce":20268513},{"type":"v1","addr":"172.21.15.115:6831","nonce":20268513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":20268513},{"type":"v1","addr":"172.21.15.115:6826","nonce":20268513}]},"public_addr":"172.21.15.115:6814/20268513","cluster_addr":"172.21.15.115:6821/20268513","heartbeat_back_addr":"172.21.15.115:6831/20268513","heartbeat_front_addr":"172.21.15.115:6826/20268513","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.692890+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.545577+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.712724+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.681944+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.492954+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.553222+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.597022+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.601698+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-21T13:36:24.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.570+0000 7fc834a32640 1 -- 172.21.15.22:0/829047553 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fc81006f400 msgr2=0x7fc8100718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:24.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.570+0000 7fc834a32640 1 --2- 172.21.15.22:0/829047553 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fc81006f400 0x7fc8100718c0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc8200b1000 tx=0x7fc8200aa000 comp rx=0 tx=0).stop 2024-05-21T13:36:24.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.570+0000 7fc834a32640 1 -- 172.21.15.22:0/829047553 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc830152680 msgr2=0x7fc8301e7980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:24.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.570+0000 7fc834a32640 1 --2- 172.21.15.22:0/829047553 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc830152680 0x7fc8301e7980 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fc82800e8b0 tx=0x7fc82800ed70 comp rx=0 tx=0).stop 2024-05-21T13:36:24.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.570+0000 7fc834a32640 1 -- 172.21.15.22:0/829047553 shutdown_connections 2024-05-21T13:36:24.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.570+0000 7fc834a32640 1 --2- 172.21.15.22:0/829047553 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fc81006f400 0x7fc8100718c0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:24.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.570+0000 7fc834a32640 1 --2- 172.21.15.22:0/829047553 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fc830152680 0x7fc8301e7980 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:24.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.570+0000 7fc834a32640 1 --2- 172.21.15.22:0/829047553 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fc8300ccd00 0x7fc8301e7440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:24.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.570+0000 7fc834a32640 1 --2- 172.21.15.22:0/829047553 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fc8300c6540 0x7fc8301e6a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:24.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.570+0000 7fc834a32640 1 -- 172.21.15.22:0/829047553 >> 172.21.15.22:0/829047553 conn(0x7fc83006f3b0 msgr2=0x7fc8300c6d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:24.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.570+0000 7fc834a32640 1 -- 172.21.15.22:0/829047553 shutdown_connections 2024-05-21T13:36:24.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.570+0000 7fc834a32640 1 -- 172.21.15.22:0/829047553 wait complete. 2024-05-21T13:36:24.566 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-21T13:36:24.566 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-21T13:36:24.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.706+0000 7f7125d91640 1 Processor -- start 2024-05-21T13:36:24.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.706+0000 7f7125d91640 1 -- start start 2024-05-21T13:36:24.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.710+0000 7f7125d91640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f7120152cc0 0x7f71200c4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:24.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.710+0000 7f7125d91640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f71200c66b0 0x7f71200c7df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:24.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.710+0000 7f7125d91640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f71201530a0 con 0x7f71200c8330 2024-05-21T13:36:24.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.710+0000 7f7125d91640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f71201592b0 con 0x7f7120152cc0 2024-05-21T13:36:24.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.710+0000 7f7125d91640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f7120074840 con 0x7f71200c66b0 2024-05-21T13:36:24.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.710+0000 7f711ffff640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f71200c8330 0x7f71200c9e30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:43856/0 (socket says 172.21.15.22:43856) 2024-05-21T13:36:24.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.710+0000 7f711ffff640 1 -- 172.21.15.22:0/536374339 learned_addr learned my addr 172.21.15.22:0/536374339 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-21T13:36:24.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.710+0000 7f711f7fe640 1 --2- 172.21.15.22:0/536374339 >> v2:172.21.15.115:3300/0 conn(0x7f7120152cc0 0x7f71200c4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:24.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.710+0000 7f711effd640 1 --2- 172.21.15.22:0/536374339 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f71200c66b0 0x7f71200c7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:24.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.710+0000 7f711e7fc640 1 -- 172.21.15.22:0/536374339 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1029421437 0 0) 0x7f71201530a0 con 0x7f71200c8330 2024-05-21T13:36:24.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.710+0000 7f711e7fc640 1 -- 172.21.15.22:0/536374339 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7108003530 con 0x7f71200c8330 2024-05-21T13:36:24.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.710+0000 7f711e7fc640 1 -- 172.21.15.22:0/536374339 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1605141204 0 0) 0x7f7108003530 con 0x7f71200c8330 2024-05-21T13:36:24.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.710+0000 7f711e7fc640 1 -- 172.21.15.22:0/536374339 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f71200c66b0 msgr2=0x7f71200c7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:24.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.710+0000 7f711e7fc640 1 --2- 172.21.15.22:0/536374339 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f71200c66b0 0x7f71200c7df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:24.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.710+0000 7f711e7fc640 1 -- 172.21.15.22:0/536374339 >> v2:172.21.15.115:3300/0 conn(0x7f7120152cc0 msgr2=0x7f71200c4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:24.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.710+0000 7f711e7fc640 1 --2- 172.21.15.22:0/536374339 >> v2:172.21.15.115:3300/0 conn(0x7f7120152cc0 0x7f71200c4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:24.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.710+0000 7f711e7fc640 1 -- 172.21.15.22:0/536374339 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71201589a0 con 0x7f71200c8330 2024-05-21T13:36:24.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.710+0000 7f711e7fc640 1 -- 172.21.15.22:0/536374339 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2684847062 0 0) 0x7f7118001a80 con 0x7f71200c8330 2024-05-21T13:36:24.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.710+0000 7f711e7fc640 1 -- 172.21.15.22:0/536374339 >> v1:172.21.15.22:6789/0 conn(0x7f71200c8330 legacy=0x7f71200c9e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:24.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.710+0000 7f711e7fc640 1 --2- 172.21.15.22:0/536374339 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f71200c66b0 0x7f7108003a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:24.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.710+0000 7f711e7fc640 1 --2- 172.21.15.22:0/536374339 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7108003fe0 0x7f7108004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:24.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.710+0000 7f711e7fc640 1 --2- 172.21.15.22:0/536374339 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7108004d50 0x7f71080051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:24.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.710+0000 7f711e7fc640 1 -- 172.21.15.22:0/536374339 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f71201592b0 con 0x7f7108004d50 2024-05-21T13:36:24.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.710+0000 7f711e7fc640 1 -- 172.21.15.22:0/536374339 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f7120074840 con 0x7f7108003fe0 2024-05-21T13:36:24.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.710+0000 7f711e7fc640 1 -- 172.21.15.22:0/536374339 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f710800ba20 con 0x7f71200c66b0 2024-05-21T13:36:24.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.710+0000 7f711ffff640 1 --2- 172.21.15.22:0/536374339 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7108004d50 0x7f71080051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:24.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.710+0000 7f711f7fe640 1 --2- 172.21.15.22:0/536374339 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f71200c66b0 0x7f7108003a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:24.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.710+0000 7f711effd640 1 --2- 172.21.15.22:0/536374339 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7108003fe0 0x7f7108004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:24.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.710+0000 7f711ffff640 1 -- 172.21.15.22:0/536374339 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f71200c66b0 msgr2=0x7f7108003a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:24.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.710+0000 7f711ffff640 1 --2- 172.21.15.22:0/536374339 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f71200c66b0 0x7f7108003a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:24.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.710+0000 7f711ffff640 1 -- 172.21.15.22:0/536374339 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7108003fe0 msgr2=0x7f7108004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:24.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.710+0000 7f711ffff640 1 --2- 172.21.15.22:0/536374339 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7108003fe0 0x7f7108004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:24.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.710+0000 7f711ffff640 1 -- 172.21.15.22:0/536374339 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7108003530 con 0x7f7108004d50 2024-05-21T13:36:24.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.714+0000 7f711ffff640 1 --2- 172.21.15.22:0/536374339 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7108004d50 0x7f71080051d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f711800a8f0 tx=0x7f711801d340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecc988519306e114 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:24.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.714+0000 7f711e7fc640 1 -- 172.21.15.22:0/536374339 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f711800a4c0 con 0x7f7108004d50 2024-05-21T13:36:24.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.714+0000 7f711e7fc640 1 -- 172.21.15.22:0/536374339 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71180ad630 con 0x7f7108004d50 2024-05-21T13:36:24.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.714+0000 7f711e7fc640 1 -- 172.21.15.22:0/536374339 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71180ada20 con 0x7f7108004d50 2024-05-21T13:36:24.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.714+0000 7f7125d91640 1 -- 172.21.15.22:0/536374339 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7108004d50 msgr2=0x7f71080051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:24.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.714+0000 7f7125d91640 1 --2- 172.21.15.22:0/536374339 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7108004d50 0x7f71080051d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f711800a8f0 tx=0x7f711801d340 comp rx=0 tx=0).stop 2024-05-21T13:36:24.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.714+0000 7f711ffff640 1 -- 172.21.15.22:0/536374339 reap_dead start 2024-05-21T13:36:24.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.714+0000 7f7125d91640 1 -- 172.21.15.22:0/536374339 shutdown_connections 2024-05-21T13:36:24.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.714+0000 7f7125d91640 1 -- 172.21.15.22:0/536374339 >> 172.21.15.22:0/536374339 conn(0x7f712006ea10 msgr2=0x7f712006ff50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:24.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.714+0000 7f7125d91640 1 -- 172.21.15.22:0/536374339 shutdown_connections 2024-05-21T13:36:24.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.714+0000 7f7125d91640 1 -- 172.21.15.22:0/536374339 wait complete. 2024-05-21T13:36:24.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.714+0000 7f7125d91640 1 Processor -- start 2024-05-21T13:36:24.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.714+0000 7f7125d91640 1 -- start start 2024-05-21T13:36:24.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.714+0000 7f7125d91640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7120146940 0x7f71201f39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:24.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.714+0000 7f7125d91640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7120147110 0x7f71201ef8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:24.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.714+0000 7f7125d91640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f712014ed50 0x7f712014b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:24.694 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.714+0000 7f7125d91640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7120158c60 con 0x7f7120147110 2024-05-21T13:36:24.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.714+0000 7f7125d91640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f71200c8b10 con 0x7f712014ed50 2024-05-21T13:36:24.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.714+0000 7f7125d91640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f7120158f40 con 0x7f7120146940 2024-05-21T13:36:24.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.718+0000 7f711effd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7120147110 0x7f71201ef8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:24.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.718+0000 7f711ffff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f712014ed50 0x7f712014b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:24.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.718+0000 7f711effd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7120147110 0x7f71201ef8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36676/0 (socket says 172.21.15.22:36676) 2024-05-21T13:36:24.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.718+0000 7f711f7fe640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7120146940 0x7f71201f39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:24.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.718+0000 7f711effd640 1 -- 172.21.15.22:0/3658476860 learned_addr learned my addr 172.21.15.22:0/3658476860 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:24.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.718+0000 7f711effd640 1 -- 172.21.15.22:0/3658476860 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7120146940 msgr2=0x7f71201f39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:24.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.718+0000 7f711effd640 1 --2- 172.21.15.22:0/3658476860 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7120146940 0x7f71201f39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:24.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.718+0000 7f711effd640 1 -- 172.21.15.22:0/3658476860 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f712014ed50 msgr2=0x7f712014b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:24.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.718+0000 7f711effd640 1 --2- 172.21.15.22:0/3658476860 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f712014ed50 0x7f712014b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:24.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.718+0000 7f711effd640 1 -- 172.21.15.22:0/3658476860 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f712014a210 con 0x7f7120147110 2024-05-21T13:36:24.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.718+0000 7f711effd640 1 --2- 172.21.15.22:0/3658476860 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7120147110 0x7f71201ef8c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7114011590 tx=0x7f7114011a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:24.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.718+0000 7f7107fff640 1 -- 172.21.15.22:0/3658476860 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7114015930 con 0x7f7120147110 2024-05-21T13:36:24.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.718+0000 7f7107fff640 1 -- 172.21.15.22:0/3658476860 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7114015ad0 con 0x7f7120147110 2024-05-21T13:36:24.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.718+0000 7f7107fff640 1 -- 172.21.15.22:0/3658476860 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f711400f460 con 0x7f7120147110 2024-05-21T13:36:24.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.718+0000 7f7125d91640 1 -- 172.21.15.22:0/3658476860 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f712014a7b0 con 0x7f7120147110 2024-05-21T13:36:24.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.718+0000 7f7125d91640 1 -- 172.21.15.22:0/3658476860 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71201f2ed0 con 0x7f7120147110 2024-05-21T13:36:24.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.718+0000 7f7125d91640 1 -- 172.21.15.22:0/3658476860 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7120077bb0 con 0x7f7120147110 2024-05-21T13:36:24.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.718+0000 7f7107fff640 1 -- 172.21.15.22:0/3658476860 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f711400f600 con 0x7f7120147110 2024-05-21T13:36:24.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.718+0000 7f7107fff640 1 --2- 172.21.15.22:0/3658476860 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f710c06f400 0x7f710c0718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:24.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.718+0000 7f7107fff640 1 -- 172.21.15.22:0/3658476860 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f711408fdf0 con 0x7f7120147110 2024-05-21T13:36:24.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.718+0000 7f711f7fe640 1 --2- 172.21.15.22:0/3658476860 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f710c06f400 0x7f710c0718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:24.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.722+0000 7f711f7fe640 1 --2- 172.21.15.22:0/3658476860 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f710c06f400 0x7f710c0718c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7110009b60 tx=0x7f7110008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:24.701 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.722+0000 7f7107fff640 1 -- 172.21.15.22:0/3658476860 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f7114019030 con 0x7f7120147110 2024-05-21T13:36:24.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.886+0000 7f7125d91640 1 -- 172.21.15.22:0/3658476860 --> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7120148070 con 0x7f710c06f400 2024-05-21T13:36:24.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.914+0000 7f7107fff640 1 -- 172.21.15.22:0/3658476860 <== mgr.4103 v2:172.21.15.115:6832/184591771 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332596 (secure 0 0 0) 0x7f7120148070 con 0x7f710c06f400 2024-05-21T13:36:24.897 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-21T13:36:24.899 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-05-21T13:36:24.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.918+0000 7f7125d91640 1 -- 172.21.15.22:0/3658476860 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f710c06f400 msgr2=0x7f710c0718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:24.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.918+0000 7f7125d91640 1 --2- 172.21.15.22:0/3658476860 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f710c06f400 0x7f710c0718c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f7110009b60 tx=0x7f7110008040 comp rx=0 tx=0).stop 2024-05-21T13:36:24.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.918+0000 7f7125d91640 1 -- 172.21.15.22:0/3658476860 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7120147110 msgr2=0x7f71201ef8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:24.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.918+0000 7f7125d91640 1 --2- 172.21.15.22:0/3658476860 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7120147110 0x7f71201ef8c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f7114011590 tx=0x7f7114011a50 comp rx=0 tx=0).stop 2024-05-21T13:36:24.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.918+0000 7f7125d91640 1 -- 172.21.15.22:0/3658476860 shutdown_connections 2024-05-21T13:36:24.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.918+0000 7f7125d91640 1 --2- 172.21.15.22:0/3658476860 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f710c06f400 0x7f710c0718c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:24.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.918+0000 7f7125d91640 1 --2- 172.21.15.22:0/3658476860 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f712014ed50 0x7f712014b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:24.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.918+0000 7f7125d91640 1 --2- 172.21.15.22:0/3658476860 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7120147110 0x7f71201ef8c0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:24.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.918+0000 7f7125d91640 1 --2- 172.21.15.22:0/3658476860 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7120146940 0x7f71201f39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:24.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.918+0000 7f7125d91640 1 -- 172.21.15.22:0/3658476860 >> 172.21.15.22:0/3658476860 conn(0x7f712006ea10 msgr2=0x7f71200cba30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:24.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.918+0000 7f7125d91640 1 -- 172.21.15.22:0/3658476860 shutdown_connections 2024-05-21T13:36:24.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:24.918+0000 7f7125d91640 1 -- 172.21.15.22:0/3658476860 wait complete. 2024-05-21T13:36:24.917 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2024-05-21T13:36:24.507648+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235032,"kb_used_data":2208,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739688,"statfs":{"total":773094113280,"available":772853440512,"internally_reserved":0,"allocated":2260992,"data_stored":2002040,"data_compressed":66916,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1781,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005361"},"pg_stats":[{"pgid":"2.1f","version":"24'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.808373+0000","last_change":"2024-05-21T13:35:56.739488+0000","last_active":"2024-05-21T13:36:02.808373+0000","last_peered":"2024-05-21T13:36:02.808373+0000","last_clean":"2024-05-21T13:36:02.808373+0000","last_became_active":"2024-05-21T13:35:56.738481+0000","last_became_peered":"2024-05-21T13:35:56.738481+0000","last_unstale":"2024-05-21T13:36:02.808373+0000","last_undegraded":"2024-05-21T13:36:02.808373+0000","last_fullsized":"2024-05-21T13:36:02.808373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:20:48.149770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.965919+0000","last_change":"2024-05-21T13:35:57.779462+0000","last_active":"2024-05-21T13:36:02.965919+0000","last_peered":"2024-05-21T13:36:02.965919+0000","last_clean":"2024-05-21T13:36:02.965919+0000","last_became_active":"2024-05-21T13:35:57.778721+0000","last_became_peered":"2024-05-21T13:35:57.778721+0000","last_unstale":"2024-05-21T13:36:02.965919+0000","last_undegraded":"2024-05-21T13:36:02.965919+0000","last_fullsized":"2024-05-21T13:36:02.965919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:13:05.005747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.963696+0000","last_change":"2024-05-21T13:36:01.868203+0000","last_active":"2024-05-21T13:36:02.963696+0000","last_peered":"2024-05-21T13:36:02.963696+0000","last_clean":"2024-05-21T13:36:02.963696+0000","last_became_active":"2024-05-21T13:36:01.864148+0000","last_became_peered":"2024-05-21T13:36:01.864148+0000","last_unstale":"2024-05-21T13:36:02.963696+0000","last_undegraded":"2024-05-21T13:36:02.963696+0000","last_fullsized":"2024-05-21T13:36:02.963696+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T13:57:33.088920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"24'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.966254+0000","last_change":"2024-05-21T13:35:56.775054+0000","last_active":"2024-05-21T13:36:02.966254+0000","last_peered":"2024-05-21T13:36:02.966254+0000","last_clean":"2024-05-21T13:36:02.966254+0000","last_became_active":"2024-05-21T13:35:56.770566+0000","last_became_peered":"2024-05-21T13:35:56.770566+0000","last_unstale":"2024-05-21T13:36:02.966254+0000","last_undegraded":"2024-05-21T13:36:02.966254+0000","last_fullsized":"2024-05-21T13:36:02.966254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:05:11.539201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.965771+0000","last_change":"2024-05-21T13:35:57.782094+0000","last_active":"2024-05-21T13:36:02.965771+0000","last_peered":"2024-05-21T13:36:02.965771+0000","last_clean":"2024-05-21T13:36:02.965771+0000","last_became_active":"2024-05-21T13:35:57.780590+0000","last_became_peered":"2024-05-21T13:35:57.780590+0000","last_unstale":"2024-05-21T13:36:02.965771+0000","last_undegraded":"2024-05-21T13:36:02.965771+0000","last_fullsized":"2024-05-21T13:36:02.965771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:30:50.929103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.960911+0000","last_change":"2024-05-21T13:36:01.852092+0000","last_active":"2024-05-21T13:36:02.960911+0000","last_peered":"2024-05-21T13:36:02.960911+0000","last_clean":"2024-05-21T13:36:02.960911+0000","last_became_active":"2024-05-21T13:36:01.851745+0000","last_became_peered":"2024-05-21T13:36:01.851745+0000","last_unstale":"2024-05-21T13:36:02.960911+0000","last_undegraded":"2024-05-21T13:36:02.960911+0000","last_fullsized":"2024-05-21T13:36:02.960911+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:57:21.599860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"24'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.961222+0000","last_change":"2024-05-21T13:35:56.731106+0000","last_active":"2024-05-21T13:36:02.961222+0000","last_peered":"2024-05-21T13:36:02.961222+0000","last_clean":"2024-05-21T13:36:02.961222+0000","last_became_active":"2024-05-21T13:35:56.730746+0000","last_became_peered":"2024-05-21T13:35:56.730746+0000","last_unstale":"2024-05-21T13:36:02.961222+0000","last_undegraded":"2024-05-21T13:36:02.961222+0000","last_fullsized":"2024-05-21T13:36:02.961222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:23:17.798397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.963099+0000","last_change":"2024-05-21T13:35:57.771371+0000","last_active":"2024-05-21T13:36:02.963099+0000","last_peered":"2024-05-21T13:36:02.963099+0000","last_clean":"2024-05-21T13:36:02.963099+0000","last_became_active":"2024-05-21T13:35:57.770595+0000","last_became_peered":"2024-05-21T13:35:57.770595+0000","last_unstale":"2024-05-21T13:36:02.963099+0000","last_undegraded":"2024-05-21T13:36:02.963099+0000","last_fullsized":"2024-05-21T13:36:02.963099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:53:17.771310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.961202+0000","last_change":"2024-05-21T13:36:01.849638+0000","last_active":"2024-05-21T13:36:02.961202+0000","last_peered":"2024-05-21T13:36:02.961202+0000","last_clean":"2024-05-21T13:36:02.961202+0000","last_became_active":"2024-05-21T13:36:01.848996+0000","last_became_peered":"2024-05-21T13:36:01.848996+0000","last_unstale":"2024-05-21T13:36:02.961202+0000","last_undegraded":"2024-05-21T13:36:02.961202+0000","last_fullsized":"2024-05-21T13:36:02.961202+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:24:31.613874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.960165+0000","last_change":"2024-05-21T13:35:56.737279+0000","last_active":"2024-05-21T13:36:02.960165+0000","last_peered":"2024-05-21T13:36:02.960165+0000","last_clean":"2024-05-21T13:36:02.960165+0000","last_became_active":"2024-05-21T13:35:56.731150+0000","last_became_peered":"2024-05-21T13:35:56.731150+0000","last_unstale":"2024-05-21T13:36:02.960165+0000","last_undegraded":"2024-05-21T13:36:02.960165+0000","last_fullsized":"2024-05-21T13:36:02.960165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:17:07.571294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.806009+0000","last_change":"2024-05-21T13:35:57.799803+0000","last_active":"2024-05-21T13:36:02.806009+0000","last_peered":"2024-05-21T13:36:02.806009+0000","last_clean":"2024-05-21T13:36:02.806009+0000","last_became_active":"2024-05-21T13:35:57.799043+0000","last_became_peered":"2024-05-21T13:35:57.799043+0000","last_unstale":"2024-05-21T13:36:02.806009+0000","last_undegraded":"2024-05-21T13:36:02.806009+0000","last_fullsized":"2024-05-21T13:36:02.806009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:22:48.607953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.961831+0000","last_change":"2024-05-21T13:36:01.852469+0000","last_active":"2024-05-21T13:36:02.961831+0000","last_peered":"2024-05-21T13:36:02.961831+0000","last_clean":"2024-05-21T13:36:02.961831+0000","last_became_active":"2024-05-21T13:36:01.851913+0000","last_became_peered":"2024-05-21T13:36:01.851913+0000","last_unstale":"2024-05-21T13:36:02.961831+0000","last_undegraded":"2024-05-21T13:36:02.961831+0000","last_fullsized":"2024-05-21T13:36:02.961831+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:42:58.062540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.805533+0000","last_change":"2024-05-21T13:35:57.796516+0000","last_active":"2024-05-21T13:36:02.805533+0000","last_peered":"2024-05-21T13:36:02.805533+0000","last_clean":"2024-05-21T13:36:02.805533+0000","last_became_active":"2024-05-21T13:35:57.795638+0000","last_became_peered":"2024-05-21T13:35:57.795638+0000","last_unstale":"2024-05-21T13:36:02.805533+0000","last_undegraded":"2024-05-21T13:36:02.805533+0000","last_fullsized":"2024-05-21T13:36:02.805533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:46:40.541835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"24'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.805922+0000","last_change":"2024-05-21T13:35:56.748046+0000","last_active":"2024-05-21T13:36:02.805922+0000","last_peered":"2024-05-21T13:36:02.805922+0000","last_clean":"2024-05-21T13:36:02.805922+0000","last_became_active":"2024-05-21T13:35:56.747635+0000","last_became_peered":"2024-05-21T13:35:56.747635+0000","last_unstale":"2024-05-21T13:36:02.805922+0000","last_undegraded":"2024-05-21T13:36:02.805922+0000","last_fullsized":"2024-05-21T13:36:02.805922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:52:28.665244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.805864+0000","last_change":"2024-05-21T13:36:01.862153+0000","last_active":"2024-05-21T13:36:02.805864+0000","last_peered":"2024-05-21T13:36:02.805864+0000","last_clean":"2024-05-21T13:36:02.805864+0000","last_became_active":"2024-05-21T13:36:01.861520+0000","last_became_peered":"2024-05-21T13:36:01.861520+0000","last_unstale":"2024-05-21T13:36:02.805864+0000","last_undegraded":"2024-05-21T13:36:02.805864+0000","last_fullsized":"2024-05-21T13:36:02.805864+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:04:37.306132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.964897+0000","last_change":"2024-05-21T13:35:57.786463+0000","last_active":"2024-05-21T13:36:02.964897+0000","last_peered":"2024-05-21T13:36:02.964897+0000","last_clean":"2024-05-21T13:36:02.964897+0000","last_became_active":"2024-05-21T13:35:57.786126+0000","last_became_peered":"2024-05-21T13:35:57.786126+0000","last_unstale":"2024-05-21T13:36:02.964897+0000","last_undegraded":"2024-05-21T13:36:02.964897+0000","last_fullsized":"2024-05-21T13:36:02.964897+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:39:32.076464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.966843+0000","last_change":"2024-05-21T13:35:56.765178+0000","last_active":"2024-05-21T13:36:02.966843+0000","last_peered":"2024-05-21T13:36:02.966843+0000","last_clean":"2024-05-21T13:36:02.966843+0000","last_became_active":"2024-05-21T13:35:56.764551+0000","last_became_peered":"2024-05-21T13:35:56.764551+0000","last_unstale":"2024-05-21T13:36:02.966843+0000","last_undegraded":"2024-05-21T13:36:02.966843+0000","last_fullsized":"2024-05-21T13:36:02.966843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:34:28.955222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.959609+0000","last_change":"2024-05-21T13:36:01.854410+0000","last_active":"2024-05-21T13:36:02.959609+0000","last_peered":"2024-05-21T13:36:02.959609+0000","last_clean":"2024-05-21T13:36:02.959609+0000","last_became_active":"2024-05-21T13:36:01.853975+0000","last_became_peered":"2024-05-21T13:36:01.853975+0000","last_unstale":"2024-05-21T13:36:02.959609+0000","last_undegraded":"2024-05-21T13:36:02.959609+0000","last_fullsized":"2024-05-21T13:36:02.959609+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:15:34.710504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.807180+0000","last_change":"2024-05-21T13:35:57.762509+0000","last_active":"2024-05-21T13:36:02.807180+0000","last_peered":"2024-05-21T13:36:02.807180+0000","last_clean":"2024-05-21T13:36:02.807180+0000","last_became_active":"2024-05-21T13:35:57.761739+0000","last_became_peered":"2024-05-21T13:35:57.761739+0000","last_unstale":"2024-05-21T13:36:02.807180+0000","last_undegraded":"2024-05-21T13:36:02.807180+0000","last_fullsized":"2024-05-21T13:36:02.807180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:41:17.911126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.807410+0000","last_change":"2024-05-21T13:35:56.734017+0000","last_active":"2024-05-21T13:36:02.807410+0000","last_peered":"2024-05-21T13:36:02.807410+0000","last_clean":"2024-05-21T13:36:02.807410+0000","last_became_active":"2024-05-21T13:35:56.733249+0000","last_became_peered":"2024-05-21T13:35:56.733249+0000","last_unstale":"2024-05-21T13:36:02.807410+0000","last_undegraded":"2024-05-21T13:36:02.807410+0000","last_fullsized":"2024-05-21T13:36:02.807410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:13:27.279557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.967145+0000","last_change":"2024-05-21T13:36:01.868669+0000","last_active":"2024-05-21T13:36:02.967145+0000","last_peered":"2024-05-21T13:36:02.967145+0000","last_clean":"2024-05-21T13:36:02.967145+0000","last_became_active":"2024-05-21T13:36:01.867701+0000","last_became_peered":"2024-05-21T13:36:01.867701+0000","last_unstale":"2024-05-21T13:36:02.967145+0000","last_undegraded":"2024-05-21T13:36:02.967145+0000","last_fullsized":"2024-05-21T13:36:02.967145+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:09:21.615570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.804889+0000","last_change":"2024-05-21T13:35:57.789966+0000","last_active":"2024-05-21T13:36:02.804889+0000","last_peered":"2024-05-21T13:36:02.804889+0000","last_clean":"2024-05-21T13:36:02.804889+0000","last_became_active":"2024-05-21T13:35:57.789213+0000","last_became_peered":"2024-05-21T13:35:57.789213+0000","last_unstale":"2024-05-21T13:36:02.804889+0000","last_undegraded":"2024-05-21T13:36:02.804889+0000","last_fullsized":"2024-05-21T13:36:02.804889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:33:24.183958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.959018+0000","last_change":"2024-05-21T13:35:56.746878+0000","last_active":"2024-05-21T13:36:02.959018+0000","last_peered":"2024-05-21T13:36:02.959018+0000","last_clean":"2024-05-21T13:36:02.959018+0000","last_became_active":"2024-05-21T13:35:56.746534+0000","last_became_peered":"2024-05-21T13:35:56.746534+0000","last_unstale":"2024-05-21T13:36:02.959018+0000","last_undegraded":"2024-05-21T13:36:02.959018+0000","last_fullsized":"2024-05-21T13:36:02.959018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:45:56.935415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.961481+0000","last_change":"2024-05-21T13:36:01.841632+0000","last_active":"2024-05-21T13:36:02.961481+0000","last_peered":"2024-05-21T13:36:02.961481+0000","last_clean":"2024-05-21T13:36:02.961481+0000","last_became_active":"2024-05-21T13:36:01.841216+0000","last_became_peered":"2024-05-21T13:36:01.841216+0000","last_unstale":"2024-05-21T13:36:02.961481+0000","last_undegraded":"2024-05-21T13:36:02.961481+0000","last_fullsized":"2024-05-21T13:36:02.961481+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:49:05.576221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.807962+0000","last_change":"2024-05-21T13:35:57.764793+0000","last_active":"2024-05-21T13:36:02.807962+0000","last_peered":"2024-05-21T13:36:02.807962+0000","last_clean":"2024-05-21T13:36:02.807962+0000","last_became_active":"2024-05-21T13:35:57.764017+0000","last_became_peered":"2024-05-21T13:35:57.764017+0000","last_unstale":"2024-05-21T13:36:02.807962+0000","last_undegraded":"2024-05-21T13:36:02.807962+0000","last_fullsized":"2024-05-21T13:36:02.807962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:25:45.006614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"24'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.808160+0000","last_change":"2024-05-21T13:35:56.752278+0000","last_active":"2024-05-21T13:36:02.808160+0000","last_peered":"2024-05-21T13:36:02.808160+0000","last_clean":"2024-05-21T13:36:02.808160+0000","last_became_active":"2024-05-21T13:35:56.751883+0000","last_became_peered":"2024-05-21T13:35:56.751883+0000","last_unstale":"2024-05-21T13:36:02.808160+0000","last_undegraded":"2024-05-21T13:36:02.808160+0000","last_fullsized":"2024-05-21T13:36:02.808160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:08:05.279701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.961503+0000","last_change":"2024-05-21T13:36:01.832621+0000","last_active":"2024-05-21T13:36:02.961503+0000","last_peered":"2024-05-21T13:36:02.961503+0000","last_clean":"2024-05-21T13:36:02.961503+0000","last_became_active":"2024-05-21T13:36:01.831609+0000","last_became_peered":"2024-05-21T13:36:01.831609+0000","last_unstale":"2024-05-21T13:36:02.961503+0000","last_undegraded":"2024-05-21T13:36:02.961503+0000","last_fullsized":"2024-05-21T13:36:02.961503+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:26:43.075259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.808212+0000","last_change":"2024-05-21T13:35:57.783487+0000","last_active":"2024-05-21T13:36:02.808212+0000","last_peered":"2024-05-21T13:36:02.808212+0000","last_clean":"2024-05-21T13:36:02.808212+0000","last_became_active":"2024-05-21T13:35:57.783150+0000","last_became_peered":"2024-05-21T13:35:57.783150+0000","last_unstale":"2024-05-21T13:36:02.808212+0000","last_undegraded":"2024-05-21T13:36:02.808212+0000","last_fullsized":"2024-05-21T13:36:02.808212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:14:56.991945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.808184+0000","last_change":"2024-05-21T13:35:56.745122+0000","last_active":"2024-05-21T13:36:02.808184+0000","last_peered":"2024-05-21T13:36:02.808184+0000","last_clean":"2024-05-21T13:36:02.808184+0000","last_became_active":"2024-05-21T13:35:56.744218+0000","last_became_peered":"2024-05-21T13:35:56.744218+0000","last_unstale":"2024-05-21T13:36:02.808184+0000","last_undegraded":"2024-05-21T13:36:02.808184+0000","last_fullsized":"2024-05-21T13:36:02.808184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:45:03.790591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.807106+0000","last_change":"2024-05-21T13:36:01.838971+0000","last_active":"2024-05-21T13:36:02.807106+0000","last_peered":"2024-05-21T13:36:02.807106+0000","last_clean":"2024-05-21T13:36:02.807106+0000","last_became_active":"2024-05-21T13:36:01.837401+0000","last_became_peered":"2024-05-21T13:36:01.837401+0000","last_unstale":"2024-05-21T13:36:02.807106+0000","last_undegraded":"2024-05-21T13:36:02.807106+0000","last_fullsized":"2024-05-21T13:36:02.807106+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:16:25.666568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.967981+0000","last_change":"2024-05-21T13:35:57.784993+0000","last_active":"2024-05-21T13:36:02.967981+0000","last_peered":"2024-05-21T13:36:02.967981+0000","last_clean":"2024-05-21T13:36:02.967981+0000","last_became_active":"2024-05-21T13:35:57.784664+0000","last_became_peered":"2024-05-21T13:35:57.784664+0000","last_unstale":"2024-05-21T13:36:02.967981+0000","last_undegraded":"2024-05-21T13:36:02.967981+0000","last_fullsized":"2024-05-21T13:36:02.967981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:58:20.045901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.806794+0000","last_change":"2024-05-21T13:35:56.741285+0000","last_active":"2024-05-21T13:36:02.806794+0000","last_peered":"2024-05-21T13:36:02.806794+0000","last_clean":"2024-05-21T13:36:02.806794+0000","last_became_active":"2024-05-21T13:35:56.740846+0000","last_became_peered":"2024-05-21T13:35:56.740846+0000","last_unstale":"2024-05-21T13:36:02.806794+0000","last_undegraded":"2024-05-21T13:36:02.806794+0000","last_fullsized":"2024-05-21T13:36:02.806794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:34:17.960870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.963587+0000","last_change":"2024-05-21T13:36:01.873172+0000","last_active":"2024-05-21T13:36:02.963587+0000","last_peered":"2024-05-21T13:36:02.963587+0000","last_clean":"2024-05-21T13:36:02.963587+0000","last_became_active":"2024-05-21T13:36:01.872085+0000","last_became_peered":"2024-05-21T13:36:01.872085+0000","last_unstale":"2024-05-21T13:36:02.963587+0000","last_undegraded":"2024-05-21T13:36:02.963587+0000","last_fullsized":"2024-05-21T13:36:02.963587+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:24:57.031323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.961092+0000","last_change":"2024-05-21T13:35:57.783176+0000","last_active":"2024-05-21T13:36:02.961092+0000","last_peered":"2024-05-21T13:36:02.961092+0000","last_clean":"2024-05-21T13:36:02.961092+0000","last_became_active":"2024-05-21T13:35:57.782517+0000","last_became_peered":"2024-05-21T13:35:57.782517+0000","last_unstale":"2024-05-21T13:36:02.961092+0000","last_undegraded":"2024-05-21T13:36:02.961092+0000","last_fullsized":"2024-05-21T13:36:02.961092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:06:58.203996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.964483+0000","last_change":"2024-05-21T13:35:56.767544+0000","last_active":"2024-05-21T13:36:02.964483+0000","last_peered":"2024-05-21T13:36:02.964483+0000","last_clean":"2024-05-21T13:36:02.964483+0000","last_became_active":"2024-05-21T13:35:56.764987+0000","last_became_peered":"2024-05-21T13:35:56.764987+0000","last_unstale":"2024-05-21T13:36:02.964483+0000","last_undegraded":"2024-05-21T13:36:02.964483+0000","last_fullsized":"2024-05-21T13:36:02.964483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:12:46.828769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.966223+0000","last_change":"2024-05-21T13:36:01.872215+0000","last_active":"2024-05-21T13:36:02.966223+0000","last_peered":"2024-05-21T13:36:02.966223+0000","last_clean":"2024-05-21T13:36:02.966223+0000","last_became_active":"2024-05-21T13:36:01.870831+0000","last_became_peered":"2024-05-21T13:36:01.870831+0000","last_unstale":"2024-05-21T13:36:02.966223+0000","last_undegraded":"2024-05-21T13:36:02.966223+0000","last_fullsized":"2024-05-21T13:36:02.966223+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:04:09.689206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.959882+0000","last_change":"2024-05-21T13:35:57.783616+0000","last_active":"2024-05-21T13:36:02.959882+0000","last_peered":"2024-05-21T13:36:02.959882+0000","last_clean":"2024-05-21T13:36:02.959882+0000","last_became_active":"2024-05-21T13:35:57.780521+0000","last_became_peered":"2024-05-21T13:35:57.780521+0000","last_unstale":"2024-05-21T13:36:02.959882+0000","last_undegraded":"2024-05-21T13:36:02.959882+0000","last_fullsized":"2024-05-21T13:36:02.959882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:59:44.121631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.806771+0000","last_change":"2024-05-21T13:35:56.750341+0000","last_active":"2024-05-21T13:36:02.806771+0000","last_peered":"2024-05-21T13:36:02.806771+0000","last_clean":"2024-05-21T13:36:02.806771+0000","last_became_active":"2024-05-21T13:35:56.750006+0000","last_became_peered":"2024-05-21T13:35:56.750006+0000","last_unstale":"2024-05-21T13:36:02.806771+0000","last_undegraded":"2024-05-21T13:36:02.806771+0000","last_fullsized":"2024-05-21T13:36:02.806771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:15:21.416234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.967726+0000","last_change":"2024-05-21T13:36:01.873693+0000","last_active":"2024-05-21T13:36:02.967726+0000","last_peered":"2024-05-21T13:36:02.967726+0000","last_clean":"2024-05-21T13:36:02.967726+0000","last_became_active":"2024-05-21T13:36:01.872363+0000","last_became_peered":"2024-05-21T13:36:01.872363+0000","last_unstale":"2024-05-21T13:36:02.967726+0000","last_undegraded":"2024-05-21T13:36:02.967726+0000","last_fullsized":"2024-05-21T13:36:02.967726+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:27:25.974289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.961878+0000","last_change":"2024-05-21T13:35:57.780809+0000","last_active":"2024-05-21T13:36:02.961878+0000","last_peered":"2024-05-21T13:36:02.961878+0000","last_clean":"2024-05-21T13:36:02.961878+0000","last_became_active":"2024-05-21T13:35:57.780313+0000","last_became_peered":"2024-05-21T13:35:57.780313+0000","last_unstale":"2024-05-21T13:36:02.961878+0000","last_undegraded":"2024-05-21T13:36:02.961878+0000","last_fullsized":"2024-05-21T13:36:02.961878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:43:11.778238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.964084+0000","last_change":"2024-05-21T13:35:56.771138+0000","last_active":"2024-05-21T13:36:02.964084+0000","last_peered":"2024-05-21T13:36:02.964084+0000","last_clean":"2024-05-21T13:36:02.964084+0000","last_became_active":"2024-05-21T13:35:56.770465+0000","last_became_peered":"2024-05-21T13:35:56.770465+0000","last_unstale":"2024-05-21T13:36:02.964084+0000","last_undegraded":"2024-05-21T13:36:02.964084+0000","last_fullsized":"2024-05-21T13:36:02.964084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:21:16.702309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.968200+0000","last_change":"2024-05-21T13:36:01.871328+0000","last_active":"2024-05-21T13:36:02.968200+0000","last_peered":"2024-05-21T13:36:02.968200+0000","last_clean":"2024-05-21T13:36:02.968200+0000","last_became_active":"2024-05-21T13:36:01.870678+0000","last_became_peered":"2024-05-21T13:36:01.870678+0000","last_unstale":"2024-05-21T13:36:02.968200+0000","last_undegraded":"2024-05-21T13:36:02.968200+0000","last_fullsized":"2024-05-21T13:36:02.968200+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:22:47.393065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.962506+0000","last_change":"2024-05-21T13:35:57.782665+0000","last_active":"2024-05-21T13:36:02.962506+0000","last_peered":"2024-05-21T13:36:02.962506+0000","last_clean":"2024-05-21T13:36:02.962506+0000","last_became_active":"2024-05-21T13:35:57.781299+0000","last_became_peered":"2024-05-21T13:35:57.781299+0000","last_unstale":"2024-05-21T13:36:02.962506+0000","last_undegraded":"2024-05-21T13:36:02.962506+0000","last_fullsized":"2024-05-21T13:36:02.962506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:21:22.721124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.805211+0000","last_change":"2024-05-21T13:35:56.768193+0000","last_active":"2024-05-21T13:36:02.805211+0000","last_peered":"2024-05-21T13:36:02.805211+0000","last_clean":"2024-05-21T13:36:02.805211+0000","last_became_active":"2024-05-21T13:35:56.767788+0000","last_became_peered":"2024-05-21T13:35:56.767788+0000","last_unstale":"2024-05-21T13:36:02.805211+0000","last_undegraded":"2024-05-21T13:36:02.805211+0000","last_fullsized":"2024-05-21T13:36:02.805211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:12:52.911816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.965762+0000","last_change":"2024-05-21T13:36:01.860305+0000","last_active":"2024-05-21T13:36:02.965762+0000","last_peered":"2024-05-21T13:36:02.965762+0000","last_clean":"2024-05-21T13:36:02.965762+0000","last_became_active":"2024-05-21T13:36:01.859141+0000","last_became_peered":"2024-05-21T13:36:01.859141+0000","last_unstale":"2024-05-21T13:36:02.965762+0000","last_undegraded":"2024-05-21T13:36:02.965762+0000","last_fullsized":"2024-05-21T13:36:02.965762+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:05:45.203241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.807817+0000","last_change":"2024-05-21T13:35:57.775523+0000","last_active":"2024-05-21T13:36:02.807817+0000","last_peered":"2024-05-21T13:36:02.807817+0000","last_clean":"2024-05-21T13:36:02.807817+0000","last_became_active":"2024-05-21T13:35:57.774322+0000","last_became_peered":"2024-05-21T13:35:57.774322+0000","last_unstale":"2024-05-21T13:36:02.807817+0000","last_undegraded":"2024-05-21T13:36:02.807817+0000","last_fullsized":"2024-05-21T13:36:02.807817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:06:35.118540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.806599+0000","last_change":"2024-05-21T13:35:56.748185+0000","last_active":"2024-05-21T13:36:02.806599+0000","last_peered":"2024-05-21T13:36:02.806599+0000","last_clean":"2024-05-21T13:36:02.806599+0000","last_became_active":"2024-05-21T13:35:56.747823+0000","last_became_peered":"2024-05-21T13:35:56.747823+0000","last_unstale":"2024-05-21T13:36:02.806599+0000","last_undegraded":"2024-05-21T13:36:02.806599+0000","last_fullsized":"2024-05-21T13:36:02.806599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:38:00.235330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":117,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.963125+0000","last_change":"2024-05-21T13:35:45.682484+0000","last_active":"2024-05-21T13:36:02.963125+0000","last_peered":"2024-05-21T13:36:02.963125+0000","last_clean":"2024-05-21T13:36:02.963125+0000","last_became_active":"2024-05-21T13:35:45.680732+0000","last_became_peered":"2024-05-21T13:35:45.680732+0000","last_unstale":"2024-05-21T13:36:02.963125+0000","last_undegraded":"2024-05-21T13:36:02.963125+0000","last_fullsized":"2024-05-21T13:36:02.963125+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:44.542324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:44.542324+0000","last_clean_scrub_stamp":"2024-05-21T13:35:44.542324+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:16:05.034161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.806631+0000","last_change":"2024-05-21T13:36:01.830034+0000","last_active":"2024-05-21T13:36:02.806631+0000","last_peered":"2024-05-21T13:36:02.806631+0000","last_clean":"2024-05-21T13:36:02.806631+0000","last_became_active":"2024-05-21T13:36:01.828957+0000","last_became_peered":"2024-05-21T13:36:01.828957+0000","last_unstale":"2024-05-21T13:36:02.806631+0000","last_undegraded":"2024-05-21T13:36:02.806631+0000","last_fullsized":"2024-05-21T13:36:02.806631+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:21:59.514268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.806258+0000","last_change":"2024-05-21T13:35:57.796419+0000","last_active":"2024-05-21T13:36:02.806258+0000","last_peered":"2024-05-21T13:36:02.806258+0000","last_clean":"2024-05-21T13:36:02.806258+0000","last_became_active":"2024-05-21T13:35:57.796050+0000","last_became_peered":"2024-05-21T13:35:57.796050+0000","last_unstale":"2024-05-21T13:36:02.806258+0000","last_undegraded":"2024-05-21T13:36:02.806258+0000","last_fullsized":"2024-05-21T13:36:02.806258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:56:07.121391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.968145+0000","last_change":"2024-05-21T13:35:56.751619+0000","last_active":"2024-05-21T13:36:02.968145+0000","last_peered":"2024-05-21T13:36:02.968145+0000","last_clean":"2024-05-21T13:36:02.968145+0000","last_became_active":"2024-05-21T13:35:56.748604+0000","last_became_peered":"2024-05-21T13:35:56.748604+0000","last_unstale":"2024-05-21T13:36:02.968145+0000","last_undegraded":"2024-05-21T13:36:02.968145+0000","last_fullsized":"2024-05-21T13:36:02.968145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:19:03.052434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.961835+0000","last_change":"2024-05-21T13:36:01.825464+0000","last_active":"2024-05-21T13:36:02.961835+0000","last_peered":"2024-05-21T13:36:02.961835+0000","last_clean":"2024-05-21T13:36:02.961835+0000","last_became_active":"2024-05-21T13:36:01.824653+0000","last_became_peered":"2024-05-21T13:36:01.824653+0000","last_unstale":"2024-05-21T13:36:02.961835+0000","last_undegraded":"2024-05-21T13:36:02.961835+0000","last_fullsized":"2024-05-21T13:36:02.961835+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:29:32.830052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.960114+0000","last_change":"2024-05-21T13:35:57.784031+0000","last_active":"2024-05-21T13:36:02.960114+0000","last_peered":"2024-05-21T13:36:02.960114+0000","last_clean":"2024-05-21T13:36:02.960114+0000","last_became_active":"2024-05-21T13:35:57.771695+0000","last_became_peered":"2024-05-21T13:35:57.771695+0000","last_unstale":"2024-05-21T13:36:02.960114+0000","last_undegraded":"2024-05-21T13:36:02.960114+0000","last_fullsized":"2024-05-21T13:36:02.960114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:46:33.308257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.965392+0000","last_change":"2024-05-21T13:35:56.768166+0000","last_active":"2024-05-21T13:36:02.965392+0000","last_peered":"2024-05-21T13:36:02.965392+0000","last_clean":"2024-05-21T13:36:02.965392+0000","last_became_active":"2024-05-21T13:35:56.767053+0000","last_became_peered":"2024-05-21T13:35:56.767053+0000","last_unstale":"2024-05-21T13:36:02.965392+0000","last_undegraded":"2024-05-21T13:36:02.965392+0000","last_fullsized":"2024-05-21T13:36:02.965392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:10:16.639491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.963683+0000","last_change":"2024-05-21T13:36:01.834253+0000","last_active":"2024-05-21T13:36:02.963683+0000","last_peered":"2024-05-21T13:36:02.963683+0000","last_clean":"2024-05-21T13:36:02.963683+0000","last_became_active":"2024-05-21T13:36:01.832972+0000","last_became_peered":"2024-05-21T13:36:01.832972+0000","last_unstale":"2024-05-21T13:36:02.963683+0000","last_undegraded":"2024-05-21T13:36:02.963683+0000","last_fullsized":"2024-05-21T13:36:02.963683+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:52:05.576063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.960150+0000","last_change":"2024-05-21T13:35:57.766504+0000","last_active":"2024-05-21T13:36:02.960150+0000","last_peered":"2024-05-21T13:36:02.960150+0000","last_clean":"2024-05-21T13:36:02.960150+0000","last_became_active":"2024-05-21T13:35:57.765756+0000","last_became_peered":"2024-05-21T13:35:57.765756+0000","last_unstale":"2024-05-21T13:36:02.960150+0000","last_undegraded":"2024-05-21T13:36:02.960150+0000","last_fullsized":"2024-05-21T13:36:02.960150+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:52:13.025110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.808071+0000","last_change":"2024-05-21T13:35:56.770347+0000","last_active":"2024-05-21T13:36:02.808071+0000","last_peered":"2024-05-21T13:36:02.808071+0000","last_clean":"2024-05-21T13:36:02.808071+0000","last_became_active":"2024-05-21T13:35:56.769767+0000","last_became_peered":"2024-05-21T13:35:56.769767+0000","last_unstale":"2024-05-21T13:36:02.808071+0000","last_undegraded":"2024-05-21T13:36:02.808071+0000","last_fullsized":"2024-05-21T13:36:02.808071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:40:01.698967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.804632+0000","last_change":"2024-05-21T13:36:01.827091+0000","last_active":"2024-05-21T13:36:02.804632+0000","last_peered":"2024-05-21T13:36:02.804632+0000","last_clean":"2024-05-21T13:36:02.804632+0000","last_became_active":"2024-05-21T13:36:01.826686+0000","last_became_peered":"2024-05-21T13:36:01.826686+0000","last_unstale":"2024-05-21T13:36:02.804632+0000","last_undegraded":"2024-05-21T13:36:02.804632+0000","last_fullsized":"2024-05-21T13:36:02.804632+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:42:47.638921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.962149+0000","last_change":"2024-05-21T13:35:57.781528+0000","last_active":"2024-05-21T13:36:02.962149+0000","last_peered":"2024-05-21T13:36:02.962149+0000","last_clean":"2024-05-21T13:36:02.962149+0000","last_became_active":"2024-05-21T13:35:57.781111+0000","last_became_peered":"2024-05-21T13:35:57.781111+0000","last_unstale":"2024-05-21T13:36:02.962149+0000","last_undegraded":"2024-05-21T13:36:02.962149+0000","last_fullsized":"2024-05-21T13:36:02.962149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:15:43.847640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"24'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.960114+0000","last_change":"2024-05-21T13:35:56.755413+0000","last_active":"2024-05-21T13:36:02.960114+0000","last_peered":"2024-05-21T13:36:02.960114+0000","last_clean":"2024-05-21T13:36:02.960114+0000","last_became_active":"2024-05-21T13:35:56.755158+0000","last_became_peered":"2024-05-21T13:35:56.755158+0000","last_unstale":"2024-05-21T13:36:02.960114+0000","last_undegraded":"2024-05-21T13:36:02.960114+0000","last_fullsized":"2024-05-21T13:36:02.960114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:23:05.102098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.962809+0000","last_change":"2024-05-21T13:36:01.827237+0000","last_active":"2024-05-21T13:36:02.962809+0000","last_peered":"2024-05-21T13:36:02.962809+0000","last_clean":"2024-05-21T13:36:02.962809+0000","last_became_active":"2024-05-21T13:36:01.826374+0000","last_became_peered":"2024-05-21T13:36:01.826374+0000","last_unstale":"2024-05-21T13:36:02.962809+0000","last_undegraded":"2024-05-21T13:36:02.962809+0000","last_fullsized":"2024-05-21T13:36:02.962809+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:12:33.528068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.804889+0000","last_change":"2024-05-21T13:35:57.787940+0000","last_active":"2024-05-21T13:36:02.804889+0000","last_peered":"2024-05-21T13:36:02.804889+0000","last_clean":"2024-05-21T13:36:02.804889+0000","last_became_active":"2024-05-21T13:35:57.787544+0000","last_became_peered":"2024-05-21T13:35:57.787544+0000","last_unstale":"2024-05-21T13:36:02.804889+0000","last_undegraded":"2024-05-21T13:36:02.804889+0000","last_fullsized":"2024-05-21T13:36:02.804889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:46:20.335316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"24'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.807309+0000","last_change":"2024-05-21T13:35:56.756262+0000","last_active":"2024-05-21T13:36:02.807309+0000","last_peered":"2024-05-21T13:36:02.807309+0000","last_clean":"2024-05-21T13:36:02.807309+0000","last_became_active":"2024-05-21T13:35:56.752342+0000","last_became_peered":"2024-05-21T13:35:56.752342+0000","last_unstale":"2024-05-21T13:36:02.807309+0000","last_undegraded":"2024-05-21T13:36:02.807309+0000","last_fullsized":"2024-05-21T13:36:02.807309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:59:09.541382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.966115+0000","last_change":"2024-05-21T13:36:01.859498+0000","last_active":"2024-05-21T13:36:02.966115+0000","last_peered":"2024-05-21T13:36:02.966115+0000","last_clean":"2024-05-21T13:36:02.966115+0000","last_became_active":"2024-05-21T13:36:01.857707+0000","last_became_peered":"2024-05-21T13:36:01.857707+0000","last_unstale":"2024-05-21T13:36:02.966115+0000","last_undegraded":"2024-05-21T13:36:02.966115+0000","last_fullsized":"2024-05-21T13:36:02.966115+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:38:06.966814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.962835+0000","last_change":"2024-05-21T13:35:57.783007+0000","last_active":"2024-05-21T13:36:02.962835+0000","last_peered":"2024-05-21T13:36:02.962835+0000","last_clean":"2024-05-21T13:36:02.962835+0000","last_became_active":"2024-05-21T13:35:57.782330+0000","last_became_peered":"2024-05-21T13:35:57.782330+0000","last_unstale":"2024-05-21T13:36:02.962835+0000","last_undegraded":"2024-05-21T13:36:02.962835+0000","last_fullsized":"2024-05-21T13:36:02.962835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:26:14.697766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.959369+0000","last_change":"2024-05-21T13:35:56.745787+0000","last_active":"2024-05-21T13:36:02.959369+0000","last_peered":"2024-05-21T13:36:02.959369+0000","last_clean":"2024-05-21T13:36:02.959369+0000","last_became_active":"2024-05-21T13:35:56.745202+0000","last_became_peered":"2024-05-21T13:35:56.745202+0000","last_unstale":"2024-05-21T13:36:02.959369+0000","last_undegraded":"2024-05-21T13:36:02.959369+0000","last_fullsized":"2024-05-21T13:36:02.959369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:31:13.498003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.965870+0000","last_change":"2024-05-21T13:36:01.858550+0000","last_active":"2024-05-21T13:36:02.965870+0000","last_peered":"2024-05-21T13:36:02.965870+0000","last_clean":"2024-05-21T13:36:02.965870+0000","last_became_active":"2024-05-21T13:36:01.857716+0000","last_became_peered":"2024-05-21T13:36:01.857716+0000","last_unstale":"2024-05-21T13:36:02.965870+0000","last_undegraded":"2024-05-21T13:36:02.965870+0000","last_fullsized":"2024-05-21T13:36:02.965870+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:48:32.490678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.805527+0000","last_change":"2024-05-21T13:35:57.799702+0000","last_active":"2024-05-21T13:36:02.805527+0000","last_peered":"2024-05-21T13:36:02.805527+0000","last_clean":"2024-05-21T13:36:02.805527+0000","last_became_active":"2024-05-21T13:35:57.799225+0000","last_became_peered":"2024-05-21T13:35:57.799225+0000","last_unstale":"2024-05-21T13:36:02.805527+0000","last_undegraded":"2024-05-21T13:36:02.805527+0000","last_fullsized":"2024-05-21T13:36:02.805527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:29:54.094448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.806444+0000","last_change":"2024-05-21T13:35:56.742650+0000","last_active":"2024-05-21T13:36:02.806444+0000","last_peered":"2024-05-21T13:36:02.806444+0000","last_clean":"2024-05-21T13:36:02.806444+0000","last_became_active":"2024-05-21T13:35:56.742296+0000","last_became_peered":"2024-05-21T13:35:56.742296+0000","last_unstale":"2024-05-21T13:36:02.806444+0000","last_undegraded":"2024-05-21T13:36:02.806444+0000","last_fullsized":"2024-05-21T13:36:02.806444+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:18:55.514845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.967634+0000","last_change":"2024-05-21T13:36:01.873708+0000","last_active":"2024-05-21T13:36:02.967634+0000","last_peered":"2024-05-21T13:36:02.967634+0000","last_clean":"2024-05-21T13:36:02.967634+0000","last_became_active":"2024-05-21T13:36:01.872320+0000","last_became_peered":"2024-05-21T13:36:01.872320+0000","last_unstale":"2024-05-21T13:36:02.967634+0000","last_undegraded":"2024-05-21T13:36:02.967634+0000","last_fullsized":"2024-05-21T13:36:02.967634+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:01:15.545756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.966606+0000","last_change":"2024-05-21T13:35:57.802763+0000","last_active":"2024-05-21T13:36:02.966606+0000","last_peered":"2024-05-21T13:36:02.966606+0000","last_clean":"2024-05-21T13:36:02.966606+0000","last_became_active":"2024-05-21T13:35:57.802433+0000","last_became_peered":"2024-05-21T13:35:57.802433+0000","last_unstale":"2024-05-21T13:36:02.966606+0000","last_undegraded":"2024-05-21T13:36:02.966606+0000","last_fullsized":"2024-05-21T13:36:02.966606+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:09:48.463186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.965357+0000","last_change":"2024-05-21T13:35:56.754087+0000","last_active":"2024-05-21T13:36:02.965357+0000","last_peered":"2024-05-21T13:36:02.965357+0000","last_clean":"2024-05-21T13:36:02.965357+0000","last_became_active":"2024-05-21T13:35:56.753319+0000","last_became_peered":"2024-05-21T13:35:56.753319+0000","last_unstale":"2024-05-21T13:36:02.965357+0000","last_undegraded":"2024-05-21T13:36:02.965357+0000","last_fullsized":"2024-05-21T13:36:02.965357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:19:21.276993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.806089+0000","last_change":"2024-05-21T13:36:01.836017+0000","last_active":"2024-05-21T13:36:02.806089+0000","last_peered":"2024-05-21T13:36:02.806089+0000","last_clean":"2024-05-21T13:36:02.806089+0000","last_became_active":"2024-05-21T13:36:01.835450+0000","last_became_peered":"2024-05-21T13:36:01.835450+0000","last_unstale":"2024-05-21T13:36:02.806089+0000","last_undegraded":"2024-05-21T13:36:02.806089+0000","last_fullsized":"2024-05-21T13:36:02.806089+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:05:56.077605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.962152+0000","last_change":"2024-05-21T13:35:57.787177+0000","last_active":"2024-05-21T13:36:02.962152+0000","last_peered":"2024-05-21T13:36:02.962152+0000","last_clean":"2024-05-21T13:36:02.962152+0000","last_became_active":"2024-05-21T13:35:57.786401+0000","last_became_peered":"2024-05-21T13:35:57.786401+0000","last_unstale":"2024-05-21T13:36:02.962152+0000","last_undegraded":"2024-05-21T13:36:02.962152+0000","last_fullsized":"2024-05-21T13:36:02.962152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:17:18.939002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:12.171576+0000","last_change":"2024-05-21T13:35:56.751229+0000","last_active":"2024-05-21T13:36:12.171576+0000","last_peered":"2024-05-21T13:36:12.171576+0000","last_clean":"2024-05-21T13:36:12.171576+0000","last_became_active":"2024-05-21T13:35:56.750831+0000","last_became_peered":"2024-05-21T13:35:56.750831+0000","last_unstale":"2024-05-21T13:36:12.171576+0000","last_undegraded":"2024-05-21T13:36:12.171576+0000","last_fullsized":"2024-05-21T13:36:12.171576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:03:40.186241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.807730+0000","last_change":"2024-05-21T13:36:01.832691+0000","last_active":"2024-05-21T13:36:02.807730+0000","last_peered":"2024-05-21T13:36:02.807730+0000","last_clean":"2024-05-21T13:36:02.807730+0000","last_became_active":"2024-05-21T13:36:01.831476+0000","last_became_peered":"2024-05-21T13:36:01.831476+0000","last_unstale":"2024-05-21T13:36:02.807730+0000","last_undegraded":"2024-05-21T13:36:02.807730+0000","last_fullsized":"2024-05-21T13:36:02.807730+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:08:38.092592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.805422+0000","last_change":"2024-05-21T13:35:57.788547+0000","last_active":"2024-05-21T13:36:02.805422+0000","last_peered":"2024-05-21T13:36:02.805422+0000","last_clean":"2024-05-21T13:36:02.805422+0000","last_became_active":"2024-05-21T13:35:57.787785+0000","last_became_peered":"2024-05-21T13:35:57.787785+0000","last_unstale":"2024-05-21T13:36:02.805422+0000","last_undegraded":"2024-05-21T13:36:02.805422+0000","last_fullsized":"2024-05-21T13:36:02.805422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:51:08.781399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"24'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.964609+0000","last_change":"2024-05-21T13:35:56.760557+0000","last_active":"2024-05-21T13:36:02.964609+0000","last_peered":"2024-05-21T13:36:02.964609+0000","last_clean":"2024-05-21T13:36:02.964609+0000","last_became_active":"2024-05-21T13:35:56.759728+0000","last_became_peered":"2024-05-21T13:35:56.759728+0000","last_unstale":"2024-05-21T13:36:02.964609+0000","last_undegraded":"2024-05-21T13:36:02.964609+0000","last_fullsized":"2024-05-21T13:36:02.964609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:56:19.754940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.962040+0000","last_change":"2024-05-21T13:36:01.861622+0000","last_active":"2024-05-21T13:36:02.962040+0000","last_peered":"2024-05-21T13:36:02.962040+0000","last_clean":"2024-05-21T13:36:02.962040+0000","last_became_active":"2024-05-21T13:36:01.861172+0000","last_became_peered":"2024-05-21T13:36:01.861172+0000","last_unstale":"2024-05-21T13:36:02.962040+0000","last_undegraded":"2024-05-21T13:36:02.962040+0000","last_fullsized":"2024-05-21T13:36:02.962040+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:39:53.211812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.966013+0000","last_change":"2024-05-21T13:35:57.804520+0000","last_active":"2024-05-21T13:36:02.966013+0000","last_peered":"2024-05-21T13:36:02.966013+0000","last_clean":"2024-05-21T13:36:02.966013+0000","last_became_active":"2024-05-21T13:35:57.804139+0000","last_became_peered":"2024-05-21T13:35:57.804139+0000","last_unstale":"2024-05-21T13:36:02.966013+0000","last_undegraded":"2024-05-21T13:36:02.966013+0000","last_fullsized":"2024-05-21T13:36:02.966013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:21:52.433019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.959802+0000","last_change":"2024-05-21T13:35:56.733821+0000","last_active":"2024-05-21T13:36:02.959802+0000","last_peered":"2024-05-21T13:36:02.959802+0000","last_clean":"2024-05-21T13:36:02.959802+0000","last_became_active":"2024-05-21T13:35:56.732488+0000","last_became_peered":"2024-05-21T13:35:56.732488+0000","last_unstale":"2024-05-21T13:36:02.959802+0000","last_undegraded":"2024-05-21T13:36:02.959802+0000","last_fullsized":"2024-05-21T13:36:02.959802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:10:01.786931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.961990+0000","last_change":"2024-05-21T13:36:01.868781+0000","last_active":"2024-05-21T13:36:02.961990+0000","last_peered":"2024-05-21T13:36:02.961990+0000","last_clean":"2024-05-21T13:36:02.961990+0000","last_became_active":"2024-05-21T13:36:01.864254+0000","last_became_peered":"2024-05-21T13:36:01.864254+0000","last_unstale":"2024-05-21T13:36:02.961990+0000","last_undegraded":"2024-05-21T13:36:02.961990+0000","last_fullsized":"2024-05-21T13:36:02.961990+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:34:12.632333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.962094+0000","last_change":"2024-05-21T13:35:57.788313+0000","last_active":"2024-05-21T13:36:02.962094+0000","last_peered":"2024-05-21T13:36:02.962094+0000","last_clean":"2024-05-21T13:36:02.962094+0000","last_became_active":"2024-05-21T13:35:57.787963+0000","last_became_peered":"2024-05-21T13:35:57.787963+0000","last_unstale":"2024-05-21T13:36:02.962094+0000","last_undegraded":"2024-05-21T13:36:02.962094+0000","last_fullsized":"2024-05-21T13:36:02.962094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:16:21.586571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.963973+0000","last_change":"2024-05-21T13:35:56.748334+0000","last_active":"2024-05-21T13:36:02.963973+0000","last_peered":"2024-05-21T13:36:02.963973+0000","last_clean":"2024-05-21T13:36:02.963973+0000","last_became_active":"2024-05-21T13:35:56.748049+0000","last_became_peered":"2024-05-21T13:35:56.748049+0000","last_unstale":"2024-05-21T13:36:02.963973+0000","last_undegraded":"2024-05-21T13:36:02.963973+0000","last_fullsized":"2024-05-21T13:36:02.963973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:59:02.802905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.807330+0000","last_change":"2024-05-21T13:36:01.856216+0000","last_active":"2024-05-21T13:36:02.807330+0000","last_peered":"2024-05-21T13:36:02.807330+0000","last_clean":"2024-05-21T13:36:02.807330+0000","last_became_active":"2024-05-21T13:36:01.855417+0000","last_became_peered":"2024-05-21T13:36:01.855417+0000","last_unstale":"2024-05-21T13:36:02.807330+0000","last_undegraded":"2024-05-21T13:36:02.807330+0000","last_fullsized":"2024-05-21T13:36:02.807330+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:36:01.423944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.807915+0000","last_change":"2024-05-21T13:36:01.838966+0000","last_active":"2024-05-21T13:36:02.807915+0000","last_peered":"2024-05-21T13:36:02.807915+0000","last_clean":"2024-05-21T13:36:02.807915+0000","last_became_active":"2024-05-21T13:36:01.837777+0000","last_became_peered":"2024-05-21T13:36:01.837777+0000","last_unstale":"2024-05-21T13:36:02.807915+0000","last_undegraded":"2024-05-21T13:36:02.807915+0000","last_fullsized":"2024-05-21T13:36:02.807915+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:40:55.688338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.807274+0000","last_change":"2024-05-21T13:35:57.762719+0000","last_active":"2024-05-21T13:36:02.807274+0000","last_peered":"2024-05-21T13:36:02.807274+0000","last_clean":"2024-05-21T13:36:02.807274+0000","last_became_active":"2024-05-21T13:35:57.762071+0000","last_became_peered":"2024-05-21T13:35:57.762071+0000","last_unstale":"2024-05-21T13:36:02.807274+0000","last_undegraded":"2024-05-21T13:36:02.807274+0000","last_fullsized":"2024-05-21T13:36:02.807274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:55:37.631695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.805108+0000","last_change":"2024-05-21T13:35:56.751481+0000","last_active":"2024-05-21T13:36:02.805108+0000","last_peered":"2024-05-21T13:36:02.805108+0000","last_clean":"2024-05-21T13:36:02.805108+0000","last_became_active":"2024-05-21T13:35:56.751201+0000","last_became_peered":"2024-05-21T13:35:56.751201+0000","last_unstale":"2024-05-21T13:36:02.805108+0000","last_undegraded":"2024-05-21T13:36:02.805108+0000","last_fullsized":"2024-05-21T13:36:02.805108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:33:28.720246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.806144+0000","last_change":"2024-05-21T13:36:01.837042+0000","last_active":"2024-05-21T13:36:02.806144+0000","last_peered":"2024-05-21T13:36:02.806144+0000","last_clean":"2024-05-21T13:36:02.806144+0000","last_became_active":"2024-05-21T13:36:01.836194+0000","last_became_peered":"2024-05-21T13:36:01.836194+0000","last_unstale":"2024-05-21T13:36:02.806144+0000","last_undegraded":"2024-05-21T13:36:02.806144+0000","last_fullsized":"2024-05-21T13:36:02.806144+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:15:50.751693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.962036+0000","last_change":"2024-05-21T13:35:57.788838+0000","last_active":"2024-05-21T13:36:02.962036+0000","last_peered":"2024-05-21T13:36:02.962036+0000","last_clean":"2024-05-21T13:36:02.962036+0000","last_became_active":"2024-05-21T13:35:57.786307+0000","last_became_peered":"2024-05-21T13:35:57.786307+0000","last_unstale":"2024-05-21T13:36:02.962036+0000","last_undegraded":"2024-05-21T13:36:02.962036+0000","last_fullsized":"2024-05-21T13:36:02.962036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:52:09.086807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.962585+0000","last_change":"2024-05-21T13:35:56.746564+0000","last_active":"2024-05-21T13:36:02.962585+0000","last_peered":"2024-05-21T13:36:02.962585+0000","last_clean":"2024-05-21T13:36:02.962585+0000","last_became_active":"2024-05-21T13:35:56.745884+0000","last_became_peered":"2024-05-21T13:35:56.745884+0000","last_unstale":"2024-05-21T13:36:02.962585+0000","last_undegraded":"2024-05-21T13:36:02.962585+0000","last_fullsized":"2024-05-21T13:36:02.962585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:01:44.738607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"24'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.806093+0000","last_change":"2024-05-21T13:35:56.753930+0000","last_active":"2024-05-21T13:36:02.806093+0000","last_peered":"2024-05-21T13:36:02.806093+0000","last_clean":"2024-05-21T13:36:02.806093+0000","last_became_active":"2024-05-21T13:35:56.753499+0000","last_became_peered":"2024-05-21T13:35:56.753499+0000","last_unstale":"2024-05-21T13:36:02.806093+0000","last_undegraded":"2024-05-21T13:36:02.806093+0000","last_fullsized":"2024-05-21T13:36:02.806093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:40:51.516544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.808045+0000","last_change":"2024-05-21T13:35:57.780101+0000","last_active":"2024-05-21T13:36:02.808045+0000","last_peered":"2024-05-21T13:36:02.808045+0000","last_clean":"2024-05-21T13:36:02.808045+0000","last_became_active":"2024-05-21T13:35:57.779368+0000","last_became_peered":"2024-05-21T13:35:57.779368+0000","last_unstale":"2024-05-21T13:36:02.808045+0000","last_undegraded":"2024-05-21T13:36:02.808045+0000","last_fullsized":"2024-05-21T13:36:02.808045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:37:39.347067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.808272+0000","last_change":"2024-05-21T13:36:01.844240+0000","last_active":"2024-05-21T13:36:02.808272+0000","last_peered":"2024-05-21T13:36:02.808272+0000","last_clean":"2024-05-21T13:36:02.808272+0000","last_became_active":"2024-05-21T13:36:01.842792+0000","last_became_peered":"2024-05-21T13:36:01.842792+0000","last_unstale":"2024-05-21T13:36:02.808272+0000","last_undegraded":"2024-05-21T13:36:02.808272+0000","last_fullsized":"2024-05-21T13:36:02.808272+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:19:54.016465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"24'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.964084+0000","last_change":"2024-05-21T13:35:56.770864+0000","last_active":"2024-05-21T13:36:02.964084+0000","last_peered":"2024-05-21T13:36:02.964084+0000","last_clean":"2024-05-21T13:36:02.964084+0000","last_became_active":"2024-05-21T13:35:56.766873+0000","last_became_peered":"2024-05-21T13:35:56.766873+0000","last_unstale":"2024-05-21T13:36:02.964084+0000","last_undegraded":"2024-05-21T13:36:02.964084+0000","last_fullsized":"2024-05-21T13:36:02.964084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:13:02.633858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.963803+0000","last_change":"2024-05-21T13:35:57.787563+0000","last_active":"2024-05-21T13:36:02.963803+0000","last_peered":"2024-05-21T13:36:02.963803+0000","last_clean":"2024-05-21T13:36:02.963803+0000","last_became_active":"2024-05-21T13:35:57.787255+0000","last_became_peered":"2024-05-21T13:35:57.787255+0000","last_unstale":"2024-05-21T13:36:02.963803+0000","last_undegraded":"2024-05-21T13:36:02.963803+0000","last_fullsized":"2024-05-21T13:36:02.963803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:32:49.325049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.964068+0000","last_change":"2024-05-21T13:36:01.868514+0000","last_active":"2024-05-21T13:36:02.964068+0000","last_peered":"2024-05-21T13:36:02.964068+0000","last_clean":"2024-05-21T13:36:02.964068+0000","last_became_active":"2024-05-21T13:36:01.867522+0000","last_became_peered":"2024-05-21T13:36:01.867522+0000","last_unstale":"2024-05-21T13:36:02.964068+0000","last_undegraded":"2024-05-21T13:36:02.964068+0000","last_fullsized":"2024-05-21T13:36:02.964068+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:19:13.533784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.960872+0000","last_change":"2024-05-21T13:35:57.782641+0000","last_active":"2024-05-21T13:36:02.960872+0000","last_peered":"2024-05-21T13:36:02.960872+0000","last_clean":"2024-05-21T13:36:02.960872+0000","last_became_active":"2024-05-21T13:35:57.782233+0000","last_became_peered":"2024-05-21T13:35:57.782233+0000","last_unstale":"2024-05-21T13:36:02.960872+0000","last_undegraded":"2024-05-21T13:36:02.960872+0000","last_fullsized":"2024-05-21T13:36:02.960872+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:55:18.808229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.963845+0000","last_change":"2024-05-21T13:35:57.770591+0000","last_active":"2024-05-21T13:36:02.963845+0000","last_peered":"2024-05-21T13:36:02.963845+0000","last_clean":"2024-05-21T13:36:02.963845+0000","last_became_active":"2024-05-21T13:35:57.769785+0000","last_became_peered":"2024-05-21T13:35:57.769785+0000","last_unstale":"2024-05-21T13:36:02.963845+0000","last_undegraded":"2024-05-21T13:36:02.963845+0000","last_fullsized":"2024-05-21T13:36:02.963845+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:18:28.168393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.805267+0000","last_change":"2024-05-21T13:35:57.799153+0000","last_active":"2024-05-21T13:36:02.805267+0000","last_peered":"2024-05-21T13:36:02.805267+0000","last_clean":"2024-05-21T13:36:02.805267+0000","last_became_active":"2024-05-21T13:35:57.796495+0000","last_became_peered":"2024-05-21T13:35:57.796495+0000","last_unstale":"2024-05-21T13:36:02.805267+0000","last_undegraded":"2024-05-21T13:36:02.805267+0000","last_fullsized":"2024-05-21T13:36:02.805267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:53:04.109036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.963840+0000","last_change":"2024-05-21T13:35:57.784335+0000","last_active":"2024-05-21T13:36:02.963840+0000","last_peered":"2024-05-21T13:36:02.963840+0000","last_clean":"2024-05-21T13:36:02.963840+0000","last_became_active":"2024-05-21T13:35:57.783968+0000","last_became_peered":"2024-05-21T13:35:57.783968+0000","last_unstale":"2024-05-21T13:36:02.963840+0000","last_undegraded":"2024-05-21T13:36:02.963840+0000","last_fullsized":"2024-05-21T13:36:02.963840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:57:20.832617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.967890+0000","last_change":"2024-05-21T13:35:57.795153+0000","last_active":"2024-05-21T13:36:02.967890+0000","last_peered":"2024-05-21T13:36:02.967890+0000","last_clean":"2024-05-21T13:36:02.967890+0000","last_became_active":"2024-05-21T13:35:57.794885+0000","last_became_peered":"2024-05-21T13:35:57.794885+0000","last_unstale":"2024-05-21T13:36:02.967890+0000","last_undegraded":"2024-05-21T13:36:02.967890+0000","last_fullsized":"2024-05-21T13:36:02.967890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:17:00.454371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.967778+0000","last_change":"2024-05-21T13:35:57.778916+0000","last_active":"2024-05-21T13:36:02.967778+0000","last_peered":"2024-05-21T13:36:02.967778+0000","last_clean":"2024-05-21T13:36:02.967778+0000","last_became_active":"2024-05-21T13:35:57.778171+0000","last_became_peered":"2024-05-21T13:35:57.778171+0000","last_unstale":"2024-05-21T13:36:02.967778+0000","last_undegraded":"2024-05-21T13:36:02.967778+0000","last_fullsized":"2024-05-21T13:36:02.967778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:15:37.425836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.961364+0000","last_change":"2024-05-21T13:35:57.791367+0000","last_active":"2024-05-21T13:36:02.961364+0000","last_peered":"2024-05-21T13:36:02.961364+0000","last_clean":"2024-05-21T13:36:02.961364+0000","last_became_active":"2024-05-21T13:35:57.790971+0000","last_became_peered":"2024-05-21T13:35:57.790971+0000","last_unstale":"2024-05-21T13:36:02.961364+0000","last_undegraded":"2024-05-21T13:36:02.961364+0000","last_fullsized":"2024-05-21T13:36:02.961364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:14:47.428631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.965591+0000","last_change":"2024-05-21T13:35:57.785257+0000","last_active":"2024-05-21T13:36:02.965591+0000","last_peered":"2024-05-21T13:36:02.965591+0000","last_clean":"2024-05-21T13:36:02.965591+0000","last_became_active":"2024-05-21T13:35:57.781533+0000","last_became_peered":"2024-05-21T13:35:57.781533+0000","last_unstale":"2024-05-21T13:36:02.965591+0000","last_undegraded":"2024-05-21T13:36:02.965591+0000","last_fullsized":"2024-05-21T13:36:02.965591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:18:32.591803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.804917+0000","last_change":"2024-05-21T13:35:57.799128+0000","last_active":"2024-05-21T13:36:02.804917+0000","last_peered":"2024-05-21T13:36:02.804917+0000","last_clean":"2024-05-21T13:36:02.804917+0000","last_became_active":"2024-05-21T13:35:57.797044+0000","last_became_peered":"2024-05-21T13:35:57.797044+0000","last_unstale":"2024-05-21T13:36:02.804917+0000","last_undegraded":"2024-05-21T13:36:02.804917+0000","last_fullsized":"2024-05-21T13:36:02.804917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:57:13.472309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.962393+0000","last_change":"2024-05-21T13:35:57.789768+0000","last_active":"2024-05-21T13:36:02.962393+0000","last_peered":"2024-05-21T13:36:02.962393+0000","last_clean":"2024-05-21T13:36:02.962393+0000","last_became_active":"2024-05-21T13:35:57.789474+0000","last_became_peered":"2024-05-21T13:35:57.789474+0000","last_unstale":"2024-05-21T13:36:02.962393+0000","last_undegraded":"2024-05-21T13:36:02.962393+0000","last_fullsized":"2024-05-21T13:36:02.962393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:42:53.993281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.963561+0000","last_change":"2024-05-21T13:35:57.756607+0000","last_active":"2024-05-21T13:36:02.963561+0000","last_peered":"2024-05-21T13:36:02.963561+0000","last_clean":"2024-05-21T13:36:02.963561+0000","last_became_active":"2024-05-21T13:35:57.755889+0000","last_became_peered":"2024-05-21T13:35:57.755889+0000","last_unstale":"2024-05-21T13:36:02.963561+0000","last_undegraded":"2024-05-21T13:36:02.963561+0000","last_fullsized":"2024-05-21T13:36:02.963561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:16:19.541597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.808181+0000","last_change":"2024-05-21T13:35:57.775322+0000","last_active":"2024-05-21T13:36:02.808181+0000","last_peered":"2024-05-21T13:36:02.808181+0000","last_clean":"2024-05-21T13:36:02.808181+0000","last_became_active":"2024-05-21T13:35:57.774386+0000","last_became_peered":"2024-05-21T13:35:57.774386+0000","last_unstale":"2024-05-21T13:36:02.808181+0000","last_undegraded":"2024-05-21T13:36:02.808181+0000","last_fullsized":"2024-05-21T13:36:02.808181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:01:02.106172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.959969+0000","last_change":"2024-05-21T13:35:57.769931+0000","last_active":"2024-05-21T13:36:02.959969+0000","last_peered":"2024-05-21T13:36:02.959969+0000","last_clean":"2024-05-21T13:36:02.959969+0000","last_became_active":"2024-05-21T13:35:57.769149+0000","last_became_peered":"2024-05-21T13:35:57.769149+0000","last_unstale":"2024-05-21T13:36:02.959969+0000","last_undegraded":"2024-05-21T13:36:02.959969+0000","last_fullsized":"2024-05-21T13:36:02.959969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:55:56.268307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.806502+0000","last_change":"2024-05-21T13:35:57.796153+0000","last_active":"2024-05-21T13:36:02.806502+0000","last_peered":"2024-05-21T13:36:02.806502+0000","last_clean":"2024-05-21T13:36:02.806502+0000","last_became_active":"2024-05-21T13:35:57.795799+0000","last_became_peered":"2024-05-21T13:35:57.795799+0000","last_unstale":"2024-05-21T13:36:02.806502+0000","last_undegraded":"2024-05-21T13:36:02.806502+0000","last_fullsized":"2024-05-21T13:36:02.806502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:52:04.794391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.966824+0000","last_change":"2024-05-21T13:35:57.776414+0000","last_active":"2024-05-21T13:36:02.966824+0000","last_peered":"2024-05-21T13:36:02.966824+0000","last_clean":"2024-05-21T13:36:02.966824+0000","last_became_active":"2024-05-21T13:35:57.775573+0000","last_became_peered":"2024-05-21T13:35:57.775573+0000","last_unstale":"2024-05-21T13:36:02.966824+0000","last_undegraded":"2024-05-21T13:36:02.966824+0000","last_fullsized":"2024-05-21T13:36:02.966824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:47:47.624662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.808011+0000","last_change":"2024-05-21T13:35:57.799673+0000","last_active":"2024-05-21T13:36:02.808011+0000","last_peered":"2024-05-21T13:36:02.808011+0000","last_clean":"2024-05-21T13:36:02.808011+0000","last_became_active":"2024-05-21T13:35:57.799313+0000","last_became_peered":"2024-05-21T13:35:57.799313+0000","last_unstale":"2024-05-21T13:36:02.808011+0000","last_undegraded":"2024-05-21T13:36:02.808011+0000","last_fullsized":"2024-05-21T13:36:02.808011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:40:52.516216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.804786+0000","last_change":"2024-05-21T13:35:57.790705+0000","last_active":"2024-05-21T13:36:02.804786+0000","last_peered":"2024-05-21T13:36:02.804786+0000","last_clean":"2024-05-21T13:36:02.804786+0000","last_became_active":"2024-05-21T13:35:57.787735+0000","last_became_peered":"2024-05-21T13:35:57.787735+0000","last_unstale":"2024-05-21T13:36:02.804786+0000","last_undegraded":"2024-05-21T13:36:02.804786+0000","last_fullsized":"2024-05-21T13:36:02.804786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:17:24.376182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.961973+0000","last_change":"2024-05-21T13:35:57.786838+0000","last_active":"2024-05-21T13:36:02.961973+0000","last_peered":"2024-05-21T13:36:02.961973+0000","last_clean":"2024-05-21T13:36:02.961973+0000","last_became_active":"2024-05-21T13:35:57.786403+0000","last_became_peered":"2024-05-21T13:35:57.786403+0000","last_unstale":"2024-05-21T13:36:02.961973+0000","last_undegraded":"2024-05-21T13:36:02.961973+0000","last_fullsized":"2024-05-21T13:36:02.961973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:29:28.760793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.966410+0000","last_change":"2024-05-21T13:35:57.783561+0000","last_active":"2024-05-21T13:36:02.966410+0000","last_peered":"2024-05-21T13:36:02.966410+0000","last_clean":"2024-05-21T13:36:02.966410+0000","last_became_active":"2024-05-21T13:35:57.783060+0000","last_became_peered":"2024-05-21T13:35:57.783060+0000","last_unstale":"2024-05-21T13:36:02.966410+0000","last_undegraded":"2024-05-21T13:36:02.966410+0000","last_fullsized":"2024-05-21T13:36:02.966410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:27:27.261449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.964046+0000","last_change":"2024-05-21T13:35:57.788210+0000","last_active":"2024-05-21T13:36:02.964046+0000","last_peered":"2024-05-21T13:36:02.964046+0000","last_clean":"2024-05-21T13:36:02.964046+0000","last_became_active":"2024-05-21T13:35:57.787508+0000","last_became_peered":"2024-05-21T13:35:57.787508+0000","last_unstale":"2024-05-21T13:36:02.964046+0000","last_undegraded":"2024-05-21T13:36:02.964046+0000","last_fullsized":"2024-05-21T13:36:02.964046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:12:56.914580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.959869+0000","last_change":"2024-05-21T13:35:57.787335+0000","last_active":"2024-05-21T13:36:02.959869+0000","last_peered":"2024-05-21T13:36:02.959869+0000","last_clean":"2024-05-21T13:36:02.959869+0000","last_became_active":"2024-05-21T13:35:57.786292+0000","last_became_peered":"2024-05-21T13:35:57.786292+0000","last_unstale":"2024-05-21T13:36:02.959869+0000","last_undegraded":"2024-05-21T13:36:02.959869+0000","last_fullsized":"2024-05-21T13:36:02.959869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:49:40.480948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.960610+0000","last_change":"2024-05-21T13:35:57.801121+0000","last_active":"2024-05-21T13:36:02.960610+0000","last_peered":"2024-05-21T13:36:02.960610+0000","last_clean":"2024-05-21T13:36:02.960610+0000","last_became_active":"2024-05-21T13:35:57.800858+0000","last_became_peered":"2024-05-21T13:35:57.800858+0000","last_unstale":"2024-05-21T13:36:02.960610+0000","last_undegraded":"2024-05-21T13:36:02.960610+0000","last_fullsized":"2024-05-21T13:36:02.960610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:41:08.765821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.959709+0000","last_change":"2024-05-21T13:35:57.778753+0000","last_active":"2024-05-21T13:36:02.959709+0000","last_peered":"2024-05-21T13:36:02.959709+0000","last_clean":"2024-05-21T13:36:02.959709+0000","last_became_active":"2024-05-21T13:35:57.777962+0000","last_became_peered":"2024-05-21T13:35:57.777962+0000","last_unstale":"2024-05-21T13:36:02.959709+0000","last_undegraded":"2024-05-21T13:36:02.959709+0000","last_fullsized":"2024-05-21T13:36:02.959709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:51:49.102945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.963934+0000","last_change":"2024-05-21T13:35:57.798312+0000","last_active":"2024-05-21T13:36:02.963934+0000","last_peered":"2024-05-21T13:36:02.963934+0000","last_clean":"2024-05-21T13:36:02.963934+0000","last_became_active":"2024-05-21T13:35:57.797793+0000","last_became_peered":"2024-05-21T13:35:57.797793+0000","last_unstale":"2024-05-21T13:36:02.963934+0000","last_undegraded":"2024-05-21T13:36:02.963934+0000","last_fullsized":"2024-05-21T13:36:02.963934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:28:47.276868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.961736+0000","last_change":"2024-05-21T13:35:57.782412+0000","last_active":"2024-05-21T13:36:02.961736+0000","last_peered":"2024-05-21T13:36:02.961736+0000","last_clean":"2024-05-21T13:36:02.961736+0000","last_became_active":"2024-05-21T13:35:57.782058+0000","last_became_peered":"2024-05-21T13:35:57.782058+0000","last_unstale":"2024-05-21T13:36:02.961736+0000","last_undegraded":"2024-05-21T13:36:02.961736+0000","last_fullsized":"2024-05-21T13:36:02.961736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:39:49.142554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.959879+0000","last_change":"2024-05-21T13:35:57.779771+0000","last_active":"2024-05-21T13:36:02.959879+0000","last_peered":"2024-05-21T13:36:02.959879+0000","last_clean":"2024-05-21T13:36:02.959879+0000","last_became_active":"2024-05-21T13:35:57.779168+0000","last_became_peered":"2024-05-21T13:35:57.779168+0000","last_unstale":"2024-05-21T13:36:02.959879+0000","last_undegraded":"2024-05-21T13:36:02.959879+0000","last_fullsized":"2024-05-21T13:36:02.959879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T13:59:58.966203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.961896+0000","last_change":"2024-05-21T13:35:57.773098+0000","last_active":"2024-05-21T13:36:02.961896+0000","last_peered":"2024-05-21T13:36:02.961896+0000","last_clean":"2024-05-21T13:36:02.961896+0000","last_became_active":"2024-05-21T13:35:57.772268+0000","last_became_peered":"2024-05-21T13:35:57.772268+0000","last_unstale":"2024-05-21T13:36:02.961896+0000","last_undegraded":"2024-05-21T13:36:02.961896+0000","last_fullsized":"2024-05-21T13:36:02.961896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:05:25.482434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.960610+0000","last_change":"2024-05-21T13:35:57.788980+0000","last_active":"2024-05-21T13:36:02.960610+0000","last_peered":"2024-05-21T13:36:02.960610+0000","last_clean":"2024-05-21T13:36:02.960610+0000","last_became_active":"2024-05-21T13:35:57.788689+0000","last_became_peered":"2024-05-21T13:35:57.788689+0000","last_unstale":"2024-05-21T13:36:02.960610+0000","last_undegraded":"2024-05-21T13:36:02.960610+0000","last_fullsized":"2024-05-21T13:36:02.960610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:15:07.615363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.961136+0000","last_change":"2024-05-21T13:35:57.772867+0000","last_active":"2024-05-21T13:36:02.961136+0000","last_peered":"2024-05-21T13:36:02.961136+0000","last_clean":"2024-05-21T13:36:02.961136+0000","last_became_active":"2024-05-21T13:35:57.772160+0000","last_became_peered":"2024-05-21T13:35:57.772160+0000","last_unstale":"2024-05-21T13:36:02.961136+0000","last_undegraded":"2024-05-21T13:36:02.961136+0000","last_fullsized":"2024-05-21T13:36:02.961136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:11:24.428796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.964773+0000","last_change":"2024-05-21T13:35:57.785297+0000","last_active":"2024-05-21T13:36:02.964773+0000","last_peered":"2024-05-21T13:36:02.964773+0000","last_clean":"2024-05-21T13:36:02.964773+0000","last_became_active":"2024-05-21T13:35:57.784741+0000","last_became_peered":"2024-05-21T13:35:57.784741+0000","last_unstale":"2024-05-21T13:36:02.964773+0000","last_undegraded":"2024-05-21T13:36:02.964773+0000","last_fullsized":"2024-05-21T13:36:02.964773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:45:08.507286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.965566+0000","last_change":"2024-05-21T13:35:57.788875+0000","last_active":"2024-05-21T13:36:02.965566+0000","last_peered":"2024-05-21T13:36:02.965566+0000","last_clean":"2024-05-21T13:36:02.965566+0000","last_became_active":"2024-05-21T13:35:57.786629+0000","last_became_peered":"2024-05-21T13:35:57.786629+0000","last_unstale":"2024-05-21T13:36:02.965566+0000","last_undegraded":"2024-05-21T13:36:02.965566+0000","last_fullsized":"2024-05-21T13:36:02.965566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:40:07.549210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.959984+0000","last_change":"2024-05-21T13:35:57.803316+0000","last_active":"2024-05-21T13:36:02.959984+0000","last_peered":"2024-05-21T13:36:02.959984+0000","last_clean":"2024-05-21T13:36:02.959984+0000","last_became_active":"2024-05-21T13:35:57.802925+0000","last_became_peered":"2024-05-21T13:35:57.802925+0000","last_unstale":"2024-05-21T13:36:02.959984+0000","last_undegraded":"2024-05-21T13:36:02.959984+0000","last_fullsized":"2024-05-21T13:36:02.959984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:17:16.304097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66916,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509450,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":101627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509450,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":101503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509449,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":262144,"data_stored":102085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509450,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":270336,"data_stored":105345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509450,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31504,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340336,"statfs":{"total":96636764160,"available":96604504064,"internally_reserved":0,"allocated":327680,"data_stored":691941,"data_compressed":33458,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509449,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":266240,"data_stored":101559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542152,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":331776,"data_stored":691963,"data_compressed":33458,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":106017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33458,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33458,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-21T13:36:24.922 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-21T13:36:25.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.102+0000 7f0afaa23640 1 Processor -- start 2024-05-21T13:36:25.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.102+0000 7f0afaa23640 1 -- start start 2024-05-21T13:36:25.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.102+0000 7f0afaa23640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0af4152cc0 0x7f0af40c4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:25.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.102+0000 7f0afaa23640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0af40c66b0 0x7f0af40c7df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:25.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.102+0000 7f0afaa23640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0af41530a0 con 0x7f0af40c8330 2024-05-21T13:36:25.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.102+0000 7f0afaa23640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f0af41592b0 con 0x7f0af4152cc0 2024-05-21T13:36:25.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.102+0000 7f0afaa23640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f0af4074840 con 0x7f0af40c66b0 2024-05-21T13:36:25.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.102+0000 7f0af37fe640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0af40c66b0 0x7f0af40c7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:25.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.102+0000 7f0af3fff640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0af4152cc0 0x7f0af40c4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:25.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.102+0000 7f0af3fff640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0af4152cc0 0x7f0af40c4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.22:52734/0 (socket says 172.21.15.22:52734) 2024-05-21T13:36:25.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.102+0000 7f0af37fe640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0af40c66b0 0x7f0af40c7df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.22:46794/0 (socket says 172.21.15.22:46794) 2024-05-21T13:36:25.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.102+0000 7f0af3fff640 1 -- 172.21.15.22:0/1596303417 learned_addr learned my addr 172.21.15.22:0/1596303417 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:25.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.102+0000 7f0af3fff640 1 -- 172.21.15.22:0/1596303417 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0af40c66b0 msgr2=0x7f0af40c7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:25.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.102+0000 7f0af3fff640 1 --2- 172.21.15.22:0/1596303417 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0af40c66b0 0x7f0af40c7df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:25.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.102+0000 7f0af3fff640 1 -- 172.21.15.22:0/1596303417 >> v1:172.21.15.115:6789/0 conn(0x7f0af40c8330 legacy=0x7f0af40c9e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:25.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.102+0000 7f0af3fff640 1 -- 172.21.15.22:0/1596303417 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0af41589a0 con 0x7f0af4152cc0 2024-05-21T13:36:25.081 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.102+0000 7f0af37fe640 1 --2- 172.21.15.22:0/1596303417 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0af40c66b0 0x7f0af40c7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-21T13:36:25.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.106+0000 7f0af3fff640 1 --2- 172.21.15.22:0/1596303417 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0af4152cc0 0x7f0af40c4bf0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0adc009870 tx=0x7f0adc01c560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3b6ee08aeb28133 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:25.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.106+0000 7f0af2ffd640 1 -- 172.21.15.22:0/1596303417 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0adc0ab650 con 0x7f0af4152cc0 2024-05-21T13:36:25.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.106+0000 7f0af2ffd640 1 -- 172.21.15.22:0/1596303417 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0adc0b0070 con 0x7f0af4152cc0 2024-05-21T13:36:25.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.106+0000 7f0af2ffd640 1 -- 172.21.15.22:0/1596303417 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0adc0aba10 con 0x7f0af4152cc0 2024-05-21T13:36:25.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.106+0000 7f0afaa23640 1 -- 172.21.15.22:0/1596303417 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0af4152cc0 msgr2=0x7f0af40c4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:25.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.106+0000 7f0afaa23640 1 --2- 172.21.15.22:0/1596303417 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0af4152cc0 0x7f0af40c4bf0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0adc009870 tx=0x7f0adc01c560 comp rx=0 tx=0).stop 2024-05-21T13:36:25.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.106+0000 7f0afaa23640 1 -- 172.21.15.22:0/1596303417 shutdown_connections 2024-05-21T13:36:25.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.106+0000 7f0afaa23640 1 --2- 172.21.15.22:0/1596303417 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0af40c66b0 0x7f0af40c7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:25.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.106+0000 7f0afaa23640 1 --2- 172.21.15.22:0/1596303417 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0af4152cc0 0x7f0af40c4bf0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:25.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.106+0000 7f0afaa23640 1 -- 172.21.15.22:0/1596303417 >> 172.21.15.22:0/1596303417 conn(0x7f0af406ea10 msgr2=0x7f0af406ff50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:25.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.106+0000 7f0afaa23640 1 -- 172.21.15.22:0/1596303417 shutdown_connections 2024-05-21T13:36:25.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.106+0000 7f0afaa23640 1 -- 172.21.15.22:0/1596303417 wait complete. 2024-05-21T13:36:25.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.106+0000 7f0afaa23640 1 Processor -- start 2024-05-21T13:36:25.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.106+0000 7f0afaa23640 1 -- start start 2024-05-21T13:36:25.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.110+0000 7f0afaa23640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0af40c66b0 0x7f0af41614b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:25.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.110+0000 7f0afaa23640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0af40c8330 0x7f0af41f8690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:25.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.110+0000 7f0afaa23640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0af4152cc0 0x7f0af4145f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:25.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.110+0000 7f0afaa23640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f0af4159740 con 0x7f0af40c66b0 2024-05-21T13:36:25.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.110+0000 7f0afaa23640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f0af4158f40 con 0x7f0af40c8330 2024-05-21T13:36:25.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.110+0000 7f0afaa23640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f0af41598c0 con 0x7f0af4152cc0 2024-05-21T13:36:25.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.110+0000 7f0af3fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0af40c66b0 0x7f0af41614b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:25.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.110+0000 7f0af3fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0af40c66b0 0x7f0af41614b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36690/0 (socket says 172.21.15.22:36690) 2024-05-21T13:36:25.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.110+0000 7f0af3fff640 1 -- 172.21.15.22:0/4129330984 learned_addr learned my addr 172.21.15.22:0/4129330984 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:25.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.110+0000 7f0af8fc0640 1 --2- 172.21.15.22:0/4129330984 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0af4152cc0 0x7f0af4145f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:25.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.110+0000 7f0af37fe640 1 --2- 172.21.15.22:0/4129330984 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0af40c8330 0x7f0af41f8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:25.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.110+0000 7f0af3fff640 1 -- 172.21.15.22:0/4129330984 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0af4152cc0 msgr2=0x7f0af4145f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:25.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.110+0000 7f0af3fff640 1 --2- 172.21.15.22:0/4129330984 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0af4152cc0 0x7f0af4145f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:25.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.110+0000 7f0af3fff640 1 -- 172.21.15.22:0/4129330984 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0af40c8330 msgr2=0x7f0af41f8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:25.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.110+0000 7f0af3fff640 1 --2- 172.21.15.22:0/4129330984 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0af40c8330 0x7f0af41f8690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:25.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.110+0000 7f0af3fff640 1 -- 172.21.15.22:0/4129330984 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0af40cd730 con 0x7f0af40c66b0 2024-05-21T13:36:25.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.110+0000 7f0af8fc0640 1 --2- 172.21.15.22:0/4129330984 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0af4152cc0 0x7f0af4145f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:36:25.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.110+0000 7f0af3fff640 1 --2- 172.21.15.22:0/4129330984 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0af40c66b0 0x7f0af41614b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0adc0ad040 tx=0x7f0adc01ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:25.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.110+0000 7f0af0ff9640 1 -- 172.21.15.22:0/4129330984 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0adc0be5f0 con 0x7f0af40c66b0 2024-05-21T13:36:25.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.110+0000 7f0af0ff9640 1 -- 172.21.15.22:0/4129330984 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0adc0be7b0 con 0x7f0af40c66b0 2024-05-21T13:36:25.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.110+0000 7f0afaa23640 1 -- 172.21.15.22:0/4129330984 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0af41f9040 con 0x7f0af40c66b0 2024-05-21T13:36:25.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.110+0000 7f0af0ff9640 1 -- 172.21.15.22:0/4129330984 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0adc0beba0 con 0x7f0af40c66b0 2024-05-21T13:36:25.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.110+0000 7f0afaa23640 1 -- 172.21.15.22:0/4129330984 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0af414b4d0 con 0x7f0af40c66b0 2024-05-21T13:36:25.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.110+0000 7f0afaa23640 1 -- 172.21.15.22:0/4129330984 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0af4077bb0 con 0x7f0af40c66b0 2024-05-21T13:36:25.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.110+0000 7f0af0ff9640 1 -- 172.21.15.22:0/4129330984 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f0adc0c9430 con 0x7f0af40c66b0 2024-05-21T13:36:25.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.110+0000 7f0af0ff9640 1 --2- 172.21.15.22:0/4129330984 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f0ad406f400 0x7f0ad40718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:25.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.110+0000 7f0af0ff9640 1 -- 172.21.15.22:0/4129330984 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f0adc12a3c0 con 0x7f0af40c66b0 2024-05-21T13:36:25.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.114+0000 7f0af37fe640 1 --2- 172.21.15.22:0/4129330984 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f0ad406f400 0x7f0ad40718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:25.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.114+0000 7f0af37fe640 1 --2- 172.21.15.22:0/4129330984 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f0ad406f400 0x7f0ad40718c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0af41508b0 tx=0x7f0ae400b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:25.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.114+0000 7f0af0ff9640 1 -- 172.21.15.22:0/4129330984 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f0adc0c4060 con 0x7f0af40c66b0 2024-05-21T13:36:25.253 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.274+0000 7f0afaa23640 1 -- 172.21.15.22:0/4129330984 --> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0af4163100 con 0x7f0ad406f400 2024-05-21T13:36:25.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.298+0000 7f0af0ff9640 1 -- 172.21.15.22:0/4129330984 <== mgr.4103 v2:172.21.15.115:6832/184591771 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332596 (secure 0 0 0) 0x7f0af4163100 con 0x7f0ad406f400 2024-05-21T13:36:25.279 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-21T13:36:25.281 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-05-21T13:36:25.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.302+0000 7f0afaa23640 1 -- 172.21.15.22:0/4129330984 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f0ad406f400 msgr2=0x7f0ad40718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:25.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.302+0000 7f0afaa23640 1 --2- 172.21.15.22:0/4129330984 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f0ad406f400 0x7f0ad40718c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f0af41508b0 tx=0x7f0ae400b040 comp rx=0 tx=0).stop 2024-05-21T13:36:25.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.302+0000 7f0afaa23640 1 -- 172.21.15.22:0/4129330984 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0af40c66b0 msgr2=0x7f0af41614b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:25.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.302+0000 7f0afaa23640 1 --2- 172.21.15.22:0/4129330984 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0af40c66b0 0x7f0af41614b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f0adc0ad040 tx=0x7f0adc01ada0 comp rx=0 tx=0).stop 2024-05-21T13:36:25.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.302+0000 7f0afaa23640 1 -- 172.21.15.22:0/4129330984 shutdown_connections 2024-05-21T13:36:25.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.302+0000 7f0afaa23640 1 --2- 172.21.15.22:0/4129330984 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f0ad406f400 0x7f0ad40718c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:25.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.302+0000 7f0afaa23640 1 --2- 172.21.15.22:0/4129330984 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0af4152cc0 0x7f0af4145f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:25.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.302+0000 7f0afaa23640 1 --2- 172.21.15.22:0/4129330984 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0af40c8330 0x7f0af41f8690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:25.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.302+0000 7f0afaa23640 1 --2- 172.21.15.22:0/4129330984 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0af40c66b0 0x7f0af41614b0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:25.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.302+0000 7f0afaa23640 1 -- 172.21.15.22:0/4129330984 >> 172.21.15.22:0/4129330984 conn(0x7f0af406ea10 msgr2=0x7f0af40c9d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:25.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.302+0000 7f0afaa23640 1 -- 172.21.15.22:0/4129330984 shutdown_connections 2024-05-21T13:36:25.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.302+0000 7f0afaa23640 1 -- 172.21.15.22:0/4129330984 wait complete. 2024-05-21T13:36:25.297 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2024-05-21T13:36:24.507648+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":149,"num_write_kb":1646,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":114,"ondisk_log_size":114,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235032,"kb_used_data":2208,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739688,"statfs":{"total":773094113280,"available":772853440512,"internally_reserved":0,"allocated":2260992,"data_stored":2002040,"data_compressed":66916,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1781,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005361"},"pg_stats":[{"pgid":"2.1f","version":"24'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.808373+0000","last_change":"2024-05-21T13:35:56.739488+0000","last_active":"2024-05-21T13:36:02.808373+0000","last_peered":"2024-05-21T13:36:02.808373+0000","last_clean":"2024-05-21T13:36:02.808373+0000","last_became_active":"2024-05-21T13:35:56.738481+0000","last_became_peered":"2024-05-21T13:35:56.738481+0000","last_unstale":"2024-05-21T13:36:02.808373+0000","last_undegraded":"2024-05-21T13:36:02.808373+0000","last_fullsized":"2024-05-21T13:36:02.808373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:20:48.149770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.965919+0000","last_change":"2024-05-21T13:35:57.779462+0000","last_active":"2024-05-21T13:36:02.965919+0000","last_peered":"2024-05-21T13:36:02.965919+0000","last_clean":"2024-05-21T13:36:02.965919+0000","last_became_active":"2024-05-21T13:35:57.778721+0000","last_became_peered":"2024-05-21T13:35:57.778721+0000","last_unstale":"2024-05-21T13:36:02.965919+0000","last_undegraded":"2024-05-21T13:36:02.965919+0000","last_fullsized":"2024-05-21T13:36:02.965919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:13:05.005747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.963696+0000","last_change":"2024-05-21T13:36:01.868203+0000","last_active":"2024-05-21T13:36:02.963696+0000","last_peered":"2024-05-21T13:36:02.963696+0000","last_clean":"2024-05-21T13:36:02.963696+0000","last_became_active":"2024-05-21T13:36:01.864148+0000","last_became_peered":"2024-05-21T13:36:01.864148+0000","last_unstale":"2024-05-21T13:36:02.963696+0000","last_undegraded":"2024-05-21T13:36:02.963696+0000","last_fullsized":"2024-05-21T13:36:02.963696+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T13:57:33.088920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"24'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.966254+0000","last_change":"2024-05-21T13:35:56.775054+0000","last_active":"2024-05-21T13:36:02.966254+0000","last_peered":"2024-05-21T13:36:02.966254+0000","last_clean":"2024-05-21T13:36:02.966254+0000","last_became_active":"2024-05-21T13:35:56.770566+0000","last_became_peered":"2024-05-21T13:35:56.770566+0000","last_unstale":"2024-05-21T13:36:02.966254+0000","last_undegraded":"2024-05-21T13:36:02.966254+0000","last_fullsized":"2024-05-21T13:36:02.966254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:05:11.539201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.965771+0000","last_change":"2024-05-21T13:35:57.782094+0000","last_active":"2024-05-21T13:36:02.965771+0000","last_peered":"2024-05-21T13:36:02.965771+0000","last_clean":"2024-05-21T13:36:02.965771+0000","last_became_active":"2024-05-21T13:35:57.780590+0000","last_became_peered":"2024-05-21T13:35:57.780590+0000","last_unstale":"2024-05-21T13:36:02.965771+0000","last_undegraded":"2024-05-21T13:36:02.965771+0000","last_fullsized":"2024-05-21T13:36:02.965771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:30:50.929103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.960911+0000","last_change":"2024-05-21T13:36:01.852092+0000","last_active":"2024-05-21T13:36:02.960911+0000","last_peered":"2024-05-21T13:36:02.960911+0000","last_clean":"2024-05-21T13:36:02.960911+0000","last_became_active":"2024-05-21T13:36:01.851745+0000","last_became_peered":"2024-05-21T13:36:01.851745+0000","last_unstale":"2024-05-21T13:36:02.960911+0000","last_undegraded":"2024-05-21T13:36:02.960911+0000","last_fullsized":"2024-05-21T13:36:02.960911+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:57:21.599860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"24'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.961222+0000","last_change":"2024-05-21T13:35:56.731106+0000","last_active":"2024-05-21T13:36:02.961222+0000","last_peered":"2024-05-21T13:36:02.961222+0000","last_clean":"2024-05-21T13:36:02.961222+0000","last_became_active":"2024-05-21T13:35:56.730746+0000","last_became_peered":"2024-05-21T13:35:56.730746+0000","last_unstale":"2024-05-21T13:36:02.961222+0000","last_undegraded":"2024-05-21T13:36:02.961222+0000","last_fullsized":"2024-05-21T13:36:02.961222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:23:17.798397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.963099+0000","last_change":"2024-05-21T13:35:57.771371+0000","last_active":"2024-05-21T13:36:02.963099+0000","last_peered":"2024-05-21T13:36:02.963099+0000","last_clean":"2024-05-21T13:36:02.963099+0000","last_became_active":"2024-05-21T13:35:57.770595+0000","last_became_peered":"2024-05-21T13:35:57.770595+0000","last_unstale":"2024-05-21T13:36:02.963099+0000","last_undegraded":"2024-05-21T13:36:02.963099+0000","last_fullsized":"2024-05-21T13:36:02.963099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:53:17.771310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.961202+0000","last_change":"2024-05-21T13:36:01.849638+0000","last_active":"2024-05-21T13:36:02.961202+0000","last_peered":"2024-05-21T13:36:02.961202+0000","last_clean":"2024-05-21T13:36:02.961202+0000","last_became_active":"2024-05-21T13:36:01.848996+0000","last_became_peered":"2024-05-21T13:36:01.848996+0000","last_unstale":"2024-05-21T13:36:02.961202+0000","last_undegraded":"2024-05-21T13:36:02.961202+0000","last_fullsized":"2024-05-21T13:36:02.961202+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:24:31.613874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.960165+0000","last_change":"2024-05-21T13:35:56.737279+0000","last_active":"2024-05-21T13:36:02.960165+0000","last_peered":"2024-05-21T13:36:02.960165+0000","last_clean":"2024-05-21T13:36:02.960165+0000","last_became_active":"2024-05-21T13:35:56.731150+0000","last_became_peered":"2024-05-21T13:35:56.731150+0000","last_unstale":"2024-05-21T13:36:02.960165+0000","last_undegraded":"2024-05-21T13:36:02.960165+0000","last_fullsized":"2024-05-21T13:36:02.960165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:17:07.571294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.806009+0000","last_change":"2024-05-21T13:35:57.799803+0000","last_active":"2024-05-21T13:36:02.806009+0000","last_peered":"2024-05-21T13:36:02.806009+0000","last_clean":"2024-05-21T13:36:02.806009+0000","last_became_active":"2024-05-21T13:35:57.799043+0000","last_became_peered":"2024-05-21T13:35:57.799043+0000","last_unstale":"2024-05-21T13:36:02.806009+0000","last_undegraded":"2024-05-21T13:36:02.806009+0000","last_fullsized":"2024-05-21T13:36:02.806009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:22:48.607953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.961831+0000","last_change":"2024-05-21T13:36:01.852469+0000","last_active":"2024-05-21T13:36:02.961831+0000","last_peered":"2024-05-21T13:36:02.961831+0000","last_clean":"2024-05-21T13:36:02.961831+0000","last_became_active":"2024-05-21T13:36:01.851913+0000","last_became_peered":"2024-05-21T13:36:01.851913+0000","last_unstale":"2024-05-21T13:36:02.961831+0000","last_undegraded":"2024-05-21T13:36:02.961831+0000","last_fullsized":"2024-05-21T13:36:02.961831+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:42:58.062540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.805533+0000","last_change":"2024-05-21T13:35:57.796516+0000","last_active":"2024-05-21T13:36:02.805533+0000","last_peered":"2024-05-21T13:36:02.805533+0000","last_clean":"2024-05-21T13:36:02.805533+0000","last_became_active":"2024-05-21T13:35:57.795638+0000","last_became_peered":"2024-05-21T13:35:57.795638+0000","last_unstale":"2024-05-21T13:36:02.805533+0000","last_undegraded":"2024-05-21T13:36:02.805533+0000","last_fullsized":"2024-05-21T13:36:02.805533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:46:40.541835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"24'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.805922+0000","last_change":"2024-05-21T13:35:56.748046+0000","last_active":"2024-05-21T13:36:02.805922+0000","last_peered":"2024-05-21T13:36:02.805922+0000","last_clean":"2024-05-21T13:36:02.805922+0000","last_became_active":"2024-05-21T13:35:56.747635+0000","last_became_peered":"2024-05-21T13:35:56.747635+0000","last_unstale":"2024-05-21T13:36:02.805922+0000","last_undegraded":"2024-05-21T13:36:02.805922+0000","last_fullsized":"2024-05-21T13:36:02.805922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:52:28.665244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.805864+0000","last_change":"2024-05-21T13:36:01.862153+0000","last_active":"2024-05-21T13:36:02.805864+0000","last_peered":"2024-05-21T13:36:02.805864+0000","last_clean":"2024-05-21T13:36:02.805864+0000","last_became_active":"2024-05-21T13:36:01.861520+0000","last_became_peered":"2024-05-21T13:36:01.861520+0000","last_unstale":"2024-05-21T13:36:02.805864+0000","last_undegraded":"2024-05-21T13:36:02.805864+0000","last_fullsized":"2024-05-21T13:36:02.805864+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:04:37.306132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.964897+0000","last_change":"2024-05-21T13:35:57.786463+0000","last_active":"2024-05-21T13:36:02.964897+0000","last_peered":"2024-05-21T13:36:02.964897+0000","last_clean":"2024-05-21T13:36:02.964897+0000","last_became_active":"2024-05-21T13:35:57.786126+0000","last_became_peered":"2024-05-21T13:35:57.786126+0000","last_unstale":"2024-05-21T13:36:02.964897+0000","last_undegraded":"2024-05-21T13:36:02.964897+0000","last_fullsized":"2024-05-21T13:36:02.964897+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:39:32.076464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.966843+0000","last_change":"2024-05-21T13:35:56.765178+0000","last_active":"2024-05-21T13:36:02.966843+0000","last_peered":"2024-05-21T13:36:02.966843+0000","last_clean":"2024-05-21T13:36:02.966843+0000","last_became_active":"2024-05-21T13:35:56.764551+0000","last_became_peered":"2024-05-21T13:35:56.764551+0000","last_unstale":"2024-05-21T13:36:02.966843+0000","last_undegraded":"2024-05-21T13:36:02.966843+0000","last_fullsized":"2024-05-21T13:36:02.966843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:34:28.955222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.959609+0000","last_change":"2024-05-21T13:36:01.854410+0000","last_active":"2024-05-21T13:36:02.959609+0000","last_peered":"2024-05-21T13:36:02.959609+0000","last_clean":"2024-05-21T13:36:02.959609+0000","last_became_active":"2024-05-21T13:36:01.853975+0000","last_became_peered":"2024-05-21T13:36:01.853975+0000","last_unstale":"2024-05-21T13:36:02.959609+0000","last_undegraded":"2024-05-21T13:36:02.959609+0000","last_fullsized":"2024-05-21T13:36:02.959609+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:15:34.710504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.807180+0000","last_change":"2024-05-21T13:35:57.762509+0000","last_active":"2024-05-21T13:36:02.807180+0000","last_peered":"2024-05-21T13:36:02.807180+0000","last_clean":"2024-05-21T13:36:02.807180+0000","last_became_active":"2024-05-21T13:35:57.761739+0000","last_became_peered":"2024-05-21T13:35:57.761739+0000","last_unstale":"2024-05-21T13:36:02.807180+0000","last_undegraded":"2024-05-21T13:36:02.807180+0000","last_fullsized":"2024-05-21T13:36:02.807180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:41:17.911126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.807410+0000","last_change":"2024-05-21T13:35:56.734017+0000","last_active":"2024-05-21T13:36:02.807410+0000","last_peered":"2024-05-21T13:36:02.807410+0000","last_clean":"2024-05-21T13:36:02.807410+0000","last_became_active":"2024-05-21T13:35:56.733249+0000","last_became_peered":"2024-05-21T13:35:56.733249+0000","last_unstale":"2024-05-21T13:36:02.807410+0000","last_undegraded":"2024-05-21T13:36:02.807410+0000","last_fullsized":"2024-05-21T13:36:02.807410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:13:27.279557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.967145+0000","last_change":"2024-05-21T13:36:01.868669+0000","last_active":"2024-05-21T13:36:02.967145+0000","last_peered":"2024-05-21T13:36:02.967145+0000","last_clean":"2024-05-21T13:36:02.967145+0000","last_became_active":"2024-05-21T13:36:01.867701+0000","last_became_peered":"2024-05-21T13:36:01.867701+0000","last_unstale":"2024-05-21T13:36:02.967145+0000","last_undegraded":"2024-05-21T13:36:02.967145+0000","last_fullsized":"2024-05-21T13:36:02.967145+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:09:21.615570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.804889+0000","last_change":"2024-05-21T13:35:57.789966+0000","last_active":"2024-05-21T13:36:02.804889+0000","last_peered":"2024-05-21T13:36:02.804889+0000","last_clean":"2024-05-21T13:36:02.804889+0000","last_became_active":"2024-05-21T13:35:57.789213+0000","last_became_peered":"2024-05-21T13:35:57.789213+0000","last_unstale":"2024-05-21T13:36:02.804889+0000","last_undegraded":"2024-05-21T13:36:02.804889+0000","last_fullsized":"2024-05-21T13:36:02.804889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:33:24.183958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.959018+0000","last_change":"2024-05-21T13:35:56.746878+0000","last_active":"2024-05-21T13:36:02.959018+0000","last_peered":"2024-05-21T13:36:02.959018+0000","last_clean":"2024-05-21T13:36:02.959018+0000","last_became_active":"2024-05-21T13:35:56.746534+0000","last_became_peered":"2024-05-21T13:35:56.746534+0000","last_unstale":"2024-05-21T13:36:02.959018+0000","last_undegraded":"2024-05-21T13:36:02.959018+0000","last_fullsized":"2024-05-21T13:36:02.959018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:45:56.935415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.961481+0000","last_change":"2024-05-21T13:36:01.841632+0000","last_active":"2024-05-21T13:36:02.961481+0000","last_peered":"2024-05-21T13:36:02.961481+0000","last_clean":"2024-05-21T13:36:02.961481+0000","last_became_active":"2024-05-21T13:36:01.841216+0000","last_became_peered":"2024-05-21T13:36:01.841216+0000","last_unstale":"2024-05-21T13:36:02.961481+0000","last_undegraded":"2024-05-21T13:36:02.961481+0000","last_fullsized":"2024-05-21T13:36:02.961481+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:49:05.576221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.807962+0000","last_change":"2024-05-21T13:35:57.764793+0000","last_active":"2024-05-21T13:36:02.807962+0000","last_peered":"2024-05-21T13:36:02.807962+0000","last_clean":"2024-05-21T13:36:02.807962+0000","last_became_active":"2024-05-21T13:35:57.764017+0000","last_became_peered":"2024-05-21T13:35:57.764017+0000","last_unstale":"2024-05-21T13:36:02.807962+0000","last_undegraded":"2024-05-21T13:36:02.807962+0000","last_fullsized":"2024-05-21T13:36:02.807962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:25:45.006614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"24'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.808160+0000","last_change":"2024-05-21T13:35:56.752278+0000","last_active":"2024-05-21T13:36:02.808160+0000","last_peered":"2024-05-21T13:36:02.808160+0000","last_clean":"2024-05-21T13:36:02.808160+0000","last_became_active":"2024-05-21T13:35:56.751883+0000","last_became_peered":"2024-05-21T13:35:56.751883+0000","last_unstale":"2024-05-21T13:36:02.808160+0000","last_undegraded":"2024-05-21T13:36:02.808160+0000","last_fullsized":"2024-05-21T13:36:02.808160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:08:05.279701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.961503+0000","last_change":"2024-05-21T13:36:01.832621+0000","last_active":"2024-05-21T13:36:02.961503+0000","last_peered":"2024-05-21T13:36:02.961503+0000","last_clean":"2024-05-21T13:36:02.961503+0000","last_became_active":"2024-05-21T13:36:01.831609+0000","last_became_peered":"2024-05-21T13:36:01.831609+0000","last_unstale":"2024-05-21T13:36:02.961503+0000","last_undegraded":"2024-05-21T13:36:02.961503+0000","last_fullsized":"2024-05-21T13:36:02.961503+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:26:43.075259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.808212+0000","last_change":"2024-05-21T13:35:57.783487+0000","last_active":"2024-05-21T13:36:02.808212+0000","last_peered":"2024-05-21T13:36:02.808212+0000","last_clean":"2024-05-21T13:36:02.808212+0000","last_became_active":"2024-05-21T13:35:57.783150+0000","last_became_peered":"2024-05-21T13:35:57.783150+0000","last_unstale":"2024-05-21T13:36:02.808212+0000","last_undegraded":"2024-05-21T13:36:02.808212+0000","last_fullsized":"2024-05-21T13:36:02.808212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:14:56.991945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.808184+0000","last_change":"2024-05-21T13:35:56.745122+0000","last_active":"2024-05-21T13:36:02.808184+0000","last_peered":"2024-05-21T13:36:02.808184+0000","last_clean":"2024-05-21T13:36:02.808184+0000","last_became_active":"2024-05-21T13:35:56.744218+0000","last_became_peered":"2024-05-21T13:35:56.744218+0000","last_unstale":"2024-05-21T13:36:02.808184+0000","last_undegraded":"2024-05-21T13:36:02.808184+0000","last_fullsized":"2024-05-21T13:36:02.808184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:45:03.790591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.807106+0000","last_change":"2024-05-21T13:36:01.838971+0000","last_active":"2024-05-21T13:36:02.807106+0000","last_peered":"2024-05-21T13:36:02.807106+0000","last_clean":"2024-05-21T13:36:02.807106+0000","last_became_active":"2024-05-21T13:36:01.837401+0000","last_became_peered":"2024-05-21T13:36:01.837401+0000","last_unstale":"2024-05-21T13:36:02.807106+0000","last_undegraded":"2024-05-21T13:36:02.807106+0000","last_fullsized":"2024-05-21T13:36:02.807106+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:16:25.666568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.967981+0000","last_change":"2024-05-21T13:35:57.784993+0000","last_active":"2024-05-21T13:36:02.967981+0000","last_peered":"2024-05-21T13:36:02.967981+0000","last_clean":"2024-05-21T13:36:02.967981+0000","last_became_active":"2024-05-21T13:35:57.784664+0000","last_became_peered":"2024-05-21T13:35:57.784664+0000","last_unstale":"2024-05-21T13:36:02.967981+0000","last_undegraded":"2024-05-21T13:36:02.967981+0000","last_fullsized":"2024-05-21T13:36:02.967981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:58:20.045901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.806794+0000","last_change":"2024-05-21T13:35:56.741285+0000","last_active":"2024-05-21T13:36:02.806794+0000","last_peered":"2024-05-21T13:36:02.806794+0000","last_clean":"2024-05-21T13:36:02.806794+0000","last_became_active":"2024-05-21T13:35:56.740846+0000","last_became_peered":"2024-05-21T13:35:56.740846+0000","last_unstale":"2024-05-21T13:36:02.806794+0000","last_undegraded":"2024-05-21T13:36:02.806794+0000","last_fullsized":"2024-05-21T13:36:02.806794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:34:17.960870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.963587+0000","last_change":"2024-05-21T13:36:01.873172+0000","last_active":"2024-05-21T13:36:02.963587+0000","last_peered":"2024-05-21T13:36:02.963587+0000","last_clean":"2024-05-21T13:36:02.963587+0000","last_became_active":"2024-05-21T13:36:01.872085+0000","last_became_peered":"2024-05-21T13:36:01.872085+0000","last_unstale":"2024-05-21T13:36:02.963587+0000","last_undegraded":"2024-05-21T13:36:02.963587+0000","last_fullsized":"2024-05-21T13:36:02.963587+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:24:57.031323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.961092+0000","last_change":"2024-05-21T13:35:57.783176+0000","last_active":"2024-05-21T13:36:02.961092+0000","last_peered":"2024-05-21T13:36:02.961092+0000","last_clean":"2024-05-21T13:36:02.961092+0000","last_became_active":"2024-05-21T13:35:57.782517+0000","last_became_peered":"2024-05-21T13:35:57.782517+0000","last_unstale":"2024-05-21T13:36:02.961092+0000","last_undegraded":"2024-05-21T13:36:02.961092+0000","last_fullsized":"2024-05-21T13:36:02.961092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:06:58.203996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.964483+0000","last_change":"2024-05-21T13:35:56.767544+0000","last_active":"2024-05-21T13:36:02.964483+0000","last_peered":"2024-05-21T13:36:02.964483+0000","last_clean":"2024-05-21T13:36:02.964483+0000","last_became_active":"2024-05-21T13:35:56.764987+0000","last_became_peered":"2024-05-21T13:35:56.764987+0000","last_unstale":"2024-05-21T13:36:02.964483+0000","last_undegraded":"2024-05-21T13:36:02.964483+0000","last_fullsized":"2024-05-21T13:36:02.964483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:12:46.828769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.966223+0000","last_change":"2024-05-21T13:36:01.872215+0000","last_active":"2024-05-21T13:36:02.966223+0000","last_peered":"2024-05-21T13:36:02.966223+0000","last_clean":"2024-05-21T13:36:02.966223+0000","last_became_active":"2024-05-21T13:36:01.870831+0000","last_became_peered":"2024-05-21T13:36:01.870831+0000","last_unstale":"2024-05-21T13:36:02.966223+0000","last_undegraded":"2024-05-21T13:36:02.966223+0000","last_fullsized":"2024-05-21T13:36:02.966223+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:04:09.689206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.959882+0000","last_change":"2024-05-21T13:35:57.783616+0000","last_active":"2024-05-21T13:36:02.959882+0000","last_peered":"2024-05-21T13:36:02.959882+0000","last_clean":"2024-05-21T13:36:02.959882+0000","last_became_active":"2024-05-21T13:35:57.780521+0000","last_became_peered":"2024-05-21T13:35:57.780521+0000","last_unstale":"2024-05-21T13:36:02.959882+0000","last_undegraded":"2024-05-21T13:36:02.959882+0000","last_fullsized":"2024-05-21T13:36:02.959882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:59:44.121631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.806771+0000","last_change":"2024-05-21T13:35:56.750341+0000","last_active":"2024-05-21T13:36:02.806771+0000","last_peered":"2024-05-21T13:36:02.806771+0000","last_clean":"2024-05-21T13:36:02.806771+0000","last_became_active":"2024-05-21T13:35:56.750006+0000","last_became_peered":"2024-05-21T13:35:56.750006+0000","last_unstale":"2024-05-21T13:36:02.806771+0000","last_undegraded":"2024-05-21T13:36:02.806771+0000","last_fullsized":"2024-05-21T13:36:02.806771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:15:21.416234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.967726+0000","last_change":"2024-05-21T13:36:01.873693+0000","last_active":"2024-05-21T13:36:02.967726+0000","last_peered":"2024-05-21T13:36:02.967726+0000","last_clean":"2024-05-21T13:36:02.967726+0000","last_became_active":"2024-05-21T13:36:01.872363+0000","last_became_peered":"2024-05-21T13:36:01.872363+0000","last_unstale":"2024-05-21T13:36:02.967726+0000","last_undegraded":"2024-05-21T13:36:02.967726+0000","last_fullsized":"2024-05-21T13:36:02.967726+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:27:25.974289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.961878+0000","last_change":"2024-05-21T13:35:57.780809+0000","last_active":"2024-05-21T13:36:02.961878+0000","last_peered":"2024-05-21T13:36:02.961878+0000","last_clean":"2024-05-21T13:36:02.961878+0000","last_became_active":"2024-05-21T13:35:57.780313+0000","last_became_peered":"2024-05-21T13:35:57.780313+0000","last_unstale":"2024-05-21T13:36:02.961878+0000","last_undegraded":"2024-05-21T13:36:02.961878+0000","last_fullsized":"2024-05-21T13:36:02.961878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:43:11.778238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.964084+0000","last_change":"2024-05-21T13:35:56.771138+0000","last_active":"2024-05-21T13:36:02.964084+0000","last_peered":"2024-05-21T13:36:02.964084+0000","last_clean":"2024-05-21T13:36:02.964084+0000","last_became_active":"2024-05-21T13:35:56.770465+0000","last_became_peered":"2024-05-21T13:35:56.770465+0000","last_unstale":"2024-05-21T13:36:02.964084+0000","last_undegraded":"2024-05-21T13:36:02.964084+0000","last_fullsized":"2024-05-21T13:36:02.964084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:21:16.702309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.968200+0000","last_change":"2024-05-21T13:36:01.871328+0000","last_active":"2024-05-21T13:36:02.968200+0000","last_peered":"2024-05-21T13:36:02.968200+0000","last_clean":"2024-05-21T13:36:02.968200+0000","last_became_active":"2024-05-21T13:36:01.870678+0000","last_became_peered":"2024-05-21T13:36:01.870678+0000","last_unstale":"2024-05-21T13:36:02.968200+0000","last_undegraded":"2024-05-21T13:36:02.968200+0000","last_fullsized":"2024-05-21T13:36:02.968200+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:22:47.393065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.962506+0000","last_change":"2024-05-21T13:35:57.782665+0000","last_active":"2024-05-21T13:36:02.962506+0000","last_peered":"2024-05-21T13:36:02.962506+0000","last_clean":"2024-05-21T13:36:02.962506+0000","last_became_active":"2024-05-21T13:35:57.781299+0000","last_became_peered":"2024-05-21T13:35:57.781299+0000","last_unstale":"2024-05-21T13:36:02.962506+0000","last_undegraded":"2024-05-21T13:36:02.962506+0000","last_fullsized":"2024-05-21T13:36:02.962506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:21:22.721124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.805211+0000","last_change":"2024-05-21T13:35:56.768193+0000","last_active":"2024-05-21T13:36:02.805211+0000","last_peered":"2024-05-21T13:36:02.805211+0000","last_clean":"2024-05-21T13:36:02.805211+0000","last_became_active":"2024-05-21T13:35:56.767788+0000","last_became_peered":"2024-05-21T13:35:56.767788+0000","last_unstale":"2024-05-21T13:36:02.805211+0000","last_undegraded":"2024-05-21T13:36:02.805211+0000","last_fullsized":"2024-05-21T13:36:02.805211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:12:52.911816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.965762+0000","last_change":"2024-05-21T13:36:01.860305+0000","last_active":"2024-05-21T13:36:02.965762+0000","last_peered":"2024-05-21T13:36:02.965762+0000","last_clean":"2024-05-21T13:36:02.965762+0000","last_became_active":"2024-05-21T13:36:01.859141+0000","last_became_peered":"2024-05-21T13:36:01.859141+0000","last_unstale":"2024-05-21T13:36:02.965762+0000","last_undegraded":"2024-05-21T13:36:02.965762+0000","last_fullsized":"2024-05-21T13:36:02.965762+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:05:45.203241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.807817+0000","last_change":"2024-05-21T13:35:57.775523+0000","last_active":"2024-05-21T13:36:02.807817+0000","last_peered":"2024-05-21T13:36:02.807817+0000","last_clean":"2024-05-21T13:36:02.807817+0000","last_became_active":"2024-05-21T13:35:57.774322+0000","last_became_peered":"2024-05-21T13:35:57.774322+0000","last_unstale":"2024-05-21T13:36:02.807817+0000","last_undegraded":"2024-05-21T13:36:02.807817+0000","last_fullsized":"2024-05-21T13:36:02.807817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:06:35.118540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.806599+0000","last_change":"2024-05-21T13:35:56.748185+0000","last_active":"2024-05-21T13:36:02.806599+0000","last_peered":"2024-05-21T13:36:02.806599+0000","last_clean":"2024-05-21T13:36:02.806599+0000","last_became_active":"2024-05-21T13:35:56.747823+0000","last_became_peered":"2024-05-21T13:35:56.747823+0000","last_unstale":"2024-05-21T13:36:02.806599+0000","last_undegraded":"2024-05-21T13:36:02.806599+0000","last_fullsized":"2024-05-21T13:36:02.806599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:38:00.235330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":117,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.963125+0000","last_change":"2024-05-21T13:35:45.682484+0000","last_active":"2024-05-21T13:36:02.963125+0000","last_peered":"2024-05-21T13:36:02.963125+0000","last_clean":"2024-05-21T13:36:02.963125+0000","last_became_active":"2024-05-21T13:35:45.680732+0000","last_became_peered":"2024-05-21T13:35:45.680732+0000","last_unstale":"2024-05-21T13:36:02.963125+0000","last_undegraded":"2024-05-21T13:36:02.963125+0000","last_fullsized":"2024-05-21T13:36:02.963125+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:44.542324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:44.542324+0000","last_clean_scrub_stamp":"2024-05-21T13:35:44.542324+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:16:05.034161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.806631+0000","last_change":"2024-05-21T13:36:01.830034+0000","last_active":"2024-05-21T13:36:02.806631+0000","last_peered":"2024-05-21T13:36:02.806631+0000","last_clean":"2024-05-21T13:36:02.806631+0000","last_became_active":"2024-05-21T13:36:01.828957+0000","last_became_peered":"2024-05-21T13:36:01.828957+0000","last_unstale":"2024-05-21T13:36:02.806631+0000","last_undegraded":"2024-05-21T13:36:02.806631+0000","last_fullsized":"2024-05-21T13:36:02.806631+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:21:59.514268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.806258+0000","last_change":"2024-05-21T13:35:57.796419+0000","last_active":"2024-05-21T13:36:02.806258+0000","last_peered":"2024-05-21T13:36:02.806258+0000","last_clean":"2024-05-21T13:36:02.806258+0000","last_became_active":"2024-05-21T13:35:57.796050+0000","last_became_peered":"2024-05-21T13:35:57.796050+0000","last_unstale":"2024-05-21T13:36:02.806258+0000","last_undegraded":"2024-05-21T13:36:02.806258+0000","last_fullsized":"2024-05-21T13:36:02.806258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:56:07.121391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.968145+0000","last_change":"2024-05-21T13:35:56.751619+0000","last_active":"2024-05-21T13:36:02.968145+0000","last_peered":"2024-05-21T13:36:02.968145+0000","last_clean":"2024-05-21T13:36:02.968145+0000","last_became_active":"2024-05-21T13:35:56.748604+0000","last_became_peered":"2024-05-21T13:35:56.748604+0000","last_unstale":"2024-05-21T13:36:02.968145+0000","last_undegraded":"2024-05-21T13:36:02.968145+0000","last_fullsized":"2024-05-21T13:36:02.968145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:19:03.052434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.961835+0000","last_change":"2024-05-21T13:36:01.825464+0000","last_active":"2024-05-21T13:36:02.961835+0000","last_peered":"2024-05-21T13:36:02.961835+0000","last_clean":"2024-05-21T13:36:02.961835+0000","last_became_active":"2024-05-21T13:36:01.824653+0000","last_became_peered":"2024-05-21T13:36:01.824653+0000","last_unstale":"2024-05-21T13:36:02.961835+0000","last_undegraded":"2024-05-21T13:36:02.961835+0000","last_fullsized":"2024-05-21T13:36:02.961835+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:29:32.830052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.960114+0000","last_change":"2024-05-21T13:35:57.784031+0000","last_active":"2024-05-21T13:36:02.960114+0000","last_peered":"2024-05-21T13:36:02.960114+0000","last_clean":"2024-05-21T13:36:02.960114+0000","last_became_active":"2024-05-21T13:35:57.771695+0000","last_became_peered":"2024-05-21T13:35:57.771695+0000","last_unstale":"2024-05-21T13:36:02.960114+0000","last_undegraded":"2024-05-21T13:36:02.960114+0000","last_fullsized":"2024-05-21T13:36:02.960114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:46:33.308257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.965392+0000","last_change":"2024-05-21T13:35:56.768166+0000","last_active":"2024-05-21T13:36:02.965392+0000","last_peered":"2024-05-21T13:36:02.965392+0000","last_clean":"2024-05-21T13:36:02.965392+0000","last_became_active":"2024-05-21T13:35:56.767053+0000","last_became_peered":"2024-05-21T13:35:56.767053+0000","last_unstale":"2024-05-21T13:36:02.965392+0000","last_undegraded":"2024-05-21T13:36:02.965392+0000","last_fullsized":"2024-05-21T13:36:02.965392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:10:16.639491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.963683+0000","last_change":"2024-05-21T13:36:01.834253+0000","last_active":"2024-05-21T13:36:02.963683+0000","last_peered":"2024-05-21T13:36:02.963683+0000","last_clean":"2024-05-21T13:36:02.963683+0000","last_became_active":"2024-05-21T13:36:01.832972+0000","last_became_peered":"2024-05-21T13:36:01.832972+0000","last_unstale":"2024-05-21T13:36:02.963683+0000","last_undegraded":"2024-05-21T13:36:02.963683+0000","last_fullsized":"2024-05-21T13:36:02.963683+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:52:05.576063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.960150+0000","last_change":"2024-05-21T13:35:57.766504+0000","last_active":"2024-05-21T13:36:02.960150+0000","last_peered":"2024-05-21T13:36:02.960150+0000","last_clean":"2024-05-21T13:36:02.960150+0000","last_became_active":"2024-05-21T13:35:57.765756+0000","last_became_peered":"2024-05-21T13:35:57.765756+0000","last_unstale":"2024-05-21T13:36:02.960150+0000","last_undegraded":"2024-05-21T13:36:02.960150+0000","last_fullsized":"2024-05-21T13:36:02.960150+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:52:13.025110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.808071+0000","last_change":"2024-05-21T13:35:56.770347+0000","last_active":"2024-05-21T13:36:02.808071+0000","last_peered":"2024-05-21T13:36:02.808071+0000","last_clean":"2024-05-21T13:36:02.808071+0000","last_became_active":"2024-05-21T13:35:56.769767+0000","last_became_peered":"2024-05-21T13:35:56.769767+0000","last_unstale":"2024-05-21T13:36:02.808071+0000","last_undegraded":"2024-05-21T13:36:02.808071+0000","last_fullsized":"2024-05-21T13:36:02.808071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:40:01.698967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.804632+0000","last_change":"2024-05-21T13:36:01.827091+0000","last_active":"2024-05-21T13:36:02.804632+0000","last_peered":"2024-05-21T13:36:02.804632+0000","last_clean":"2024-05-21T13:36:02.804632+0000","last_became_active":"2024-05-21T13:36:01.826686+0000","last_became_peered":"2024-05-21T13:36:01.826686+0000","last_unstale":"2024-05-21T13:36:02.804632+0000","last_undegraded":"2024-05-21T13:36:02.804632+0000","last_fullsized":"2024-05-21T13:36:02.804632+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:42:47.638921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.962149+0000","last_change":"2024-05-21T13:35:57.781528+0000","last_active":"2024-05-21T13:36:02.962149+0000","last_peered":"2024-05-21T13:36:02.962149+0000","last_clean":"2024-05-21T13:36:02.962149+0000","last_became_active":"2024-05-21T13:35:57.781111+0000","last_became_peered":"2024-05-21T13:35:57.781111+0000","last_unstale":"2024-05-21T13:36:02.962149+0000","last_undegraded":"2024-05-21T13:36:02.962149+0000","last_fullsized":"2024-05-21T13:36:02.962149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:15:43.847640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"24'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.960114+0000","last_change":"2024-05-21T13:35:56.755413+0000","last_active":"2024-05-21T13:36:02.960114+0000","last_peered":"2024-05-21T13:36:02.960114+0000","last_clean":"2024-05-21T13:36:02.960114+0000","last_became_active":"2024-05-21T13:35:56.755158+0000","last_became_peered":"2024-05-21T13:35:56.755158+0000","last_unstale":"2024-05-21T13:36:02.960114+0000","last_undegraded":"2024-05-21T13:36:02.960114+0000","last_fullsized":"2024-05-21T13:36:02.960114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:23:05.102098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.962809+0000","last_change":"2024-05-21T13:36:01.827237+0000","last_active":"2024-05-21T13:36:02.962809+0000","last_peered":"2024-05-21T13:36:02.962809+0000","last_clean":"2024-05-21T13:36:02.962809+0000","last_became_active":"2024-05-21T13:36:01.826374+0000","last_became_peered":"2024-05-21T13:36:01.826374+0000","last_unstale":"2024-05-21T13:36:02.962809+0000","last_undegraded":"2024-05-21T13:36:02.962809+0000","last_fullsized":"2024-05-21T13:36:02.962809+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:12:33.528068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.804889+0000","last_change":"2024-05-21T13:35:57.787940+0000","last_active":"2024-05-21T13:36:02.804889+0000","last_peered":"2024-05-21T13:36:02.804889+0000","last_clean":"2024-05-21T13:36:02.804889+0000","last_became_active":"2024-05-21T13:35:57.787544+0000","last_became_peered":"2024-05-21T13:35:57.787544+0000","last_unstale":"2024-05-21T13:36:02.804889+0000","last_undegraded":"2024-05-21T13:36:02.804889+0000","last_fullsized":"2024-05-21T13:36:02.804889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:46:20.335316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"24'8","reported_seq":30,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.807309+0000","last_change":"2024-05-21T13:35:56.756262+0000","last_active":"2024-05-21T13:36:02.807309+0000","last_peered":"2024-05-21T13:36:02.807309+0000","last_clean":"2024-05-21T13:36:02.807309+0000","last_became_active":"2024-05-21T13:35:56.752342+0000","last_became_peered":"2024-05-21T13:35:56.752342+0000","last_unstale":"2024-05-21T13:36:02.807309+0000","last_undegraded":"2024-05-21T13:36:02.807309+0000","last_fullsized":"2024-05-21T13:36:02.807309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:59:09.541382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.966115+0000","last_change":"2024-05-21T13:36:01.859498+0000","last_active":"2024-05-21T13:36:02.966115+0000","last_peered":"2024-05-21T13:36:02.966115+0000","last_clean":"2024-05-21T13:36:02.966115+0000","last_became_active":"2024-05-21T13:36:01.857707+0000","last_became_peered":"2024-05-21T13:36:01.857707+0000","last_unstale":"2024-05-21T13:36:02.966115+0000","last_undegraded":"2024-05-21T13:36:02.966115+0000","last_fullsized":"2024-05-21T13:36:02.966115+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:38:06.966814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.962835+0000","last_change":"2024-05-21T13:35:57.783007+0000","last_active":"2024-05-21T13:36:02.962835+0000","last_peered":"2024-05-21T13:36:02.962835+0000","last_clean":"2024-05-21T13:36:02.962835+0000","last_became_active":"2024-05-21T13:35:57.782330+0000","last_became_peered":"2024-05-21T13:35:57.782330+0000","last_unstale":"2024-05-21T13:36:02.962835+0000","last_undegraded":"2024-05-21T13:36:02.962835+0000","last_fullsized":"2024-05-21T13:36:02.962835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:26:14.697766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.959369+0000","last_change":"2024-05-21T13:35:56.745787+0000","last_active":"2024-05-21T13:36:02.959369+0000","last_peered":"2024-05-21T13:36:02.959369+0000","last_clean":"2024-05-21T13:36:02.959369+0000","last_became_active":"2024-05-21T13:35:56.745202+0000","last_became_peered":"2024-05-21T13:35:56.745202+0000","last_unstale":"2024-05-21T13:36:02.959369+0000","last_undegraded":"2024-05-21T13:36:02.959369+0000","last_fullsized":"2024-05-21T13:36:02.959369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:31:13.498003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.965870+0000","last_change":"2024-05-21T13:36:01.858550+0000","last_active":"2024-05-21T13:36:02.965870+0000","last_peered":"2024-05-21T13:36:02.965870+0000","last_clean":"2024-05-21T13:36:02.965870+0000","last_became_active":"2024-05-21T13:36:01.857716+0000","last_became_peered":"2024-05-21T13:36:01.857716+0000","last_unstale":"2024-05-21T13:36:02.965870+0000","last_undegraded":"2024-05-21T13:36:02.965870+0000","last_fullsized":"2024-05-21T13:36:02.965870+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:48:32.490678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.805527+0000","last_change":"2024-05-21T13:35:57.799702+0000","last_active":"2024-05-21T13:36:02.805527+0000","last_peered":"2024-05-21T13:36:02.805527+0000","last_clean":"2024-05-21T13:36:02.805527+0000","last_became_active":"2024-05-21T13:35:57.799225+0000","last_became_peered":"2024-05-21T13:35:57.799225+0000","last_unstale":"2024-05-21T13:36:02.805527+0000","last_undegraded":"2024-05-21T13:36:02.805527+0000","last_fullsized":"2024-05-21T13:36:02.805527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:29:54.094448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.806444+0000","last_change":"2024-05-21T13:35:56.742650+0000","last_active":"2024-05-21T13:36:02.806444+0000","last_peered":"2024-05-21T13:36:02.806444+0000","last_clean":"2024-05-21T13:36:02.806444+0000","last_became_active":"2024-05-21T13:35:56.742296+0000","last_became_peered":"2024-05-21T13:35:56.742296+0000","last_unstale":"2024-05-21T13:36:02.806444+0000","last_undegraded":"2024-05-21T13:36:02.806444+0000","last_fullsized":"2024-05-21T13:36:02.806444+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:18:55.514845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.967634+0000","last_change":"2024-05-21T13:36:01.873708+0000","last_active":"2024-05-21T13:36:02.967634+0000","last_peered":"2024-05-21T13:36:02.967634+0000","last_clean":"2024-05-21T13:36:02.967634+0000","last_became_active":"2024-05-21T13:36:01.872320+0000","last_became_peered":"2024-05-21T13:36:01.872320+0000","last_unstale":"2024-05-21T13:36:02.967634+0000","last_undegraded":"2024-05-21T13:36:02.967634+0000","last_fullsized":"2024-05-21T13:36:02.967634+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:01:15.545756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.966606+0000","last_change":"2024-05-21T13:35:57.802763+0000","last_active":"2024-05-21T13:36:02.966606+0000","last_peered":"2024-05-21T13:36:02.966606+0000","last_clean":"2024-05-21T13:36:02.966606+0000","last_became_active":"2024-05-21T13:35:57.802433+0000","last_became_peered":"2024-05-21T13:35:57.802433+0000","last_unstale":"2024-05-21T13:36:02.966606+0000","last_undegraded":"2024-05-21T13:36:02.966606+0000","last_fullsized":"2024-05-21T13:36:02.966606+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:09:48.463186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.965357+0000","last_change":"2024-05-21T13:35:56.754087+0000","last_active":"2024-05-21T13:36:02.965357+0000","last_peered":"2024-05-21T13:36:02.965357+0000","last_clean":"2024-05-21T13:36:02.965357+0000","last_became_active":"2024-05-21T13:35:56.753319+0000","last_became_peered":"2024-05-21T13:35:56.753319+0000","last_unstale":"2024-05-21T13:36:02.965357+0000","last_undegraded":"2024-05-21T13:36:02.965357+0000","last_fullsized":"2024-05-21T13:36:02.965357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:19:21.276993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.806089+0000","last_change":"2024-05-21T13:36:01.836017+0000","last_active":"2024-05-21T13:36:02.806089+0000","last_peered":"2024-05-21T13:36:02.806089+0000","last_clean":"2024-05-21T13:36:02.806089+0000","last_became_active":"2024-05-21T13:36:01.835450+0000","last_became_peered":"2024-05-21T13:36:01.835450+0000","last_unstale":"2024-05-21T13:36:02.806089+0000","last_undegraded":"2024-05-21T13:36:02.806089+0000","last_fullsized":"2024-05-21T13:36:02.806089+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:05:56.077605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.962152+0000","last_change":"2024-05-21T13:35:57.787177+0000","last_active":"2024-05-21T13:36:02.962152+0000","last_peered":"2024-05-21T13:36:02.962152+0000","last_clean":"2024-05-21T13:36:02.962152+0000","last_became_active":"2024-05-21T13:35:57.786401+0000","last_became_peered":"2024-05-21T13:35:57.786401+0000","last_unstale":"2024-05-21T13:36:02.962152+0000","last_undegraded":"2024-05-21T13:36:02.962152+0000","last_fullsized":"2024-05-21T13:36:02.962152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:17:18.939002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:12.171576+0000","last_change":"2024-05-21T13:35:56.751229+0000","last_active":"2024-05-21T13:36:12.171576+0000","last_peered":"2024-05-21T13:36:12.171576+0000","last_clean":"2024-05-21T13:36:12.171576+0000","last_became_active":"2024-05-21T13:35:56.750831+0000","last_became_peered":"2024-05-21T13:35:56.750831+0000","last_unstale":"2024-05-21T13:36:12.171576+0000","last_undegraded":"2024-05-21T13:36:12.171576+0000","last_fullsized":"2024-05-21T13:36:12.171576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:03:40.186241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.807730+0000","last_change":"2024-05-21T13:36:01.832691+0000","last_active":"2024-05-21T13:36:02.807730+0000","last_peered":"2024-05-21T13:36:02.807730+0000","last_clean":"2024-05-21T13:36:02.807730+0000","last_became_active":"2024-05-21T13:36:01.831476+0000","last_became_peered":"2024-05-21T13:36:01.831476+0000","last_unstale":"2024-05-21T13:36:02.807730+0000","last_undegraded":"2024-05-21T13:36:02.807730+0000","last_fullsized":"2024-05-21T13:36:02.807730+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:08:38.092592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.805422+0000","last_change":"2024-05-21T13:35:57.788547+0000","last_active":"2024-05-21T13:36:02.805422+0000","last_peered":"2024-05-21T13:36:02.805422+0000","last_clean":"2024-05-21T13:36:02.805422+0000","last_became_active":"2024-05-21T13:35:57.787785+0000","last_became_peered":"2024-05-21T13:35:57.787785+0000","last_unstale":"2024-05-21T13:36:02.805422+0000","last_undegraded":"2024-05-21T13:36:02.805422+0000","last_fullsized":"2024-05-21T13:36:02.805422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:51:08.781399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"24'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.964609+0000","last_change":"2024-05-21T13:35:56.760557+0000","last_active":"2024-05-21T13:36:02.964609+0000","last_peered":"2024-05-21T13:36:02.964609+0000","last_clean":"2024-05-21T13:36:02.964609+0000","last_became_active":"2024-05-21T13:35:56.759728+0000","last_became_peered":"2024-05-21T13:35:56.759728+0000","last_unstale":"2024-05-21T13:36:02.964609+0000","last_undegraded":"2024-05-21T13:36:02.964609+0000","last_fullsized":"2024-05-21T13:36:02.964609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:56:19.754940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.962040+0000","last_change":"2024-05-21T13:36:01.861622+0000","last_active":"2024-05-21T13:36:02.962040+0000","last_peered":"2024-05-21T13:36:02.962040+0000","last_clean":"2024-05-21T13:36:02.962040+0000","last_became_active":"2024-05-21T13:36:01.861172+0000","last_became_peered":"2024-05-21T13:36:01.861172+0000","last_unstale":"2024-05-21T13:36:02.962040+0000","last_undegraded":"2024-05-21T13:36:02.962040+0000","last_fullsized":"2024-05-21T13:36:02.962040+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:39:53.211812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.966013+0000","last_change":"2024-05-21T13:35:57.804520+0000","last_active":"2024-05-21T13:36:02.966013+0000","last_peered":"2024-05-21T13:36:02.966013+0000","last_clean":"2024-05-21T13:36:02.966013+0000","last_became_active":"2024-05-21T13:35:57.804139+0000","last_became_peered":"2024-05-21T13:35:57.804139+0000","last_unstale":"2024-05-21T13:36:02.966013+0000","last_undegraded":"2024-05-21T13:36:02.966013+0000","last_fullsized":"2024-05-21T13:36:02.966013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:21:52.433019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.959802+0000","last_change":"2024-05-21T13:35:56.733821+0000","last_active":"2024-05-21T13:36:02.959802+0000","last_peered":"2024-05-21T13:36:02.959802+0000","last_clean":"2024-05-21T13:36:02.959802+0000","last_became_active":"2024-05-21T13:35:56.732488+0000","last_became_peered":"2024-05-21T13:35:56.732488+0000","last_unstale":"2024-05-21T13:36:02.959802+0000","last_undegraded":"2024-05-21T13:36:02.959802+0000","last_fullsized":"2024-05-21T13:36:02.959802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:10:01.786931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.961990+0000","last_change":"2024-05-21T13:36:01.868781+0000","last_active":"2024-05-21T13:36:02.961990+0000","last_peered":"2024-05-21T13:36:02.961990+0000","last_clean":"2024-05-21T13:36:02.961990+0000","last_became_active":"2024-05-21T13:36:01.864254+0000","last_became_peered":"2024-05-21T13:36:01.864254+0000","last_unstale":"2024-05-21T13:36:02.961990+0000","last_undegraded":"2024-05-21T13:36:02.961990+0000","last_fullsized":"2024-05-21T13:36:02.961990+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:34:12.632333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.962094+0000","last_change":"2024-05-21T13:35:57.788313+0000","last_active":"2024-05-21T13:36:02.962094+0000","last_peered":"2024-05-21T13:36:02.962094+0000","last_clean":"2024-05-21T13:36:02.962094+0000","last_became_active":"2024-05-21T13:35:57.787963+0000","last_became_peered":"2024-05-21T13:35:57.787963+0000","last_unstale":"2024-05-21T13:36:02.962094+0000","last_undegraded":"2024-05-21T13:36:02.962094+0000","last_fullsized":"2024-05-21T13:36:02.962094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:16:21.586571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.963973+0000","last_change":"2024-05-21T13:35:56.748334+0000","last_active":"2024-05-21T13:36:02.963973+0000","last_peered":"2024-05-21T13:36:02.963973+0000","last_clean":"2024-05-21T13:36:02.963973+0000","last_became_active":"2024-05-21T13:35:56.748049+0000","last_became_peered":"2024-05-21T13:35:56.748049+0000","last_unstale":"2024-05-21T13:36:02.963973+0000","last_undegraded":"2024-05-21T13:36:02.963973+0000","last_fullsized":"2024-05-21T13:36:02.963973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:59:02.802905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.807330+0000","last_change":"2024-05-21T13:36:01.856216+0000","last_active":"2024-05-21T13:36:02.807330+0000","last_peered":"2024-05-21T13:36:02.807330+0000","last_clean":"2024-05-21T13:36:02.807330+0000","last_became_active":"2024-05-21T13:36:01.855417+0000","last_became_peered":"2024-05-21T13:36:01.855417+0000","last_unstale":"2024-05-21T13:36:02.807330+0000","last_undegraded":"2024-05-21T13:36:02.807330+0000","last_fullsized":"2024-05-21T13:36:02.807330+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:36:01.423944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.807915+0000","last_change":"2024-05-21T13:36:01.838966+0000","last_active":"2024-05-21T13:36:02.807915+0000","last_peered":"2024-05-21T13:36:02.807915+0000","last_clean":"2024-05-21T13:36:02.807915+0000","last_became_active":"2024-05-21T13:36:01.837777+0000","last_became_peered":"2024-05-21T13:36:01.837777+0000","last_unstale":"2024-05-21T13:36:02.807915+0000","last_undegraded":"2024-05-21T13:36:02.807915+0000","last_fullsized":"2024-05-21T13:36:02.807915+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:40:55.688338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.807274+0000","last_change":"2024-05-21T13:35:57.762719+0000","last_active":"2024-05-21T13:36:02.807274+0000","last_peered":"2024-05-21T13:36:02.807274+0000","last_clean":"2024-05-21T13:36:02.807274+0000","last_became_active":"2024-05-21T13:35:57.762071+0000","last_became_peered":"2024-05-21T13:35:57.762071+0000","last_unstale":"2024-05-21T13:36:02.807274+0000","last_undegraded":"2024-05-21T13:36:02.807274+0000","last_fullsized":"2024-05-21T13:36:02.807274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:55:37.631695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.805108+0000","last_change":"2024-05-21T13:35:56.751481+0000","last_active":"2024-05-21T13:36:02.805108+0000","last_peered":"2024-05-21T13:36:02.805108+0000","last_clean":"2024-05-21T13:36:02.805108+0000","last_became_active":"2024-05-21T13:35:56.751201+0000","last_became_peered":"2024-05-21T13:35:56.751201+0000","last_unstale":"2024-05-21T13:36:02.805108+0000","last_undegraded":"2024-05-21T13:36:02.805108+0000","last_fullsized":"2024-05-21T13:36:02.805108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:33:28.720246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.806144+0000","last_change":"2024-05-21T13:36:01.837042+0000","last_active":"2024-05-21T13:36:02.806144+0000","last_peered":"2024-05-21T13:36:02.806144+0000","last_clean":"2024-05-21T13:36:02.806144+0000","last_became_active":"2024-05-21T13:36:01.836194+0000","last_became_peered":"2024-05-21T13:36:01.836194+0000","last_unstale":"2024-05-21T13:36:02.806144+0000","last_undegraded":"2024-05-21T13:36:02.806144+0000","last_fullsized":"2024-05-21T13:36:02.806144+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:15:50.751693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.962036+0000","last_change":"2024-05-21T13:35:57.788838+0000","last_active":"2024-05-21T13:36:02.962036+0000","last_peered":"2024-05-21T13:36:02.962036+0000","last_clean":"2024-05-21T13:36:02.962036+0000","last_became_active":"2024-05-21T13:35:57.786307+0000","last_became_peered":"2024-05-21T13:35:57.786307+0000","last_unstale":"2024-05-21T13:36:02.962036+0000","last_undegraded":"2024-05-21T13:36:02.962036+0000","last_fullsized":"2024-05-21T13:36:02.962036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:52:09.086807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.962585+0000","last_change":"2024-05-21T13:35:56.746564+0000","last_active":"2024-05-21T13:36:02.962585+0000","last_peered":"2024-05-21T13:36:02.962585+0000","last_clean":"2024-05-21T13:36:02.962585+0000","last_became_active":"2024-05-21T13:35:56.745884+0000","last_became_peered":"2024-05-21T13:35:56.745884+0000","last_unstale":"2024-05-21T13:36:02.962585+0000","last_undegraded":"2024-05-21T13:36:02.962585+0000","last_fullsized":"2024-05-21T13:36:02.962585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:01:44.738607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"24'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.806093+0000","last_change":"2024-05-21T13:35:56.753930+0000","last_active":"2024-05-21T13:36:02.806093+0000","last_peered":"2024-05-21T13:36:02.806093+0000","last_clean":"2024-05-21T13:36:02.806093+0000","last_became_active":"2024-05-21T13:35:56.753499+0000","last_became_peered":"2024-05-21T13:35:56.753499+0000","last_unstale":"2024-05-21T13:36:02.806093+0000","last_undegraded":"2024-05-21T13:36:02.806093+0000","last_fullsized":"2024-05-21T13:36:02.806093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:40:51.516544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.808045+0000","last_change":"2024-05-21T13:35:57.780101+0000","last_active":"2024-05-21T13:36:02.808045+0000","last_peered":"2024-05-21T13:36:02.808045+0000","last_clean":"2024-05-21T13:36:02.808045+0000","last_became_active":"2024-05-21T13:35:57.779368+0000","last_became_peered":"2024-05-21T13:35:57.779368+0000","last_unstale":"2024-05-21T13:36:02.808045+0000","last_undegraded":"2024-05-21T13:36:02.808045+0000","last_fullsized":"2024-05-21T13:36:02.808045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:37:39.347067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.808272+0000","last_change":"2024-05-21T13:36:01.844240+0000","last_active":"2024-05-21T13:36:02.808272+0000","last_peered":"2024-05-21T13:36:02.808272+0000","last_clean":"2024-05-21T13:36:02.808272+0000","last_became_active":"2024-05-21T13:36:01.842792+0000","last_became_peered":"2024-05-21T13:36:01.842792+0000","last_unstale":"2024-05-21T13:36:02.808272+0000","last_undegraded":"2024-05-21T13:36:02.808272+0000","last_fullsized":"2024-05-21T13:36:02.808272+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:19:54.016465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"24'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.964084+0000","last_change":"2024-05-21T13:35:56.770864+0000","last_active":"2024-05-21T13:36:02.964084+0000","last_peered":"2024-05-21T13:36:02.964084+0000","last_clean":"2024-05-21T13:36:02.964084+0000","last_became_active":"2024-05-21T13:35:56.766873+0000","last_became_peered":"2024-05-21T13:35:56.766873+0000","last_unstale":"2024-05-21T13:36:02.964084+0000","last_undegraded":"2024-05-21T13:36:02.964084+0000","last_fullsized":"2024-05-21T13:36:02.964084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:13:02.633858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.963803+0000","last_change":"2024-05-21T13:35:57.787563+0000","last_active":"2024-05-21T13:36:02.963803+0000","last_peered":"2024-05-21T13:36:02.963803+0000","last_clean":"2024-05-21T13:36:02.963803+0000","last_became_active":"2024-05-21T13:35:57.787255+0000","last_became_peered":"2024-05-21T13:35:57.787255+0000","last_unstale":"2024-05-21T13:36:02.963803+0000","last_undegraded":"2024-05-21T13:36:02.963803+0000","last_fullsized":"2024-05-21T13:36:02.963803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:32:49.325049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.964068+0000","last_change":"2024-05-21T13:36:01.868514+0000","last_active":"2024-05-21T13:36:02.964068+0000","last_peered":"2024-05-21T13:36:02.964068+0000","last_clean":"2024-05-21T13:36:02.964068+0000","last_became_active":"2024-05-21T13:36:01.867522+0000","last_became_peered":"2024-05-21T13:36:01.867522+0000","last_unstale":"2024-05-21T13:36:02.964068+0000","last_undegraded":"2024-05-21T13:36:02.964068+0000","last_fullsized":"2024-05-21T13:36:02.964068+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:19:13.533784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.960872+0000","last_change":"2024-05-21T13:35:57.782641+0000","last_active":"2024-05-21T13:36:02.960872+0000","last_peered":"2024-05-21T13:36:02.960872+0000","last_clean":"2024-05-21T13:36:02.960872+0000","last_became_active":"2024-05-21T13:35:57.782233+0000","last_became_peered":"2024-05-21T13:35:57.782233+0000","last_unstale":"2024-05-21T13:36:02.960872+0000","last_undegraded":"2024-05-21T13:36:02.960872+0000","last_fullsized":"2024-05-21T13:36:02.960872+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:55:18.808229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.963845+0000","last_change":"2024-05-21T13:35:57.770591+0000","last_active":"2024-05-21T13:36:02.963845+0000","last_peered":"2024-05-21T13:36:02.963845+0000","last_clean":"2024-05-21T13:36:02.963845+0000","last_became_active":"2024-05-21T13:35:57.769785+0000","last_became_peered":"2024-05-21T13:35:57.769785+0000","last_unstale":"2024-05-21T13:36:02.963845+0000","last_undegraded":"2024-05-21T13:36:02.963845+0000","last_fullsized":"2024-05-21T13:36:02.963845+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:18:28.168393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.805267+0000","last_change":"2024-05-21T13:35:57.799153+0000","last_active":"2024-05-21T13:36:02.805267+0000","last_peered":"2024-05-21T13:36:02.805267+0000","last_clean":"2024-05-21T13:36:02.805267+0000","last_became_active":"2024-05-21T13:35:57.796495+0000","last_became_peered":"2024-05-21T13:35:57.796495+0000","last_unstale":"2024-05-21T13:36:02.805267+0000","last_undegraded":"2024-05-21T13:36:02.805267+0000","last_fullsized":"2024-05-21T13:36:02.805267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:53:04.109036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.963840+0000","last_change":"2024-05-21T13:35:57.784335+0000","last_active":"2024-05-21T13:36:02.963840+0000","last_peered":"2024-05-21T13:36:02.963840+0000","last_clean":"2024-05-21T13:36:02.963840+0000","last_became_active":"2024-05-21T13:35:57.783968+0000","last_became_peered":"2024-05-21T13:35:57.783968+0000","last_unstale":"2024-05-21T13:36:02.963840+0000","last_undegraded":"2024-05-21T13:36:02.963840+0000","last_fullsized":"2024-05-21T13:36:02.963840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:57:20.832617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.967890+0000","last_change":"2024-05-21T13:35:57.795153+0000","last_active":"2024-05-21T13:36:02.967890+0000","last_peered":"2024-05-21T13:36:02.967890+0000","last_clean":"2024-05-21T13:36:02.967890+0000","last_became_active":"2024-05-21T13:35:57.794885+0000","last_became_peered":"2024-05-21T13:35:57.794885+0000","last_unstale":"2024-05-21T13:36:02.967890+0000","last_undegraded":"2024-05-21T13:36:02.967890+0000","last_fullsized":"2024-05-21T13:36:02.967890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:17:00.454371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.967778+0000","last_change":"2024-05-21T13:35:57.778916+0000","last_active":"2024-05-21T13:36:02.967778+0000","last_peered":"2024-05-21T13:36:02.967778+0000","last_clean":"2024-05-21T13:36:02.967778+0000","last_became_active":"2024-05-21T13:35:57.778171+0000","last_became_peered":"2024-05-21T13:35:57.778171+0000","last_unstale":"2024-05-21T13:36:02.967778+0000","last_undegraded":"2024-05-21T13:36:02.967778+0000","last_fullsized":"2024-05-21T13:36:02.967778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:15:37.425836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.961364+0000","last_change":"2024-05-21T13:35:57.791367+0000","last_active":"2024-05-21T13:36:02.961364+0000","last_peered":"2024-05-21T13:36:02.961364+0000","last_clean":"2024-05-21T13:36:02.961364+0000","last_became_active":"2024-05-21T13:35:57.790971+0000","last_became_peered":"2024-05-21T13:35:57.790971+0000","last_unstale":"2024-05-21T13:36:02.961364+0000","last_undegraded":"2024-05-21T13:36:02.961364+0000","last_fullsized":"2024-05-21T13:36:02.961364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:14:47.428631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.965591+0000","last_change":"2024-05-21T13:35:57.785257+0000","last_active":"2024-05-21T13:36:02.965591+0000","last_peered":"2024-05-21T13:36:02.965591+0000","last_clean":"2024-05-21T13:36:02.965591+0000","last_became_active":"2024-05-21T13:35:57.781533+0000","last_became_peered":"2024-05-21T13:35:57.781533+0000","last_unstale":"2024-05-21T13:36:02.965591+0000","last_undegraded":"2024-05-21T13:36:02.965591+0000","last_fullsized":"2024-05-21T13:36:02.965591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:18:32.591803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.804917+0000","last_change":"2024-05-21T13:35:57.799128+0000","last_active":"2024-05-21T13:36:02.804917+0000","last_peered":"2024-05-21T13:36:02.804917+0000","last_clean":"2024-05-21T13:36:02.804917+0000","last_became_active":"2024-05-21T13:35:57.797044+0000","last_became_peered":"2024-05-21T13:35:57.797044+0000","last_unstale":"2024-05-21T13:36:02.804917+0000","last_undegraded":"2024-05-21T13:36:02.804917+0000","last_fullsized":"2024-05-21T13:36:02.804917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:57:13.472309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.962393+0000","last_change":"2024-05-21T13:35:57.789768+0000","last_active":"2024-05-21T13:36:02.962393+0000","last_peered":"2024-05-21T13:36:02.962393+0000","last_clean":"2024-05-21T13:36:02.962393+0000","last_became_active":"2024-05-21T13:35:57.789474+0000","last_became_peered":"2024-05-21T13:35:57.789474+0000","last_unstale":"2024-05-21T13:36:02.962393+0000","last_undegraded":"2024-05-21T13:36:02.962393+0000","last_fullsized":"2024-05-21T13:36:02.962393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:42:53.993281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.963561+0000","last_change":"2024-05-21T13:35:57.756607+0000","last_active":"2024-05-21T13:36:02.963561+0000","last_peered":"2024-05-21T13:36:02.963561+0000","last_clean":"2024-05-21T13:36:02.963561+0000","last_became_active":"2024-05-21T13:35:57.755889+0000","last_became_peered":"2024-05-21T13:35:57.755889+0000","last_unstale":"2024-05-21T13:36:02.963561+0000","last_undegraded":"2024-05-21T13:36:02.963561+0000","last_fullsized":"2024-05-21T13:36:02.963561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:16:19.541597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.808181+0000","last_change":"2024-05-21T13:35:57.775322+0000","last_active":"2024-05-21T13:36:02.808181+0000","last_peered":"2024-05-21T13:36:02.808181+0000","last_clean":"2024-05-21T13:36:02.808181+0000","last_became_active":"2024-05-21T13:35:57.774386+0000","last_became_peered":"2024-05-21T13:35:57.774386+0000","last_unstale":"2024-05-21T13:36:02.808181+0000","last_undegraded":"2024-05-21T13:36:02.808181+0000","last_fullsized":"2024-05-21T13:36:02.808181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:01:02.106172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.959969+0000","last_change":"2024-05-21T13:35:57.769931+0000","last_active":"2024-05-21T13:36:02.959969+0000","last_peered":"2024-05-21T13:36:02.959969+0000","last_clean":"2024-05-21T13:36:02.959969+0000","last_became_active":"2024-05-21T13:35:57.769149+0000","last_became_peered":"2024-05-21T13:35:57.769149+0000","last_unstale":"2024-05-21T13:36:02.959969+0000","last_undegraded":"2024-05-21T13:36:02.959969+0000","last_fullsized":"2024-05-21T13:36:02.959969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:55:56.268307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.806502+0000","last_change":"2024-05-21T13:35:57.796153+0000","last_active":"2024-05-21T13:36:02.806502+0000","last_peered":"2024-05-21T13:36:02.806502+0000","last_clean":"2024-05-21T13:36:02.806502+0000","last_became_active":"2024-05-21T13:35:57.795799+0000","last_became_peered":"2024-05-21T13:35:57.795799+0000","last_unstale":"2024-05-21T13:36:02.806502+0000","last_undegraded":"2024-05-21T13:36:02.806502+0000","last_fullsized":"2024-05-21T13:36:02.806502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:52:04.794391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.966824+0000","last_change":"2024-05-21T13:35:57.776414+0000","last_active":"2024-05-21T13:36:02.966824+0000","last_peered":"2024-05-21T13:36:02.966824+0000","last_clean":"2024-05-21T13:36:02.966824+0000","last_became_active":"2024-05-21T13:35:57.775573+0000","last_became_peered":"2024-05-21T13:35:57.775573+0000","last_unstale":"2024-05-21T13:36:02.966824+0000","last_undegraded":"2024-05-21T13:36:02.966824+0000","last_fullsized":"2024-05-21T13:36:02.966824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:47:47.624662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.808011+0000","last_change":"2024-05-21T13:35:57.799673+0000","last_active":"2024-05-21T13:36:02.808011+0000","last_peered":"2024-05-21T13:36:02.808011+0000","last_clean":"2024-05-21T13:36:02.808011+0000","last_became_active":"2024-05-21T13:35:57.799313+0000","last_became_peered":"2024-05-21T13:35:57.799313+0000","last_unstale":"2024-05-21T13:36:02.808011+0000","last_undegraded":"2024-05-21T13:36:02.808011+0000","last_fullsized":"2024-05-21T13:36:02.808011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:40:52.516216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.804786+0000","last_change":"2024-05-21T13:35:57.790705+0000","last_active":"2024-05-21T13:36:02.804786+0000","last_peered":"2024-05-21T13:36:02.804786+0000","last_clean":"2024-05-21T13:36:02.804786+0000","last_became_active":"2024-05-21T13:35:57.787735+0000","last_became_peered":"2024-05-21T13:35:57.787735+0000","last_unstale":"2024-05-21T13:36:02.804786+0000","last_undegraded":"2024-05-21T13:36:02.804786+0000","last_fullsized":"2024-05-21T13:36:02.804786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:17:24.376182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.961973+0000","last_change":"2024-05-21T13:35:57.786838+0000","last_active":"2024-05-21T13:36:02.961973+0000","last_peered":"2024-05-21T13:36:02.961973+0000","last_clean":"2024-05-21T13:36:02.961973+0000","last_became_active":"2024-05-21T13:35:57.786403+0000","last_became_peered":"2024-05-21T13:35:57.786403+0000","last_unstale":"2024-05-21T13:36:02.961973+0000","last_undegraded":"2024-05-21T13:36:02.961973+0000","last_fullsized":"2024-05-21T13:36:02.961973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:29:28.760793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.966410+0000","last_change":"2024-05-21T13:35:57.783561+0000","last_active":"2024-05-21T13:36:02.966410+0000","last_peered":"2024-05-21T13:36:02.966410+0000","last_clean":"2024-05-21T13:36:02.966410+0000","last_became_active":"2024-05-21T13:35:57.783060+0000","last_became_peered":"2024-05-21T13:35:57.783060+0000","last_unstale":"2024-05-21T13:36:02.966410+0000","last_undegraded":"2024-05-21T13:36:02.966410+0000","last_fullsized":"2024-05-21T13:36:02.966410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:27:27.261449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.964046+0000","last_change":"2024-05-21T13:35:57.788210+0000","last_active":"2024-05-21T13:36:02.964046+0000","last_peered":"2024-05-21T13:36:02.964046+0000","last_clean":"2024-05-21T13:36:02.964046+0000","last_became_active":"2024-05-21T13:35:57.787508+0000","last_became_peered":"2024-05-21T13:35:57.787508+0000","last_unstale":"2024-05-21T13:36:02.964046+0000","last_undegraded":"2024-05-21T13:36:02.964046+0000","last_fullsized":"2024-05-21T13:36:02.964046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:12:56.914580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.959869+0000","last_change":"2024-05-21T13:35:57.787335+0000","last_active":"2024-05-21T13:36:02.959869+0000","last_peered":"2024-05-21T13:36:02.959869+0000","last_clean":"2024-05-21T13:36:02.959869+0000","last_became_active":"2024-05-21T13:35:57.786292+0000","last_became_peered":"2024-05-21T13:35:57.786292+0000","last_unstale":"2024-05-21T13:36:02.959869+0000","last_undegraded":"2024-05-21T13:36:02.959869+0000","last_fullsized":"2024-05-21T13:36:02.959869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:49:40.480948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.960610+0000","last_change":"2024-05-21T13:35:57.801121+0000","last_active":"2024-05-21T13:36:02.960610+0000","last_peered":"2024-05-21T13:36:02.960610+0000","last_clean":"2024-05-21T13:36:02.960610+0000","last_became_active":"2024-05-21T13:35:57.800858+0000","last_became_peered":"2024-05-21T13:35:57.800858+0000","last_unstale":"2024-05-21T13:36:02.960610+0000","last_undegraded":"2024-05-21T13:36:02.960610+0000","last_fullsized":"2024-05-21T13:36:02.960610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:41:08.765821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.959709+0000","last_change":"2024-05-21T13:35:57.778753+0000","last_active":"2024-05-21T13:36:02.959709+0000","last_peered":"2024-05-21T13:36:02.959709+0000","last_clean":"2024-05-21T13:36:02.959709+0000","last_became_active":"2024-05-21T13:35:57.777962+0000","last_became_peered":"2024-05-21T13:35:57.777962+0000","last_unstale":"2024-05-21T13:36:02.959709+0000","last_undegraded":"2024-05-21T13:36:02.959709+0000","last_fullsized":"2024-05-21T13:36:02.959709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:51:49.102945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.963934+0000","last_change":"2024-05-21T13:35:57.798312+0000","last_active":"2024-05-21T13:36:02.963934+0000","last_peered":"2024-05-21T13:36:02.963934+0000","last_clean":"2024-05-21T13:36:02.963934+0000","last_became_active":"2024-05-21T13:35:57.797793+0000","last_became_peered":"2024-05-21T13:35:57.797793+0000","last_unstale":"2024-05-21T13:36:02.963934+0000","last_undegraded":"2024-05-21T13:36:02.963934+0000","last_fullsized":"2024-05-21T13:36:02.963934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:28:47.276868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.961736+0000","last_change":"2024-05-21T13:35:57.782412+0000","last_active":"2024-05-21T13:36:02.961736+0000","last_peered":"2024-05-21T13:36:02.961736+0000","last_clean":"2024-05-21T13:36:02.961736+0000","last_became_active":"2024-05-21T13:35:57.782058+0000","last_became_peered":"2024-05-21T13:35:57.782058+0000","last_unstale":"2024-05-21T13:36:02.961736+0000","last_undegraded":"2024-05-21T13:36:02.961736+0000","last_fullsized":"2024-05-21T13:36:02.961736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:39:49.142554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.959879+0000","last_change":"2024-05-21T13:35:57.779771+0000","last_active":"2024-05-21T13:36:02.959879+0000","last_peered":"2024-05-21T13:36:02.959879+0000","last_clean":"2024-05-21T13:36:02.959879+0000","last_became_active":"2024-05-21T13:35:57.779168+0000","last_became_peered":"2024-05-21T13:35:57.779168+0000","last_unstale":"2024-05-21T13:36:02.959879+0000","last_undegraded":"2024-05-21T13:36:02.959879+0000","last_fullsized":"2024-05-21T13:36:02.959879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T13:59:58.966203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.961896+0000","last_change":"2024-05-21T13:35:57.773098+0000","last_active":"2024-05-21T13:36:02.961896+0000","last_peered":"2024-05-21T13:36:02.961896+0000","last_clean":"2024-05-21T13:36:02.961896+0000","last_became_active":"2024-05-21T13:35:57.772268+0000","last_became_peered":"2024-05-21T13:35:57.772268+0000","last_unstale":"2024-05-21T13:36:02.961896+0000","last_undegraded":"2024-05-21T13:36:02.961896+0000","last_fullsized":"2024-05-21T13:36:02.961896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:05:25.482434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.960610+0000","last_change":"2024-05-21T13:35:57.788980+0000","last_active":"2024-05-21T13:36:02.960610+0000","last_peered":"2024-05-21T13:36:02.960610+0000","last_clean":"2024-05-21T13:36:02.960610+0000","last_became_active":"2024-05-21T13:35:57.788689+0000","last_became_peered":"2024-05-21T13:35:57.788689+0000","last_unstale":"2024-05-21T13:36:02.960610+0000","last_undegraded":"2024-05-21T13:36:02.960610+0000","last_fullsized":"2024-05-21T13:36:02.960610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:15:07.615363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.961136+0000","last_change":"2024-05-21T13:35:57.772867+0000","last_active":"2024-05-21T13:36:02.961136+0000","last_peered":"2024-05-21T13:36:02.961136+0000","last_clean":"2024-05-21T13:36:02.961136+0000","last_became_active":"2024-05-21T13:35:57.772160+0000","last_became_peered":"2024-05-21T13:35:57.772160+0000","last_unstale":"2024-05-21T13:36:02.961136+0000","last_undegraded":"2024-05-21T13:36:02.961136+0000","last_fullsized":"2024-05-21T13:36:02.961136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:11:24.428796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.964773+0000","last_change":"2024-05-21T13:35:57.785297+0000","last_active":"2024-05-21T13:36:02.964773+0000","last_peered":"2024-05-21T13:36:02.964773+0000","last_clean":"2024-05-21T13:36:02.964773+0000","last_became_active":"2024-05-21T13:35:57.784741+0000","last_became_peered":"2024-05-21T13:35:57.784741+0000","last_unstale":"2024-05-21T13:36:02.964773+0000","last_undegraded":"2024-05-21T13:36:02.964773+0000","last_fullsized":"2024-05-21T13:36:02.964773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:45:08.507286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.965566+0000","last_change":"2024-05-21T13:35:57.788875+0000","last_active":"2024-05-21T13:36:02.965566+0000","last_peered":"2024-05-21T13:36:02.965566+0000","last_clean":"2024-05-21T13:36:02.965566+0000","last_became_active":"2024-05-21T13:35:57.786629+0000","last_became_peered":"2024-05-21T13:35:57.786629+0000","last_unstale":"2024-05-21T13:36:02.965566+0000","last_undegraded":"2024-05-21T13:36:02.965566+0000","last_fullsized":"2024-05-21T13:36:02.965566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:40:07.549210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.959984+0000","last_change":"2024-05-21T13:35:57.803316+0000","last_active":"2024-05-21T13:36:02.959984+0000","last_peered":"2024-05-21T13:36:02.959984+0000","last_clean":"2024-05-21T13:36:02.959984+0000","last_became_active":"2024-05-21T13:35:57.802925+0000","last_became_peered":"2024-05-21T13:35:57.802925+0000","last_unstale":"2024-05-21T13:36:02.959984+0000","last_undegraded":"2024-05-21T13:36:02.959984+0000","last_fullsized":"2024-05-21T13:36:02.959984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:17:16.304097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66916,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509450,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":101627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509450,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":101503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509449,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":262144,"data_stored":102085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509450,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":270336,"data_stored":105345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509450,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31504,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340336,"statfs":{"total":96636764160,"available":96604504064,"internally_reserved":0,"allocated":327680,"data_stored":691941,"data_compressed":33458,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509449,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":266240,"data_stored":101559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542152,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":331776,"data_stored":691963,"data_compressed":33458,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":278528,"data_stored":106017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33458,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33458,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":4514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-21T13:36:25.302 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-21T13:36:25.302 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-21T13:36:25.302 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-05-21T13:36:25.302 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-05-21T13:36:25.303 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-05-21T13:36:25.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.486+0000 7fa1619f5640 1 Processor -- start 2024-05-21T13:36:25.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.486+0000 7fa1619f5640 1 -- start start 2024-05-21T13:36:25.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.486+0000 7fa1619f5640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa15c155b00 0x7fa15c0c83a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:25.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.486+0000 7fa1619f5640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa15c0ca9f0 0x7fa15c15f190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:25.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.486+0000 7fa1619f5640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa15c0c88e0 con 0x7fa15c155ee0 2024-05-21T13:36:25.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.486+0000 7fa1619f5640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fa15c15bc20 con 0x7fa15c0ca9f0 2024-05-21T13:36:25.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.486+0000 7fa1619f5640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7fa15c15bf00 con 0x7fa15c155b00 2024-05-21T13:36:25.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.486+0000 7fa15b7fe640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa15c0ca9f0 0x7fa15c15f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:25.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.486+0000 7fa15b7fe640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa15c0ca9f0 0x7fa15c15f190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36702/0 (socket says 172.21.15.22:36702) 2024-05-21T13:36:25.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.486+0000 7fa15b7fe640 1 -- 172.21.15.22:0/2747898583 learned_addr learned my addr 172.21.15.22:0/2747898583 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:25.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.486+0000 7fa15a7fc640 1 --1- 172.21.15.22:0/2747898583 >> v1:172.21.15.22:6789/0 conn(0x7fa15c155ee0 0x7fa15c0ca2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:43870/0 (socket says 172.21.15.22:43870) 2024-05-21T13:36:25.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.486+0000 7fa15affd640 1 --2- 172.21.15.22:0/2747898583 >> v2:172.21.15.115:3300/0 conn(0x7fa15c155b00 0x7fa15c0c83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:25.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.486+0000 7fa15b7fe640 1 -- 172.21.15.22:0/2747898583 >> v2:172.21.15.115:3300/0 conn(0x7fa15c155b00 msgr2=0x7fa15c0c83a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:25.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.486+0000 7fa15b7fe640 1 --2- 172.21.15.22:0/2747898583 >> v2:172.21.15.115:3300/0 conn(0x7fa15c155b00 0x7fa15c0c83a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:25.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.486+0000 7fa15b7fe640 1 -- 172.21.15.22:0/2747898583 >> v1:172.21.15.22:6789/0 conn(0x7fa15c155ee0 legacy=0x7fa15c0ca2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:25.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.486+0000 7fa15b7fe640 1 -- 172.21.15.22:0/2747898583 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa15c15c1e0 con 0x7fa15c0ca9f0 2024-05-21T13:36:25.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.486+0000 7fa159ffb640 1 -- 172.21.15.22:0/2747898583 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 463213006 0 0) 0x7fa15c0c88e0 con 0x7fa15c155ee0 2024-05-21T13:36:25.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.490+0000 7fa15b7fe640 1 --2- 172.21.15.22:0/2747898583 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa15c0ca9f0 0x7fa15c15f190 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa15c068460 tx=0x7fa15401ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ea6ed27879dcfb9 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:25.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.490+0000 7fa159ffb640 1 -- 172.21.15.22:0/2747898583 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1540b5070 con 0x7fa15c0ca9f0 2024-05-21T13:36:25.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.490+0000 7fa159ffb640 1 -- 172.21.15.22:0/2747898583 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1540a8a10 con 0x7fa15c0ca9f0 2024-05-21T13:36:25.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.490+0000 7fa159ffb640 1 -- 172.21.15.22:0/2747898583 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1540a8de0 con 0x7fa15c0ca9f0 2024-05-21T13:36:25.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.490+0000 7fa1619f5640 1 -- 172.21.15.22:0/2747898583 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa15c0ca9f0 msgr2=0x7fa15c15f190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:25.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.490+0000 7fa1619f5640 1 --2- 172.21.15.22:0/2747898583 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa15c0ca9f0 0x7fa15c15f190 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa15c068460 tx=0x7fa15401ed10 comp rx=0 tx=0).stop 2024-05-21T13:36:25.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.490+0000 7fa1619f5640 1 -- 172.21.15.22:0/2747898583 shutdown_connections 2024-05-21T13:36:25.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.490+0000 7fa1619f5640 1 --2- 172.21.15.22:0/2747898583 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa15c0ca9f0 0x7fa15c15f190 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:25.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.490+0000 7fa1619f5640 1 --2- 172.21.15.22:0/2747898583 >> v2:172.21.15.115:3300/0 conn(0x7fa15c155b00 0x7fa15c0c83a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:25.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.490+0000 7fa1619f5640 1 -- 172.21.15.22:0/2747898583 >> 172.21.15.22:0/2747898583 conn(0x7fa15c0cd9a0 msgr2=0x7fa15c0cddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:25.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.490+0000 7fa1619f5640 1 -- 172.21.15.22:0/2747898583 shutdown_connections 2024-05-21T13:36:25.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.490+0000 7fa1619f5640 1 -- 172.21.15.22:0/2747898583 wait complete. 2024-05-21T13:36:25.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.490+0000 7fa1619f5640 1 Processor -- start 2024-05-21T13:36:25.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.490+0000 7fa1619f5640 1 -- start start 2024-05-21T13:36:25.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.490+0000 7fa1619f5640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa15c0ca9f0 0x7fa15c14e390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:25.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.490+0000 7fa1619f5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa15c155b00 0x7fa15c0c6830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:25.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.490+0000 7fa1619f5640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa15c155ee0 0x7fa15c1f11a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:25.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.490+0000 7fa1619f5640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa15c0688c0 con 0x7fa15c155b00 2024-05-21T13:36:25.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.490+0000 7fa1619f5640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fa15c068740 con 0x7fa15c0ca9f0 2024-05-21T13:36:25.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.490+0000 7fa1619f5640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7fa15c0cb7a0 con 0x7fa15c155ee0 2024-05-21T13:36:25.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.490+0000 7fa15a7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa15c155b00 0x7fa15c0c6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:25.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.490+0000 7fa15a7fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa15c155b00 0x7fa15c0c6830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36718/0 (socket says 172.21.15.22:36718) 2024-05-21T13:36:25.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.490+0000 7fa15a7fc640 1 -- 172.21.15.22:0/1196408160 learned_addr learned my addr 172.21.15.22:0/1196408160 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:25.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.490+0000 7fa15affd640 1 --2- 172.21.15.22:0/1196408160 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa15c0ca9f0 0x7fa15c14e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:25.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.490+0000 7fa15b7fe640 1 --2- 172.21.15.22:0/1196408160 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa15c155ee0 0x7fa15c1f11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:25.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.490+0000 7fa15a7fc640 1 -- 172.21.15.22:0/1196408160 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa15c155ee0 msgr2=0x7fa15c1f11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:25.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.490+0000 7fa15a7fc640 1 --2- 172.21.15.22:0/1196408160 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa15c155ee0 0x7fa15c1f11a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:25.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.490+0000 7fa15a7fc640 1 -- 172.21.15.22:0/1196408160 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa15c0ca9f0 msgr2=0x7fa15c14e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:25.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.490+0000 7fa15a7fc640 1 --2- 172.21.15.22:0/1196408160 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa15c0ca9f0 0x7fa15c14e390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:25.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.490+0000 7fa15a7fc640 1 -- 172.21.15.22:0/1196408160 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa15c0c59f0 con 0x7fa15c155b00 2024-05-21T13:36:25.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.494+0000 7fa15a7fc640 1 --2- 172.21.15.22:0/1196408160 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa15c155b00 0x7fa15c0c6830 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa15000c460 tx=0x7fa15000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:25.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.494+0000 7fa143fff640 1 -- 172.21.15.22:0/1196408160 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa150018070 con 0x7fa15c155b00 2024-05-21T13:36:25.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.494+0000 7fa143fff640 1 -- 172.21.15.22:0/1196408160 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa150007500 con 0x7fa15c155b00 2024-05-21T13:36:25.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.494+0000 7fa143fff640 1 -- 172.21.15.22:0/1196408160 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa150004a30 con 0x7fa15c155b00 2024-05-21T13:36:25.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.494+0000 7fa1619f5640 1 -- 172.21.15.22:0/1196408160 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa15c0c5cd0 con 0x7fa15c155b00 2024-05-21T13:36:25.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.494+0000 7fa1619f5640 1 -- 172.21.15.22:0/1196408160 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa15c154c20 con 0x7fa15c155b00 2024-05-21T13:36:25.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.494+0000 7fa1619f5640 1 -- 172.21.15.22:0/1196408160 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa15c077bb0 con 0x7fa15c155b00 2024-05-21T13:36:25.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.494+0000 7fa143fff640 1 -- 172.21.15.22:0/1196408160 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fa150004bd0 con 0x7fa15c155b00 2024-05-21T13:36:25.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.494+0000 7fa143fff640 1 --2- 172.21.15.22:0/1196408160 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fa14806f400 0x7fa1480718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:25.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.494+0000 7fa143fff640 1 -- 172.21.15.22:0/1196408160 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fa15008e880 con 0x7fa15c155b00 2024-05-21T13:36:25.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.494+0000 7fa15affd640 1 --2- 172.21.15.22:0/1196408160 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fa14806f400 0x7fa1480718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:25.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.494+0000 7fa15affd640 1 --2- 172.21.15.22:0/1196408160 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fa14806f400 0x7fa1480718c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa14c003fd0 tx=0x7fa14c0039a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:25.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.498+0000 7fa143fff640 1 -- 172.21.15.22:0/1196408160 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fa15005b4c0 con 0x7fa15c155b00 2024-05-21T13:36:25.678 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.702+0000 7fa1619f5640 1 -- 172.21.15.22:0/1196408160 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fa15c070550 con 0x7fa15c155b00 2024-05-21T13:36:25.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.702+0000 7fa143fff640 1 -- 172.21.15.22:0/1196408160 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+179549 (secure 0 0 0) 0x7fa15005adc0 con 0x7fa15c155b00 2024-05-21T13:36:25.683 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-21T13:36:25.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.706+0000 7fa1619f5640 1 -- 172.21.15.22:0/1196408160 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fa14806f400 msgr2=0x7fa1480718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:25.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.706+0000 7fa1619f5640 1 --2- 172.21.15.22:0/1196408160 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fa14806f400 0x7fa1480718c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa14c003fd0 tx=0x7fa14c0039a0 comp rx=0 tx=0).stop 2024-05-21T13:36:25.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.706+0000 7fa1619f5640 1 -- 172.21.15.22:0/1196408160 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa15c155b00 msgr2=0x7fa15c0c6830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:25.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.706+0000 7fa1619f5640 1 --2- 172.21.15.22:0/1196408160 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa15c155b00 0x7fa15c0c6830 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fa15000c460 tx=0x7fa15000c920 comp rx=0 tx=0).stop 2024-05-21T13:36:25.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.706+0000 7fa1619f5640 1 -- 172.21.15.22:0/1196408160 shutdown_connections 2024-05-21T13:36:25.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.706+0000 7fa1619f5640 1 --2- 172.21.15.22:0/1196408160 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fa14806f400 0x7fa1480718c0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:25.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.706+0000 7fa1619f5640 1 --2- 172.21.15.22:0/1196408160 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa15c155ee0 0x7fa15c1f11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:25.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.706+0000 7fa1619f5640 1 --2- 172.21.15.22:0/1196408160 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa15c155b00 0x7fa15c0c6830 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:25.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.706+0000 7fa1619f5640 1 --2- 172.21.15.22:0/1196408160 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa15c0ca9f0 0x7fa15c14e390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:25.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.706+0000 7fa1619f5640 1 -- 172.21.15.22:0/1196408160 >> 172.21.15.22:0/1196408160 conn(0x7fa15c0cd9a0 msgr2=0x7fa15c0cbbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:25.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.706+0000 7fa1619f5640 1 -- 172.21.15.22:0/1196408160 shutdown_connections 2024-05-21T13:36:25.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.706+0000 7fa1619f5640 1 -- 172.21.15.22:0/1196408160 wait complete. 2024-05-21T13:36:25.701 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":5,"flags":0,"active_gid":4103,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6832","nonce":184591771},{"type":"v1","addr":"172.21.15.115:6833","nonce":184591771}]},"active_addr":"172.21.15.115:6833/184591771","active_change":"2024-05-21T13:35:38.481881+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4104,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.115:0","nonce":3817959159}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.115:0","nonce":1166304418}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.115:0","nonce":1562035956}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.115:0","nonce":4027717541}]}]} 2024-05-21T13:36:25.704 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-05-21T13:36:25.705 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-05-21T13:36:25.705 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-21T13:36:25.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.850+0000 7f9f95af3640 1 Processor -- start 2024-05-21T13:36:25.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.854+0000 7f9f95af3640 1 -- start start 2024-05-21T13:36:25.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.854+0000 7f9f95af3640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9f90155d80 0x7f9f9015b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:25.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.854+0000 7f9f95af3640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f90156160 con 0x7f9f900cd1c0 2024-05-21T13:36:25.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.854+0000 7f9f95af3640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f9015c4a0 con 0x7f9f9015bf30 2024-05-21T13:36:25.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.854+0000 7f9f95af3640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f9f900ccfc0 con 0x7f9f90155d80 2024-05-21T13:36:25.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.854+0000 7f9f8ffff640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f9f900cd1c0 0x7f9f900d1420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:44476/0 (socket says 172.21.15.22:44476) 2024-05-21T13:36:25.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.854+0000 7f9f8ffff640 1 -- 172.21.15.22:0/207669181 learned_addr learned my addr 172.21.15.22:0/207669181 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-21T13:36:25.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.854+0000 7f9f8f7fe640 1 --2- 172.21.15.22:0/207669181 >> v2:172.21.15.115:3300/0 conn(0x7f9f90155d80 0x7f9f9015b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:25.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.854+0000 7f9f8e7fc640 1 -- 172.21.15.22:0/207669181 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3873561279 0 0) 0x7f9f90156160 con 0x7f9f900cd1c0 2024-05-21T13:36:25.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.854+0000 7f9f8e7fc640 1 -- 172.21.15.22:0/207669181 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9f7c003530 con 0x7f9f900cd1c0 2024-05-21T13:36:25.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.854+0000 7f9f8e7fc640 1 -- 172.21.15.22:0/207669181 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1346981092 0 0) 0x7f9f7c003530 con 0x7f9f900cd1c0 2024-05-21T13:36:25.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.854+0000 7f9f8e7fc640 1 -- 172.21.15.22:0/207669181 >> v2:172.21.15.115:3300/0 conn(0x7f9f90155d80 msgr2=0x7f9f9015b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:25.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.854+0000 7f9f8e7fc640 1 --2- 172.21.15.22:0/207669181 >> v2:172.21.15.115:3300/0 conn(0x7f9f90155d80 0x7f9f9015b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:25.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.854+0000 7f9f8e7fc640 1 -- 172.21.15.22:0/207669181 >> v1:172.21.15.115:6789/0 conn(0x7f9f9015bf30 legacy=0x7f9f900ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:25.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.854+0000 7f9f8e7fc640 1 -- 172.21.15.22:0/207669181 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f9015c780 con 0x7f9f900cd1c0 2024-05-21T13:36:25.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.854+0000 7f9f8e7fc640 1 -- 172.21.15.22:0/207669181 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2684847062 0 0) 0x7f9f88001a80 con 0x7f9f900cd1c0 2024-05-21T13:36:25.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.854+0000 7f9f8e7fc640 1 -- 172.21.15.22:0/207669181 >> v1:172.21.15.22:6789/0 conn(0x7f9f900cd1c0 legacy=0x7f9f900d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:25.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.854+0000 7f9f8e7fc640 1 --2- 172.21.15.22:0/207669181 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f7c003a60 0x7f9f7c003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:25.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.854+0000 7f9f8e7fc640 1 --2- 172.21.15.22:0/207669181 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f7c004810 0x7f9f7c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:25.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.854+0000 7f9f8e7fc640 1 --2- 172.21.15.22:0/207669181 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f7c0052f0 0x7f9f7c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:25.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.854+0000 7f9f8e7fc640 1 -- 172.21.15.22:0/207669181 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9f7c00c190 con 0x7f9f7c003a60 2024-05-21T13:36:25.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.854+0000 7f9f8e7fc640 1 -- 172.21.15.22:0/207669181 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f9f7c00c340 con 0x7f9f7c0052f0 2024-05-21T13:36:25.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.854+0000 7f9f8e7fc640 1 -- 172.21.15.22:0/207669181 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f9f7c00c540 con 0x7f9f7c004810 2024-05-21T13:36:25.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.854+0000 7f9f8f7fe640 1 --2- 172.21.15.22:0/207669181 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f7c003a60 0x7f9f7c003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:25.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.854+0000 7f9f8f7fe640 1 -- 172.21.15.22:0/207669181 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f7c004810 msgr2=0x7f9f7c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:25.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.854+0000 7f9f8effd640 1 --2- 172.21.15.22:0/207669181 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f7c004810 0x7f9f7c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:25.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.854+0000 7f9f8f7fe640 1 --2- 172.21.15.22:0/207669181 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f7c004810 0x7f9f7c004c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:25.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.854+0000 7f9f8f7fe640 1 -- 172.21.15.22:0/207669181 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f7c0052f0 msgr2=0x7f9f7c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:25.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.854+0000 7f9f8f7fe640 1 --2- 172.21.15.22:0/207669181 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f7c0052f0 0x7f9f7c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:25.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.854+0000 7f9f8ffff640 1 -- 172.21.15.22:0/207669181 reap_dead start 2024-05-21T13:36:25.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.854+0000 7f9f8f7fe640 1 -- 172.21.15.22:0/207669181 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f7c003530 con 0x7f9f7c003a60 2024-05-21T13:36:25.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.858+0000 7f9f8f7fe640 1 --2- 172.21.15.22:0/207669181 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f7c003a60 0x7f9f7c003e80 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9f80009ab0 tx=0x7f9f8001ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7657771af774a63 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:25.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.858+0000 7f9f8e7fc640 1 -- 172.21.15.22:0/207669181 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f800096b0 con 0x7f9f7c003a60 2024-05-21T13:36:25.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.858+0000 7f9f8e7fc640 1 -- 172.21.15.22:0/207669181 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f800a6450 con 0x7f9f7c003a60 2024-05-21T13:36:25.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.858+0000 7f9f8e7fc640 1 -- 172.21.15.22:0/207669181 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f800a6640 con 0x7f9f7c003a60 2024-05-21T13:36:25.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.858+0000 7f9f95af3640 1 -- 172.21.15.22:0/207669181 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f7c003a60 msgr2=0x7f9f7c003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:25.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.858+0000 7f9f95af3640 1 --2- 172.21.15.22:0/207669181 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f7c003a60 0x7f9f7c003e80 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9f80009ab0 tx=0x7f9f8001ca70 comp rx=0 tx=0).stop 2024-05-21T13:36:25.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.858+0000 7f9f95af3640 1 -- 172.21.15.22:0/207669181 shutdown_connections 2024-05-21T13:36:25.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.858+0000 7f9f95af3640 1 --2- 172.21.15.22:0/207669181 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f7c003a60 0x7f9f7c003e80 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:25.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.858+0000 7f9f95af3640 1 -- 172.21.15.22:0/207669181 >> 172.21.15.22:0/207669181 conn(0x7f9f9006f3b0 msgr2=0x7f9f9006d430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:25.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.858+0000 7f9f95af3640 1 -- 172.21.15.22:0/207669181 shutdown_connections 2024-05-21T13:36:25.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.858+0000 7f9f95af3640 1 -- 172.21.15.22:0/207669181 wait complete. 2024-05-21T13:36:25.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.858+0000 7f9f95af3640 1 Processor -- start 2024-05-21T13:36:25.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.858+0000 7f9f95af3640 1 -- start start 2024-05-21T13:36:25.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.858+0000 7f9f95af3640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f7c003a60 0x7f9f90154dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:25.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.858+0000 7f9f95af3640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f90158e20 0x7f9f901563b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:25.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.858+0000 7f9f95af3640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f901568f0 0x7f9f9014aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:25.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.858+0000 7f9f95af3640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9f900d1570 con 0x7f9f7c003a60 2024-05-21T13:36:25.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.858+0000 7f9f95af3640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f9f900d13f0 con 0x7f9f901568f0 2024-05-21T13:36:25.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.858+0000 7f9f95af3640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f9f900d16f0 con 0x7f9f90158e20 2024-05-21T13:36:25.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.858+0000 7f9f8f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f7c003a60 0x7f9f90154dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:25.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.858+0000 7f9f8f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f7c003a60 0x7f9f90154dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48074/0 (socket says 172.21.15.22:48074) 2024-05-21T13:36:25.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.858+0000 7f9f8f7fe640 1 -- 172.21.15.22:0/3284244171 learned_addr learned my addr 172.21.15.22:0/3284244171 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:25.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.858+0000 7f9f8effd640 1 --2- 172.21.15.22:0/3284244171 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f90158e20 0x7f9f901563b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:25.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.858+0000 7f9f8ffff640 1 --2- 172.21.15.22:0/3284244171 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f901568f0 0x7f9f9014aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:25.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.858+0000 7f9f8f7fe640 1 -- 172.21.15.22:0/3284244171 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f90158e20 msgr2=0x7f9f901563b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:25.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.858+0000 7f9f8f7fe640 1 --2- 172.21.15.22:0/3284244171 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f90158e20 0x7f9f901563b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:25.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.858+0000 7f9f8f7fe640 1 -- 172.21.15.22:0/3284244171 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f901568f0 msgr2=0x7f9f9014aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:25.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.858+0000 7f9f8f7fe640 1 --2- 172.21.15.22:0/3284244171 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f901568f0 0x7f9f9014aef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:25.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.858+0000 7f9f8f7fe640 1 -- 172.21.15.22:0/3284244171 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f90156d70 con 0x7f9f7c003a60 2024-05-21T13:36:25.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.858+0000 7f9f8f7fe640 1 --2- 172.21.15.22:0/3284244171 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f7c003a60 0x7f9f90154dd0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9f8001c8a0 tx=0x7f9f80019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:25.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.862+0000 7f9f87fff640 1 -- 172.21.15.22:0/3284244171 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f800a6c80 con 0x7f9f7c003a60 2024-05-21T13:36:25.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.862+0000 7f9f87fff640 1 -- 172.21.15.22:0/3284244171 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9f800a6e20 con 0x7f9f7c003a60 2024-05-21T13:36:25.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.862+0000 7f9f87fff640 1 -- 172.21.15.22:0/3284244171 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f800b9660 con 0x7f9f7c003a60 2024-05-21T13:36:25.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.862+0000 7f9f95af3640 1 -- 172.21.15.22:0/3284244171 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f901e9d20 con 0x7f9f7c003a60 2024-05-21T13:36:25.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.862+0000 7f9f95af3640 1 -- 172.21.15.22:0/3284244171 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f901ea2a0 con 0x7f9f7c003a60 2024-05-21T13:36:25.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.862+0000 7f9f95af3640 1 -- 172.21.15.22:0/3284244171 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f90077bb0 con 0x7f9f7c003a60 2024-05-21T13:36:25.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.862+0000 7f9f87fff640 1 -- 172.21.15.22:0/3284244171 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f9f800a7430 con 0x7f9f7c003a60 2024-05-21T13:36:25.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.862+0000 7f9f87fff640 1 --2- 172.21.15.22:0/3284244171 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f9f7006f400 0x7f9f700718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:25.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.862+0000 7f9f87fff640 1 -- 172.21.15.22:0/3284244171 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f9f80129670 con 0x7f9f7c003a60 2024-05-21T13:36:25.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.862+0000 7f9f8effd640 1 --2- 172.21.15.22:0/3284244171 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f9f7006f400 0x7f9f700718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:25.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.862+0000 7f9f8effd640 1 --2- 172.21.15.22:0/3284244171 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f9f7006f400 0x7f9f700718c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9f78007fd0 tx=0x7f9f78009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:25.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:25.866+0000 7f9f87fff640 1 -- 172.21.15.22:0/3284244171 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f9f90156d70 con 0x7f9f7c003a60 2024-05-21T13:36:26.008 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.030+0000 7f9f95af3640 1 -- 172.21.15.22:0/3284244171 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9f900c7880 con 0x7f9f7c003a60 2024-05-21T13:36:26.010 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.034+0000 7f9f87fff640 1 -- 172.21.15.22:0/3284244171 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18458 (secure 0 0 0) 0x7f9f800ac020 con 0x7f9f7c003a60 2024-05-21T13:36:26.011 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-21T13:36:26.011 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":25,"fsid":"f2c96204-e240-4e7f-8a76-927b4f80f534","created":"2024-05-21T13:35:33.827005+0000","modified":"2024-05-21T13:36:02.190808+0000","last_up_change":"2024-05-21T13:35:44.542324+0000","last_in_change":"2024-05-21T13:35:36.061492+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-21T13:35:44.536105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-21T13:35:54.972996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-21T13:35:56.065755+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-21T13:35:59.791448+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"09157d4a-9443-4e10-bbb3-cf8ed7c42cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":222752954},{"type":"v1","addr":"172.21.15.22:6801","nonce":222752954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":222752954},{"type":"v1","addr":"172.21.15.22:6803","nonce":222752954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":222752954},{"type":"v1","addr":"172.21.15.22:6807","nonce":222752954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":222752954},{"type":"v1","addr":"172.21.15.22:6805","nonce":222752954}]},"public_addr":"172.21.15.22:6801/222752954","cluster_addr":"172.21.15.22:6803/222752954","heartbeat_back_addr":"172.21.15.22:6807/222752954","heartbeat_front_addr":"172.21.15.22:6805/222752954","state":["exists","up"]},{"osd":1,"uuid":"2a6a87c0-01ad-4a98-a538-c0a8e865b05d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":685426272},{"type":"v1","addr":"172.21.15.22:6809","nonce":685426272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":685426272},{"type":"v1","addr":"172.21.15.22:6811","nonce":685426272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":685426272},{"type":"v1","addr":"172.21.15.22:6815","nonce":685426272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":685426272},{"type":"v1","addr":"172.21.15.22:6813","nonce":685426272}]},"public_addr":"172.21.15.22:6809/685426272","cluster_addr":"172.21.15.22:6811/685426272","heartbeat_back_addr":"172.21.15.22:6815/685426272","heartbeat_front_addr":"172.21.15.22:6813/685426272","state":["exists","up"]},{"osd":2,"uuid":"4c18f931-40a4-46ac-a752-0d1be35b01a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":2092224336},{"type":"v1","addr":"172.21.15.22:6817","nonce":2092224336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":2092224336},{"type":"v1","addr":"172.21.15.22:6819","nonce":2092224336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":2092224336},{"type":"v1","addr":"172.21.15.22:6823","nonce":2092224336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":2092224336},{"type":"v1","addr":"172.21.15.22:6821","nonce":2092224336}]},"public_addr":"172.21.15.22:6817/2092224336","cluster_addr":"172.21.15.22:6819/2092224336","heartbeat_back_addr":"172.21.15.22:6823/2092224336","heartbeat_front_addr":"172.21.15.22:6821/2092224336","state":["exists","up"]},{"osd":3,"uuid":"d57ee7fd-b73e-41ec-8e3b-e62fb8898128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":1232311110},{"type":"v1","addr":"172.21.15.22:6825","nonce":1232311110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":1232311110},{"type":"v1","addr":"172.21.15.22:6827","nonce":1232311110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":1232311110},{"type":"v1","addr":"172.21.15.22:6831","nonce":1232311110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":1232311110},{"type":"v1","addr":"172.21.15.22:6829","nonce":1232311110}]},"public_addr":"172.21.15.22:6825/1232311110","cluster_addr":"172.21.15.22:6827/1232311110","heartbeat_back_addr":"172.21.15.22:6831/1232311110","heartbeat_front_addr":"172.21.15.22:6829/1232311110","state":["exists","up"]},{"osd":4,"uuid":"43c6494f-352b-42a7-b6a9-fe7e3573fab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":832695158},{"type":"v1","addr":"172.21.15.115:6801","nonce":832695158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":832695158},{"type":"v1","addr":"172.21.15.115:6803","nonce":832695158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":832695158},{"type":"v1","addr":"172.21.15.115:6807","nonce":832695158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":832695158},{"type":"v1","addr":"172.21.15.115:6805","nonce":832695158}]},"public_addr":"172.21.15.115:6801/832695158","cluster_addr":"172.21.15.115:6803/832695158","heartbeat_back_addr":"172.21.15.115:6807/832695158","heartbeat_front_addr":"172.21.15.115:6805/832695158","state":["exists","up"]},{"osd":5,"uuid":"25fc861c-593d-4d49-942a-c75c19f25994","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":1504764223},{"type":"v1","addr":"172.21.15.115:6815","nonce":1504764223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":1504764223},{"type":"v1","addr":"172.21.15.115:6823","nonce":1504764223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":1504764223},{"type":"v1","addr":"172.21.15.115:6830","nonce":1504764223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6825","nonce":1504764223},{"type":"v1","addr":"172.21.15.115:6827","nonce":1504764223}]},"public_addr":"172.21.15.115:6815/1504764223","cluster_addr":"172.21.15.115:6823/1504764223","heartbeat_back_addr":"172.21.15.115:6830/1504764223","heartbeat_front_addr":"172.21.15.115:6827/1504764223","state":["exists","up"]},{"osd":6,"uuid":"2e7fb0b8-1162-497f-bffc-e2c02b9b9ef4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":959292720},{"type":"v1","addr":"172.21.15.115:6809","nonce":959292720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":959292720},{"type":"v1","addr":"172.21.15.115:6813","nonce":959292720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":959292720},{"type":"v1","addr":"172.21.15.115:6822","nonce":959292720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":959292720},{"type":"v1","addr":"172.21.15.115:6818","nonce":959292720}]},"public_addr":"172.21.15.115:6809/959292720","cluster_addr":"172.21.15.115:6813/959292720","heartbeat_back_addr":"172.21.15.115:6822/959292720","heartbeat_front_addr":"172.21.15.115:6818/959292720","state":["exists","up"]},{"osd":7,"uuid":"a97df0dc-e370-45ce-8742-25ae31e2212e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6811","nonce":20268513},{"type":"v1","addr":"172.21.15.115:6814","nonce":20268513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":20268513},{"type":"v1","addr":"172.21.15.115:6821","nonce":20268513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6829","nonce":20268513},{"type":"v1","addr":"172.21.15.115:6831","nonce":20268513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":20268513},{"type":"v1","addr":"172.21.15.115:6826","nonce":20268513}]},"public_addr":"172.21.15.115:6814/20268513","cluster_addr":"172.21.15.115:6821/20268513","heartbeat_back_addr":"172.21.15.115:6831/20268513","heartbeat_front_addr":"172.21.15.115:6826/20268513","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.692890+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.545577+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.712724+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.681944+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.492954+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.553222+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.597022+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.601698+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-21T13:36:26.012 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.034+0000 7f9f95af3640 1 -- 172.21.15.22:0/3284244171 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f9f7006f400 msgr2=0x7f9f700718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:26.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.034+0000 7f9f95af3640 1 --2- 172.21.15.22:0/3284244171 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f9f7006f400 0x7f9f700718c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9f78007fd0 tx=0x7f9f78009040 comp rx=0 tx=0).stop 2024-05-21T13:36:26.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.034+0000 7f9f95af3640 1 -- 172.21.15.22:0/3284244171 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f7c003a60 msgr2=0x7f9f90154dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:26.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.034+0000 7f9f95af3640 1 --2- 172.21.15.22:0/3284244171 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f7c003a60 0x7f9f90154dd0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9f8001c8a0 tx=0x7f9f80019810 comp rx=0 tx=0).stop 2024-05-21T13:36:26.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.034+0000 7f9f95af3640 1 -- 172.21.15.22:0/3284244171 shutdown_connections 2024-05-21T13:36:26.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.034+0000 7f9f95af3640 1 --2- 172.21.15.22:0/3284244171 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f9f7006f400 0x7f9f700718c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.034+0000 7f9f95af3640 1 --2- 172.21.15.22:0/3284244171 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9f901568f0 0x7f9f9014aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.034+0000 7f9f95af3640 1 --2- 172.21.15.22:0/3284244171 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9f90158e20 0x7f9f901563b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.034+0000 7f9f95af3640 1 --2- 172.21.15.22:0/3284244171 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9f7c003a60 0x7f9f90154dd0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.034+0000 7f9f95af3640 1 -- 172.21.15.22:0/3284244171 >> 172.21.15.22:0/3284244171 conn(0x7f9f9006f3b0 msgr2=0x7f9f900b53e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:26.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.034+0000 7f9f95af3640 1 -- 172.21.15.22:0/3284244171 shutdown_connections 2024-05-21T13:36:26.013 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.034+0000 7f9f95af3640 1 -- 172.21.15.22:0/3284244171 wait complete. 2024-05-21T13:36:26.030 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-05-21T13:36:26.030 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-21T13:36:26.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.178+0000 7f9c4984f640 1 Processor -- start 2024-05-21T13:36:26.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.178+0000 7f9c4984f640 1 -- start start 2024-05-21T13:36:26.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.182+0000 7f9c4984f640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9c44152520 0x7f9c4406c4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.182+0000 7f9c4984f640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9c44072ea0 0x7f9c4406ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.182+0000 7f9c4984f640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c44152900 con 0x7f9c440723d0 2024-05-21T13:36:26.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.182+0000 7f9c4984f640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f9c440cae30 con 0x7f9c44152520 2024-05-21T13:36:26.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.182+0000 7f9c4984f640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f9c440c82e0 con 0x7f9c44072ea0 2024-05-21T13:36:26.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.182+0000 7f9c42ffd640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9c44152520 0x7f9c4406c4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.182+0000 7f9c42ffd640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9c44152520 0x7f9c4406c4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48086/0 (socket says 172.21.15.22:48086) 2024-05-21T13:36:26.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.182+0000 7f9c42ffd640 1 -- 172.21.15.22:0/2420780030 learned_addr learned my addr 172.21.15.22:0/2420780030 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:26.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.182+0000 7f9c427fc640 1 --2- 172.21.15.22:0/2420780030 >> v2:172.21.15.115:3300/0 conn(0x7f9c44072ea0 0x7f9c4406ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.182+0000 7f9c42ffd640 1 -- 172.21.15.22:0/2420780030 >> v2:172.21.15.115:3300/0 conn(0x7f9c44072ea0 msgr2=0x7f9c4406ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:26.159 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.182+0000 7f9c42ffd640 1 --2- 172.21.15.22:0/2420780030 >> v2:172.21.15.115:3300/0 conn(0x7f9c44072ea0 0x7f9c4406ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.182+0000 7f9c42ffd640 1 -- 172.21.15.22:0/2420780030 >> v1:172.21.15.115:6789/0 conn(0x7f9c440723d0 legacy=0x7f9c440c8770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:26.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.182+0000 7f9c42ffd640 1 -- 172.21.15.22:0/2420780030 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c44158c00 con 0x7f9c44152520 2024-05-21T13:36:26.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.182+0000 7f9c42ffd640 1 --2- 172.21.15.22:0/2420780030 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c44152520 0x7f9c4406c4f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9c440cb280 tx=0x7f9c3401ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4309f0c5f7163699 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:26.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.182+0000 7f9c41ffb640 1 -- 172.21.15.22:0/2420780030 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c340b5070 con 0x7f9c44152520 2024-05-21T13:36:26.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.182+0000 7f9c41ffb640 1 -- 172.21.15.22:0/2420780030 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c340a89d0 con 0x7f9c44152520 2024-05-21T13:36:26.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.182+0000 7f9c41ffb640 1 -- 172.21.15.22:0/2420780030 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c340a8da0 con 0x7f9c44152520 2024-05-21T13:36:26.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.182+0000 7f9c4984f640 1 -- 172.21.15.22:0/2420780030 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c44152520 msgr2=0x7f9c4406c4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:26.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.182+0000 7f9c4984f640 1 --2- 172.21.15.22:0/2420780030 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c44152520 0x7f9c4406c4f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9c440cb280 tx=0x7f9c3401ed10 comp rx=0 tx=0).stop 2024-05-21T13:36:26.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.182+0000 7f9c4984f640 1 -- 172.21.15.22:0/2420780030 shutdown_connections 2024-05-21T13:36:26.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.182+0000 7f9c4984f640 1 --2- 172.21.15.22:0/2420780030 >> v2:172.21.15.115:3300/0 conn(0x7f9c44072ea0 0x7f9c4406ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.182+0000 7f9c4984f640 1 --2- 172.21.15.22:0/2420780030 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c44152520 0x7f9c4406c4f0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.182+0000 7f9c4984f640 1 -- 172.21.15.22:0/2420780030 >> 172.21.15.22:0/2420780030 conn(0x7f9c4406ea10 msgr2=0x7f9c4406ff50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:26.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.186+0000 7f9c4984f640 1 -- 172.21.15.22:0/2420780030 shutdown_connections 2024-05-21T13:36:26.162 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.186+0000 7f9c4984f640 1 -- 172.21.15.22:0/2420780030 wait complete. 2024-05-21T13:36:26.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.186+0000 7f9c4984f640 1 Processor -- start 2024-05-21T13:36:26.163 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.186+0000 7f9c4984f640 1 -- start start 2024-05-21T13:36:26.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.186+0000 7f9c4984f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c440723d0 0x7f9c441518c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.186+0000 7f9c4984f640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c44072ea0 0x7f9c4413d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.186+0000 7f9c4984f640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9c44152520 0x7f9c441f3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.186+0000 7f9c4984f640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9c440c7f70 con 0x7f9c440723d0 2024-05-21T13:36:26.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.186+0000 7f9c4984f640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f9c44158ea0 con 0x7f9c44072ea0 2024-05-21T13:36:26.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.186+0000 7f9c4984f640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f9c440c9870 con 0x7f9c44152520 2024-05-21T13:36:26.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.186+0000 7f9c42ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c440723d0 0x7f9c441518c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.186+0000 7f9c42ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c440723d0 0x7f9c441518c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48098/0 (socket says 172.21.15.22:48098) 2024-05-21T13:36:26.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.186+0000 7f9c42ffd640 1 -- 172.21.15.22:0/2373417230 learned_addr learned my addr 172.21.15.22:0/2373417230 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:26.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.186+0000 7f9c427fc640 1 --2- 172.21.15.22:0/2373417230 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c44072ea0 0x7f9c4413d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.186+0000 7f9c437fe640 1 --2- 172.21.15.22:0/2373417230 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9c44152520 0x7f9c441f3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.186+0000 7f9c42ffd640 1 -- 172.21.15.22:0/2373417230 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9c44152520 msgr2=0x7f9c441f3890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:26.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.186+0000 7f9c42ffd640 1 --2- 172.21.15.22:0/2373417230 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9c44152520 0x7f9c441f3890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.186+0000 7f9c42ffd640 1 -- 172.21.15.22:0/2373417230 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c44072ea0 msgr2=0x7f9c4413d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:26.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.186+0000 7f9c42ffd640 1 --2- 172.21.15.22:0/2373417230 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c44072ea0 0x7f9c4413d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.186+0000 7f9c42ffd640 1 -- 172.21.15.22:0/2373417230 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c4413cf20 con 0x7f9c440723d0 2024-05-21T13:36:26.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.186+0000 7f9c42ffd640 1 --2- 172.21.15.22:0/2373417230 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c440723d0 0x7f9c441518c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9c340b3040 tx=0x7f9c3401bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:26.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.186+0000 7f9c2bfff640 1 -- 172.21.15.22:0/2373417230 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c340c0070 con 0x7f9c440723d0 2024-05-21T13:36:26.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.186+0000 7f9c2bfff640 1 -- 172.21.15.22:0/2373417230 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c340b0b60 con 0x7f9c440723d0 2024-05-21T13:36:26.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.186+0000 7f9c4984f640 1 -- 172.21.15.22:0/2373417230 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c4414fd20 con 0x7f9c440723d0 2024-05-21T13:36:26.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.186+0000 7f9c2bfff640 1 -- 172.21.15.22:0/2373417230 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c340b5070 con 0x7f9c440723d0 2024-05-21T13:36:26.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.186+0000 7f9c4984f640 1 -- 172.21.15.22:0/2373417230 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c44150de0 con 0x7f9c440723d0 2024-05-21T13:36:26.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.186+0000 7f9c4984f640 1 -- 172.21.15.22:0/2373417230 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c44077bb0 con 0x7f9c440723d0 2024-05-21T13:36:26.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.190+0000 7f9c2bfff640 1 -- 172.21.15.22:0/2373417230 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f9c340c3070 con 0x7f9c440723d0 2024-05-21T13:36:26.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.190+0000 7f9c2bfff640 1 --2- 172.21.15.22:0/2373417230 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f9c3006f400 0x7f9c300718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.190+0000 7f9c2bfff640 1 -- 172.21.15.22:0/2373417230 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f9c3412c750 con 0x7f9c440723d0 2024-05-21T13:36:26.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.190+0000 7f9c427fc640 1 --2- 172.21.15.22:0/2373417230 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f9c3006f400 0x7f9c300718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.190+0000 7f9c427fc640 1 --2- 172.21.15.22:0/2373417230 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f9c3006f400 0x7f9c300718c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9c440cbb80 tx=0x7f9c38008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:26.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.194+0000 7f9c2bfff640 1 -- 172.21.15.22:0/2373417230 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f9c34018870 con 0x7f9c440723d0 2024-05-21T13:36:26.336 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.358+0000 7f9c4984f640 1 -- 172.21.15.22:0/2373417230 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9c440c9650 con 0x7f9c440723d0 2024-05-21T13:36:26.338 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.362+0000 7f9c2bfff640 1 -- 172.21.15.22:0/2373417230 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18458 (secure 0 0 0) 0x7f9c340f9420 con 0x7f9c440723d0 2024-05-21T13:36:26.339 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-21T13:36:26.339 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":25,"fsid":"f2c96204-e240-4e7f-8a76-927b4f80f534","created":"2024-05-21T13:35:33.827005+0000","modified":"2024-05-21T13:36:02.190808+0000","last_up_change":"2024-05-21T13:35:44.542324+0000","last_in_change":"2024-05-21T13:35:36.061492+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-21T13:35:44.536105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-21T13:35:54.972996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-21T13:35:56.065755+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-21T13:35:59.791448+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"09157d4a-9443-4e10-bbb3-cf8ed7c42cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":222752954},{"type":"v1","addr":"172.21.15.22:6801","nonce":222752954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":222752954},{"type":"v1","addr":"172.21.15.22:6803","nonce":222752954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":222752954},{"type":"v1","addr":"172.21.15.22:6807","nonce":222752954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":222752954},{"type":"v1","addr":"172.21.15.22:6805","nonce":222752954}]},"public_addr":"172.21.15.22:6801/222752954","cluster_addr":"172.21.15.22:6803/222752954","heartbeat_back_addr":"172.21.15.22:6807/222752954","heartbeat_front_addr":"172.21.15.22:6805/222752954","state":["exists","up"]},{"osd":1,"uuid":"2a6a87c0-01ad-4a98-a538-c0a8e865b05d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":685426272},{"type":"v1","addr":"172.21.15.22:6809","nonce":685426272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":685426272},{"type":"v1","addr":"172.21.15.22:6811","nonce":685426272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":685426272},{"type":"v1","addr":"172.21.15.22:6815","nonce":685426272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":685426272},{"type":"v1","addr":"172.21.15.22:6813","nonce":685426272}]},"public_addr":"172.21.15.22:6809/685426272","cluster_addr":"172.21.15.22:6811/685426272","heartbeat_back_addr":"172.21.15.22:6815/685426272","heartbeat_front_addr":"172.21.15.22:6813/685426272","state":["exists","up"]},{"osd":2,"uuid":"4c18f931-40a4-46ac-a752-0d1be35b01a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":2092224336},{"type":"v1","addr":"172.21.15.22:6817","nonce":2092224336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":2092224336},{"type":"v1","addr":"172.21.15.22:6819","nonce":2092224336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":2092224336},{"type":"v1","addr":"172.21.15.22:6823","nonce":2092224336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":2092224336},{"type":"v1","addr":"172.21.15.22:6821","nonce":2092224336}]},"public_addr":"172.21.15.22:6817/2092224336","cluster_addr":"172.21.15.22:6819/2092224336","heartbeat_back_addr":"172.21.15.22:6823/2092224336","heartbeat_front_addr":"172.21.15.22:6821/2092224336","state":["exists","up"]},{"osd":3,"uuid":"d57ee7fd-b73e-41ec-8e3b-e62fb8898128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":1232311110},{"type":"v1","addr":"172.21.15.22:6825","nonce":1232311110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":1232311110},{"type":"v1","addr":"172.21.15.22:6827","nonce":1232311110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":1232311110},{"type":"v1","addr":"172.21.15.22:6831","nonce":1232311110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":1232311110},{"type":"v1","addr":"172.21.15.22:6829","nonce":1232311110}]},"public_addr":"172.21.15.22:6825/1232311110","cluster_addr":"172.21.15.22:6827/1232311110","heartbeat_back_addr":"172.21.15.22:6831/1232311110","heartbeat_front_addr":"172.21.15.22:6829/1232311110","state":["exists","up"]},{"osd":4,"uuid":"43c6494f-352b-42a7-b6a9-fe7e3573fab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":832695158},{"type":"v1","addr":"172.21.15.115:6801","nonce":832695158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":832695158},{"type":"v1","addr":"172.21.15.115:6803","nonce":832695158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":832695158},{"type":"v1","addr":"172.21.15.115:6807","nonce":832695158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":832695158},{"type":"v1","addr":"172.21.15.115:6805","nonce":832695158}]},"public_addr":"172.21.15.115:6801/832695158","cluster_addr":"172.21.15.115:6803/832695158","heartbeat_back_addr":"172.21.15.115:6807/832695158","heartbeat_front_addr":"172.21.15.115:6805/832695158","state":["exists","up"]},{"osd":5,"uuid":"25fc861c-593d-4d49-942a-c75c19f25994","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":1504764223},{"type":"v1","addr":"172.21.15.115:6815","nonce":1504764223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":1504764223},{"type":"v1","addr":"172.21.15.115:6823","nonce":1504764223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":1504764223},{"type":"v1","addr":"172.21.15.115:6830","nonce":1504764223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6825","nonce":1504764223},{"type":"v1","addr":"172.21.15.115:6827","nonce":1504764223}]},"public_addr":"172.21.15.115:6815/1504764223","cluster_addr":"172.21.15.115:6823/1504764223","heartbeat_back_addr":"172.21.15.115:6830/1504764223","heartbeat_front_addr":"172.21.15.115:6827/1504764223","state":["exists","up"]},{"osd":6,"uuid":"2e7fb0b8-1162-497f-bffc-e2c02b9b9ef4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":959292720},{"type":"v1","addr":"172.21.15.115:6809","nonce":959292720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":959292720},{"type":"v1","addr":"172.21.15.115:6813","nonce":959292720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":959292720},{"type":"v1","addr":"172.21.15.115:6822","nonce":959292720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":959292720},{"type":"v1","addr":"172.21.15.115:6818","nonce":959292720}]},"public_addr":"172.21.15.115:6809/959292720","cluster_addr":"172.21.15.115:6813/959292720","heartbeat_back_addr":"172.21.15.115:6822/959292720","heartbeat_front_addr":"172.21.15.115:6818/959292720","state":["exists","up"]},{"osd":7,"uuid":"a97df0dc-e370-45ce-8742-25ae31e2212e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6811","nonce":20268513},{"type":"v1","addr":"172.21.15.115:6814","nonce":20268513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":20268513},{"type":"v1","addr":"172.21.15.115:6821","nonce":20268513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6829","nonce":20268513},{"type":"v1","addr":"172.21.15.115:6831","nonce":20268513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":20268513},{"type":"v1","addr":"172.21.15.115:6826","nonce":20268513}]},"public_addr":"172.21.15.115:6814/20268513","cluster_addr":"172.21.15.115:6821/20268513","heartbeat_back_addr":"172.21.15.115:6831/20268513","heartbeat_front_addr":"172.21.15.115:6826/20268513","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.692890+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.545577+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.712724+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.681944+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.492954+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.553222+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.597022+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.601698+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-21T13:36:26.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.362+0000 7f9c4984f640 1 -- 172.21.15.22:0/2373417230 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f9c3006f400 msgr2=0x7f9c300718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:26.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.362+0000 7f9c4984f640 1 --2- 172.21.15.22:0/2373417230 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f9c3006f400 0x7f9c300718c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9c440cbb80 tx=0x7f9c38008040 comp rx=0 tx=0).stop 2024-05-21T13:36:26.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.362+0000 7f9c4984f640 1 -- 172.21.15.22:0/2373417230 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c440723d0 msgr2=0x7f9c441518c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:26.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.362+0000 7f9c4984f640 1 --2- 172.21.15.22:0/2373417230 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c440723d0 0x7f9c441518c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9c340b3040 tx=0x7f9c3401bab0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.362+0000 7f9c4984f640 1 -- 172.21.15.22:0/2373417230 shutdown_connections 2024-05-21T13:36:26.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.362+0000 7f9c4984f640 1 --2- 172.21.15.22:0/2373417230 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f9c3006f400 0x7f9c300718c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.362+0000 7f9c4984f640 1 --2- 172.21.15.22:0/2373417230 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9c44152520 0x7f9c441f3890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.362+0000 7f9c4984f640 1 --2- 172.21.15.22:0/2373417230 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c44072ea0 0x7f9c4413d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.362+0000 7f9c4984f640 1 --2- 172.21.15.22:0/2373417230 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c440723d0 0x7f9c441518c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.362+0000 7f9c4984f640 1 -- 172.21.15.22:0/2373417230 >> 172.21.15.22:0/2373417230 conn(0x7f9c4406ea10 msgr2=0x7f9c440c9ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:26.341 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.362+0000 7f9c4984f640 1 -- 172.21.15.22:0/2373417230 shutdown_connections 2024-05-21T13:36:26.342 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.362+0000 7f9c4984f640 1 -- 172.21.15.22:0/2373417230 wait complete. 2024-05-21T13:36:26.357 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-05-21T13:36:26.358 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-05-21T13:36:26.358 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-05-21T13:36:26.359 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-05-21T13:36:26.359 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-05-21T13:36:26.359 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-05-21T13:36:26.360 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-05-21T13:36:26.360 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-05-21T13:36:26.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.558+0000 7f4f3c297640 1 Processor -- start 2024-05-21T13:36:26.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.558+0000 7f4f3c297640 1 -- start start 2024-05-21T13:36:26.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.562+0000 7f4f3c297640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4f340707b0 0x7f4f3415bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.562+0000 7f4f3c297640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f3415c0a0 con 0x7f4f34073030 2024-05-21T13:36:26.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.562+0000 7f4f3c297640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f340c8800 con 0x7f4f34072280 2024-05-21T13:36:26.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.562+0000 7f4f3c297640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f4f340c8ae0 con 0x7f4f340707b0 2024-05-21T13:36:26.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.562+0000 7f99e16d5640 1 Processor -- start 2024-05-21T13:36:26.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.562+0000 7f99e16d5640 1 -- start start 2024-05-21T13:36:26.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.562+0000 7f4f3a033640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4f340707b0 0x7f4f3415bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.562+0000 7f4f3a033640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4f340707b0 0x7f4f3415bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48108/0 (socket says 172.21.15.22:48108) 2024-05-21T13:36:26.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.562+0000 7f4f3a033640 1 -- 172.21.15.22:0/3911639745 learned_addr learned my addr 172.21.15.22:0/3911639745 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:26.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.562+0000 7f7841a26640 1 Processor -- start 2024-05-21T13:36:26.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.562+0000 7f7841a26640 1 -- start start 2024-05-21T13:36:26.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.562+0000 7fd5c1562640 1 Processor -- start 2024-05-21T13:36:26.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.562+0000 7fd5c1562640 1 -- start start 2024-05-21T13:36:26.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.562+0000 7f99e16d5640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f99dc0cae40 0x7f99dc152350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.562+0000 7f99e16d5640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f99dc0686b0 0x7f99dc15b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.562+0000 7f99e16d5640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f99dc0c8cb0 con 0x7f99dc068260 2024-05-21T13:36:26.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.562+0000 7f99e16d5640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f99dc0c8f90 con 0x7f99dc0cae40 2024-05-21T13:36:26.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.562+0000 7f99e16d5640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f99dc0c9270 con 0x7f99dc0686b0 2024-05-21T13:36:26.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.562+0000 7f99daffd640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f99dc0cae40 0x7f99dc152350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.562+0000 7f4f39031640 1 -- 172.21.15.22:0/3911639745 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 343351685 0 0) 0x7f4f3415c0a0 con 0x7f4f34073030 2024-05-21T13:36:26.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.562+0000 7f4f3a033640 1 -- 172.21.15.22:0/3911639745 >> v1:172.21.15.115:6789/0 conn(0x7f4f34072280 legacy=0x7f4f340c9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:26.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.562+0000 7f4f3a033640 1 -- 172.21.15.22:0/3911639745 >> v1:172.21.15.22:6789/0 conn(0x7f4f34073030 legacy=0x7f4f34073430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:26.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.562+0000 7f99daffd640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f99dc0cae40 0x7f99dc152350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48122/0 (socket says 172.21.15.22:48122) 2024-05-21T13:36:26.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.562+0000 7f99daffd640 1 -- 172.21.15.22:0/3049518363 learned_addr learned my addr 172.21.15.22:0/3049518363 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:26.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.562+0000 7f99db7fe640 1 --2- 172.21.15.22:0/3049518363 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f99dc0686b0 0x7f99dc15b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.562+0000 7f4f3a033640 1 -- 172.21.15.22:0/3911639745 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f340c8dc0 con 0x7f4f340707b0 2024-05-21T13:36:26.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.562+0000 7effa5c01640 1 Processor -- start 2024-05-21T13:36:26.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.562+0000 7f99daffd640 1 -- 172.21.15.22:0/3049518363 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f99dc0686b0 msgr2=0x7f99dc15b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:26.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.562+0000 7f99daffd640 1 --2- 172.21.15.22:0/3049518363 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f99dc0686b0 0x7f99dc15b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.562+0000 7f99daffd640 1 -- 172.21.15.22:0/3049518363 >> v1:172.21.15.115:6789/0 conn(0x7f99dc068260 legacy=0x7f99dc0c6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:26.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.562+0000 7f99daffd640 1 -- 172.21.15.22:0/3049518363 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99dc0c9550 con 0x7f99dc0cae40 2024-05-21T13:36:26.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.562+0000 7effa5c01640 1 -- start start 2024-05-21T13:36:26.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.562+0000 7fd5c1562640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fd5bc0d1650 0x7fd5bc0cc250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.562+0000 7fd5c1562640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd5bc0d1a30 0x7fd5bc0cc790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.562+0000 7fd5c1562640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5bc0cd040 con 0x7fd5bc15ca50 2024-05-21T13:36:26.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.562+0000 7fd5c1562640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fd5bc0cdf30 con 0x7fd5bc0d1650 2024-05-21T13:36:26.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.562+0000 7fd5c1562640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7fd5bc0cd320 con 0x7fd5bc0d1a30 2024-05-21T13:36:26.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.562+0000 7fd5c0d61640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fd5bc15ca50 0x7fd5bc0ce3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:44494/0 (socket says 172.21.15.22:44494) 2024-05-21T13:36:26.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.562+0000 7fd5c0d61640 1 -- 172.21.15.22:0/2195808547 learned_addr learned my addr 172.21.15.22:0/2195808547 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-21T13:36:26.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7f06b4b2f640 1 Processor -- start 2024-05-21T13:36:26.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7fd5bbfff640 1 --2- 172.21.15.22:0/2195808547 >> v2:172.21.15.22:3300/0 conn(0x7fd5bc0d1650 0x7fd5bc0cc250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7fd5bb7fe640 1 --2- 172.21.15.22:0/2195808547 >> v2:172.21.15.115:3300/0 conn(0x7fd5bc0d1a30 0x7fd5bc0cc790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7effa5c01640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7effa00738d0 0x7effa0163560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7effa5c01640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effa00ce110 con 0x7effa00734f0 2024-05-21T13:36:26.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7effa5c01640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7effa00cde30 con 0x7effa0163aa0 2024-05-21T13:36:26.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7effa5c01640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7effa00c8600 con 0x7effa00738d0 2024-05-21T13:36:26.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7fd5bbfff640 1 -- 172.21.15.22:0/2195808547 >> v2:172.21.15.115:3300/0 conn(0x7fd5bc0d1a30 msgr2=0x7fd5bc0cc790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:26.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7fd5bbfff640 1 --2- 172.21.15.22:0/2195808547 >> v2:172.21.15.115:3300/0 conn(0x7fd5bc0d1a30 0x7fd5bc0cc790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7fd5bbfff640 1 -- 172.21.15.22:0/2195808547 >> v1:172.21.15.22:6789/0 conn(0x7fd5bc15ca50 legacy=0x7fd5bc0ce3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:26.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7fd5bbfff640 1 -- 172.21.15.22:0/2195808547 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5bc0cd600 con 0x7fd5bc0d1650 2024-05-21T13:36:26.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7fd5bb7fe640 1 --2- 172.21.15.22:0/2195808547 >> v2:172.21.15.115:3300/0 conn(0x7fd5bc0d1a30 0x7fd5bc0cc790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-21T13:36:26.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7eff9f7fe640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7effa00734f0 0x7effa0072ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:44496/0 (socket says 172.21.15.22:44496) 2024-05-21T13:36:26.549 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7eff9f7fe640 1 -- 172.21.15.22:0/1221415066 learned_addr learned my addr 172.21.15.22:0/1221415066 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-21T13:36:26.549 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7eff9effd640 1 --2- 172.21.15.22:0/1221415066 >> v2:172.21.15.115:3300/0 conn(0x7effa00738d0 0x7effa0163560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.549 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7f06b4b2f640 1 -- start start 2024-05-21T13:36:26.549 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7f4f3a033640 1 --2- 172.21.15.22:0/3911639745 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4f340707b0 0x7f4f3415bb60 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4f30009870 tx=0x7f4f3001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=763037a05668f75f server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:26.549 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7eff9e7fc640 1 -- 172.21.15.22:0/1221415066 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2106406730 0 0) 0x7effa00cde30 con 0x7effa0163aa0 2024-05-21T13:36:26.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7f06b4b2f640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f06b00c9f40 0x7f06b015bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7f06b4b2f640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f06b00707b0 0x7f06b0151a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7f06b4b2f640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06b015c0a0 con 0x7f06b00ca320 2024-05-21T13:36:26.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7f06b4b2f640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f06b00c8800 con 0x7f06b00707b0 2024-05-21T13:36:26.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7f06b4b2f640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f06b00c8ae0 con 0x7f06b00c9f40 2024-05-21T13:36:26.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7eff9e7fc640 1 -- 172.21.15.22:0/1221415066 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff88003530 con 0x7effa0163aa0 2024-05-21T13:36:26.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7eff9e7fc640 1 -- 172.21.15.22:0/1221415066 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2956286491 0 0) 0x7effa00ce110 con 0x7effa00734f0 2024-05-21T13:36:26.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7eff9e7fc640 1 -- 172.21.15.22:0/1221415066 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7effa00cde30 con 0x7effa00734f0 2024-05-21T13:36:26.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7f7841a26640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f783c152350 0x7f783c0c6180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7f9c79372640 1 Processor -- start 2024-05-21T13:36:26.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7f9c79372640 1 -- start start 2024-05-21T13:36:26.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7f7841a26640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f783c0c66c0 0x7f783c158760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7f7841a26640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f783c0c6b50 con 0x7f783c0cae40 2024-05-21T13:36:26.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7f7841a26640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f783c0c8cb0 con 0x7f783c152350 2024-05-21T13:36:26.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7f7841a26640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f783c0c8f90 con 0x7f783c0c66c0 2024-05-21T13:36:26.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7f99daffd640 1 --2- 172.21.15.22:0/3049518363 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f99dc0cae40 0x7f99dc152350 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f99cc009870 tx=0x7f99cc01c580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=864cfbcdb71d4734 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:26.553 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7f06aed9d640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f06b00ca320 0x7f06b0073030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.22:48282/0 (socket says 172.21.15.22:48282) 2024-05-21T13:36:26.553 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7f06aed9d640 1 -- 172.21.15.22:0/4206397363 learned_addr learned my addr 172.21.15.22:0/4206397363 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-21T13:36:26.553 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7eff9e7fc640 1 -- 172.21.15.22:0/1221415066 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 535665154 0 0) 0x7effa00cde30 con 0x7effa00734f0 2024-05-21T13:36:26.553 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7eff9e7fc640 1 -- 172.21.15.22:0/1221415066 >> v2:172.21.15.115:3300/0 conn(0x7effa00738d0 msgr2=0x7effa0163560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:26.553 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7eff9e7fc640 1 --2- 172.21.15.22:0/1221415066 >> v2:172.21.15.115:3300/0 conn(0x7effa00738d0 0x7effa0163560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.553 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7eff9e7fc640 1 -- 172.21.15.22:0/1221415066 >> v1:172.21.15.115:6789/0 conn(0x7effa0163aa0 legacy=0x7effa0159ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:26.553 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7eff9e7fc640 1 -- 172.21.15.22:0/1221415066 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effa00c88e0 con 0x7effa00734f0 2024-05-21T13:36:26.553 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7eff9e7fc640 1 -- 172.21.15.22:0/1221415066 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2684847062 0 0) 0x7eff900016e0 con 0x7effa00734f0 2024-05-21T13:36:26.553 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7eff9e7fc640 1 -- 172.21.15.22:0/1221415066 >> v1:172.21.15.22:6789/0 conn(0x7effa00734f0 legacy=0x7effa0072ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:26.553 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7eff9e7fc640 1 --2- 172.21.15.22:0/1221415066 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff88003c40 0x7eff88004040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7eff9e7fc640 1 --2- 172.21.15.22:0/1221415066 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7eff88004810 0x7eff88004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7eff9e7fc640 1 --2- 172.21.15.22:0/1221415066 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7eff880051d0 0x7eff8800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7eff9e7fc640 1 -- 172.21.15.22:0/1221415066 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7effa00c8600 con 0x7eff88004810 2024-05-21T13:36:26.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7eff9e7fc640 1 -- 172.21.15.22:0/1221415066 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7eff8800c100 con 0x7eff88003c40 2024-05-21T13:36:26.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7eff9e7fc640 1 -- 172.21.15.22:0/1221415066 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7eff8800c300 con 0x7eff880051d0 2024-05-21T13:36:26.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7f99d9ffb640 1 -- 172.21.15.22:0/3049518363 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99cc0b2070 con 0x7f99dc0cae40 2024-05-21T13:36:26.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7f99d9ffb640 1 -- 172.21.15.22:0/3049518363 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99cc0a9070 con 0x7f99dc0cae40 2024-05-21T13:36:26.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7f99d9ffb640 1 -- 172.21.15.22:0/3049518363 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99cc0ad880 con 0x7f99dc0cae40 2024-05-21T13:36:26.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7f4f39031640 1 -- 172.21.15.22:0/3911639745 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f300a9620 con 0x7f4f340707b0 2024-05-21T13:36:26.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7f4f39031640 1 -- 172.21.15.22:0/3911639745 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f300a97c0 con 0x7f4f340707b0 2024-05-21T13:36:26.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7f06add9b640 1 --2- 172.21.15.22:0/4206397363 >> v2:172.21.15.115:3300/0 conn(0x7f06b00707b0 0x7f06b0151a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7f4f39031640 1 -- 172.21.15.22:0/3911639745 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f300a9b90 con 0x7f4f340707b0 2024-05-21T13:36:26.556 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7f0c8ee6e640 1 Processor -- start 2024-05-21T13:36:26.556 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7f783b7fe640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f783c0c66c0 0x7f783c158760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.556 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7f06ae59c640 1 --2- 172.21.15.22:0/4206397363 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f06b00c9f40 0x7f06b015bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.557 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7f783b7fe640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f783c0c66c0 0x7f783c158760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.22:41810/0 (socket says 172.21.15.22:41810) 2024-05-21T13:36:26.557 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7f783b7fe640 1 -- 172.21.15.22:0/192440873 learned_addr learned my addr 172.21.15.22:0/192440873 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:26.557 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7eff9f7fe640 1 --2- 172.21.15.22:0/1221415066 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff88003c40 0x7eff88004040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.557 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7eff9effd640 1 --2- 172.21.15.22:0/1221415066 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7eff88004810 0x7eff88004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.557 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7f9c79372640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f9c740c7e60 0x7f9c740c9800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.557 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7f9c79372640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9c740c90a0 0x7f9c7416a960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.558 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7f9c79372640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c740c8830 con 0x7f9c740c8cc0 2024-05-21T13:36:26.558 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7f9c79372640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f9c74073030 con 0x7f9c740c7e60 2024-05-21T13:36:26.558 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7f9c79372640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f9c74160f10 con 0x7f9c740c90a0 2024-05-21T13:36:26.558 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7eff9effd640 1 -- 172.21.15.22:0/1221415066 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7eff880051d0 msgr2=0x7eff8800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:26.558 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7eff9effd640 1 --2- 172.21.15.22:0/1221415066 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7eff880051d0 0x7eff8800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.558 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7eff9effd640 1 -- 172.21.15.22:0/1221415066 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff88003c40 msgr2=0x7eff88004040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:26.558 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7eff9effd640 1 --2- 172.21.15.22:0/1221415066 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7eff88003c40 0x7eff88004040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.558 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7eff9ffff640 1 -- 172.21.15.22:0/1221415066 reap_dead start 2024-05-21T13:36:26.558 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7eff9effd640 1 -- 172.21.15.22:0/1221415066 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effa00c88e0 con 0x7eff88004810 2024-05-21T13:36:26.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7f99e16d5640 1 -- 172.21.15.22:0/3049518363 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f99dc0cae40 msgr2=0x7f99dc152350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:26.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7f99e16d5640 1 --2- 172.21.15.22:0/3049518363 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f99dc0cae40 0x7f99dc152350 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f99cc009870 tx=0x7f99cc01c580 comp rx=0 tx=0).stop 2024-05-21T13:36:26.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7f783b7fe640 1 -- 172.21.15.22:0/192440873 >> v2:172.21.15.115:3300/0 conn(0x7f783c152350 msgr2=0x7f783c0c6180 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-21T13:36:26.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7f783b7fe640 1 --2- 172.21.15.22:0/192440873 >> v2:172.21.15.115:3300/0 conn(0x7f783c152350 0x7f783c0c6180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7f783b7fe640 1 -- 172.21.15.22:0/192440873 >> v1:172.21.15.115:6789/0 conn(0x7f783c0cae40 legacy=0x7f783c158050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:26.559 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7f783b7fe640 1 -- 172.21.15.22:0/192440873 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f783c0c9270 con 0x7f783c0c66c0 2024-05-21T13:36:26.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7f9c737fe640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9c740c90a0 0x7f9c7416a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7f9c737fe640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f9c740c90a0 0x7f9c7416a960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.22:36344/0 (socket says 172.21.15.22:36344) 2024-05-21T13:36:26.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7f9c737fe640 1 -- 172.21.15.22:0/1262009337 learned_addr learned my addr 172.21.15.22:0/1262009337 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:26.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7f06add9b640 1 -- 172.21.15.22:0/4206397363 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f06b00c9f40 msgr2=0x7f06b015bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:26.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7f06add9b640 1 --2- 172.21.15.22:0/4206397363 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f06b00c9f40 0x7f06b015bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7f06add9b640 1 -- 172.21.15.22:0/4206397363 >> v1:172.21.15.115:6789/0 conn(0x7f06b00ca320 legacy=0x7f06b0073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:26.560 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7f06add9b640 1 -- 172.21.15.22:0/4206397363 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06b00c8dc0 con 0x7f06b00707b0 2024-05-21T13:36:26.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.570+0000 7f99e16d5640 1 -- 172.21.15.22:0/3049518363 shutdown_connections 2024-05-21T13:36:26.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.570+0000 7f99e16d5640 1 --2- 172.21.15.22:0/3049518363 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f99dc0686b0 0x7f99dc15b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.570+0000 7f99e16d5640 1 --2- 172.21.15.22:0/3049518363 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f99dc0cae40 0x7f99dc152350 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.570+0000 7f99e16d5640 1 -- 172.21.15.22:0/3049518363 >> 172.21.15.22:0/3049518363 conn(0x7f99dc0ca320 msgr2=0x7f99dc0ca730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:26.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7f0c8ee6e640 1 -- start start 2024-05-21T13:36:26.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.570+0000 7f0c8ee6e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0c880c6770 0x7f0c8815b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.561 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.570+0000 7f0c8ee6e640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f0c880cae40 0x7f0c8815bb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.570+0000 7f0c8ee6e640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c880c8b00 con 0x7f0c881524a0 2024-05-21T13:36:26.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.570+0000 7f0c8ee6e640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f0c880c9990 con 0x7f0c880cae40 2024-05-21T13:36:26.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7f4f3c297640 1 -- 172.21.15.22:0/3911639745 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4f340707b0 msgr2=0x7f4f3415bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:26.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.570+0000 7f9c6bfff640 1 --2- 172.21.15.22:0/1262009337 >> v2:172.21.15.22:3300/0 conn(0x7f9c740c7e60 0x7f9c740c9800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.562 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.570+0000 7f0c8ee6e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f0c880c8d80 con 0x7f0c880c6770 2024-05-21T13:36:26.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7f4f3c297640 1 --2- 172.21.15.22:0/3911639745 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4f340707b0 0x7f4f3415bb60 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4f30009870 tx=0x7f4f3001c560 comp rx=0 tx=0).stop 2024-05-21T13:36:26.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7f4f3c297640 1 -- 172.21.15.22:0/3911639745 shutdown_connections 2024-05-21T13:36:26.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7f4f3c297640 1 --2- 172.21.15.22:0/3911639745 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4f340707b0 0x7f4f3415bb60 secure :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4f30009870 tx=0x7f4f3001c560 comp rx=0 tx=0).stop 2024-05-21T13:36:26.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.566+0000 7f4f3c297640 1 -- 172.21.15.22:0/3911639745 >> 172.21.15.22:0/3911639745 conn(0x7f4f340703a0 msgr2=0x7f4f340cd250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:26.563 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.570+0000 7fd5bbfff640 1 --2- 172.21.15.22:0/2195808547 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5bc0d1650 0x7fd5bc0cc250 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd5ac0097c0 tx=0x7fd5ac01ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af9ef42b9ae79868 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:26.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.570+0000 7f9c737fe640 1 -- 172.21.15.22:0/1262009337 >> v2:172.21.15.22:3300/0 conn(0x7f9c740c7e60 msgr2=0x7f9c740c9800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:26.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.570+0000 7f9c737fe640 1 --2- 172.21.15.22:0/1262009337 >> v2:172.21.15.22:3300/0 conn(0x7f9c740c7e60 0x7f9c740c9800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.570+0000 7f9c737fe640 1 -- 172.21.15.22:0/1262009337 >> v1:172.21.15.22:6789/0 conn(0x7f9c740c8cc0 legacy=0x7f9c74163c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:26.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.570+0000 7f9c737fe640 1 -- 172.21.15.22:0/1262009337 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c74160390 con 0x7f9c740c90a0 2024-05-21T13:36:26.564 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.570+0000 7f4f3c297640 1 -- 172.21.15.22:0/3911639745 shutdown_connections 2024-05-21T13:36:26.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.570+0000 7f0c8cc0a640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f0c881524a0 0x7f0c880c6060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.22:48308/0 (socket says 172.21.15.22:48308) 2024-05-21T13:36:26.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.570+0000 7f0c8cc0a640 1 -- 172.21.15.22:0/3532578221 learned_addr learned my addr 172.21.15.22:0/3532578221 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-21T13:36:26.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.570+0000 7f4f3c297640 1 -- 172.21.15.22:0/3911639745 wait complete. 2024-05-21T13:36:26.565 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.570+0000 7f0c8d40b640 1 --2- 172.21.15.22:0/3532578221 >> v2:172.21.15.22:3300/0 conn(0x7f0c880cae40 0x7f0c8815bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.570+0000 7fd5baffd640 1 -- 172.21.15.22:0/2195808547 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5ac0b5070 con 0x7fd5bc0d1650 2024-05-21T13:36:26.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.570+0000 7fd5baffd640 1 -- 172.21.15.22:0/2195808547 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5ac0a8950 con 0x7fd5bc0d1650 2024-05-21T13:36:26.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.570+0000 7fd5baffd640 1 -- 172.21.15.22:0/2195808547 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5ac0a8d20 con 0x7fd5bc0d1650 2024-05-21T13:36:26.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.570+0000 7f0c8d40b640 1 -- 172.21.15.22:0/3532578221 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0c880c6770 msgr2=0x7f0c8815b5c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-21T13:36:26.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.570+0000 7f0c8d40b640 1 --2- 172.21.15.22:0/3532578221 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0c880c6770 0x7f0c8815b5c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.570+0000 7f0c8d40b640 1 -- 172.21.15.22:0/3532578221 >> v1:172.21.15.115:6789/0 conn(0x7f0c881524a0 legacy=0x7f0c880c6060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:26.566 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.570+0000 7f0c8d40b640 1 -- 172.21.15.22:0/3532578221 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c880c9060 con 0x7f0c880cae40 2024-05-21T13:36:26.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.570+0000 7f99e16d5640 1 -- 172.21.15.22:0/3049518363 shutdown_connections 2024-05-21T13:36:26.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.570+0000 7f99e16d5640 1 -- 172.21.15.22:0/3049518363 wait complete. 2024-05-21T13:36:26.567 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.570+0000 7f9c6bfff640 1 --2- 172.21.15.22:0/1262009337 >> v2:172.21.15.22:3300/0 conn(0x7f9c740c7e60 0x7f9c740c9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:36:26.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.570+0000 7f4f3c297640 1 Processor -- start 2024-05-21T13:36:26.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.570+0000 7f783b7fe640 1 --2- 172.21.15.22:0/192440873 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f783c0c66c0 0x7f783c158760 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7834009e50 tx=0x7f783401c9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c1339ee743428e4 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:26.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.570+0000 7eff9effd640 1 --2- 172.21.15.22:0/1221415066 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7eff88004810 0x7eff88004c90 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7eff94009ac0 tx=0x7eff9401ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33382548894f984b server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:26.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.570+0000 7fd5c1562640 1 -- 172.21.15.22:0/2195808547 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5bc0d1650 msgr2=0x7fd5bc0cc250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:26.568 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.570+0000 7fd5c1562640 1 --2- 172.21.15.22:0/2195808547 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5bc0d1650 0x7fd5bc0cc250 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fd5ac0097c0 tx=0x7fd5ac01ec50 comp rx=0 tx=0).stop 2024-05-21T13:36:26.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.570+0000 7f4f3c297640 1 -- start start 2024-05-21T13:36:26.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.570+0000 7f99e16d5640 1 Processor -- start 2024-05-21T13:36:26.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.570+0000 7eff9e7fc640 1 -- 172.21.15.22:0/1221415066 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff940b2070 con 0x7eff88004810 2024-05-21T13:36:26.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.570+0000 7f4f3c297640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4f34072280 0x7f4f3414e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.570+0000 7f4f3c297640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f34073030 0x7f4f341575b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.569 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.570+0000 7f4f3c297640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4f3414fea0 0x7f4f34142c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.570+0000 7f4f3c297640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4f34165680 con 0x7f4f3414fea0 2024-05-21T13:36:26.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.570+0000 7f4f3c297640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f4f34165500 con 0x7f4f34073030 2024-05-21T13:36:26.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.570+0000 7f4f3c297640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f4f34165800 con 0x7f4f34072280 2024-05-21T13:36:26.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.570+0000 7fd5c1562640 1 -- 172.21.15.22:0/2195808547 shutdown_connections 2024-05-21T13:36:26.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.570+0000 7fd5c1562640 1 --2- 172.21.15.22:0/2195808547 >> v2:172.21.15.115:3300/0 conn(0x7fd5bc0d1a30 0x7fd5bc0cc790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.570+0000 7fd5c1562640 1 --2- 172.21.15.22:0/2195808547 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5bc0d1650 0x7fd5bc0cc250 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.570 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.570+0000 7fd5c1562640 1 -- 172.21.15.22:0/2195808547 >> 172.21.15.22:0/2195808547 conn(0x7fd5bc073df0 msgr2=0x7fd5bc06ebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:26.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.570+0000 7f7839ffb640 1 -- 172.21.15.22:0/192440873 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78340a5580 con 0x7f783c0c66c0 2024-05-21T13:36:26.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.570+0000 7f7839ffb640 1 -- 172.21.15.22:0/192440873 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78340a5720 con 0x7f783c0c66c0 2024-05-21T13:36:26.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.570+0000 7f7839ffb640 1 -- 172.21.15.22:0/192440873 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78340a5af0 con 0x7f783c0c66c0 2024-05-21T13:36:26.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.570+0000 7f7841a26640 1 -- 172.21.15.22:0/192440873 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f783c0c66c0 msgr2=0x7f783c158760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:26.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.570+0000 7f7841a26640 1 --2- 172.21.15.22:0/192440873 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f783c0c66c0 0x7f783c158760 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7834009e50 tx=0x7f783401c9c0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.570+0000 7f7841a26640 1 -- 172.21.15.22:0/192440873 shutdown_connections 2024-05-21T13:36:26.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.570+0000 7f7841a26640 1 --2- 172.21.15.22:0/192440873 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f783c0c66c0 0x7f783c158760 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.570+0000 7f7841a26640 1 --2- 172.21.15.22:0/192440873 >> v2:172.21.15.115:3300/0 conn(0x7f783c152350 0x7f783c0c6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.570+0000 7f7841a26640 1 -- 172.21.15.22:0/192440873 >> 172.21.15.22:0/192440873 conn(0x7f783c0ca320 msgr2=0x7f783c0ca730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:26.571 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.570+0000 7eff9e7fc640 1 -- 172.21.15.22:0/1221415066 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff940a5660 con 0x7eff88004810 2024-05-21T13:36:26.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.570+0000 7eff9e7fc640 1 -- 172.21.15.22:0/1221415066 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff94009690 con 0x7eff88004810 2024-05-21T13:36:26.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.570+0000 7f4f3a834640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4f3414fea0 0x7f4f34142c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.570+0000 7f4f3a834640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4f3414fea0 0x7f4f34142c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48152/0 (socket says 172.21.15.22:48152) 2024-05-21T13:36:26.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.570+0000 7f4f3a834640 1 -- 172.21.15.22:0/3837080922 learned_addr learned my addr 172.21.15.22:0/3837080922 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:26.572 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.574+0000 7f4f3a033640 1 --2- 172.21.15.22:0/3837080922 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4f34072280 0x7f4f3414e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.570+0000 7f06add9b640 1 --2- 172.21.15.22:0/4206397363 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f06b00707b0 0x7f06b0151a40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f06a00097c0 tx=0x7f06a001ecb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4c0692ab5722e07 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:26.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.574+0000 7f06ad59a640 1 -- 172.21.15.22:0/4206397363 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06a00b5070 con 0x7f06b00707b0 2024-05-21T13:36:26.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.574+0000 7f06ad59a640 1 -- 172.21.15.22:0/4206397363 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06a00a8990 con 0x7f06b00707b0 2024-05-21T13:36:26.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.574+0000 7f06ad59a640 1 -- 172.21.15.22:0/4206397363 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06a00a8d60 con 0x7f06b00707b0 2024-05-21T13:36:26.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.570+0000 7f99e16d5640 1 -- start start 2024-05-21T13:36:26.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.574+0000 7effa5c01640 1 -- 172.21.15.22:0/1221415066 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7eff88004810 msgr2=0x7eff88004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:26.573 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.574+0000 7effa5c01640 1 --2- 172.21.15.22:0/1221415066 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7eff88004810 0x7eff88004c90 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7eff94009ac0 tx=0x7eff9401ca70 comp rx=0 tx=0).stop 2024-05-21T13:36:26.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.574+0000 7f4f3a834640 1 -- 172.21.15.22:0/3837080922 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4f34072280 msgr2=0x7f4f3414e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:26.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.574+0000 7f4f3a834640 1 --2- 172.21.15.22:0/3837080922 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4f34072280 0x7f4f3414e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.574+0000 7f4f3a834640 1 -- 172.21.15.22:0/3837080922 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f34073030 msgr2=0x7f4f341575b0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-21T13:36:26.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.574+0000 7f4f3a834640 1 --2- 172.21.15.22:0/3837080922 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4f34073030 0x7f4f341575b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.574 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.574+0000 7f7841a26640 1 -- 172.21.15.22:0/192440873 shutdown_connections 2024-05-21T13:36:26.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.574+0000 7effa5c01640 1 -- 172.21.15.22:0/1221415066 shutdown_connections 2024-05-21T13:36:26.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.574+0000 7effa5c01640 1 --2- 172.21.15.22:0/1221415066 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7eff88004810 0x7eff88004c90 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.574+0000 7effa5c01640 1 -- 172.21.15.22:0/1221415066 >> 172.21.15.22:0/1221415066 conn(0x7effa00703a0 msgr2=0x7effa00cd250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:26.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.574+0000 7f4f3a834640 1 -- 172.21.15.22:0/3837080922 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f34147840 con 0x7f4f3414fea0 2024-05-21T13:36:26.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.574+0000 7effa5c01640 1 -- 172.21.15.22:0/1221415066 shutdown_connections 2024-05-21T13:36:26.575 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.574+0000 7f0c8d40b640 1 --2- 172.21.15.22:0/3532578221 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0c880cae40 0x7f0c8815bb00 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0c7800a960 tx=0x7f0c7801d690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5f963bb982384bb server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:26.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.574+0000 7f99e16d5640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f99dc068260 0x7f99dc15f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.574+0000 7f99e16d5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f99dc0686b0 0x7f99dc154c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.574+0000 7f99e16d5640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f99dc0cae40 0x7f99dc1fc440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.574+0000 7f99e16d5640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f99dc15cc50 con 0x7f99dc0686b0 2024-05-21T13:36:26.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.574+0000 7f99e16d5640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f99dc15cad0 con 0x7f99dc0cae40 2024-05-21T13:36:26.576 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.574+0000 7f99e16d5640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f99dc15cdd0 con 0x7f99dc068260 2024-05-21T13:36:26.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.574+0000 7f4f3a834640 1 --2- 172.21.15.22:0/3837080922 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4f3414fea0 0x7f4f34142c10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c00c730 tx=0x7f4f2c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:26.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.574+0000 7f99daffd640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f99dc068260 0x7f99dc15f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.574+0000 7f4f2affd640 1 -- 172.21.15.22:0/3837080922 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c003ba0 con 0x7f4f3414fea0 2024-05-21T13:36:26.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.574+0000 7f99db7fe640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f99dc0cae40 0x7f99dc1fc440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.577 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.574+0000 7f99daffd640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f99dc068260 0x7f99dc15f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.22:41824/0 (socket says 172.21.15.22:41824) 2024-05-21T13:36:26.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.574+0000 7f99daffd640 1 -- 172.21.15.22:0/925678720 learned_addr learned my addr 172.21.15.22:0/925678720 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:26.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.574+0000 7f06b4b2f640 1 -- 172.21.15.22:0/4206397363 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f06b00707b0 msgr2=0x7f06b0151a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:26.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.574+0000 7f06b4b2f640 1 --2- 172.21.15.22:0/4206397363 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f06b00707b0 0x7f06b0151a40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f06a00097c0 tx=0x7f06a001ecb0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.574+0000 7f4f2affd640 1 -- 172.21.15.22:0/3837080922 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f2c003d60 con 0x7f4f3414fea0 2024-05-21T13:36:26.578 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.574+0000 7f4f2affd640 1 -- 172.21.15.22:0/3837080922 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c005310 con 0x7f4f3414fea0 2024-05-21T13:36:26.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.574+0000 7f99da7fc640 1 --2- 172.21.15.22:0/925678720 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f99dc0686b0 0x7f99dc154c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.574+0000 7f06b4b2f640 1 -- 172.21.15.22:0/4206397363 shutdown_connections 2024-05-21T13:36:26.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.574+0000 7f06b4b2f640 1 --2- 172.21.15.22:0/4206397363 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f06b00707b0 0x7f06b0151a40 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.574+0000 7f06b4b2f640 1 --2- 172.21.15.22:0/4206397363 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f06b00c9f40 0x7f06b015bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.574+0000 7f06b4b2f640 1 -- 172.21.15.22:0/4206397363 >> 172.21.15.22:0/4206397363 conn(0x7f06b00703a0 msgr2=0x7f06b00cd250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:26.579 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.574+0000 7f06b4b2f640 1 -- 172.21.15.22:0/4206397363 shutdown_connections 2024-05-21T13:36:26.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.574+0000 7fd5c1562640 1 -- 172.21.15.22:0/2195808547 shutdown_connections 2024-05-21T13:36:26.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.574+0000 7f4f3c297640 1 -- 172.21.15.22:0/3837080922 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f341f2030 con 0x7f4f3414fea0 2024-05-21T13:36:26.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.574+0000 7f4f3c297640 1 -- 172.21.15.22:0/3837080922 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f341f22f0 con 0x7f4f3414fea0 2024-05-21T13:36:26.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.574+0000 7f99da7fc640 1 -- 172.21.15.22:0/925678720 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f99dc068260 msgr2=0x7f99dc15f060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:26.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.574+0000 7f99da7fc640 1 --2- 172.21.15.22:0/925678720 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f99dc068260 0x7f99dc15f060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.574+0000 7f99da7fc640 1 -- 172.21.15.22:0/925678720 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f99dc0cae40 msgr2=0x7f99dc1fc440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:26.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.574+0000 7f99da7fc640 1 --2- 172.21.15.22:0/925678720 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f99dc0cae40 0x7f99dc1fc440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.580 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.574+0000 7f99da7fc640 1 -- 172.21.15.22:0/925678720 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99dc150df0 con 0x7f99dc0686b0 2024-05-21T13:36:26.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.574+0000 7f7841a26640 1 -- 172.21.15.22:0/192440873 wait complete. 2024-05-21T13:36:26.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.574+0000 7f7841a26640 1 Processor -- start 2024-05-21T13:36:26.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.574+0000 7f4f3c297640 1 -- 172.21.15.22:0/3837080922 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4f341f2c90 con 0x7f4f3414fea0 2024-05-21T13:36:26.581 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.574+0000 7effa5c01640 1 -- 172.21.15.22:0/1221415066 wait complete. 2024-05-21T13:36:26.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.574+0000 7effa5c01640 1 Processor -- start 2024-05-21T13:36:26.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.574+0000 7f99da7fc640 1 --2- 172.21.15.22:0/925678720 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f99dc0686b0 0x7f99dc154c30 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f99d000c430 tx=0x7f99d000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:26.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.574+0000 7f06b4b2f640 1 -- 172.21.15.22:0/4206397363 wait complete. 2024-05-21T13:36:26.582 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.574+0000 7f0c877fe640 1 -- 172.21.15.22:0/3532578221 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c780a8070 con 0x7f0c880cae40 2024-05-21T13:36:26.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.574+0000 7f0c877fe640 1 -- 172.21.15.22:0/3532578221 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c780b1070 con 0x7f0c880cae40 2024-05-21T13:36:26.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.574+0000 7f0c877fe640 1 -- 172.21.15.22:0/3532578221 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c7800b040 con 0x7f0c880cae40 2024-05-21T13:36:26.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.574+0000 7f99c37fe640 1 -- 172.21.15.22:0/925678720 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99d0017070 con 0x7f99dc0686b0 2024-05-21T13:36:26.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.574+0000 7f99c37fe640 1 -- 172.21.15.22:0/925678720 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f99d00052d0 con 0x7f99dc0686b0 2024-05-21T13:36:26.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.574+0000 7f99c37fe640 1 -- 172.21.15.22:0/925678720 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99d0003820 con 0x7f99dc0686b0 2024-05-21T13:36:26.583 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.574+0000 7f06b4b2f640 1 Processor -- start 2024-05-21T13:36:26.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.574+0000 7f06b4b2f640 1 -- start start 2024-05-21T13:36:26.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.574+0000 7effa5c01640 1 -- start start 2024-05-21T13:36:26.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.574+0000 7effa5c01640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7eff88004810 0x7effa015c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.574+0000 7effa5c01640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7effa015a8d0 0x7effa01f8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.574+0000 7effa5c01640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7effa006f330 0x7effa01f9300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.584 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.574+0000 7effa5c01640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7effa00c7d30 con 0x7effa015a8d0 2024-05-21T13:36:26.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.574+0000 7effa5c01640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7effa0163ec0 con 0x7effa006f330 2024-05-21T13:36:26.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.574+0000 7effa5c01640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7effa00cdaf0 con 0x7eff88004810 2024-05-21T13:36:26.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.574+0000 7f99e16d5640 1 -- 172.21.15.22:0/925678720 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99dc0c4030 con 0x7f99dc0686b0 2024-05-21T13:36:26.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.574+0000 7f99e16d5640 1 -- 172.21.15.22:0/925678720 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99dc15e580 con 0x7f99dc0686b0 2024-05-21T13:36:26.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.574+0000 7f99e16d5640 1 -- 172.21.15.22:0/925678720 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f99dc0697d0 con 0x7f99dc0686b0 2024-05-21T13:36:26.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.574+0000 7f0c8ee6e640 1 -- 172.21.15.22:0/3532578221 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0c880cae40 msgr2=0x7f0c8815bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:26.585 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.574+0000 7f0c8ee6e640 1 --2- 172.21.15.22:0/3532578221 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0c880cae40 0x7f0c8815bb00 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f0c7800a960 tx=0x7f0c7801d690 comp rx=0 tx=0).stop 2024-05-21T13:36:26.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.574+0000 7f4f2affd640 1 -- 172.21.15.22:0/3837080922 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f4f2c0054b0 con 0x7f4f3414fea0 2024-05-21T13:36:26.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.574+0000 7fd5c1562640 1 -- 172.21.15.22:0/2195808547 wait complete. 2024-05-21T13:36:26.586 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.574+0000 7fd5c1562640 1 Processor -- start 2024-05-21T13:36:26.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.574+0000 7eff9effd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7effa015a8d0 0x7effa01f8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.574+0000 7eff9effd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7effa015a8d0 0x7effa01f8dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48170/0 (socket says 172.21.15.22:48170) 2024-05-21T13:36:26.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7eff9effd640 1 -- 172.21.15.22:0/1553043978 learned_addr learned my addr 172.21.15.22:0/1553043978 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:26.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7eff9f7fe640 1 --2- 172.21.15.22:0/1553043978 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7eff88004810 0x7effa015c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7eff9ffff640 1 --2- 172.21.15.22:0/1553043978 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7effa006f330 0x7effa01f9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7f0c8ee6e640 1 -- 172.21.15.22:0/3532578221 shutdown_connections 2024-05-21T13:36:26.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7f0c8ee6e640 1 --2- 172.21.15.22:0/3532578221 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0c880cae40 0x7f0c8815bb00 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7f0c8ee6e640 1 --2- 172.21.15.22:0/3532578221 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0c880c6770 0x7f0c8815b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.587 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7f0c8ee6e640 1 -- 172.21.15.22:0/3532578221 >> 172.21.15.22:0/3532578221 conn(0x7f0c880ca320 msgr2=0x7f0c880ca730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:26.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7eff9effd640 1 -- 172.21.15.22:0/1553043978 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7eff88004810 msgr2=0x7effa015c830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:26.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7eff9effd640 1 --2- 172.21.15.22:0/1553043978 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7eff88004810 0x7effa015c830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7eff9effd640 1 -- 172.21.15.22:0/1553043978 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7effa006f330 msgr2=0x7effa01f9300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:26.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7eff9effd640 1 --2- 172.21.15.22:0/1553043978 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7effa006f330 0x7effa01f9300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7eff9effd640 1 -- 172.21.15.22:0/1553043978 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effa015ae10 con 0x7effa015a8d0 2024-05-21T13:36:26.588 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7f4f2affd640 1 --2- 172.21.15.22:0/3837080922 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f4f1806f430 0x7f4f180718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.589 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7eff9f7fe640 1 --2- 172.21.15.22:0/1553043978 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7eff88004810 0x7effa015c830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T13:36:26.589 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7eff9ffff640 1 --2- 172.21.15.22:0/1553043978 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7effa006f330 0x7effa01f9300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T13:36:26.589 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7f9c737fe640 1 --2- 172.21.15.22:0/1262009337 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c740c90a0 0x7f9c7416a960 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9c7406cf90 tx=0x7f9c6c01ca30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=903a3b377d27749 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:26.589 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7f9c727fc640 1 -- 172.21.15.22:0/1262009337 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c6c0a56c0 con 0x7f9c740c90a0 2024-05-21T13:36:26.589 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7f9c727fc640 1 -- 172.21.15.22:0/1262009337 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c6c0a5860 con 0x7f9c740c90a0 2024-05-21T13:36:26.589 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7f9c727fc640 1 -- 172.21.15.22:0/1262009337 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c6c0a5c30 con 0x7f9c740c90a0 2024-05-21T13:36:26.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7f06b4b2f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06b00707b0 0x7f06b01f9360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7f06b4b2f640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f06b00c9f40 0x7f06b0143310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7f06b4b2f640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f06b00ca320 0x7f06b0143850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7f06b4b2f640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f06b006f770 con 0x7f06b00707b0 2024-05-21T13:36:26.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7f06b4b2f640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f06b00c9380 con 0x7f06b00ca320 2024-05-21T13:36:26.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7f06b4b2f640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f06b0073740 con 0x7f06b00c9f40 2024-05-21T13:36:26.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7f06ae59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06b00707b0 0x7f06b01f9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7f06ae59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06b00707b0 0x7f06b01f9360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48174/0 (socket says 172.21.15.22:48174) 2024-05-21T13:36:26.590 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7f06ae59c640 1 -- 172.21.15.22:0/3661697049 learned_addr learned my addr 172.21.15.22:0/3661697049 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:26.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7f4f3a033640 1 --2- 172.21.15.22:0/3837080922 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f4f1806f430 0x7f4f180718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7f7841a26640 1 -- start start 2024-05-21T13:36:26.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7f7841a26640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f783c0c66c0 0x7f783c13d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7f06add9b640 1 --2- 172.21.15.22:0/3661697049 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f06b00c9f40 0x7f06b0143310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.591 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7f7841a26640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f783c0cae40 0x7f783c074040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7f7841a26640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f783c152350 0x7f783c074580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7f7841a26640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f783c071430 con 0x7f783c0c66c0 2024-05-21T13:36:26.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7f7841a26640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f783c0712b0 con 0x7f783c0cae40 2024-05-21T13:36:26.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7f7841a26640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f783c164900 con 0x7f783c152350 2024-05-21T13:36:26.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7f06ae59c640 1 -- 172.21.15.22:0/3661697049 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f06b00c9f40 msgr2=0x7f06b0143310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:26.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7f06ae59c640 1 --2- 172.21.15.22:0/3661697049 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f06b00c9f40 0x7f06b0143310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7f06ae59c640 1 -- 172.21.15.22:0/3661697049 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f06b00ca320 msgr2=0x7f06b0143850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:26.592 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7f06ae59c640 1 --2- 172.21.15.22:0/3661697049 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f06b00ca320 0x7f06b0143850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7f06ae59c640 1 -- 172.21.15.22:0/3661697049 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06b0077dc0 con 0x7f06b00707b0 2024-05-21T13:36:26.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7f06add9b640 1 --2- 172.21.15.22:0/3661697049 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f06b00c9f40 0x7f06b0143310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:36:26.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7f0c8ee6e640 1 -- 172.21.15.22:0/3532578221 shutdown_connections 2024-05-21T13:36:26.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7f9c79372640 1 -- 172.21.15.22:0/1262009337 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c740c90a0 msgr2=0x7f9c7416a960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:26.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7f9c79372640 1 --2- 172.21.15.22:0/1262009337 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c740c90a0 0x7f9c7416a960 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f9c7406cf90 tx=0x7f9c6c01ca30 comp rx=0 tx=0).stop 2024-05-21T13:36:26.594 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7f06ae59c640 1 --2- 172.21.15.22:0/3661697049 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06b00707b0 0x7f06b01f9360 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f06a800ce10 tx=0x7f06a800a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:26.594 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7f9c79372640 1 -- 172.21.15.22:0/1262009337 shutdown_connections 2024-05-21T13:36:26.594 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7f9c79372640 1 --2- 172.21.15.22:0/1262009337 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c740c90a0 0x7f9c7416a960 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.594 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7f9c79372640 1 --2- 172.21.15.22:0/1262009337 >> v2:172.21.15.22:3300/0 conn(0x7f9c740c7e60 0x7f9c740c9800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.594 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7f9c79372640 1 -- 172.21.15.22:0/1262009337 >> 172.21.15.22:0/1262009337 conn(0x7f9c740cd460 msgr2=0x7f9c740cd870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:26.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7f783affd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f783c0c66c0 0x7f783c13d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7f783affd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f783c0c66c0 0x7f783c13d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48176/0 (socket says 172.21.15.22:48176) 2024-05-21T13:36:26.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7f783affd640 1 -- 172.21.15.22:0/3392685946 learned_addr learned my addr 172.21.15.22:0/3392685946 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:26.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7f9c79372640 1 -- 172.21.15.22:0/1262009337 shutdown_connections 2024-05-21T13:36:26.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7fd5c1562640 1 -- start start 2024-05-21T13:36:26.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7f9c79372640 1 -- 172.21.15.22:0/1262009337 wait complete. 2024-05-21T13:36:26.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7f4f3a033640 1 --2- 172.21.15.22:0/3837080922 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f4f1806f430 0x7f4f180718f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4f300ae000 tx=0x7f4f300b3040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:26.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7f783affd640 1 -- 172.21.15.22:0/3392685946 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f783c152350 msgr2=0x7f783c074580 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-21T13:36:26.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7f783affd640 1 --2- 172.21.15.22:0/3392685946 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f783c152350 0x7f783c074580 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7f783affd640 1 -- 172.21.15.22:0/3392685946 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f783c0cae40 msgr2=0x7f783c074040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:26.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7f783affd640 1 --2- 172.21.15.22:0/3392685946 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f783c0cae40 0x7f783c074040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7f783affd640 1 -- 172.21.15.22:0/3392685946 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f783c0cb850 con 0x7f783c0c66c0 2024-05-21T13:36:26.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7f783affd640 1 --2- 172.21.15.22:0/3392685946 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f783c0c66c0 0x7f783c13d090 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f782c00b3f0 tx=0x7f782c00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:26.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7f0c8ee6e640 1 -- 172.21.15.22:0/3532578221 wait complete. 2024-05-21T13:36:26.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7f9c79372640 1 Processor -- start 2024-05-21T13:36:26.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7fd5c1562640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd5bc0d1650 0x7fd5bc202120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7fd5c1562640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5bc0d1a30 0x7fd5bc151960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7fd5c1562640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5bc15ca50 0x7fd5bc155a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7fd5c1562640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd5bc0cead0 con 0x7fd5bc0d1a30 2024-05-21T13:36:26.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7fd5c1562640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fd5bc0cdbc0 con 0x7fd5bc15ca50 2024-05-21T13:36:26.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7fd5c1562640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7fd5bc0cec50 con 0x7fd5bc0d1650 2024-05-21T13:36:26.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7fd5bbfff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd5bc0d1650 0x7fd5bc202120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7fd5c0d61640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5bc15ca50 0x7fd5bc155a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7fd5c0d61640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5bc15ca50 0x7fd5bc155a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.22:36408/0 (socket says 172.21.15.22:36408) 2024-05-21T13:36:26.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7fd5c0d61640 1 -- 172.21.15.22:0/264853710 learned_addr learned my addr 172.21.15.22:0/264853710 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:26.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7f9c79372640 1 -- start start 2024-05-21T13:36:26.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7f069effd640 1 -- 172.21.15.22:0/3661697049 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06a8003ba0 con 0x7f06b00707b0 2024-05-21T13:36:26.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7f7823fff640 1 -- 172.21.15.22:0/3392685946 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f782c015020 con 0x7f783c0c66c0 2024-05-21T13:36:26.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7f069effd640 1 -- 172.21.15.22:0/3661697049 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06a8003d40 con 0x7f06b00707b0 2024-05-21T13:36:26.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7f069effd640 1 -- 172.21.15.22:0/3661697049 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06a8004240 con 0x7f06b00707b0 2024-05-21T13:36:26.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7eff9effd640 1 --2- 172.21.15.22:0/1553043978 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7effa015a8d0 0x7effa01f8dc0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7eff9401cf50 tx=0x7eff94019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:26.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7f99c37fe640 1 -- 172.21.15.22:0/925678720 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f99d001a070 con 0x7f99dc0686b0 2024-05-21T13:36:26.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7f99c37fe640 1 --2- 172.21.15.22:0/925678720 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f99c806f450 0x7f99c8071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7f99c37fe640 1 -- 172.21.15.22:0/925678720 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f99d008ef30 con 0x7f99dc0686b0 2024-05-21T13:36:26.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7f99c37fe640 1 --2- 172.21.15.22:0/925678720 >> [v2:172.21.15.115:6800/832695158,v1:172.21.15.115:6801/832695158] conn(0x7f99c8078bc0 0x7f99c807b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7f99c37fe640 1 -- 172.21.15.22:0/925678720 --> [v2:172.21.15.115:6800/832695158,v1:172.21.15.115:6801/832695158] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f99d001dec0 con 0x7f99c8078bc0 2024-05-21T13:36:26.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7f99c37fe640 1 -- 172.21.15.22:0/925678720 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f99d008f410 con 0x7f99dc0686b0 2024-05-21T13:36:26.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7fd5bb7fe640 1 --2- 172.21.15.22:0/264853710 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5bc0d1a30 0x7fd5bc151960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7fd5c0d61640 1 -- 172.21.15.22:0/264853710 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd5bc0d1650 msgr2=0x7fd5bc202120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:26.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7fd5c0d61640 1 --2- 172.21.15.22:0/264853710 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd5bc0d1650 0x7fd5bc202120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7fd5c0d61640 1 -- 172.21.15.22:0/264853710 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5bc0d1a30 msgr2=0x7fd5bc151960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:26.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7fd5c0d61640 1 --2- 172.21.15.22:0/264853710 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd5bc0d1a30 0x7fd5bc151960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7fd5c0d61640 1 -- 172.21.15.22:0/264853710 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5bc202660 con 0x7fd5bc15ca50 2024-05-21T13:36:26.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7fd5c0d61640 1 --2- 172.21.15.22:0/264853710 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5bc15ca50 0x7fd5bc155a40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd5b400cb00 tx=0x7fd5b400a060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:26.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7f7841a26640 1 -- 172.21.15.22:0/3392685946 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f783c13cb30 con 0x7f783c0c66c0 2024-05-21T13:36:26.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.578+0000 7f7841a26640 1 -- 172.21.15.22:0/3392685946 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f783c156c50 con 0x7f783c0c66c0 2024-05-21T13:36:26.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.582+0000 7f7823fff640 1 -- 172.21.15.22:0/3392685946 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f782c011850 con 0x7f783c0c66c0 2024-05-21T13:36:26.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.582+0000 7f7823fff640 1 -- 172.21.15.22:0/3392685946 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f782c011c40 con 0x7f783c0c66c0 2024-05-21T13:36:26.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.582+0000 7f0c8ee6e640 1 Processor -- start 2024-05-21T13:36:26.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.582+0000 7f99db7fe640 1 --2- 172.21.15.22:0/925678720 >> [v2:172.21.15.115:6800/832695158,v1:172.21.15.115:6801/832695158] conn(0x7f99c8078bc0 0x7f99c807b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.582+0000 7f99daffd640 1 --2- 172.21.15.22:0/925678720 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f99c806f450 0x7f99c8071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.582+0000 7f06b4b2f640 1 -- 172.21.15.22:0/3661697049 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06b00cc750 con 0x7f06b00707b0 2024-05-21T13:36:26.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.582+0000 7f06b4b2f640 1 -- 172.21.15.22:0/3661697049 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06b00cd580 con 0x7f06b00707b0 2024-05-21T13:36:26.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.582+0000 7fd5b8ff9640 1 -- 172.21.15.22:0/264853710 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5b4017070 con 0x7fd5bc15ca50 2024-05-21T13:36:26.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.582+0000 7fd5c1562640 1 -- 172.21.15.22:0/264853710 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5bc151ea0 con 0x7fd5bc15ca50 2024-05-21T13:36:26.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.582+0000 7fd5c1562640 1 -- 172.21.15.22:0/264853710 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5bc152130 con 0x7fd5bc15ca50 2024-05-21T13:36:26.604 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.582+0000 7f9c79372640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c740c7e60 0x7f9c740c6a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.604 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.582+0000 7f9c79372640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c740c8cc0 0x7f9c74161760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.604 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.582+0000 7f9c79372640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9c740c90a0 0x7f9c74161ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.604 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.582+0000 7f9c79372640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9c7415ffe0 con 0x7f9c740c7e60 2024-05-21T13:36:26.604 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.582+0000 7f9c79372640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f9c740c94b0 con 0x7f9c740c8cc0 2024-05-21T13:36:26.604 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.582+0000 7f9c79372640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f9c7416b960 con 0x7f9c740c90a0 2024-05-21T13:36:26.604 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.582+0000 7fd5b8ff9640 1 -- 172.21.15.22:0/264853710 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5b400aca0 con 0x7fd5bc15ca50 2024-05-21T13:36:26.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.582+0000 7fd5b8ff9640 1 -- 172.21.15.22:0/264853710 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5b4012600 con 0x7fd5bc15ca50 2024-05-21T13:36:26.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.582+0000 7f06b4b2f640 1 -- 172.21.15.22:0/3661697049 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f06b0077bb0 con 0x7f06b00707b0 2024-05-21T13:36:26.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.582+0000 7f99db7fe640 1 --2- 172.21.15.22:0/925678720 >> [v2:172.21.15.115:6800/832695158,v1:172.21.15.115:6801/832695158] conn(0x7f99c8078bc0 0x7f99c807b000 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:26.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.582+0000 7f9c737fe640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9c740c90a0 0x7f9c74161ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.582+0000 7f9c737fe640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9c740c90a0 0x7f9c74161ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.22:41874/0 (socket says 172.21.15.22:41874) 2024-05-21T13:36:26.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.582+0000 7f9c737fe640 1 -- 172.21.15.22:0/2720750413 learned_addr learned my addr 172.21.15.22:0/2720750413 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:26.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.582+0000 7f7841a26640 1 -- 172.21.15.22:0/3392685946 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f781c001040 con 0x7f783c0c66c0 2024-05-21T13:36:26.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.582+0000 7fd5c1562640 1 -- 172.21.15.22:0/264853710 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd59c001040 con 0x7fd5bc15ca50 2024-05-21T13:36:26.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.582+0000 7f0c8ee6e640 1 -- start start 2024-05-21T13:36:26.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.582+0000 7f0c8ee6e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0c880c6770 0x7f0c881f9e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.582+0000 7f0c8ee6e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0c880cae40 0x7f0c881fc970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.582+0000 7f0c8ee6e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0c881524a0 0x7f0c8806e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.582+0000 7f0c8ee6e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f0c88071430 con 0x7f0c881524a0 2024-05-21T13:36:26.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.582+0000 7f0c8ee6e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f0c880712b0 con 0x7f0c880cae40 2024-05-21T13:36:26.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.582+0000 7f0c8ee6e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f0c88164900 con 0x7f0c880c6770 2024-05-21T13:36:26.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.582+0000 7f99daffd640 1 --2- 172.21.15.22:0/925678720 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f99c806f450 0x7f99c8071910 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f99cc000c10 tx=0x7f99cc0a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:26.608 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.582+0000 7f0c8cc0a640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0c880c6770 0x7f0c881f9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.608 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.582+0000 7f0c87fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0c880cae40 0x7f0c881fc970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.608 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.582+0000 7f0c8cc0a640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0c880c6770 0x7f0c881f9e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.22:41888/0 (socket says 172.21.15.22:41888) 2024-05-21T13:36:26.608 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.582+0000 7f0c8cc0a640 1 -- 172.21.15.22:0/1269262334 learned_addr learned my addr 172.21.15.22:0/1269262334 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:26.608 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.582+0000 7f9c6bfff640 1 --2- 172.21.15.22:0/2720750413 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c740c8cc0 0x7f9c74161760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.608 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.582+0000 7f9c72ffd640 1 --2- 172.21.15.22:0/2720750413 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c740c7e60 0x7f9c740c6a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.582+0000 7f9c737fe640 1 -- 172.21.15.22:0/2720750413 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c740c8cc0 msgr2=0x7f9c74161760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:26.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.582+0000 7f9c737fe640 1 --2- 172.21.15.22:0/2720750413 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9c740c8cc0 0x7f9c74161760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.582+0000 7f0c8d40b640 1 --2- 172.21.15.22:0/1269262334 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0c881524a0 0x7f0c8806e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.582+0000 7f9c737fe640 1 -- 172.21.15.22:0/2720750413 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c740c7e60 msgr2=0x7f9c740c6a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:26.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.582+0000 7f9c737fe640 1 --2- 172.21.15.22:0/2720750413 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c740c7e60 0x7f9c740c6a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.582+0000 7f9c737fe640 1 -- 172.21.15.22:0/2720750413 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c740cd170 con 0x7f9c740c90a0 2024-05-21T13:36:26.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.582+0000 7f9c72ffd640 1 --2- 172.21.15.22:0/2720750413 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9c740c7e60 0x7f9c740c6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:36:26.610 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.582+0000 7eff87fff640 1 -- 172.21.15.22:0/1553043978 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff940b2040 con 0x7effa015a8d0 2024-05-21T13:36:26.610 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.582+0000 7eff87fff640 1 -- 172.21.15.22:0/1553043978 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff940bd070 con 0x7effa015a8d0 2024-05-21T13:36:26.610 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.582+0000 7eff87fff640 1 -- 172.21.15.22:0/1553043978 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff940b8870 con 0x7effa015a8d0 2024-05-21T13:36:26.610 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.582+0000 7f0c8d40b640 1 -- 172.21.15.22:0/1269262334 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0c880c6770 msgr2=0x7f0c881f9e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:26.610 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.582+0000 7f0c8d40b640 1 --2- 172.21.15.22:0/1269262334 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0c880c6770 0x7f0c881f9e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.610 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.582+0000 7f0c8d40b640 1 -- 172.21.15.22:0/1269262334 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0c880cae40 msgr2=0x7f0c881fc970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:26.610 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.582+0000 7f0c8d40b640 1 --2- 172.21.15.22:0/1269262334 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0c880cae40 0x7f0c881fc970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.610 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.582+0000 7f0c8d40b640 1 -- 172.21.15.22:0/1269262334 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c881f9380 con 0x7f0c881524a0 2024-05-21T13:36:26.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.582+0000 7f9c737fe640 1 --2- 172.21.15.22:0/2720750413 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9c740c90a0 0x7f9c74161ca0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c01a660 tx=0x7f9c6c0197d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:26.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.582+0000 7f4f2affd640 1 -- 172.21.15.22:0/3837080922 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f4f2c013e10 con 0x7f4f3414fea0 2024-05-21T13:36:26.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.582+0000 7f4f2affd640 1 --2- 172.21.15.22:0/3837080922 >> [v2:172.21.15.22:6808/685426272,v1:172.21.15.22:6809/685426272] conn(0x7f4f18078aa0 0x7f4f1807aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.582+0000 7f4f2affd640 1 -- 172.21.15.22:0/3837080922 --> [v2:172.21.15.22:6808/685426272,v1:172.21.15.22:6809/685426272] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4f2c017ec0 con 0x7f4f18078aa0 2024-05-21T13:36:26.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.582+0000 7f4f2affd640 1 -- 172.21.15.22:0/3837080922 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4f2c0575b0 con 0x7f4f3414fea0 2024-05-21T13:36:26.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.582+0000 7f4f39832640 1 --2- 172.21.15.22:0/3837080922 >> [v2:172.21.15.22:6808/685426272,v1:172.21.15.22:6809/685426272] conn(0x7f4f18078aa0 0x7f4f1807aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.582+0000 7effa5c01640 1 -- 172.21.15.22:0/1553043978 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effa00cc420 con 0x7effa015a8d0 2024-05-21T13:36:26.612 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.582+0000 7effa5c01640 1 -- 172.21.15.22:0/1553043978 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effa00cc9e0 con 0x7effa015a8d0 2024-05-21T13:36:26.612 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.582+0000 7f9c6b7fe640 1 -- 172.21.15.22:0/2720750413 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c6c0b8670 con 0x7f9c740c90a0 2024-05-21T13:36:26.612 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.582+0000 7f9c6b7fe640 1 -- 172.21.15.22:0/2720750413 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c6c0be070 con 0x7f9c740c90a0 2024-05-21T13:36:26.612 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.582+0000 7f9c6b7fe640 1 -- 172.21.15.22:0/2720750413 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c6c0b8a50 con 0x7f9c740c90a0 2024-05-21T13:36:26.613 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.582+0000 7f9c79372640 1 -- 172.21.15.22:0/2720750413 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c7416bc00 con 0x7f9c740c90a0 2024-05-21T13:36:26.613 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.582+0000 7f9c79372640 1 -- 172.21.15.22:0/2720750413 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c740ccbb0 con 0x7f9c740c90a0 2024-05-21T13:36:26.613 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.582+0000 7f069effd640 1 -- 172.21.15.22:0/3661697049 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f06a80043e0 con 0x7f06b00707b0 2024-05-21T13:36:26.613 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.586+0000 7f069effd640 1 --2- 172.21.15.22:0/3661697049 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f069006f400 0x7f06900718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.613 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.586+0000 7f069effd640 1 -- 172.21.15.22:0/3661697049 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f06a80906e0 con 0x7f06b00707b0 2024-05-21T13:36:26.613 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.586+0000 7f069effd640 1 --2- 172.21.15.22:0/3661697049 >> [v2:172.21.15.22:6800/222752954,v1:172.21.15.22:6801/222752954] conn(0x7f0690078a70 0x7f069007aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.613 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.586+0000 7f069effd640 1 -- 172.21.15.22:0/3661697049 --> [v2:172.21.15.22:6800/222752954,v1:172.21.15.22:6801/222752954] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f069007b580 con 0x7f0690078a70 2024-05-21T13:36:26.613 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.586+0000 7f06add9b640 1 --2- 172.21.15.22:0/3661697049 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f069006f400 0x7f06900718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.613 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.586+0000 7f06add9b640 1 --2- 172.21.15.22:0/3661697049 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f069006f400 0x7f06900718c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f06a00b2000 tx=0x7f06a00aa070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:26.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.582+0000 7f4f39832640 1 --2- 172.21.15.22:0/3837080922 >> [v2:172.21.15.22:6808/685426272,v1:172.21.15.22:6809/685426272] conn(0x7f4f18078aa0 0x7f4f1807aee0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:26.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.586+0000 7f4f2affd640 1 -- 172.21.15.22:0/3837080922 <== osd.1 v2:172.21.15.22:6808/685426272 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4f2c017ec0 con 0x7f4f18078aa0 2024-05-21T13:36:26.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.582+0000 7effa5c01640 1 -- 172.21.15.22:0/1553043978 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7effa0077bb0 con 0x7effa015a8d0 2024-05-21T13:36:26.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.586+0000 7eff87fff640 1 -- 172.21.15.22:0/1553043978 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7eff940b8a10 con 0x7effa015a8d0 2024-05-21T13:36:26.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.586+0000 7eff87fff640 1 --2- 172.21.15.22:0/1553043978 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7eff8c06f400 0x7eff8c0718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.586+0000 7eff87fff640 1 -- 172.21.15.22:0/1553043978 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7eff9412a870 con 0x7effa015a8d0 2024-05-21T13:36:26.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.586+0000 7f7823fff640 1 -- 172.21.15.22:0/3392685946 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f782c018020 con 0x7f783c0c66c0 2024-05-21T13:36:26.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.586+0000 7f7823fff640 1 --2- 172.21.15.22:0/3392685946 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f782806f430 0x7f78280718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.586+0000 7f7823fff640 1 -- 172.21.15.22:0/3392685946 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f782c08fd20 con 0x7f783c0c66c0 2024-05-21T13:36:26.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.586+0000 7f7823fff640 1 --2- 172.21.15.22:0/3392685946 >> [v2:172.21.15.22:6824/1232311110,v1:172.21.15.22:6825/1232311110] conn(0x7f7828078bb0 0x7f782807aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.586+0000 7f7823fff640 1 -- 172.21.15.22:0/3392685946 --> [v2:172.21.15.22:6824/1232311110,v1:172.21.15.22:6825/1232311110] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f782807b6c0 con 0x7f7828078bb0 2024-05-21T13:36:26.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.586+0000 7f7823fff640 1 -- 172.21.15.22:0/3392685946 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f782c090110 con 0x7f783c0c66c0 2024-05-21T13:36:26.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.586+0000 7f783b7fe640 1 --2- 172.21.15.22:0/3392685946 >> [v2:172.21.15.22:6824/1232311110,v1:172.21.15.22:6825/1232311110] conn(0x7f7828078bb0 0x7f782807aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.586+0000 7f783a7fc640 1 --2- 172.21.15.22:0/3392685946 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f782806f430 0x7f78280718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.586+0000 7f783b7fe640 1 --2- 172.21.15.22:0/3392685946 >> [v2:172.21.15.22:6824/1232311110,v1:172.21.15.22:6825/1232311110] conn(0x7f7828078bb0 0x7f782807aff0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:26.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.586+0000 7f7823fff640 1 -- 172.21.15.22:0/3392685946 <== osd.3 v2:172.21.15.22:6824/1232311110 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f782807b6c0 con 0x7f7828078bb0 2024-05-21T13:36:26.616 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.586+0000 7f99c37fe640 1 -- 172.21.15.22:0/925678720 <== osd.4 v2:172.21.15.115:6800/832695158 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f99d001dec0 con 0x7f99c8078bc0 2024-05-21T13:36:26.616 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.586+0000 7f9c79372640 1 -- 172.21.15.22:0/2720750413 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9c58001040 con 0x7f9c740c90a0 2024-05-21T13:36:26.616 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.582+0000 7f0c8d40b640 1 --2- 172.21.15.22:0/1269262334 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0c881524a0 0x7f0c8806e820 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0c780ad000 tx=0x7f0c7801a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:26.616 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.586+0000 7f0c857fa640 1 -- 172.21.15.22:0/1269262334 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c780ba030 con 0x7f0c881524a0 2024-05-21T13:36:26.616 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.586+0000 7f0c857fa640 1 -- 172.21.15.22:0/1269262334 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c780bf410 con 0x7f0c881524a0 2024-05-21T13:36:26.616 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.586+0000 7f0c8ee6e640 1 -- 172.21.15.22:0/1269262334 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c881fd1b0 con 0x7f0c881524a0 2024-05-21T13:36:26.616 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.586+0000 7f0c857fa640 1 -- 172.21.15.22:0/1269262334 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c780bf820 con 0x7f0c881524a0 2024-05-21T13:36:26.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.586+0000 7fd5b8ff9640 1 -- 172.21.15.22:0/264853710 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fd5b401a070 con 0x7fd5bc15ca50 2024-05-21T13:36:26.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.586+0000 7fd5b8ff9640 1 --2- 172.21.15.22:0/264853710 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fd5a806f400 0x7fd5a80718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.586+0000 7fd5b8ff9640 1 -- 172.21.15.22:0/264853710 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd5b408f9e0 con 0x7fd5bc15ca50 2024-05-21T13:36:26.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.586+0000 7fd5b8ff9640 1 --2- 172.21.15.22:0/264853710 >> [v2:172.21.15.115:6811/20268513,v1:172.21.15.115:6814/20268513] conn(0x7fd5a8078b80 0x7fd5a807afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.586+0000 7fd5b8ff9640 1 -- 172.21.15.22:0/264853710 --> [v2:172.21.15.115:6811/20268513,v1:172.21.15.115:6814/20268513] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd5b400ae50 con 0x7fd5a8078b80 2024-05-21T13:36:26.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.586+0000 7fd5b8ff9640 1 -- 172.21.15.22:0/264853710 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fd5b408fdd0 con 0x7fd5bc15ca50 2024-05-21T13:36:26.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.586+0000 7fd5bb7fe640 1 --2- 172.21.15.22:0/264853710 >> [v2:172.21.15.115:6811/20268513,v1:172.21.15.115:6814/20268513] conn(0x7fd5a8078b80 0x7fd5a807afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.586+0000 7fd5bbfff640 1 --2- 172.21.15.22:0/264853710 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fd5a806f400 0x7fd5a80718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.586+0000 7fd5bb7fe640 1 --2- 172.21.15.22:0/264853710 >> [v2:172.21.15.115:6811/20268513,v1:172.21.15.115:6814/20268513] conn(0x7fd5a8078b80 0x7fd5a807afc0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:26.618 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.586+0000 7f0c8ee6e640 1 -- 172.21.15.22:0/1269262334 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c881fd770 con 0x7f0c881524a0 2024-05-21T13:36:26.618 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.586+0000 7eff87fff640 1 --2- 172.21.15.22:0/1553043978 >> [v2:172.21.15.22:6816/2092224336,v1:172.21.15.22:6817/2092224336] conn(0x7eff8c078b00 0x7eff8c07af40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.618 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.586+0000 7eff87fff640 1 -- 172.21.15.22:0/1553043978 --> [v2:172.21.15.22:6816/2092224336,v1:172.21.15.22:6817/2092224336] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7eff940a5660 con 0x7eff8c078b00 2024-05-21T13:36:26.618 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.586+0000 7eff87fff640 1 -- 172.21.15.22:0/1553043978 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7eff9412ad00 con 0x7effa015a8d0 2024-05-21T13:36:26.618 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.586+0000 7eff9f7fe640 1 --2- 172.21.15.22:0/1553043978 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7eff8c06f400 0x7eff8c0718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.618 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.586+0000 7eff9ffff640 1 --2- 172.21.15.22:0/1553043978 >> [v2:172.21.15.22:6816/2092224336,v1:172.21.15.22:6817/2092224336] conn(0x7eff8c078b00 0x7eff8c07af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.618 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.590+0000 7f9c6b7fe640 1 -- 172.21.15.22:0/2720750413 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f9c6c0b8bf0 con 0x7f9c740c90a0 2024-05-21T13:36:26.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.590+0000 7fd5bbfff640 1 --2- 172.21.15.22:0/264853710 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fd5a806f400 0x7fd5a80718c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd5ac0b2000 tx=0x7fd5ac0aa070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:26.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.590+0000 7f783a7fc640 1 --2- 172.21.15.22:0/3392685946 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f782806f430 0x7f78280718f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7830007fd0 tx=0x7f78300079a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:26.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.590+0000 7eff9ffff640 1 --2- 172.21.15.22:0/1553043978 >> [v2:172.21.15.22:6816/2092224336,v1:172.21.15.22:6817/2092224336] conn(0x7eff8c078b00 0x7eff8c07af40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:26.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.590+0000 7eff9f7fe640 1 --2- 172.21.15.22:0/1553043978 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7eff8c06f400 0x7eff8c0718c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7eff90000fc0 tx=0x7eff90009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:26.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.590+0000 7fd5b8ff9640 1 -- 172.21.15.22:0/264853710 <== osd.7 v2:172.21.15.115:6811/20268513 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd5b400ae50 con 0x7fd5a8078b80 2024-05-21T13:36:26.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.590+0000 7eff87fff640 1 -- 172.21.15.22:0/1553043978 <== osd.2 v2:172.21.15.22:6816/2092224336 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7eff940a5660 con 0x7eff8c078b00 2024-05-21T13:36:26.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.590+0000 7f0c857fa640 1 -- 172.21.15.22:0/1269262334 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f0c780bd030 con 0x7f0c881524a0 2024-05-21T13:36:26.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.590+0000 7f0c857fa640 1 --2- 172.21.15.22:0/1269262334 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f0c7406f400 0x7f0c740718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.590+0000 7f0c8cc0a640 1 --2- 172.21.15.22:0/1269262334 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f0c7406f400 0x7f0c740718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.590+0000 7f0c8cc0a640 1 --2- 172.21.15.22:0/1269262334 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f0c7406f400 0x7f0c740718c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0c80002240 tx=0x7f0c80001b30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:26.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.586+0000 7f069effd640 1 -- 172.21.15.22:0/3661697049 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f06a8059270 con 0x7f06b00707b0 2024-05-21T13:36:26.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.590+0000 7f9c6b7fe640 1 --2- 172.21.15.22:0/2720750413 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f9c5406f4d0 0x7f9c54071990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.590+0000 7f9c6b7fe640 1 -- 172.21.15.22:0/2720750413 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f9c6c12b090 con 0x7f9c740c90a0 2024-05-21T13:36:26.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.590+0000 7f9c6b7fe640 1 --2- 172.21.15.22:0/2720750413 >> [v2:172.21.15.115:6812/1504764223,v1:172.21.15.115:6815/1504764223] conn(0x7f9c54078c40 0x7f9c5407b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.590+0000 7f9c6b7fe640 1 -- 172.21.15.22:0/2720750413 --> [v2:172.21.15.115:6812/1504764223,v1:172.21.15.115:6815/1504764223] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9c6c00ae60 con 0x7f9c54078c40 2024-05-21T13:36:26.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.590+0000 7f9c6b7fe640 1 -- 172.21.15.22:0/2720750413 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f9c6c12b480 con 0x7f9c740c90a0 2024-05-21T13:36:26.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.594+0000 7f9c6bfff640 1 --2- 172.21.15.22:0/2720750413 >> [v2:172.21.15.115:6812/1504764223,v1:172.21.15.115:6815/1504764223] conn(0x7f9c54078c40 0x7f9c5407b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.594+0000 7f0c8ee6e640 1 -- 172.21.15.22:0/1269262334 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0c881fa380 con 0x7f0c881524a0 2024-05-21T13:36:26.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.594+0000 7f9c72ffd640 1 --2- 172.21.15.22:0/2720750413 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f9c5406f4d0 0x7f9c54071990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.594+0000 7f0c857fa640 1 -- 172.21.15.22:0/1269262334 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f0c78127600 con 0x7f0c881524a0 2024-05-21T13:36:26.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.594+0000 7f0c857fa640 1 --2- 172.21.15.22:0/1269262334 >> [v2:172.21.15.115:6808/959292720,v1:172.21.15.115:6809/959292720] conn(0x7f0c74078a70 0x7f0c7407aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.623 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.594+0000 7f0c857fa640 1 -- 172.21.15.22:0/1269262334 --> [v2:172.21.15.115:6808/959292720,v1:172.21.15.115:6809/959292720] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0c780b7e50 con 0x7f0c74078a70 2024-05-21T13:36:26.623 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.594+0000 7f0c857fa640 1 -- 172.21.15.22:0/1269262334 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f0c780f1eb0 con 0x7f0c881524a0 2024-05-21T13:36:26.623 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.594+0000 7f9c6bfff640 1 --2- 172.21.15.22:0/2720750413 >> [v2:172.21.15.115:6812/1504764223,v1:172.21.15.115:6815/1504764223] conn(0x7f9c54078c40 0x7f9c5407b080 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:26.623 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.594+0000 7f06aed9d640 1 --2- 172.21.15.22:0/3661697049 >> [v2:172.21.15.22:6800/222752954,v1:172.21.15.22:6801/222752954] conn(0x7f0690078a70 0x7f069007aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.623 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.594+0000 7f0c87fff640 1 --2- 172.21.15.22:0/1269262334 >> [v2:172.21.15.115:6808/959292720,v1:172.21.15.115:6809/959292720] conn(0x7f0c74078a70 0x7f0c7407aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.624 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.594+0000 7f9c72ffd640 1 --2- 172.21.15.22:0/2720750413 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f9c5406f4d0 0x7f9c54071990 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c001630 tx=0x7f9c5c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:26.624 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.594+0000 7f06aed9d640 1 --2- 172.21.15.22:0/3661697049 >> [v2:172.21.15.22:6800/222752954,v1:172.21.15.22:6801/222752954] conn(0x7f0690078a70 0x7f069007aeb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:26.624 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.594+0000 7f0c87fff640 1 --2- 172.21.15.22:0/1269262334 >> [v2:172.21.15.115:6808/959292720,v1:172.21.15.115:6809/959292720] conn(0x7f0c74078a70 0x7f0c7407aeb0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:26.625 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.594+0000 7f069effd640 1 -- 172.21.15.22:0/3661697049 <== osd.0 v2:172.21.15.22:6800/222752954 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f069007b580 con 0x7f0690078a70 2024-05-21T13:36:26.625 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.594+0000 7f9c6b7fe640 1 -- 172.21.15.22:0/2720750413 <== osd.5 v2:172.21.15.115:6812/1504764223 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9c6c00ae60 con 0x7f9c54078c40 2024-05-21T13:36:26.625 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.594+0000 7f0c857fa640 1 -- 172.21.15.22:0/1269262334 <== osd.6 v2:172.21.15.115:6808/959292720 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0c780b7e50 con 0x7f0c74078a70 2024-05-21T13:36:26.625 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.602+0000 7f4f3c297640 1 -- 172.21.15.22:0/3837080922 --> [v2:172.21.15.22:6808/685426272,v1:172.21.15.22:6809/685426272] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4f34077bb0 con 0x7f4f18078aa0 2024-05-21T13:36:26.625 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.602+0000 7f4f2affd640 1 -- 172.21.15.22:0/3837080922 <== osd.1 v2:172.21.15.22:6808/685426272 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f4f34077bb0 con 0x7f4f18078aa0 2024-05-21T13:36:26.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.606+0000 7f4f3c297640 1 -- 172.21.15.22:0/3837080922 >> [v2:172.21.15.22:6808/685426272,v1:172.21.15.22:6809/685426272] conn(0x7f4f18078aa0 msgr2=0x7f4f1807aee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:26.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.606+0000 7f4f3c297640 1 --2- 172.21.15.22:0/3837080922 >> [v2:172.21.15.22:6808/685426272,v1:172.21.15.22:6809/685426272] conn(0x7f4f18078aa0 0x7f4f1807aee0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.606+0000 7f4f3c297640 1 -- 172.21.15.22:0/3837080922 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f4f1806f430 msgr2=0x7f4f180718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:26.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.606+0000 7f4f3c297640 1 --2- 172.21.15.22:0/3837080922 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f4f1806f430 0x7f4f180718f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f4f300ae000 tx=0x7f4f300b3040 comp rx=0 tx=0).stop 2024-05-21T13:36:26.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.606+0000 7f4f3c297640 1 -- 172.21.15.22:0/3837080922 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4f3414fea0 msgr2=0x7f4f34142c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:26.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.606+0000 7f4f3c297640 1 --2- 172.21.15.22:0/3837080922 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4f3414fea0 0x7f4f34142c10 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c00c730 tx=0x7f4f2c00cbf0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.606+0000 7f4f3a834640 1 -- 172.21.15.22:0/3837080922 reap_dead start 2024-05-21T13:36:26.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.606+0000 7f4f3c297640 1 -- 172.21.15.22:0/3837080922 shutdown_connections 2024-05-21T13:36:26.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.606+0000 7f4f3c297640 1 -- 172.21.15.22:0/3837080922 >> 172.21.15.22:0/3837080922 conn(0x7f4f340703a0 msgr2=0x7f4f340cb050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:26.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.606+0000 7f4f3c297640 1 -- 172.21.15.22:0/3837080922 shutdown_connections 2024-05-21T13:36:26.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.606+0000 7f4f3c297640 1 -- 172.21.15.22:0/3837080922 wait complete. 2024-05-21T13:36:26.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.614+0000 7effa5c01640 1 -- 172.21.15.22:0/1553043978 --> [v2:172.21.15.22:6816/2092224336,v1:172.21.15.22:6817/2092224336] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7effa00ccfa0 con 0x7eff8c078b00 2024-05-21T13:36:26.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.614+0000 7eff87fff640 1 -- 172.21.15.22:0/1553043978 <== osd.2 v2:172.21.15.22:6816/2092224336 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7effa00ccfa0 con 0x7eff8c078b00 2024-05-21T13:36:26.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.614+0000 7effa5c01640 1 -- 172.21.15.22:0/1553043978 >> [v2:172.21.15.22:6816/2092224336,v1:172.21.15.22:6817/2092224336] conn(0x7eff8c078b00 msgr2=0x7eff8c07af40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:26.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.614+0000 7effa5c01640 1 --2- 172.21.15.22:0/1553043978 >> [v2:172.21.15.22:6816/2092224336,v1:172.21.15.22:6817/2092224336] conn(0x7eff8c078b00 0x7eff8c07af40 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.618+0000 7effa5c01640 1 -- 172.21.15.22:0/1553043978 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7eff8c06f400 msgr2=0x7eff8c0718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:26.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.618+0000 7effa5c01640 1 --2- 172.21.15.22:0/1553043978 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7eff8c06f400 0x7eff8c0718c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7eff90000fc0 tx=0x7eff90009040 comp rx=0 tx=0).stop 2024-05-21T13:36:26.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.618+0000 7effa5c01640 1 -- 172.21.15.22:0/1553043978 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7effa015a8d0 msgr2=0x7effa01f8dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:26.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.618+0000 7effa5c01640 1 --2- 172.21.15.22:0/1553043978 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7effa015a8d0 0x7effa01f8dc0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7eff9401cf50 tx=0x7eff94019810 comp rx=0 tx=0).stop 2024-05-21T13:36:26.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.618+0000 7eff9ffff640 1 -- 172.21.15.22:0/1553043978 reap_dead start 2024-05-21T13:36:26.630 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.618+0000 7f7841a26640 1 -- 172.21.15.22:0/3392685946 --> [v2:172.21.15.22:6824/1232311110,v1:172.21.15.22:6825/1232311110] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f781c002de0 con 0x7f7828078bb0 2024-05-21T13:36:26.630 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.618+0000 7fd5c1562640 1 -- 172.21.15.22:0/264853710 --> [v2:172.21.15.115:6811/20268513,v1:172.21.15.115:6814/20268513] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd59c002de0 con 0x7fd5a8078b80 2024-05-21T13:36:26.630 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.618+0000 7f9c79372640 1 -- 172.21.15.22:0/2720750413 --> [v2:172.21.15.115:6812/1504764223,v1:172.21.15.115:6815/1504764223] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9c58002de0 con 0x7f9c54078c40 2024-05-21T13:36:26.630 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.622+0000 7f7823fff640 1 -- 172.21.15.22:0/3392685946 <== osd.3 v2:172.21.15.22:6824/1232311110 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f781c002de0 con 0x7f7828078bb0 2024-05-21T13:36:26.631 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.622+0000 7effa5c01640 1 -- 172.21.15.22:0/1553043978 shutdown_connections 2024-05-21T13:36:26.631 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.622+0000 7effa5c01640 1 -- 172.21.15.22:0/1553043978 >> 172.21.15.22:0/1553043978 conn(0x7effa00703a0 msgr2=0x7effa0158e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:26.631 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.622+0000 7fd5b8ff9640 1 -- 172.21.15.22:0/264853710 <== osd.7 v2:172.21.15.115:6811/20268513 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd59c002de0 con 0x7fd5a8078b80 2024-05-21T13:36:26.632 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.622+0000 7f9c6b7fe640 1 -- 172.21.15.22:0/2720750413 <== osd.5 v2:172.21.15.115:6812/1504764223 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9c58002de0 con 0x7f9c54078c40 2024-05-21T13:36:26.632 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.622+0000 7fd5a27fc640 1 -- 172.21.15.22:0/264853710 >> [v2:172.21.15.115:6811/20268513,v1:172.21.15.115:6814/20268513] conn(0x7fd5a8078b80 msgr2=0x7fd5a807afc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:26.632 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.622+0000 7fd5a27fc640 1 --2- 172.21.15.22:0/264853710 >> [v2:172.21.15.115:6811/20268513,v1:172.21.15.115:6814/20268513] conn(0x7fd5a8078b80 0x7fd5a807afc0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.632 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.622+0000 7effa5c01640 1 -- 172.21.15.22:0/1553043978 shutdown_connections 2024-05-21T13:36:26.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.622+0000 7fd5a27fc640 1 -- 172.21.15.22:0/264853710 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fd5a806f400 msgr2=0x7fd5a80718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:26.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.622+0000 7fd5a27fc640 1 --2- 172.21.15.22:0/264853710 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fd5a806f400 0x7fd5a80718c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fd5ac0b2000 tx=0x7fd5ac0aa070 comp rx=0 tx=0).stop 2024-05-21T13:36:26.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.622+0000 7f7841a26640 1 -- 172.21.15.22:0/3392685946 >> [v2:172.21.15.22:6824/1232311110,v1:172.21.15.22:6825/1232311110] conn(0x7f7828078bb0 msgr2=0x7f782807aff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:26.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.622+0000 7f7841a26640 1 --2- 172.21.15.22:0/3392685946 >> [v2:172.21.15.22:6824/1232311110,v1:172.21.15.22:6825/1232311110] conn(0x7f7828078bb0 0x7f782807aff0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.622+0000 7fd5a27fc640 1 -- 172.21.15.22:0/264853710 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5bc15ca50 msgr2=0x7fd5bc155a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:26.634 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.622+0000 7fd5a27fc640 1 --2- 172.21.15.22:0/264853710 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd5bc15ca50 0x7fd5bc155a40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd5b400cb00 tx=0x7fd5b400a060 comp rx=0 tx=0).stop 2024-05-21T13:36:26.634 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.622+0000 7effa5c01640 1 -- 172.21.15.22:0/1553043978 wait complete. 2024-05-21T13:36:26.634 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.622+0000 7fd5c0d61640 1 -- 172.21.15.22:0/264853710 reap_dead start 2024-05-21T13:36:26.634 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.622+0000 7fd5a27fc640 1 -- 172.21.15.22:0/264853710 shutdown_connections 2024-05-21T13:36:26.634 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.622+0000 7fd5a27fc640 1 -- 172.21.15.22:0/264853710 >> 172.21.15.22:0/264853710 conn(0x7fd5bc073df0 msgr2=0x7fd5bc0cc210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:26.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.622+0000 7f7841a26640 1 -- 172.21.15.22:0/3392685946 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f782806f430 msgr2=0x7f78280718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:26.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.622+0000 7f7841a26640 1 --2- 172.21.15.22:0/3392685946 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f782806f430 0x7f78280718f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f7830007fd0 tx=0x7f78300079a0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.622+0000 7fd5a27fc640 1 -- 172.21.15.22:0/264853710 shutdown_connections 2024-05-21T13:36:26.635 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.622+0000 7fd5a27fc640 1 -- 172.21.15.22:0/264853710 wait complete. 2024-05-21T13:36:26.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.622+0000 7f7841a26640 1 -- 172.21.15.22:0/3392685946 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f783c0c66c0 msgr2=0x7f783c13d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:26.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.622+0000 7f7841a26640 1 --2- 172.21.15.22:0/3392685946 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f783c0c66c0 0x7f783c13d090 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f782c00b3f0 tx=0x7f782c00b8b0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.622+0000 7f9c79372640 1 -- 172.21.15.22:0/2720750413 >> [v2:172.21.15.115:6812/1504764223,v1:172.21.15.115:6815/1504764223] conn(0x7f9c54078c40 msgr2=0x7f9c5407b080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:26.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.622+0000 7f9c79372640 1 --2- 172.21.15.22:0/2720750413 >> [v2:172.21.15.115:6812/1504764223,v1:172.21.15.115:6815/1504764223] conn(0x7f9c54078c40 0x7f9c5407b080 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.636 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.622+0000 7f783b7fe640 1 -- 172.21.15.22:0/3392685946 reap_dead start 2024-05-21T13:36:26.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.622+0000 7f7841a26640 1 -- 172.21.15.22:0/3392685946 shutdown_connections 2024-05-21T13:36:26.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.622+0000 7f7841a26640 1 -- 172.21.15.22:0/3392685946 >> 172.21.15.22:0/3392685946 conn(0x7f783c0ca320 msgr2=0x7f783c14d110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:26.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.622+0000 7f9c79372640 1 -- 172.21.15.22:0/2720750413 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f9c5406f4d0 msgr2=0x7f9c54071990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:26.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.622+0000 7f9c79372640 1 --2- 172.21.15.22:0/2720750413 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f9c5406f4d0 0x7f9c54071990 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f9c5c001630 tx=0x7f9c5c009040 comp rx=0 tx=0).stop 2024-05-21T13:36:26.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.622+0000 7f9c79372640 1 -- 172.21.15.22:0/2720750413 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9c740c90a0 msgr2=0x7f9c74161ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:26.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.622+0000 7f9c79372640 1 --2- 172.21.15.22:0/2720750413 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9c740c90a0 0x7f9c74161ca0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c01a660 tx=0x7f9c6c0197d0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.622+0000 7f9c737fe640 1 -- 172.21.15.22:0/2720750413 reap_dead start 2024-05-21T13:36:26.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.622+0000 7f9c79372640 1 -- 172.21.15.22:0/2720750413 shutdown_connections 2024-05-21T13:36:26.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.622+0000 7f9c79372640 1 -- 172.21.15.22:0/2720750413 >> 172.21.15.22:0/2720750413 conn(0x7f9c740cd460 msgr2=0x7f9c74070320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:26.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.622+0000 7f9c79372640 1 -- 172.21.15.22:0/2720750413 shutdown_connections 2024-05-21T13:36:26.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.622+0000 7f9c79372640 1 -- 172.21.15.22:0/2720750413 wait complete. 2024-05-21T13:36:26.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.622+0000 7f7841a26640 1 -- 172.21.15.22:0/3392685946 shutdown_connections 2024-05-21T13:36:26.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.622+0000 7f7841a26640 1 -- 172.21.15.22:0/3392685946 wait complete. 2024-05-21T13:36:26.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.622+0000 7f99e16d5640 1 -- 172.21.15.22:0/925678720 --> [v2:172.21.15.115:6800/832695158,v1:172.21.15.115:6801/832695158] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f99dc0c9e70 con 0x7f99c8078bc0 2024-05-21T13:36:26.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.622+0000 7f99c37fe640 1 -- 172.21.15.22:0/925678720 <== osd.4 v2:172.21.15.115:6800/832695158 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f99dc0c9e70 con 0x7f99c8078bc0 2024-05-21T13:36:26.639 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.622+0000 7f99e16d5640 1 -- 172.21.15.22:0/925678720 >> [v2:172.21.15.115:6800/832695158,v1:172.21.15.115:6801/832695158] conn(0x7f99c8078bc0 msgr2=0x7f99c807b000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:26.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.622+0000 7f99e16d5640 1 --2- 172.21.15.22:0/925678720 >> [v2:172.21.15.115:6800/832695158,v1:172.21.15.115:6801/832695158] conn(0x7f99c8078bc0 0x7f99c807b000 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.622+0000 7f99e16d5640 1 -- 172.21.15.22:0/925678720 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f99c806f450 msgr2=0x7f99c8071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:26.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.622+0000 7f99e16d5640 1 --2- 172.21.15.22:0/925678720 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f99c806f450 0x7f99c8071910 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f99cc000c10 tx=0x7f99cc0a7000 comp rx=0 tx=0).stop 2024-05-21T13:36:26.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.622+0000 7f99e16d5640 1 -- 172.21.15.22:0/925678720 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f99dc0686b0 msgr2=0x7f99dc154c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:26.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.622+0000 7f99e16d5640 1 --2- 172.21.15.22:0/925678720 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f99dc0686b0 0x7f99dc154c30 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f99d000c430 tx=0x7f99d000c8f0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.622+0000 7f99db7fe640 1 -- 172.21.15.22:0/925678720 reap_dead start 2024-05-21T13:36:26.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.622+0000 7f99e16d5640 1 -- 172.21.15.22:0/925678720 shutdown_connections 2024-05-21T13:36:26.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.622+0000 7f99e16d5640 1 -- 172.21.15.22:0/925678720 >> 172.21.15.22:0/925678720 conn(0x7f99dc0ca320 msgr2=0x7f99dc06e690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:26.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.622+0000 7f99e16d5640 1 -- 172.21.15.22:0/925678720 shutdown_connections 2024-05-21T13:36:26.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.622+0000 7f99e16d5640 1 -- 172.21.15.22:0/925678720 wait complete. 2024-05-21T13:36:26.641 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.626+0000 7f0c8ee6e640 1 -- 172.21.15.22:0/1269262334 --> [v2:172.21.15.115:6808/959292720,v1:172.21.15.115:6809/959292720] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0c881fa380 con 0x7f0c74078a70 2024-05-21T13:36:26.641 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.626+0000 7f0c857fa640 1 -- 172.21.15.22:0/1269262334 <== osd.6 v2:172.21.15.115:6808/959292720 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0c7c0095c0 con 0x7f0c74078a70 2024-05-21T13:36:26.641 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.630+0000 7f06b4b2f640 1 -- 172.21.15.22:0/3661697049 --> [v2:172.21.15.22:6800/222752954,v1:172.21.15.22:6801/222752954] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f06b01e2540 con 0x7f0690078a70 2024-05-21T13:36:26.641 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.630+0000 7f069effd640 1 -- 172.21.15.22:0/3661697049 <== osd.0 v2:172.21.15.22:6800/222752954 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f06b01e2540 con 0x7f0690078a70 2024-05-21T13:36:26.642 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.630+0000 7f06b4b2f640 1 -- 172.21.15.22:0/3661697049 >> [v2:172.21.15.22:6800/222752954,v1:172.21.15.22:6801/222752954] conn(0x7f0690078a70 msgr2=0x7f069007aeb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:26.642 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.630+0000 7f06b4b2f640 1 --2- 172.21.15.22:0/3661697049 >> [v2:172.21.15.22:6800/222752954,v1:172.21.15.22:6801/222752954] conn(0x7f0690078a70 0x7f069007aeb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.642 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.630+0000 7f06b4b2f640 1 -- 172.21.15.22:0/3661697049 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f069006f400 msgr2=0x7f06900718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:26.642 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.630+0000 7f06b4b2f640 1 --2- 172.21.15.22:0/3661697049 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f069006f400 0x7f06900718c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f06a00b2000 tx=0x7f06a00aa070 comp rx=0 tx=0).stop 2024-05-21T13:36:26.642 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.630+0000 7f06b4b2f640 1 -- 172.21.15.22:0/3661697049 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06b00707b0 msgr2=0x7f06b01f9360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:26.642 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.630+0000 7f06b4b2f640 1 --2- 172.21.15.22:0/3661697049 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f06b00707b0 0x7f06b01f9360 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f06a800ce10 tx=0x7f06a800a660 comp rx=0 tx=0).stop 2024-05-21T13:36:26.643 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.630+0000 7f06aed9d640 1 -- 172.21.15.22:0/3661697049 reap_dead start 2024-05-21T13:36:26.643 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.630+0000 7f06b4b2f640 1 -- 172.21.15.22:0/3661697049 shutdown_connections 2024-05-21T13:36:26.643 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.630+0000 7f06b4b2f640 1 -- 172.21.15.22:0/3661697049 >> 172.21.15.22:0/3661697049 conn(0x7f06b00703a0 msgr2=0x7f06b0073030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:26.643 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.630+0000 7f06b4b2f640 1 -- 172.21.15.22:0/3661697049 shutdown_connections 2024-05-21T13:36:26.643 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.630+0000 7f06b4b2f640 1 -- 172.21.15.22:0/3661697049 wait complete. 2024-05-21T13:36:26.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.634+0000 7f0c6effd640 1 -- 172.21.15.22:0/1269262334 >> [v2:172.21.15.115:6808/959292720,v1:172.21.15.115:6809/959292720] conn(0x7f0c74078a70 msgr2=0x7f0c7407aeb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:26.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.634+0000 7f0c6effd640 1 --2- 172.21.15.22:0/1269262334 >> [v2:172.21.15.115:6808/959292720,v1:172.21.15.115:6809/959292720] conn(0x7f0c74078a70 0x7f0c7407aeb0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.634+0000 7f0c6effd640 1 -- 172.21.15.22:0/1269262334 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f0c7406f400 msgr2=0x7f0c740718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:26.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.634+0000 7f0c6effd640 1 --2- 172.21.15.22:0/1269262334 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f0c7406f400 0x7f0c740718c0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0c80002240 tx=0x7f0c80001b30 comp rx=0 tx=0).stop 2024-05-21T13:36:26.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.634+0000 7f0c6effd640 1 -- 172.21.15.22:0/1269262334 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0c881524a0 msgr2=0x7f0c8806e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:26.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.634+0000 7f0c6effd640 1 --2- 172.21.15.22:0/1269262334 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0c881524a0 0x7f0c8806e820 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0c780ad000 tx=0x7f0c7801a430 comp rx=0 tx=0).stop 2024-05-21T13:36:26.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.634+0000 7f0c8d40b640 1 -- 172.21.15.22:0/1269262334 reap_dead start 2024-05-21T13:36:26.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.634+0000 7f0c6effd640 1 -- 172.21.15.22:0/1269262334 shutdown_connections 2024-05-21T13:36:26.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.634+0000 7f0c6effd640 1 -- 172.21.15.22:0/1269262334 >> 172.21.15.22:0/1269262334 conn(0x7f0c880ca320 msgr2=0x7f0c881505d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:26.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.634+0000 7f0c6effd640 1 -- 172.21.15.22:0/1269262334 shutdown_connections 2024-05-21T13:36:26.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.634+0000 7f0c6effd640 1 -- 172.21.15.22:0/1269262334 wait complete. 2024-05-21T13:36:26.645 INFO:teuthology.orchestra.run.smithi022.stdout:64424509452 2024-05-21T13:36:26.646 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-21T13:36:26.647 INFO:teuthology.orchestra.run.smithi022.stdout:55834574858 2024-05-21T13:36:26.647 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-21T13:36:26.648 INFO:teuthology.orchestra.run.smithi022.stdout:64424509452 2024-05-21T13:36:26.648 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-21T13:36:26.649 INFO:teuthology.orchestra.run.smithi022.stdout:64424509452 2024-05-21T13:36:26.649 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-21T13:36:26.650 INFO:teuthology.orchestra.run.smithi022.stdout:60129542154 2024-05-21T13:36:26.650 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-21T13:36:26.651 INFO:teuthology.orchestra.run.smithi022.stdout:64424509451 2024-05-21T13:36:26.651 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-21T13:36:26.651 INFO:teuthology.orchestra.run.smithi022.stdout:64424509451 2024-05-21T13:36:26.652 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-21T13:36:26.653 INFO:teuthology.orchestra.run.smithi022.stdout:64424509452 2024-05-21T13:36:26.653 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-21T13:36:26.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.882+0000 7f6eaae94640 1 Processor -- start 2024-05-21T13:36:26.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.882+0000 7f6eaae94640 1 -- start start 2024-05-21T13:36:26.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.886+0000 7f6eaae94640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6ea40ca320 0x7f6ea4151a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.886+0000 7f6eaae94640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ea40c8800 con 0x7f6ea40c9f40 2024-05-21T13:36:26.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.886+0000 7f6eaae94640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ea40c8ae0 con 0x7f6ea4072280 2024-05-21T13:36:26.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.886+0000 7f6eaae94640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f6ea40c8dc0 con 0x7f6ea40ca320 2024-05-21T13:36:26.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.886+0000 7f6ea3fff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6ea40ca320 0x7f6ea4151a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.886+0000 7f6ea3fff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6ea40ca320 0x7f6ea4151a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48210/0 (socket says 172.21.15.22:48210) 2024-05-21T13:36:26.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.886+0000 7f6ea3fff640 1 -- 172.21.15.22:0/4100108568 learned_addr learned my addr 172.21.15.22:0/4100108568 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:26.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.886+0000 7f560f59e640 1 Processor -- start 2024-05-21T13:36:26.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.886+0000 7f560f59e640 1 -- start start 2024-05-21T13:36:26.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.886+0000 7f6ea3fff640 1 -- 172.21.15.22:0/4100108568 >> v1:172.21.15.115:6789/0 conn(0x7f6ea4072280 legacy=0x7f6ea4073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:26.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.886+0000 7f6ea3fff640 1 -- 172.21.15.22:0/4100108568 >> v1:172.21.15.22:6789/0 conn(0x7f6ea40c9f40 legacy=0x7f6ea415bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:26.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.886+0000 7f6ea3fff640 1 -- 172.21.15.22:0/4100108568 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ea40c90a0 con 0x7f6ea40ca320 2024-05-21T13:36:26.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.886+0000 7f6ea37fe640 1 -- 172.21.15.22:0/4100108568 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2789479831 0 0) 0x7f6ea40c8800 con 0x7f6ea40c9f40 2024-05-21T13:36:26.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.886+0000 7f560f59e640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f56080e22f0 0x7f5608045130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.886+0000 7f560ed9d640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f56080457d0 0x7f56080e26d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:44536/0 (socket says 172.21.15.22:44536) 2024-05-21T13:36:26.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.886+0000 7f560ed9d640 1 -- 172.21.15.22:0/2308974965 learned_addr learned my addr 172.21.15.22:0/2308974965 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-21T13:36:26.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.890+0000 7f560f59e640 1 -- 172.21.15.22:0/2308974965 --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f56080e30c0 con 0x7f56080457d0 2024-05-21T13:36:26.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.890+0000 7f560d59a640 1 -- 172.21.15.22:0/2308974965 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1988486917 0 0) 0x7f56080e30c0 con 0x7f56080457d0 2024-05-21T13:36:26.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.890+0000 7f560f59e640 1 -- 172.21.15.22:0/2308974965 --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5608050dd0 con 0x7f5608046d30 2024-05-21T13:36:26.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.890+0000 7f560f59e640 1 -- 172.21.15.22:0/2308974965 --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f5608045d20 con 0x7f56080e22f0 2024-05-21T13:36:26.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.890+0000 7f560d59a640 1 -- 172.21.15.22:0/2308974965 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f55f8003530 con 0x7f56080457d0 2024-05-21T13:36:26.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.886+0000 7efc35b91640 1 Processor -- start 2024-05-21T13:36:26.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.886+0000 7faa71450640 1 Processor -- start 2024-05-21T13:36:26.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.886+0000 7ffb76809640 1 Processor -- start 2024-05-21T13:36:26.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.890+0000 7f6ea3fff640 1 --2- 172.21.15.22:0/4100108568 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ea40ca320 0x7f6ea4151a40 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c00d370 tx=0x7f6e9c01f3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d353bbc6ef682aa server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:26.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.890+0000 7f560d59a640 1 -- 172.21.15.22:0/2308974965 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 422189562 0 0) 0x7f55f8003530 con 0x7f56080457d0 2024-05-21T13:36:26.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.890+0000 7f560d59a640 1 -- 172.21.15.22:0/2308974965 >> v2:172.21.15.115:3300/0 conn(0x7f56080e22f0 msgr2=0x7f5608045130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:26.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.890+0000 7f560d59a640 1 --2- 172.21.15.22:0/2308974965 >> v2:172.21.15.115:3300/0 conn(0x7f56080e22f0 0x7f5608045130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.890+0000 7f560d59a640 1 -- 172.21.15.22:0/2308974965 >> v1:172.21.15.115:6789/0 conn(0x7f5608046d30 legacy=0x7f5608005ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:26.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.890+0000 7f560d59a640 1 -- 172.21.15.22:0/2308974965 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5608045f70 con 0x7f56080457d0 2024-05-21T13:36:26.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.890+0000 7f560d59a640 1 -- 172.21.15.22:0/2308974965 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2684847062 0 0) 0x7f56100693e0 con 0x7f56080457d0 2024-05-21T13:36:26.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.890+0000 7f560d59a640 1 -- 172.21.15.22:0/2308974965 >> v1:172.21.15.22:6789/0 conn(0x7f56080457d0 legacy=0x7f56080e26d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:26.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.890+0000 7f560d59a640 1 --2- 172.21.15.22:0/2308974965 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f55f80039c0 0x7f55f8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.890+0000 7f560d59a640 1 --2- 172.21.15.22:0/2308974965 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f55f8004810 0x7f55f8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.890+0000 7f560d59a640 1 --2- 172.21.15.22:0/2308974965 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f55f8005220 0x7f55f80141e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.890+0000 7f560d59a640 1 -- 172.21.15.22:0/2308974965 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5608045d20 con 0x7f55f8004810 2024-05-21T13:36:26.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.890+0000 7f560d59a640 1 -- 172.21.15.22:0/2308974965 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f55f8014980 con 0x7f55f8005220 2024-05-21T13:36:26.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.890+0000 7f560d59a640 1 -- 172.21.15.22:0/2308974965 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f55f8014b80 con 0x7f55f80039c0 2024-05-21T13:36:26.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.886+0000 7faa71450640 1 -- start start 2024-05-21T13:36:26.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.890+0000 7faa71450640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faa6c0c8410 0x7faa6c0c8d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.890+0000 7faa71450640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7faa6c070c70 0x7faa6c0710e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.890+0000 7faa71450640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa6c0ced40 con 0x7faa6c152bc0 2024-05-21T13:36:26.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.890+0000 7faa71450640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7faa6c0c7d60 con 0x7faa6c070c70 2024-05-21T13:36:26.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.890+0000 7faa71450640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7faa6c0c9240 con 0x7faa6c0c8410 2024-05-21T13:36:26.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.890+0000 7f560dd9b640 1 --2- 172.21.15.22:0/2308974965 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f55f8004810 0x7f55f8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.890+0000 7f560e59c640 1 --2- 172.21.15.22:0/2308974965 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f55f80039c0 0x7f55f8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.890+0000 7efc35b91640 1 -- start start 2024-05-21T13:36:26.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.890+0000 7efc35b91640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7efc280dd2c0 0x7efc280e66f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.890+0000 7efc35b91640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc2804c690 con 0x7efc280e6c30 2024-05-21T13:36:26.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.890+0000 7efc35b91640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc280454e0 con 0x7efc280e71f0 2024-05-21T13:36:26.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.890+0000 7efc35b91640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7efc280457c0 con 0x7efc280dd2c0 2024-05-21T13:36:26.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.890+0000 7f560ed9d640 1 --2- 172.21.15.22:0/2308974965 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f55f8005220 0x7f55f80141e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.890+0000 7ffb76809640 1 -- start start 2024-05-21T13:36:26.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.890+0000 7ffb76809640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ffb680dd2c0 0x7ffb680e66f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.890+0000 7ffb76809640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb6804c690 con 0x7ffb680e6c30 2024-05-21T13:36:26.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.890+0000 7ffb76809640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb680454e0 con 0x7ffb680e71f0 2024-05-21T13:36:26.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.890+0000 7ffb76809640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7ffb680457c0 con 0x7ffb680dd2c0 2024-05-21T13:36:26.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.890+0000 7f6ea37fe640 1 -- 172.21.15.22:0/4100108568 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e9c0b6070 con 0x7f6ea40ca320 2024-05-21T13:36:26.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.890+0000 7f6ea37fe640 1 -- 172.21.15.22:0/4100108568 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e9c0b1410 con 0x7f6ea40ca320 2024-05-21T13:36:26.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.890+0000 7f6ea37fe640 1 -- 172.21.15.22:0/4100108568 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e9c00be60 con 0x7f6ea40ca320 2024-05-21T13:36:26.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.890+0000 7efc2ffff640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7efc280e6c30 0x7efc2804ba70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:44544/0 (socket says 172.21.15.22:44544) 2024-05-21T13:36:26.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.890+0000 7efc2ffff640 1 -- 172.21.15.22:0/2866461660 learned_addr learned my addr 172.21.15.22:0/2866461660 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-21T13:36:26.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.890+0000 7ffb76008640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7ffb680e6c30 0x7ffb6804ba70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:44546/0 (socket says 172.21.15.22:44546) 2024-05-21T13:36:26.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.890+0000 7ffb76008640 1 -- 172.21.15.22:0/1117972492 learned_addr learned my addr 172.21.15.22:0/1117972492 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-21T13:36:26.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.890+0000 7fe44d7a2640 1 Processor -- start 2024-05-21T13:36:26.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.890+0000 7fe44d7a2640 1 -- start start 2024-05-21T13:36:26.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.890+0000 7efc2f7fe640 1 --2- 172.21.15.22:0/2866461660 >> v2:172.21.15.115:3300/0 conn(0x7efc280dd2c0 0x7efc280e66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.890+0000 7f560dd9b640 1 -- 172.21.15.22:0/2308974965 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f55f80039c0 msgr2=0x7f55f8003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:26.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.890+0000 7f560dd9b640 1 --2- 172.21.15.22:0/2308974965 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f55f80039c0 0x7f55f8003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.890+0000 7f560dd9b640 1 -- 172.21.15.22:0/2308974965 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f55f8005220 msgr2=0x7f55f80141e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:26.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.890+0000 7f560dd9b640 1 --2- 172.21.15.22:0/2308974965 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f55f8005220 0x7f55f80141e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.890+0000 7f6eaae94640 1 -- 172.21.15.22:0/4100108568 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ea40ca320 msgr2=0x7f6ea4151a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:26.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.890+0000 7f6eaae94640 1 --2- 172.21.15.22:0/4100108568 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ea40ca320 0x7f6ea4151a40 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c00d370 tx=0x7f6e9c01f3b0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.890+0000 7f560dd9b640 1 -- 172.21.15.22:0/2308974965 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5608045f70 con 0x7f55f8004810 2024-05-21T13:36:26.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.890+0000 7f6eaae94640 1 -- 172.21.15.22:0/4100108568 shutdown_connections 2024-05-21T13:36:26.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.890+0000 7f6eaae94640 1 --2- 172.21.15.22:0/4100108568 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ea40ca320 0x7f6ea4151a40 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.890+0000 7f6eaae94640 1 -- 172.21.15.22:0/4100108568 >> 172.21.15.22:0/4100108568 conn(0x7f6ea40703a0 msgr2=0x7f6ea40cd250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:26.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.890+0000 7f6eaae94640 1 -- 172.21.15.22:0/4100108568 shutdown_connections 2024-05-21T13:36:26.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.890+0000 7f6eaae94640 1 -- 172.21.15.22:0/4100108568 wait complete. 2024-05-21T13:36:26.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.890+0000 7faa70c4f640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7faa6c070c70 0x7faa6c0710e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.890+0000 7faa70c4f640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7faa6c070c70 0x7faa6c0710e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48232/0 (socket says 172.21.15.22:48232) 2024-05-21T13:36:26.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.890+0000 7faa70c4f640 1 -- 172.21.15.22:0/2533761925 learned_addr learned my addr 172.21.15.22:0/2533761925 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:26.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.890+0000 7faa70c4f640 1 -- 172.21.15.22:0/2533761925 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faa6c0c8410 msgr2=0x7faa6c0c8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:26.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.890+0000 7faa70c4f640 1 --2- 172.21.15.22:0/2533761925 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faa6c0c8410 0x7faa6c0c8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.890+0000 7faa70c4f640 1 -- 172.21.15.22:0/2533761925 >> v1:172.21.15.115:6789/0 conn(0x7faa6c152bc0 legacy=0x7faa6c0ce630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:26.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.890+0000 7faa70c4f640 1 -- 172.21.15.22:0/2533761925 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa6c0c5b40 con 0x7faa6c070c70 2024-05-21T13:36:26.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.890+0000 7fe44d7a2640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe448072280 0x7fe448159c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.890+0000 7fe44d7a2640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe4480c6fa0 0x7fe44815a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.890+0000 7fe44d7a2640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe44806e600 con 0x7fe4480c6bc0 2024-05-21T13:36:26.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.890+0000 7fe44d7a2640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fe44806f9d0 con 0x7fe4480c6fa0 2024-05-21T13:36:26.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.890+0000 7fe44d7a2640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7fe44806f130 con 0x7fe448072280 2024-05-21T13:36:26.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.890+0000 7f52820a2640 1 Processor -- start 2024-05-21T13:36:26.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.890+0000 7f52820a2640 1 -- start start 2024-05-21T13:36:26.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.890+0000 7f52820a2640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f527404b300 0x7f5274005ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.890+0000 7f52820a2640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f527404b6e0 0x7f52740d4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.890+0000 7f52820a2640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f5274046d80 0x7f52740d5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.890+0000 7f52820a2640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f52740dbd50 con 0x7f5274046d80 2024-05-21T13:36:26.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.890+0000 7f52820a2640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f52740468f0 con 0x7f527404b300 2024-05-21T13:36:26.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.890+0000 7f52820a2640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f52740dbab0 con 0x7f527404b6e0 2024-05-21T13:36:26.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.894+0000 7f560ed9d640 1 -- 172.21.15.22:0/2308974965 reap_dead start 2024-05-21T13:36:26.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.894+0000 7ffb75807640 1 --2- 172.21.15.22:0/1117972492 >> v2:172.21.15.115:3300/0 conn(0x7ffb680dd2c0 0x7ffb680e66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.894+0000 7f52818a1640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f5274046d80 0x7f52740d5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.894+0000 7efc2e7fc640 1 -- 172.21.15.22:0/2866461660 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1357647208 0 0) 0x7efc2804c690 con 0x7efc280e6c30 2024-05-21T13:36:26.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.894+0000 7efc2e7fc640 1 -- 172.21.15.22:0/2866461660 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efc20003530 con 0x7efc280e6c30 2024-05-21T13:36:26.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.894+0000 7f52818a1640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f5274046d80 0x7f52740d5090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48248/0 (socket says 172.21.15.22:48248) 2024-05-21T13:36:26.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.894+0000 7f52818a1640 1 -- 172.21.15.22:0/3289901615 learned_addr learned my addr 172.21.15.22:0/3289901615 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:26.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.894+0000 7fe4477fe640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe4480c6fa0 0x7fe44815a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.894+0000 7fe4477fe640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe4480c6fa0 0x7fe44815a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48236/0 (socket says 172.21.15.22:48236) 2024-05-21T13:36:26.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.894+0000 7fe4477fe640 1 -- 172.21.15.22:0/2525462882 learned_addr learned my addr 172.21.15.22:0/2525462882 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:26.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.894+0000 7f6eaae94640 1 Processor -- start 2024-05-21T13:36:26.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.894+0000 7ffb74805640 1 -- 172.21.15.22:0/1117972492 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1675973143 0 0) 0x7ffb6804c690 con 0x7ffb680e6c30 2024-05-21T13:36:26.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.894+0000 7ffb74805640 1 -- 172.21.15.22:0/1117972492 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffb5c003530 con 0x7ffb680e6c30 2024-05-21T13:36:26.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.894+0000 7f52818a1640 1 -- 172.21.15.22:0/3289901615 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f527404b6e0 msgr2=0x7f52740d4b50 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-21T13:36:26.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.894+0000 7f52818a1640 1 --2- 172.21.15.22:0/3289901615 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f527404b6e0 0x7f52740d4b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.894+0000 7f52818a1640 1 -- 172.21.15.22:0/3289901615 >> v2:172.21.15.115:3300/0 conn(0x7f527404b300 msgr2=0x7f5274005ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:26.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.894+0000 7f52818a1640 1 --2- 172.21.15.22:0/3289901615 >> v2:172.21.15.115:3300/0 conn(0x7f527404b300 0x7f5274005ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.894+0000 7f52818a1640 1 -- 172.21.15.22:0/3289901615 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5274045fc0 con 0x7f5274046d80 2024-05-21T13:36:26.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.894+0000 7efc2e7fc640 1 -- 172.21.15.22:0/2866461660 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1036908533 0 0) 0x7efc20003530 con 0x7efc280e6c30 2024-05-21T13:36:26.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.894+0000 7efc2e7fc640 1 -- 172.21.15.22:0/2866461660 >> v2:172.21.15.115:3300/0 conn(0x7efc280dd2c0 msgr2=0x7efc280e66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:26.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.894+0000 7efc2e7fc640 1 --2- 172.21.15.22:0/2866461660 >> v2:172.21.15.115:3300/0 conn(0x7efc280dd2c0 0x7efc280e66f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.894+0000 7efc2e7fc640 1 -- 172.21.15.22:0/2866461660 >> v1:172.21.15.115:6789/0 conn(0x7efc280e71f0 legacy=0x7efc280462a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:26.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.894+0000 7efc2e7fc640 1 -- 172.21.15.22:0/2866461660 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc28045aa0 con 0x7efc280e6c30 2024-05-21T13:36:26.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.894+0000 7efc2e7fc640 1 -- 172.21.15.22:0/2866461660 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2684847062 0 0) 0x7efc24001700 con 0x7efc280e6c30 2024-05-21T13:36:26.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.894+0000 7efc2e7fc640 1 -- 172.21.15.22:0/2866461660 >> v1:172.21.15.22:6789/0 conn(0x7efc280e6c30 legacy=0x7efc2804ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:26.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.894+0000 7efc2e7fc640 1 --2- 172.21.15.22:0/2866461660 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc20003a10 0x7efc20003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.894+0000 7efc2e7fc640 1 --2- 172.21.15.22:0/2866461660 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc20004810 0x7efc20004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.894+0000 7efc2e7fc640 1 --2- 172.21.15.22:0/2866461660 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc200052f0 0x7efc2000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.894+0000 7efc2e7fc640 1 -- 172.21.15.22:0/2866461660 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7efc280457c0 con 0x7efc20004810 2024-05-21T13:36:26.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.894+0000 7efc2e7fc640 1 -- 172.21.15.22:0/2866461660 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7efc2000c1e0 con 0x7efc20003a10 2024-05-21T13:36:26.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.894+0000 7efc2e7fc640 1 -- 172.21.15.22:0/2866461660 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7efc2000c3e0 con 0x7efc200052f0 2024-05-21T13:36:26.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.894+0000 7efc2ffff640 1 --2- 172.21.15.22:0/2866461660 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc200052f0 0x7efc2000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.884 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.894+0000 7f6eaae94640 1 -- start start 2024-05-21T13:36:26.884 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.894+0000 7f6eaae94640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ea4072280 0x7f6ea414c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.884 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.894+0000 7f6eaae94640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6ea40c9f40 0x7f6ea4073290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.884 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.894+0000 7f6eaae94640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6ea40ca320 0x7f6ea41e0a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.884 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.894+0000 7f6eaae94640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6ea40707b0 con 0x7f6ea4072280 2024-05-21T13:36:26.884 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.894+0000 7f6eaae94640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f6ea406f770 con 0x7f6ea40c9f40 2024-05-21T13:36:26.884 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.894+0000 7f6eaae94640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f6ea4070930 con 0x7f6ea40ca320 2024-05-21T13:36:26.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.894+0000 7fe4477fe640 1 -- 172.21.15.22:0/2525462882 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe448072280 msgr2=0x7fe448159c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:26.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.894+0000 7fe4477fe640 1 --2- 172.21.15.22:0/2525462882 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe448072280 0x7fe448159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.894+0000 7fe4477fe640 1 -- 172.21.15.22:0/2525462882 >> v1:172.21.15.115:6789/0 conn(0x7fe4480c6bc0 legacy=0x7fe448153680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:26.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.894+0000 7fe4477fe640 1 -- 172.21.15.22:0/2525462882 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe44806f410 con 0x7fe4480c6fa0 2024-05-21T13:36:26.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.894+0000 7efc2effd640 1 --2- 172.21.15.22:0/2866461660 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc20004810 0x7efc20004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.894+0000 7f6ea8c30640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ea4072280 0x7f6ea414c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.894+0000 7f6ea8c30640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ea4072280 0x7f6ea414c610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48266/0 (socket says 172.21.15.22:48266) 2024-05-21T13:36:26.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.894+0000 7f6ea8c30640 1 -- 172.21.15.22:0/1006248881 learned_addr learned my addr 172.21.15.22:0/1006248881 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:26.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.894+0000 7f6ea9431640 1 --2- 172.21.15.22:0/1006248881 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6ea40ca320 0x7f6ea41e0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.894+0000 7ffb74805640 1 -- 172.21.15.22:0/1117972492 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2093669976 0 0) 0x7ffb5c003530 con 0x7ffb680e6c30 2024-05-21T13:36:26.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.894+0000 7ffb74805640 1 -- 172.21.15.22:0/1117972492 >> v2:172.21.15.115:3300/0 conn(0x7ffb680dd2c0 msgr2=0x7ffb680e66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:26.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.894+0000 7ffb74805640 1 --2- 172.21.15.22:0/1117972492 >> v2:172.21.15.115:3300/0 conn(0x7ffb680dd2c0 0x7ffb680e66f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.894+0000 7ffb74805640 1 -- 172.21.15.22:0/1117972492 >> v1:172.21.15.115:6789/0 conn(0x7ffb680e71f0 legacy=0x7ffb680462a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:26.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.894+0000 7ffb74805640 1 -- 172.21.15.22:0/1117972492 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb68045aa0 con 0x7ffb680e6c30 2024-05-21T13:36:26.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.894+0000 7ffb74805640 1 -- 172.21.15.22:0/1117972492 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2684847062 0 0) 0x7ffb6c001700 con 0x7ffb680e6c30 2024-05-21T13:36:26.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.894+0000 7ffb74805640 1 -- 172.21.15.22:0/1117972492 >> v1:172.21.15.22:6789/0 conn(0x7ffb680e6c30 legacy=0x7ffb6804ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:26.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.894+0000 7ffb74805640 1 --2- 172.21.15.22:0/1117972492 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffb5c003ab0 0x7ffb5c003ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.894+0000 7ffb74805640 1 --2- 172.21.15.22:0/1117972492 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffb5c004810 0x7ffb5c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.894+0000 7ffb74805640 1 --2- 172.21.15.22:0/1117972492 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffb5c0052f0 0x7ffb5c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.894+0000 7ffb74805640 1 -- 172.21.15.22:0/1117972492 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ffb680457c0 con 0x7ffb5c003ab0 2024-05-21T13:36:26.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.894+0000 7ffb74805640 1 -- 172.21.15.22:0/1117972492 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7ffb5c00c230 con 0x7ffb5c0052f0 2024-05-21T13:36:26.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.894+0000 7ffb74805640 1 -- 172.21.15.22:0/1117972492 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7ffb5c00c430 con 0x7ffb5c004810 2024-05-21T13:36:26.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.898+0000 7f6ea3fff640 1 --2- 172.21.15.22:0/1006248881 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6ea40c9f40 0x7f6ea4073290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.898+0000 7ffb76008640 1 --2- 172.21.15.22:0/1117972492 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffb5c0052f0 0x7ffb5c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.898+0000 7f560dd9b640 1 --2- 172.21.15.22:0/2308974965 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f55f8004810 0x7f55f8004c90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5604007fd0 tx=0x7f560401c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5a42221beecaf76 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:26.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.898+0000 7efc2ffff640 1 -- 172.21.15.22:0/2866461660 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc20003a10 msgr2=0x7efc20003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:26.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.898+0000 7efc2ffff640 1 --2- 172.21.15.22:0/2866461660 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc20003a10 0x7efc20003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.898+0000 7efc2ffff640 1 -- 172.21.15.22:0/2866461660 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc20004810 msgr2=0x7efc20004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:26.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.898+0000 7efc2ffff640 1 --2- 172.21.15.22:0/2866461660 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc20004810 0x7efc20004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.898+0000 7efc2ffff640 1 -- 172.21.15.22:0/2866461660 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc28045aa0 con 0x7efc200052f0 2024-05-21T13:36:26.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.898+0000 7f6ea8c30640 1 -- 172.21.15.22:0/1006248881 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6ea40ca320 msgr2=0x7f6ea41e0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:26.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.898+0000 7f6ea8c30640 1 --2- 172.21.15.22:0/1006248881 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6ea40ca320 0x7f6ea41e0a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.898+0000 7f6ea8c30640 1 -- 172.21.15.22:0/1006248881 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6ea40c9f40 msgr2=0x7f6ea4073290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:26.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.898+0000 7f6ea8c30640 1 --2- 172.21.15.22:0/1006248881 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6ea40c9f40 0x7f6ea4073290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.898+0000 7f6ea8c30640 1 -- 172.21.15.22:0/1006248881 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ea415a300 con 0x7f6ea4072280 2024-05-21T13:36:26.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.898+0000 7faa70c4f640 1 --2- 172.21.15.22:0/2533761925 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa6c070c70 0x7faa6c0710e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7faa6400bf20 tx=0x7faa64027a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40039aa4592eee5 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:26.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.898+0000 7f52818a1640 1 --2- 172.21.15.22:0/3289901615 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5274046d80 0x7f52740d5090 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5274051200 tx=0x7f526c01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e560afecc811213 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:26.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.898+0000 7f560d59a640 1 -- 172.21.15.22:0/2308974965 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56040013e0 con 0x7f55f8004810 2024-05-21T13:36:26.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.898+0000 7f560d59a640 1 -- 172.21.15.22:0/2308974965 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56040052d0 con 0x7f55f8004810 2024-05-21T13:36:26.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.898+0000 7f560d59a640 1 -- 172.21.15.22:0/2308974965 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56040054c0 con 0x7f55f8004810 2024-05-21T13:36:26.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.898+0000 7efc2ffff640 1 -- 172.21.15.22:0/2866461660 reap_dead start 2024-05-21T13:36:26.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.898+0000 7fe4477fe640 1 --2- 172.21.15.22:0/2525462882 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe4480c6fa0 0x7fe44815a160 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe44806fb50 tx=0x7fe44001f200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cccd4d5bc1f19183 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:26.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.898+0000 7ffb75807640 1 --2- 172.21.15.22:0/1117972492 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffb5c003ab0 0x7ffb5c003ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.898+0000 7ffb75807640 1 -- 172.21.15.22:0/1117972492 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffb5c004810 msgr2=0x7ffb5c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:26.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.898+0000 7ffb75807640 1 --2- 172.21.15.22:0/1117972492 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffb5c004810 0x7ffb5c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.898+0000 7ffb75807640 1 -- 172.21.15.22:0/1117972492 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffb5c0052f0 msgr2=0x7ffb5c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:26.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.898+0000 7ffb75807640 1 --2- 172.21.15.22:0/1117972492 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffb5c0052f0 0x7ffb5c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.891 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.898+0000 7ffb75807640 1 -- 172.21.15.22:0/1117972492 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb5c003530 con 0x7ffb5c003ab0 2024-05-21T13:36:26.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.898+0000 7fe445ffb640 1 -- 172.21.15.22:0/2525462882 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4400b4070 con 0x7fe4480c6fa0 2024-05-21T13:36:26.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.898+0000 7f560f59e640 1 -- 172.21.15.22:0/2308974965 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f55f8004810 msgr2=0x7f55f8004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:26.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.898+0000 7f560f59e640 1 --2- 172.21.15.22:0/2308974965 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f55f8004810 0x7f55f8004c90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f5604007fd0 tx=0x7f560401c3c0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.898+0000 7f560f59e640 1 -- 172.21.15.22:0/2308974965 shutdown_connections 2024-05-21T13:36:26.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.898+0000 7f560f59e640 1 --2- 172.21.15.22:0/2308974965 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f55f8004810 0x7f55f8004c90 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.898+0000 7f560f59e640 1 -- 172.21.15.22:0/2308974965 >> 172.21.15.22:0/2308974965 conn(0x7f5608050190 msgr2=0x7f56080505a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:26.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.898+0000 7f560f59e640 1 -- 172.21.15.22:0/2308974965 shutdown_connections 2024-05-21T13:36:26.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.898+0000 7f560f59e640 1 -- 172.21.15.22:0/2308974965 wait complete. 2024-05-21T13:36:26.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.902+0000 7f6ea8c30640 1 --2- 172.21.15.22:0/1006248881 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ea4072280 0x7f6ea414c610 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6e9800c450 tx=0x7f6e9800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:26.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.898+0000 7faa6b7fe640 1 -- 172.21.15.22:0/2533761925 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa6400b2d0 con 0x7faa6c070c70 2024-05-21T13:36:26.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.898+0000 7faa6b7fe640 1 -- 172.21.15.22:0/2533761925 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa6400b470 con 0x7faa6c070c70 2024-05-21T13:36:26.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.898+0000 7faa6b7fe640 1 -- 172.21.15.22:0/2533761925 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa64009840 con 0x7faa6c070c70 2024-05-21T13:36:26.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.902+0000 7faa71450640 1 -- 172.21.15.22:0/2533761925 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa6c070c70 msgr2=0x7faa6c0710e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:26.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.902+0000 7faa71450640 1 --2- 172.21.15.22:0/2533761925 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa6c070c70 0x7faa6c0710e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7faa6400bf20 tx=0x7faa64027a30 comp rx=0 tx=0).stop 2024-05-21T13:36:26.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.902+0000 7faa71450640 1 -- 172.21.15.22:0/2533761925 shutdown_connections 2024-05-21T13:36:26.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.902+0000 7faa71450640 1 --2- 172.21.15.22:0/2533761925 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa6c070c70 0x7faa6c0710e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.902+0000 7faa71450640 1 --2- 172.21.15.22:0/2533761925 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faa6c0c8410 0x7faa6c0c8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.902+0000 7faa71450640 1 -- 172.21.15.22:0/2533761925 >> 172.21.15.22:0/2533761925 conn(0x7faa6c0733b0 msgr2=0x7faa6c0737c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:26.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.902+0000 7f5273fff640 1 -- 172.21.15.22:0/3289901615 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f526c0ab660 con 0x7f5274046d80 2024-05-21T13:36:26.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.902+0000 7f5273fff640 1 -- 172.21.15.22:0/3289901615 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f526c0b0070 con 0x7f5274046d80 2024-05-21T13:36:26.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.902+0000 7f5273fff640 1 -- 172.21.15.22:0/3289901615 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f526c0aba20 con 0x7f5274046d80 2024-05-21T13:36:26.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.898+0000 7fe445ffb640 1 -- 172.21.15.22:0/2525462882 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4400af400 con 0x7fe4480c6fa0 2024-05-21T13:36:26.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.898+0000 7fe445ffb640 1 -- 172.21.15.22:0/2525462882 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4400af7d0 con 0x7fe4480c6fa0 2024-05-21T13:36:26.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.898+0000 7ffb76008640 1 -- 172.21.15.22:0/1117972492 reap_dead start 2024-05-21T13:36:26.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.902+0000 7fe44d7a2640 1 -- 172.21.15.22:0/2525462882 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe4480c6fa0 msgr2=0x7fe44815a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:26.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.902+0000 7fe44d7a2640 1 --2- 172.21.15.22:0/2525462882 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe4480c6fa0 0x7fe44815a160 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe44806fb50 tx=0x7fe44001f200 comp rx=0 tx=0).stop 2024-05-21T13:36:26.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.902+0000 7ffb75807640 1 --2- 172.21.15.22:0/1117972492 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffb5c003ab0 0x7ffb5c003ed0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ffb7002e140 tx=0x7ffb700999d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe74d47ad68433b3 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:26.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.902+0000 7f6ea17fa640 1 -- 172.21.15.22:0/1006248881 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e98005480 con 0x7f6ea4072280 2024-05-21T13:36:26.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.902+0000 7f6ea17fa640 1 -- 172.21.15.22:0/1006248881 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e98003600 con 0x7f6ea4072280 2024-05-21T13:36:26.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.902+0000 7f6ea17fa640 1 -- 172.21.15.22:0/1006248881 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e980039d0 con 0x7f6ea4072280 2024-05-21T13:36:26.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.902+0000 7f560f59e640 1 Processor -- start 2024-05-21T13:36:26.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.902+0000 7efc2ffff640 1 --2- 172.21.15.22:0/2866461660 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc200052f0 0x7efc2000b9d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7efc2400c2f0 tx=0x7efc2401ccb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3392a1c0f1293cfd server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:26.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.902+0000 7efc2e7fc640 1 -- 172.21.15.22:0/2866461660 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc24007da0 con 0x7efc200052f0 2024-05-21T13:36:26.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.902+0000 7efc2e7fc640 1 -- 172.21.15.22:0/2866461660 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc240a9070 con 0x7efc200052f0 2024-05-21T13:36:26.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.902+0000 7efc2e7fc640 1 -- 172.21.15.22:0/2866461660 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc240a5e50 con 0x7efc200052f0 2024-05-21T13:36:26.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.902+0000 7faa71450640 1 -- 172.21.15.22:0/2533761925 shutdown_connections 2024-05-21T13:36:26.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.902+0000 7faa71450640 1 -- 172.21.15.22:0/2533761925 wait complete. 2024-05-21T13:36:26.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.902+0000 7f52820a2640 1 -- 172.21.15.22:0/3289901615 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5274046d80 msgr2=0x7f52740d5090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:26.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.902+0000 7f52820a2640 1 --2- 172.21.15.22:0/3289901615 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5274046d80 0x7f52740d5090 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f5274051200 tx=0x7f526c01c4a0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.902+0000 7f52820a2640 1 -- 172.21.15.22:0/3289901615 shutdown_connections 2024-05-21T13:36:26.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.902+0000 7f52820a2640 1 --2- 172.21.15.22:0/3289901615 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f527404b6e0 0x7f52740d4b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.902+0000 7f52820a2640 1 --2- 172.21.15.22:0/3289901615 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5274046d80 0x7f52740d5090 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.902+0000 7f52820a2640 1 --2- 172.21.15.22:0/3289901615 >> v2:172.21.15.115:3300/0 conn(0x7f527404b300 0x7f5274005ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.902+0000 7f52820a2640 1 -- 172.21.15.22:0/3289901615 >> 172.21.15.22:0/3289901615 conn(0x7f5274050190 msgr2=0x7f52740505a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:26.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.902+0000 7f52820a2640 1 -- 172.21.15.22:0/3289901615 shutdown_connections 2024-05-21T13:36:26.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.902+0000 7f52820a2640 1 -- 172.21.15.22:0/3289901615 wait complete. 2024-05-21T13:36:26.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.902+0000 7ffb74805640 1 -- 172.21.15.22:0/1117972492 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb70051040 con 0x7ffb5c003ab0 2024-05-21T13:36:26.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.902+0000 7ffb74805640 1 -- 172.21.15.22:0/1117972492 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb701256f0 con 0x7ffb5c003ab0 2024-05-21T13:36:26.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.902+0000 7ffb74805640 1 -- 172.21.15.22:0/1117972492 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb70125b80 con 0x7ffb5c003ab0 2024-05-21T13:36:26.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.902+0000 7faa71450640 1 Processor -- start 2024-05-21T13:36:26.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.902+0000 7efc35b91640 1 -- 172.21.15.22:0/2866461660 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc200052f0 msgr2=0x7efc2000b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:26.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.902+0000 7efc35b91640 1 --2- 172.21.15.22:0/2866461660 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc200052f0 0x7efc2000b9d0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7efc2400c2f0 tx=0x7efc2401ccb0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.902+0000 7ffb76809640 1 -- 172.21.15.22:0/1117972492 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffb5c003ab0 msgr2=0x7ffb5c003ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:26.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.902+0000 7ffb76809640 1 --2- 172.21.15.22:0/1117972492 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffb5c003ab0 0x7ffb5c003ed0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ffb7002e140 tx=0x7ffb700999d0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.899 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.902+0000 7f560f59e640 1 -- start start 2024-05-21T13:36:26.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.902+0000 7f560f59e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f55f8004810 0x7f56081796f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.902+0000 7f560f59e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5608047110 0x7f56080e1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.902+0000 7f560f59e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f56080e1e80 0x7f56080d5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.902+0000 7f560f59e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f56080d93e0 con 0x7f5608047110 2024-05-21T13:36:26.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.902+0000 7f560f59e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f56080d9260 con 0x7f56080e1e80 2024-05-21T13:36:26.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.902+0000 7f560f59e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f5608045130 con 0x7f55f8004810 2024-05-21T13:36:26.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.902+0000 7efc35b91640 1 -- 172.21.15.22:0/2866461660 shutdown_connections 2024-05-21T13:36:26.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.902+0000 7efc35b91640 1 --2- 172.21.15.22:0/2866461660 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc200052f0 0x7efc2000b9d0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.902+0000 7efc35b91640 1 -- 172.21.15.22:0/2866461660 >> 172.21.15.22:0/2866461660 conn(0x7efc28050190 msgr2=0x7efc280505a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:26.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.902+0000 7f52820a2640 1 Processor -- start 2024-05-21T13:36:26.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.902+0000 7faa71450640 1 -- start start 2024-05-21T13:36:26.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.902+0000 7fe44d7a2640 1 -- 172.21.15.22:0/2525462882 shutdown_connections 2024-05-21T13:36:26.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.902+0000 7fe44d7a2640 1 --2- 172.21.15.22:0/2525462882 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe4480c6fa0 0x7fe44815a160 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.902+0000 7fe44d7a2640 1 --2- 172.21.15.22:0/2525462882 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe448072280 0x7fe448159c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.902+0000 7fe44d7a2640 1 -- 172.21.15.22:0/2525462882 >> 172.21.15.22:0/2525462882 conn(0x7fe4480703a0 msgr2=0x7fe4480cd250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:26.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.902+0000 7f6eaae94640 1 -- 172.21.15.22:0/1006248881 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ea414cb50 con 0x7f6ea4072280 2024-05-21T13:36:26.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.902+0000 7f6eaae94640 1 -- 172.21.15.22:0/1006248881 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ea415a880 con 0x7f6ea4072280 2024-05-21T13:36:26.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.902+0000 7f52820a2640 1 -- start start 2024-05-21T13:36:26.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.906+0000 7fe44d7a2640 1 -- 172.21.15.22:0/2525462882 shutdown_connections 2024-05-21T13:36:26.902 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.906+0000 7f560dd9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5608047110 0x7f56080e1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.906+0000 7f560dd9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5608047110 0x7f56080e1940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48284/0 (socket says 172.21.15.22:48284) 2024-05-21T13:36:26.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.906+0000 7f560dd9b640 1 -- 172.21.15.22:0/2318967343 learned_addr learned my addr 172.21.15.22:0/2318967343 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:26.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.906+0000 7f560e59c640 1 --2- 172.21.15.22:0/2318967343 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f55f8004810 0x7f56081796f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.906+0000 7ffb76809640 1 -- 172.21.15.22:0/1117972492 shutdown_connections 2024-05-21T13:36:26.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.906+0000 7ffb76809640 1 --2- 172.21.15.22:0/1117972492 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffb5c003ab0 0x7ffb5c003ed0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.906+0000 7ffb76809640 1 -- 172.21.15.22:0/1117972492 >> 172.21.15.22:0/1117972492 conn(0x7ffb68050190 msgr2=0x7ffb680505a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:26.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.906+0000 7f560ed9d640 1 --2- 172.21.15.22:0/2318967343 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f56080e1e80 0x7f56080d5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.906+0000 7f560dd9b640 1 -- 172.21.15.22:0/2318967343 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f55f8004810 msgr2=0x7f56081796f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:26.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.906+0000 7f560dd9b640 1 --2- 172.21.15.22:0/2318967343 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f55f8004810 0x7f56081796f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.906+0000 7f560dd9b640 1 -- 172.21.15.22:0/2318967343 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f56080e1e80 msgr2=0x7f56080d5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:26.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.906+0000 7f560dd9b640 1 --2- 172.21.15.22:0/2318967343 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f56080e1e80 0x7f56080d5880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.906+0000 7f560dd9b640 1 -- 172.21.15.22:0/2318967343 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56080e02e0 con 0x7f5608047110 2024-05-21T13:36:26.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.906+0000 7f560dd9b640 1 --2- 172.21.15.22:0/2318967343 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5608047110 0x7f56080e1940 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5604000c10 tx=0x7f55f8005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:26.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.906+0000 7efc35b91640 1 -- 172.21.15.22:0/2866461660 shutdown_connections 2024-05-21T13:36:26.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.906+0000 7efc35b91640 1 -- 172.21.15.22:0/2866461660 wait complete. 2024-05-21T13:36:26.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.906+0000 7f6eaae94640 1 -- 172.21.15.22:0/1006248881 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ea4077bb0 con 0x7f6ea4072280 2024-05-21T13:36:26.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.906+0000 7faa71450640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faa6c070c70 0x7faa6c146ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.906+0000 7faa71450640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faa6c0c8410 0x7faa6c14ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.906+0000 7faa71450640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa6c152bc0 0x7faa6c156e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.906+0000 7faa71450640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7faa6c0c5e20 con 0x7faa6c152bc0 2024-05-21T13:36:26.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.906+0000 7faa71450640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7faa6c0c8850 con 0x7faa6c070c70 2024-05-21T13:36:26.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.906+0000 7faa71450640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7faa6c0c77a0 con 0x7faa6c0c8410 2024-05-21T13:36:26.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.906+0000 7f52820a2640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5274046d80 0x7f52740dea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.906+0000 7f52820a2640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f527404b300 0x7f527416cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.906+0000 7f52820a2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f527404b6e0 0x7f52740dc2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.906+0000 7f52820a2640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f527404c8b0 con 0x7f527404b6e0 2024-05-21T13:36:26.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.906+0000 7f52820a2640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f527404c730 con 0x7f5274046d80 2024-05-21T13:36:26.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.906+0000 7f52820a2640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f527400e2b0 con 0x7f527404b300 2024-05-21T13:36:26.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.906+0000 7f52810a0640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5274046d80 0x7f52740dea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.906+0000 7f52818a1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f527404b6e0 0x7f52740dc2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.906+0000 7f52818a1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f527404b6e0 0x7f52740dc2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48286/0 (socket says 172.21.15.22:48286) 2024-05-21T13:36:26.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.906+0000 7f52818a1640 1 -- 172.21.15.22:0/2259181321 learned_addr learned my addr 172.21.15.22:0/2259181321 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:26.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.906+0000 7f528089f640 1 --2- 172.21.15.22:0/2259181321 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f527404b300 0x7f527416cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.906 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.906+0000 7fe44d7a2640 1 -- 172.21.15.22:0/2525462882 wait complete. 2024-05-21T13:36:26.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.906+0000 7fe44d7a2640 1 Processor -- start 2024-05-21T13:36:26.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.906+0000 7fe44d7a2640 1 -- start start 2024-05-21T13:36:26.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.906+0000 7f6ea17fa640 1 -- 172.21.15.22:0/1006248881 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f6e98003b70 con 0x7f6ea4072280 2024-05-21T13:36:26.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.906+0000 7f52818a1640 1 -- 172.21.15.22:0/2259181321 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f527404b300 msgr2=0x7f527416cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:26.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.906+0000 7f52818a1640 1 --2- 172.21.15.22:0/2259181321 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f527404b300 0x7f527416cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.906+0000 7f52818a1640 1 -- 172.21.15.22:0/2259181321 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5274046d80 msgr2=0x7f52740dea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:26.907 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.906+0000 7f52818a1640 1 --2- 172.21.15.22:0/2259181321 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5274046d80 0x7f52740dea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.906+0000 7f52818a1640 1 -- 172.21.15.22:0/2259181321 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52740d12d0 con 0x7f527404b6e0 2024-05-21T13:36:26.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.906+0000 7ffb76809640 1 -- 172.21.15.22:0/1117972492 shutdown_connections 2024-05-21T13:36:26.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.906+0000 7ffb76809640 1 -- 172.21.15.22:0/1117972492 wait complete. 2024-05-21T13:36:26.908 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.906+0000 7f52818a1640 1 --2- 172.21.15.22:0/2259181321 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f527404b6e0 0x7f52740dc2e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f526c01ab50 tx=0x7f526c01ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:26.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.906+0000 7f55feffd640 1 -- 172.21.15.22:0/2318967343 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56040bb020 con 0x7f5608047110 2024-05-21T13:36:26.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.906+0000 7f55feffd640 1 -- 172.21.15.22:0/2318967343 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56040013c0 con 0x7f5608047110 2024-05-21T13:36:26.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.906+0000 7f55feffd640 1 -- 172.21.15.22:0/2318967343 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5604003e20 con 0x7f5608047110 2024-05-21T13:36:26.909 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.906+0000 7f6ea17fa640 1 --2- 172.21.15.22:0/1006248881 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f6e9006f450 0x7f6e90071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.906+0000 7fe44d7a2640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe448072280 0x7fe44815ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.906+0000 7fe44d7a2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe4480c6bc0 0x7fe4481f92c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.906+0000 7fe44d7a2640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe4480c6fa0 0x7fe4481f5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.906+0000 7fe44d7a2640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe44806eb10 con 0x7fe4480c6bc0 2024-05-21T13:36:26.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.906+0000 7fe44d7a2640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fe44806e990 con 0x7fe448072280 2024-05-21T13:36:26.910 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.906+0000 7fe44d7a2640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7fe44806e1e0 con 0x7fe4480c6fa0 2024-05-21T13:36:26.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.906+0000 7efc35b91640 1 Processor -- start 2024-05-21T13:36:26.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.906+0000 7f6ea3fff640 1 --2- 172.21.15.22:0/1006248881 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f6e9006f450 0x7f6e90071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.906+0000 7faa6bfff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faa6c070c70 0x7faa6c146ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.906+0000 7faa63fff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faa6c0c8410 0x7faa6c14ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.906+0000 7faa6bfff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faa6c070c70 0x7faa6c146ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.22:36494/0 (socket says 172.21.15.22:36494) 2024-05-21T13:36:26.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.906+0000 7faa6bfff640 1 -- 172.21.15.22:0/2097781059 learned_addr learned my addr 172.21.15.22:0/2097781059 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:26.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.906+0000 7faa63fff640 1 -- 172.21.15.22:0/2097781059 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faa6c070c70 msgr2=0x7faa6c146ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:26.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.906+0000 7faa63fff640 1 --2- 172.21.15.22:0/2097781059 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faa6c070c70 0x7faa6c146ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.906+0000 7faa63fff640 1 -- 172.21.15.22:0/2097781059 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa6c152bc0 msgr2=0x7faa6c156e50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-21T13:36:26.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.906+0000 7faa63fff640 1 --2- 172.21.15.22:0/2097781059 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa6c152bc0 0x7faa6c156e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.906+0000 7faa63fff640 1 -- 172.21.15.22:0/2097781059 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa6c14d440 con 0x7faa6c0c8410 2024-05-21T13:36:26.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.906+0000 7f560f59e640 1 -- 172.21.15.22:0/2318967343 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5608176e50 con 0x7f5608047110 2024-05-21T13:36:26.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.906+0000 7f560f59e640 1 -- 172.21.15.22:0/2318967343 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5608177410 con 0x7f5608047110 2024-05-21T13:36:26.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.906+0000 7fe446ffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe448072280 0x7fe44815ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.906+0000 7efc35b91640 1 -- start start 2024-05-21T13:36:26.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.906+0000 7fe446ffd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe448072280 0x7fe44815ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.22:36502/0 (socket says 172.21.15.22:36502) 2024-05-21T13:36:26.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.906+0000 7fe446ffd640 1 -- 172.21.15.22:0/2960072598 learned_addr learned my addr 172.21.15.22:0/2960072598 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:26.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.906+0000 7ffb76809640 1 Processor -- start 2024-05-21T13:36:26.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.910+0000 7faa63fff640 1 --2- 172.21.15.22:0/2097781059 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faa6c0c8410 0x7faa6c14ca40 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7faa5400b440 tx=0x7faa5400b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:26.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.910+0000 7f6ea17fa640 1 -- 172.21.15.22:0/1006248881 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f6e9808f100 con 0x7f6ea4072280 2024-05-21T13:36:26.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.910+0000 7f6ea3fff640 1 --2- 172.21.15.22:0/1006248881 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f6e9006f450 0x7f6e90071910 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c0b3000 tx=0x7f6e9c00d040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:26.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.910+0000 7faa697fa640 1 -- 172.21.15.22:0/2097781059 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa54015020 con 0x7faa6c0c8410 2024-05-21T13:36:26.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.910+0000 7faa697fa640 1 -- 172.21.15.22:0/2097781059 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faa54011830 con 0x7faa6c0c8410 2024-05-21T13:36:26.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.910+0000 7faa697fa640 1 -- 172.21.15.22:0/2097781059 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa54011c20 con 0x7faa6c0c8410 2024-05-21T13:36:26.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.910+0000 7fe4477fe640 1 --2- 172.21.15.22:0/2960072598 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe4480c6fa0 0x7fe4481f5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.906+0000 7f5271ffb640 1 -- 172.21.15.22:0/2259181321 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f526c0be5f0 con 0x7f527404b6e0 2024-05-21T13:36:26.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.910+0000 7f5271ffb640 1 -- 172.21.15.22:0/2259181321 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f526c0be790 con 0x7f527404b6e0 2024-05-21T13:36:26.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.910+0000 7f5271ffb640 1 -- 172.21.15.22:0/2259181321 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f526c0beb60 con 0x7f527404b6e0 2024-05-21T13:36:26.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.910+0000 7f52820a2640 1 -- 172.21.15.22:0/2259181321 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52740d15b0 con 0x7f527404b6e0 2024-05-21T13:36:26.915 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.910+0000 7f52820a2640 1 -- 172.21.15.22:0/2259181321 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52740d1b70 con 0x7f527404b6e0 2024-05-21T13:36:26.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.910+0000 7f560f59e640 1 -- 172.21.15.22:0/2318967343 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56080053a0 con 0x7f5608047110 2024-05-21T13:36:26.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.910+0000 7efc35b91640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc200052f0 0x7efc28049bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.910+0000 7efc35b91640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc280e5f30 0x7efc280c6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.910+0000 7efc35b91640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc280e2010 0x7efc280c6750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.910+0000 7efc35b91640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7efc2804c9e0 con 0x7efc280e5f30 2024-05-21T13:36:26.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.910+0000 7efc35b91640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7efc2804c860 con 0x7efc200052f0 2024-05-21T13:36:26.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.910+0000 7efc35b91640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7efc280e66f0 con 0x7efc280e2010 2024-05-21T13:36:26.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.910+0000 7efc2effd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc280e5f30 0x7efc280c6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.917 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.910+0000 7efc2effd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc280e5f30 0x7efc280c6210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48306/0 (socket says 172.21.15.22:48306) 2024-05-21T13:36:26.917 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.910+0000 7efc2effd640 1 -- 172.21.15.22:0/304058996 learned_addr learned my addr 172.21.15.22:0/304058996 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:26.917 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.910+0000 7efc2effd640 1 -- 172.21.15.22:0/304058996 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc280e2010 msgr2=0x7efc280c6750 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-21T13:36:26.917 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.910+0000 7efc2effd640 1 --2- 172.21.15.22:0/304058996 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc280e2010 0x7efc280c6750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.917 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.910+0000 7efc2effd640 1 -- 172.21.15.22:0/304058996 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc200052f0 msgr2=0x7efc28049bb0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-21T13:36:26.917 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.910+0000 7efc2effd640 1 --2- 172.21.15.22:0/304058996 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc200052f0 0x7efc28049bb0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.917 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.910+0000 7efc2effd640 1 -- 172.21.15.22:0/304058996 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc280e10f0 con 0x7efc280e5f30 2024-05-21T13:36:26.917 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.910+0000 7efc2effd640 1 --2- 172.21.15.22:0/304058996 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc280e5f30 0x7efc280c6210 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7efc300756a0 tx=0x7efc3006a2b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:26.917 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.910+0000 7faa71450640 1 -- 172.21.15.22:0/2097781059 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa6c14d6e0 con 0x7faa6c0c8410 2024-05-21T13:36:26.917 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.910+0000 7faa71450640 1 -- 172.21.15.22:0/2097781059 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7faa6c1f17f0 con 0x7faa6c0c8410 2024-05-21T13:36:26.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.910+0000 7faa71450640 1 -- 172.21.15.22:0/2097781059 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa6c076eb0 con 0x7faa6c0c8410 2024-05-21T13:36:26.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.910+0000 7fe446ffd640 1 -- 172.21.15.22:0/2960072598 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe4480c6fa0 msgr2=0x7fe4481f5af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:26.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.910+0000 7fe446ffd640 1 --2- 172.21.15.22:0/2960072598 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe4480c6fa0 0x7fe4481f5af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.910+0000 7fe446ffd640 1 -- 172.21.15.22:0/2960072598 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe4480c6bc0 msgr2=0x7fe4481f92c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:26.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.910+0000 7fe446ffd640 1 --2- 172.21.15.22:0/2960072598 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe4480c6bc0 0x7fe4481f92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.910+0000 7fe446ffd640 1 -- 172.21.15.22:0/2960072598 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4480ce080 con 0x7fe448072280 2024-05-21T13:36:26.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.910+0000 7ffb76809640 1 -- start start 2024-05-21T13:36:26.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.910+0000 7ffb76809640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffb5c003ab0 0x7ffb680d5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.910+0000 7ffb76809640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffb680d58c0 0x7ffb6804caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.910+0000 7ffb76809640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffb680dac10 0x7ffb6804d030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.910+0000 7ffb76809640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ffb680e66f0 con 0x7ffb680d58c0 2024-05-21T13:36:26.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.910+0000 7ffb76809640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7ffb6804c970 con 0x7ffb5c003ab0 2024-05-21T13:36:26.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.910+0000 7ffb76809640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7ffb680e6870 con 0x7ffb680dac10 2024-05-21T13:36:26.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.910+0000 7ffb75807640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffb5c003ab0 0x7ffb680d5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.910+0000 7ffb75807640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffb5c003ab0 0x7ffb680d5380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.22:36522/0 (socket says 172.21.15.22:36522) 2024-05-21T13:36:26.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.910+0000 7ffb75807640 1 -- 172.21.15.22:0/4013722171 learned_addr learned my addr 172.21.15.22:0/4013722171 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:26.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.910+0000 7f52820a2640 1 -- 172.21.15.22:0/2259181321 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f525c0052a0 con 0x7f527404b6e0 2024-05-21T13:36:26.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.910+0000 7fe446ffd640 1 --2- 172.21.15.22:0/2960072598 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe448072280 0x7fe44815ce10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe43800c450 tx=0x7fe43800c910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:26.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.910+0000 7ffb76008640 1 --2- 172.21.15.22:0/4013722171 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffb680dac10 0x7ffb6804d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.910+0000 7ffb75006640 1 --2- 172.21.15.22:0/4013722171 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffb680d58c0 0x7ffb6804caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.910+0000 7f55feffd640 1 -- 172.21.15.22:0/2318967343 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f56040be070 con 0x7f5608047110 2024-05-21T13:36:26.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.910+0000 7f55feffd640 1 --2- 172.21.15.22:0/2318967343 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f55f006f430 0x7f55f00718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.910+0000 7f55feffd640 1 -- 172.21.15.22:0/2318967343 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f5604128520 con 0x7f5608047110 2024-05-21T13:36:26.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.910+0000 7fe42f7fe640 1 -- 172.21.15.22:0/2960072598 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe438012830 con 0x7fe448072280 2024-05-21T13:36:26.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.910+0000 7ffb75807640 1 -- 172.21.15.22:0/4013722171 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffb680dac10 msgr2=0x7ffb6804d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:26.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.910+0000 7ffb75807640 1 --2- 172.21.15.22:0/4013722171 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffb680dac10 0x7ffb6804d030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.910+0000 7ffb75807640 1 -- 172.21.15.22:0/4013722171 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffb680d58c0 msgr2=0x7ffb6804caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:26.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.910+0000 7fe44d7a2640 1 -- 172.21.15.22:0/2960072598 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4481f9f00 con 0x7fe448072280 2024-05-21T13:36:26.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.910+0000 7ffb75807640 1 --2- 172.21.15.22:0/4013722171 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffb680d58c0 0x7ffb6804caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.910+0000 7ffb75807640 1 -- 172.21.15.22:0/4013722171 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb680e61c0 con 0x7ffb5c003ab0 2024-05-21T13:36:26.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.910+0000 7fe44d7a2640 1 -- 172.21.15.22:0/2960072598 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4481f9c20 con 0x7fe448072280 2024-05-21T13:36:26.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.910+0000 7f560e59c640 1 --2- 172.21.15.22:0/2318967343 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f55f006f430 0x7f55f00718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.910+0000 7fe42f7fe640 1 -- 172.21.15.22:0/2960072598 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe438017070 con 0x7fe448072280 2024-05-21T13:36:26.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.910+0000 7fe42f7fe640 1 -- 172.21.15.22:0/2960072598 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe438012c30 con 0x7fe448072280 2024-05-21T13:36:26.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.910+0000 7ffb75807640 1 --2- 172.21.15.22:0/4013722171 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffb5c003ab0 0x7ffb680d5380 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ffb7002e140 tx=0x7ffb70096810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:26.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.910+0000 7f5271ffb640 1 -- 172.21.15.22:0/2259181321 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f526c0b43f0 con 0x7f527404b6e0 2024-05-21T13:36:26.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.914+0000 7f560e59c640 1 --2- 172.21.15.22:0/2318967343 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f55f006f430 0x7f55f00718f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5600006b50 tx=0x7f5600008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:26.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.914+0000 7ffb667fc640 1 -- 172.21.15.22:0/4013722171 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb7013c070 con 0x7ffb5c003ab0 2024-05-21T13:36:26.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.914+0000 7ffb667fc640 1 -- 172.21.15.22:0/4013722171 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb7012d440 con 0x7ffb5c003ab0 2024-05-21T13:36:26.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.914+0000 7ffb667fc640 1 -- 172.21.15.22:0/4013722171 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb70051040 con 0x7ffb5c003ab0 2024-05-21T13:36:26.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.914+0000 7fe44d7a2640 1 -- 172.21.15.22:0/2960072598 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4280052a0 con 0x7fe448072280 2024-05-21T13:36:26.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.914+0000 7ffb76809640 1 -- 172.21.15.22:0/4013722171 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb680d9750 con 0x7ffb5c003ab0 2024-05-21T13:36:26.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.914+0000 7ffb76809640 1 -- 172.21.15.22:0/4013722171 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb680d9d10 con 0x7ffb5c003ab0 2024-05-21T13:36:26.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.914+0000 7faa697fa640 1 -- 172.21.15.22:0/2097781059 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7faa54018020 con 0x7faa6c0c8410 2024-05-21T13:36:26.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.914+0000 7f5271ffb640 1 --2- 172.21.15.22:0/2259181321 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f526006f4d0 0x7f5260071990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.914+0000 7f5271ffb640 1 -- 172.21.15.22:0/2259181321 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f526c129ad0 con 0x7f527404b6e0 2024-05-21T13:36:26.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.914+0000 7f52810a0640 1 --2- 172.21.15.22:0/2259181321 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f526006f4d0 0x7f5260071990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.914+0000 7f67edb5a640 1 Processor -- start 2024-05-21T13:36:26.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.914+0000 7faa697fa640 1 --2- 172.21.15.22:0/2097781059 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7faa4c06f400 0x7faa4c0718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.914+0000 7ffb76809640 1 -- 172.21.15.22:0/4013722171 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb680053a0 con 0x7ffb5c003ab0 2024-05-21T13:36:26.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.914+0000 7faa697fa640 1 -- 172.21.15.22:0/2097781059 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7faa5408fa10 con 0x7faa6c0c8410 2024-05-21T13:36:26.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.914+0000 7faa6bfff640 1 --2- 172.21.15.22:0/2097781059 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7faa4c06f400 0x7faa4c0718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.914+0000 7f52810a0640 1 --2- 172.21.15.22:0/2259181321 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f526006f4d0 0x7f5260071990 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f527c051640 tx=0x7f527c077a90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:26.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.914+0000 7f67edb5a640 1 -- start start 2024-05-21T13:36:26.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.914+0000 7f67edb5a640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f67e806fc90 0x7f67e80700e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.914+0000 7f67edb5a640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67e8074000 con 0x7f67e8159fa0 2024-05-21T13:36:26.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.914+0000 7f67edb5a640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67e8072f60 con 0x7f67e80c83f0 2024-05-21T13:36:26.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.914+0000 7f67edb5a640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f67e80c8840 con 0x7f67e806fc90 2024-05-21T13:36:26.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.914+0000 7faa6bfff640 1 --2- 172.21.15.22:0/2097781059 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7faa4c06f400 0x7faa4c0718c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7faa5c001960 tx=0x7faa5c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:26.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.914+0000 7f67ed359640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f67e806fc90 0x7f67e80700e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.914+0000 7f67ecb58640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f67e8159fa0 0x7f67e81607d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:44548/0 (socket says 172.21.15.22:44548) 2024-05-21T13:36:26.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.914+0000 7f67ecb58640 1 -- 172.21.15.22:0/2825699049 learned_addr learned my addr 172.21.15.22:0/2825699049 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-21T13:36:26.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.914+0000 7fe42f7fe640 1 -- 172.21.15.22:0/2960072598 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fe43801c460 con 0x7fe448072280 2024-05-21T13:36:26.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.914+0000 7fe42f7fe640 1 --2- 172.21.15.22:0/2960072598 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fe43406f400 0x7fe4340718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.914+0000 7fe42f7fe640 1 -- 172.21.15.22:0/2960072598 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fe43808fda0 con 0x7fe448072280 2024-05-21T13:36:26.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.914+0000 7fe4467fc640 1 --2- 172.21.15.22:0/2960072598 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fe43406f400 0x7fe4340718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.914+0000 7fe4467fc640 1 --2- 172.21.15.22:0/2960072598 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fe43406f400 0x7fe4340718c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe44814fe50 tx=0x7fe43c006ca0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:26.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.914+0000 7f67ed359640 1 -- 172.21.15.22:0/2825699049 >> v1:172.21.15.115:6789/0 conn(0x7f67e80c83f0 legacy=0x7f67e80c8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:26.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.914+0000 7f67ed359640 1 -- 172.21.15.22:0/2825699049 >> v1:172.21.15.22:6789/0 conn(0x7f67e8159fa0 legacy=0x7f67e81607d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:26.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.914+0000 7f67ed359640 1 -- 172.21.15.22:0/2825699049 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67e8073240 con 0x7f67e806fc90 2024-05-21T13:36:26.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.918+0000 7f6ea17fa640 1 -- 172.21.15.22:0/1006248881 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f6e9805bd90 con 0x7f6ea4072280 2024-05-21T13:36:26.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.918+0000 7f67ed359640 1 --2- 172.21.15.22:0/2825699049 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f67e806fc90 0x7f67e80700e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f67e0009dc0 tx=0x7f67e001f140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aab6104802f8491c server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:26.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.922+0000 7efc1bfff640 1 -- 172.21.15.22:0/304058996 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc30050d60 con 0x7efc280e5f30 2024-05-21T13:36:26.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.922+0000 7f67e77fe640 1 -- 172.21.15.22:0/2825699049 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67e00b4070 con 0x7f67e806fc90 2024-05-21T13:36:26.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.922+0000 7efc35b91640 1 -- 172.21.15.22:0/304058996 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc280e13d0 con 0x7efc280e5f30 2024-05-21T13:36:26.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.922+0000 7efc35b91640 1 -- 172.21.15.22:0/304058996 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc280e1990 con 0x7efc280e5f30 2024-05-21T13:36:26.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.922+0000 7efc35b91640 1 -- 172.21.15.22:0/304058996 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc280053a0 con 0x7efc280e5f30 2024-05-21T13:36:26.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.922+0000 7faa697fa640 1 -- 172.21.15.22:0/2097781059 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7faa5401f020 con 0x7faa6c0c8410 2024-05-21T13:36:26.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.926+0000 7fe42f7fe640 1 -- 172.21.15.22:0/2960072598 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fe43805ca30 con 0x7fe448072280 2024-05-21T13:36:26.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.930+0000 7ffb667fc640 1 -- 172.21.15.22:0/4013722171 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ffb7012d7f0 con 0x7ffb5c003ab0 2024-05-21T13:36:26.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.930+0000 7ffb667fc640 1 --2- 172.21.15.22:0/4013722171 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7ffb5406f4d0 0x7ffb54071990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.930+0000 7ffb667fc640 1 -- 172.21.15.22:0/4013722171 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7ffb701a6c40 con 0x7ffb5c003ab0 2024-05-21T13:36:26.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.930+0000 7f55feffd640 1 -- 172.21.15.22:0/2318967343 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f5604016150 con 0x7f5608047110 2024-05-21T13:36:26.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.930+0000 7ffb75006640 1 --2- 172.21.15.22:0/4013722171 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7ffb5406f4d0 0x7ffb54071990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.930+0000 7ffb75006640 1 --2- 172.21.15.22:0/4013722171 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7ffb5406f4d0 0x7ffb54071990 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ffb68176a10 tx=0x7ffb60009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:26.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.934+0000 7ffb667fc640 1 -- 172.21.15.22:0/4013722171 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7ffb680e61c0 con 0x7ffb5c003ab0 2024-05-21T13:36:26.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.938+0000 7f5271ffb640 1 -- 172.21.15.22:0/2259181321 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f526c016150 con 0x7f527404b6e0 2024-05-21T13:36:26.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.938+0000 7efc1bfff640 1 -- 172.21.15.22:0/304058996 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc30069cd0 con 0x7efc280e5f30 2024-05-21T13:36:26.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.938+0000 7efc1bfff640 1 -- 172.21.15.22:0/304058996 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc3006ed50 con 0x7efc280e5f30 2024-05-21T13:36:26.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.938+0000 7f67e77fe640 1 -- 172.21.15.22:0/2825699049 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67e00af600 con 0x7f67e806fc90 2024-05-21T13:36:26.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.938+0000 7f67e77fe640 1 -- 172.21.15.22:0/2825699049 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67e00af9d0 con 0x7f67e806fc90 2024-05-21T13:36:26.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.942+0000 7efc1bfff640 1 -- 172.21.15.22:0/304058996 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7efc300a0440 con 0x7efc280e5f30 2024-05-21T13:36:26.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.942+0000 7efc1bfff640 1 --2- 172.21.15.22:0/304058996 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7efc1406f430 0x7efc140718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.942+0000 7efc1bfff640 1 -- 172.21.15.22:0/304058996 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7efc3010c3a0 con 0x7efc280e5f30 2024-05-21T13:36:26.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.942+0000 7efc2f7fe640 1 --2- 172.21.15.22:0/304058996 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7efc1406f430 0x7efc140718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.942+0000 7f67edb5a640 1 -- 172.21.15.22:0/2825699049 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f67e806fc90 msgr2=0x7f67e80700e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:26.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.942+0000 7f67edb5a640 1 --2- 172.21.15.22:0/2825699049 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f67e806fc90 0x7f67e80700e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f67e0009dc0 tx=0x7f67e001f140 comp rx=0 tx=0).stop 2024-05-21T13:36:26.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.942+0000 7f67edb5a640 1 -- 172.21.15.22:0/2825699049 shutdown_connections 2024-05-21T13:36:26.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.942+0000 7f67edb5a640 1 --2- 172.21.15.22:0/2825699049 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f67e806fc90 0x7f67e80700e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.942+0000 7f67edb5a640 1 -- 172.21.15.22:0/2825699049 >> 172.21.15.22:0/2825699049 conn(0x7f67e806e1c0 msgr2=0x7f67e806e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:26.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.942+0000 7f67edb5a640 1 -- 172.21.15.22:0/2825699049 shutdown_connections 2024-05-21T13:36:26.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.942+0000 7f67edb5a640 1 -- 172.21.15.22:0/2825699049 wait complete. 2024-05-21T13:36:26.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.946+0000 7f67edb5a640 1 Processor -- start 2024-05-21T13:36:26.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.946+0000 7f67edb5a640 1 -- start start 2024-05-21T13:36:26.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.946+0000 7f67edb5a640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f67e806fc90 0x7f67e8157990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.946+0000 7efc2f7fe640 1 --2- 172.21.15.22:0/304058996 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7efc1406f430 0x7efc140718f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7efc1c006fd0 tx=0x7efc1c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:26.941 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.946+0000 7f67edb5a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f67e80c83f0 0x7f67e815cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.941 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.946+0000 7f67edb5a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f67e8159fa0 0x7f67e81495c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.941 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.946+0000 7f67edb5a640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f67e8073ae0 con 0x7f67e8159fa0 2024-05-21T13:36:26.941 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.946+0000 7f67edb5a640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f67e8073800 con 0x7f67e80c83f0 2024-05-21T13:36:26.941 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.946+0000 7f67edb5a640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f67e80c9640 con 0x7f67e806fc90 2024-05-21T13:36:26.941 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.946+0000 7f67ecb58640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f67e806fc90 0x7f67e8157990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.941 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.946+0000 7f67ecb58640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f67e806fc90 0x7f67e8157990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.22:42014/0 (socket says 172.21.15.22:42014) 2024-05-21T13:36:26.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.946+0000 7f67ecb58640 1 -- 172.21.15.22:0/3795397041 learned_addr learned my addr 172.21.15.22:0/3795397041 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:26.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.946+0000 7f67ed359640 1 --2- 172.21.15.22:0/3795397041 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f67e8159fa0 0x7f67e81495c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.946+0000 7f67e7fff640 1 --2- 172.21.15.22:0/3795397041 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f67e80c83f0 0x7f67e815cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.946+0000 7f67ed359640 1 -- 172.21.15.22:0/3795397041 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f67e806fc90 msgr2=0x7f67e8157990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:26.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.946+0000 7f67ed359640 1 --2- 172.21.15.22:0/3795397041 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f67e806fc90 0x7f67e8157990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.946+0000 7f67ed359640 1 -- 172.21.15.22:0/3795397041 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f67e80c83f0 msgr2=0x7f67e815cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:26.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.946+0000 7f67ed359640 1 --2- 172.21.15.22:0/3795397041 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f67e80c83f0 0x7f67e815cfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:26.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.946+0000 7f67ed359640 1 -- 172.21.15.22:0/3795397041 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67e815abc0 con 0x7f67e8159fa0 2024-05-21T13:36:26.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.946+0000 7f67ecb58640 1 --2- 172.21.15.22:0/3795397041 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f67e806fc90 0x7f67e8157990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-21T13:36:26.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.946+0000 7f67ed359640 1 --2- 172.21.15.22:0/3795397041 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f67e8159fa0 0x7f67e81495c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f67e8070d00 tx=0x7f67e001bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:26.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.946+0000 7efc1bfff640 1 -- 172.21.15.22:0/304058996 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7efc3009d2b0 con 0x7efc280e5f30 2024-05-21T13:36:26.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.950+0000 7f67e57fa640 1 -- 172.21.15.22:0/3795397041 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67e00b4040 con 0x7f67e8159fa0 2024-05-21T13:36:26.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.950+0000 7f67edb5a640 1 -- 172.21.15.22:0/3795397041 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67e815a620 con 0x7f67e8159fa0 2024-05-21T13:36:26.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.950+0000 7f67edb5a640 1 -- 172.21.15.22:0/3795397041 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67e80cdd90 con 0x7f67e8159fa0 2024-05-21T13:36:26.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.950+0000 7f67e57fa640 1 -- 172.21.15.22:0/3795397041 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67e00c1070 con 0x7f67e8159fa0 2024-05-21T13:36:26.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.954+0000 7f67e57fa640 1 -- 172.21.15.22:0/3795397041 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67e00ba6b0 con 0x7f67e8159fa0 2024-05-21T13:36:26.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.954+0000 7f67edb5a640 1 -- 172.21.15.22:0/3795397041 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67c80052a0 con 0x7f67e8159fa0 2024-05-21T13:36:26.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.954+0000 7f67e57fa640 1 -- 172.21.15.22:0/3795397041 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f67e00ba8d0 con 0x7f67e8159fa0 2024-05-21T13:36:26.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.954+0000 7f67e57fa640 1 --2- 172.21.15.22:0/3795397041 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f67d406f430 0x7f67d40718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:26.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.954+0000 7f67e57fa640 1 -- 172.21.15.22:0/3795397041 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f67e012e030 con 0x7f67e8159fa0 2024-05-21T13:36:26.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.954+0000 7f67ecb58640 1 --2- 172.21.15.22:0/3795397041 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f67d406f430 0x7f67d40718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:26.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.958+0000 7f67ecb58640 1 --2- 172.21.15.22:0/3795397041 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f67d406f430 0x7f67d40718f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f67dc000f70 tx=0x7f67dc007f70 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:26.945 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:26.962+0000 7f67e57fa640 1 -- 172.21.15.22:0/3795397041 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f67e0018ca0 con 0x7f67e8159fa0 2024-05-21T13:36:27.219 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.242+0000 7faa71450640 1 -- 172.21.15.22:0/2097781059 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7faa6c0c7fe0 con 0x7faa6c0c8410 2024-05-21T13:36:27.220 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.242+0000 7faa697fa640 1 -- 172.21.15.22:0/2097781059 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7faa5405c630 con 0x7faa6c0c8410 2024-05-21T13:36:27.223 INFO:teuthology.orchestra.run.smithi022.stdout:64424509451 2024-05-21T13:36:27.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.246+0000 7faa71450640 1 -- 172.21.15.22:0/2097781059 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7faa4c06f400 msgr2=0x7faa4c0718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:27.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.246+0000 7faa71450640 1 --2- 172.21.15.22:0/2097781059 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7faa4c06f400 0x7faa4c0718c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7faa5c001960 tx=0x7faa5c009040 comp rx=0 tx=0).stop 2024-05-21T13:36:27.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.246+0000 7faa71450640 1 -- 172.21.15.22:0/2097781059 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faa6c0c8410 msgr2=0x7faa6c14ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:27.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.246+0000 7faa71450640 1 --2- 172.21.15.22:0/2097781059 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faa6c0c8410 0x7faa6c14ca40 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7faa5400b440 tx=0x7faa5400b840 comp rx=0 tx=0).stop 2024-05-21T13:36:27.224 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.246+0000 7faa71450640 1 -- 172.21.15.22:0/2097781059 shutdown_connections 2024-05-21T13:36:27.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.246+0000 7faa71450640 1 --2- 172.21.15.22:0/2097781059 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7faa4c06f400 0x7faa4c0718c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:27.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.246+0000 7faa71450640 1 --2- 172.21.15.22:0/2097781059 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faa6c152bc0 0x7faa6c156e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:27.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.246+0000 7faa71450640 1 --2- 172.21.15.22:0/2097781059 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faa6c0c8410 0x7faa6c14ca40 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:27.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.246+0000 7faa71450640 1 --2- 172.21.15.22:0/2097781059 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faa6c070c70 0x7faa6c146ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:27.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.246+0000 7faa71450640 1 -- 172.21.15.22:0/2097781059 >> 172.21.15.22:0/2097781059 conn(0x7faa6c0733b0 msgr2=0x7faa6c06cf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:27.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.246+0000 7faa71450640 1 -- 172.21.15.22:0/2097781059 shutdown_connections 2024-05-21T13:36:27.225 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.246+0000 7faa71450640 1 -- 172.21.15.22:0/2097781059 wait complete. 2024-05-21T13:36:27.230 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.254+0000 7f6eaae94640 1 -- 172.21.15.22:0/1006248881 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f6ea415b080 con 0x7f6ea4072280 2024-05-21T13:36:27.231 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.254+0000 7f6ea17fa640 1 -- 172.21.15.22:0/1006248881 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6e9805b690 con 0x7f6ea4072280 2024-05-21T13:36:27.231 INFO:teuthology.orchestra.run.smithi022.stdout:64424509451 2024-05-21T13:36:27.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.258+0000 7f6e8affd640 1 -- 172.21.15.22:0/1006248881 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f6e9006f450 msgr2=0x7f6e90071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:27.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.258+0000 7f6e8affd640 1 --2- 172.21.15.22:0/1006248881 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f6e9006f450 0x7f6e90071910 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c0b3000 tx=0x7f6e9c00d040 comp rx=0 tx=0).stop 2024-05-21T13:36:27.234 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.258+0000 7f6e8affd640 1 -- 172.21.15.22:0/1006248881 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ea4072280 msgr2=0x7f6ea414c610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:27.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.258+0000 7f6e8affd640 1 --2- 172.21.15.22:0/1006248881 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ea4072280 0x7f6ea414c610 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f6e9800c450 tx=0x7f6e9800c910 comp rx=0 tx=0).stop 2024-05-21T13:36:27.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.258+0000 7f6e8affd640 1 -- 172.21.15.22:0/1006248881 shutdown_connections 2024-05-21T13:36:27.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.258+0000 7f6e8affd640 1 --2- 172.21.15.22:0/1006248881 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f6e9006f450 0x7f6e90071910 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:27.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.258+0000 7f6e8affd640 1 --2- 172.21.15.22:0/1006248881 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6ea40ca320 0x7f6ea41e0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:27.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.258+0000 7f6e8affd640 1 --2- 172.21.15.22:0/1006248881 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6ea40c9f40 0x7f6ea4073290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:27.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.258+0000 7f6e8affd640 1 --2- 172.21.15.22:0/1006248881 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6ea4072280 0x7f6ea414c610 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:27.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.258+0000 7f6e8affd640 1 -- 172.21.15.22:0/1006248881 >> 172.21.15.22:0/1006248881 conn(0x7f6ea40703a0 msgr2=0x7f6ea40cbb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:27.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.258+0000 7f6e8affd640 1 -- 172.21.15.22:0/1006248881 shutdown_connections 2024-05-21T13:36:27.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.258+0000 7f6e8affd640 1 -- 172.21.15.22:0/1006248881 wait complete. 2024-05-21T13:36:27.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.258+0000 7fe44d7a2640 1 -- 172.21.15.22:0/2960072598 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fe428005860 con 0x7fe448072280 2024-05-21T13:36:27.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.258+0000 7fe42f7fe640 1 -- 172.21.15.22:0/2960072598 <== mon.1 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe43805c330 con 0x7fe448072280 2024-05-21T13:36:27.238 INFO:teuthology.orchestra.run.smithi022.stdout:64424509450 2024-05-21T13:36:27.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.262+0000 7f52820a2640 1 -- 172.21.15.22:0/2259181321 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f525c005590 con 0x7f527404b6e0 2024-05-21T13:36:27.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.262+0000 7f5271ffb640 1 -- 172.21.15.22:0/2259181321 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f526c0f6160 con 0x7f527404b6e0 2024-05-21T13:36:27.239 INFO:teuthology.orchestra.run.smithi022.stdout:64424509450 2024-05-21T13:36:27.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.262+0000 7fe44d7a2640 1 -- 172.21.15.22:0/2960072598 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fe43406f400 msgr2=0x7fe4340718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:27.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.262+0000 7fe44d7a2640 1 --2- 172.21.15.22:0/2960072598 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fe43406f400 0x7fe4340718c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fe44814fe50 tx=0x7fe43c006ca0 comp rx=0 tx=0).stop 2024-05-21T13:36:27.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.262+0000 7fe44d7a2640 1 -- 172.21.15.22:0/2960072598 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe448072280 msgr2=0x7fe44815ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:27.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.262+0000 7fe44d7a2640 1 --2- 172.21.15.22:0/2960072598 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe448072280 0x7fe44815ce10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe43800c450 tx=0x7fe43800c910 comp rx=0 tx=0).stop 2024-05-21T13:36:27.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.262+0000 7fe44d7a2640 1 -- 172.21.15.22:0/2960072598 shutdown_connections 2024-05-21T13:36:27.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.262+0000 7fe44d7a2640 1 --2- 172.21.15.22:0/2960072598 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fe43406f400 0x7fe4340718c0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:27.241 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.262+0000 7fe44d7a2640 1 --2- 172.21.15.22:0/2960072598 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe4480c6fa0 0x7fe4481f5af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:27.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.262+0000 7fe44d7a2640 1 --2- 172.21.15.22:0/2960072598 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe4480c6bc0 0x7fe4481f92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:27.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.262+0000 7fe44d7a2640 1 --2- 172.21.15.22:0/2960072598 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe448072280 0x7fe44815ce10 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:27.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.262+0000 7fe44d7a2640 1 -- 172.21.15.22:0/2960072598 >> 172.21.15.22:0/2960072598 conn(0x7fe4480703a0 msgr2=0x7fe448141290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:27.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.262+0000 7fe44d7a2640 1 -- 172.21.15.22:0/2960072598 shutdown_connections 2024-05-21T13:36:27.242 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.262+0000 7fe44d7a2640 1 -- 172.21.15.22:0/2960072598 wait complete. 2024-05-21T13:36:27.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.266+0000 7f52820a2640 1 -- 172.21.15.22:0/2259181321 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f526006f4d0 msgr2=0x7f5260071990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:27.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.266+0000 7f52820a2640 1 --2- 172.21.15.22:0/2259181321 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f526006f4d0 0x7f5260071990 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f527c051640 tx=0x7f527c077a90 comp rx=0 tx=0).stop 2024-05-21T13:36:27.243 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.266+0000 7f52820a2640 1 -- 172.21.15.22:0/2259181321 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f527404b6e0 msgr2=0x7f52740dc2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:27.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.266+0000 7f52820a2640 1 --2- 172.21.15.22:0/2259181321 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f527404b6e0 0x7f52740dc2e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f526c01ab50 tx=0x7f526c01ace0 comp rx=0 tx=0).stop 2024-05-21T13:36:27.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.266+0000 7f52820a2640 1 -- 172.21.15.22:0/2259181321 shutdown_connections 2024-05-21T13:36:27.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.266+0000 7f52820a2640 1 --2- 172.21.15.22:0/2259181321 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f526006f4d0 0x7f5260071990 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:27.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.266+0000 7f52820a2640 1 --2- 172.21.15.22:0/2259181321 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f527404b6e0 0x7f52740dc2e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:27.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.266+0000 7f52820a2640 1 --2- 172.21.15.22:0/2259181321 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f527404b300 0x7f527416cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:27.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.266+0000 7f52820a2640 1 --2- 172.21.15.22:0/2259181321 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5274046d80 0x7f52740dea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:27.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.266+0000 7f52820a2640 1 -- 172.21.15.22:0/2259181321 >> 172.21.15.22:0/2259181321 conn(0x7f5274050190 msgr2=0x7f527404e680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:27.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.266+0000 7f52820a2640 1 -- 172.21.15.22:0/2259181321 shutdown_connections 2024-05-21T13:36:27.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.266+0000 7f52820a2640 1 -- 172.21.15.22:0/2259181321 wait complete. 2024-05-21T13:36:27.244 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.266+0000 7f560f59e640 1 -- 172.21.15.22:0/2318967343 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f56080dc720 con 0x7f5608047110 2024-05-21T13:36:27.245 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.266+0000 7f55feffd640 1 -- 172.21.15.22:0/2318967343 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f56040f5030 con 0x7f5608047110 2024-05-21T13:36:27.245 INFO:teuthology.orchestra.run.smithi022.stdout:64424509451 2024-05-21T13:36:27.249 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.270+0000 7f560f59e640 1 -- 172.21.15.22:0/2318967343 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f55f006f430 msgr2=0x7f55f00718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:27.249 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.270+0000 7f560f59e640 1 --2- 172.21.15.22:0/2318967343 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f55f006f430 0x7f55f00718f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f5600006b50 tx=0x7f5600008040 comp rx=0 tx=0).stop 2024-05-21T13:36:27.249 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.270+0000 7f560f59e640 1 -- 172.21.15.22:0/2318967343 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5608047110 msgr2=0x7f56080e1940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:27.249 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.270+0000 7f560f59e640 1 --2- 172.21.15.22:0/2318967343 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5608047110 0x7f56080e1940 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5604000c10 tx=0x7f55f8005840 comp rx=0 tx=0).stop 2024-05-21T13:36:27.249 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.270+0000 7f560f59e640 1 -- 172.21.15.22:0/2318967343 shutdown_connections 2024-05-21T13:36:27.249 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.270+0000 7f560f59e640 1 --2- 172.21.15.22:0/2318967343 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f55f006f430 0x7f55f00718f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:27.249 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.270+0000 7f560f59e640 1 --2- 172.21.15.22:0/2318967343 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f56080e1e80 0x7f56080d5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:27.249 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.270+0000 7f560f59e640 1 --2- 172.21.15.22:0/2318967343 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5608047110 0x7f56080e1940 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:27.250 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.270+0000 7f560f59e640 1 --2- 172.21.15.22:0/2318967343 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f55f8004810 0x7f56081796f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:27.250 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.270+0000 7f560f59e640 1 -- 172.21.15.22:0/2318967343 >> 172.21.15.22:0/2318967343 conn(0x7f5608050190 msgr2=0x7f560804ab60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:27.250 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.270+0000 7f560f59e640 1 -- 172.21.15.22:0/2318967343 shutdown_connections 2024-05-21T13:36:27.250 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.270+0000 7f560f59e640 1 -- 172.21.15.22:0/2318967343 wait complete. 2024-05-21T13:36:27.256 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509452 got 64424509451 for osd.2 2024-05-21T13:36:27.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.278+0000 7efc35b91640 1 -- 172.21.15.22:0/304058996 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7efc2804b850 con 0x7efc280e5f30 2024-05-21T13:36:27.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.278+0000 7efc1bfff640 1 -- 172.21.15.22:0/304058996 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7efc300d8f40 con 0x7efc280e5f30 2024-05-21T13:36:27.258 INFO:teuthology.orchestra.run.smithi022.stdout:55834574857 2024-05-21T13:36:27.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.282+0000 7ffb76809640 1 -- 172.21.15.22:0/4013722171 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7ffb680db7c0 con 0x7ffb5c003ab0 2024-05-21T13:36:27.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.282+0000 7ffb667fc640 1 -- 172.21.15.22:0/4013722171 <== mon.1 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ffb70132070 con 0x7ffb5c003ab0 2024-05-21T13:36:27.260 INFO:teuthology.orchestra.run.smithi022.stdout:64424509451 2024-05-21T13:36:27.262 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.282+0000 7efc35b91640 1 -- 172.21.15.22:0/304058996 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7efc1406f430 msgr2=0x7efc140718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:27.262 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.282+0000 7efc35b91640 1 --2- 172.21.15.22:0/304058996 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7efc1406f430 0x7efc140718f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7efc1c006fd0 tx=0x7efc1c008040 comp rx=0 tx=0).stop 2024-05-21T13:36:27.262 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.282+0000 7efc35b91640 1 -- 172.21.15.22:0/304058996 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc280e5f30 msgr2=0x7efc280c6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:27.262 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.282+0000 7efc35b91640 1 --2- 172.21.15.22:0/304058996 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc280e5f30 0x7efc280c6210 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7efc300756a0 tx=0x7efc3006a2b0 comp rx=0 tx=0).stop 2024-05-21T13:36:27.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.286+0000 7efc35b91640 1 -- 172.21.15.22:0/304058996 shutdown_connections 2024-05-21T13:36:27.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.286+0000 7efc35b91640 1 --2- 172.21.15.22:0/304058996 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7efc1406f430 0x7efc140718f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:27.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.286+0000 7efc35b91640 1 --2- 172.21.15.22:0/304058996 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc280e2010 0x7efc280c6750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:27.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.286+0000 7efc35b91640 1 --2- 172.21.15.22:0/304058996 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc280e5f30 0x7efc280c6210 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:27.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.286+0000 7efc35b91640 1 --2- 172.21.15.22:0/304058996 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc200052f0 0x7efc28049bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:27.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.286+0000 7efc35b91640 1 -- 172.21.15.22:0/304058996 >> 172.21.15.22:0/304058996 conn(0x7efc28050190 msgr2=0x7efc28006e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:27.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.286+0000 7efc35b91640 1 -- 172.21.15.22:0/304058996 shutdown_connections 2024-05-21T13:36:27.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.286+0000 7efc35b91640 1 -- 172.21.15.22:0/304058996 wait complete. 2024-05-21T13:36:27.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.286+0000 7ffb76809640 1 -- 172.21.15.22:0/4013722171 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7ffb5406f4d0 msgr2=0x7ffb54071990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:27.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.286+0000 7ffb76809640 1 --2- 172.21.15.22:0/4013722171 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7ffb5406f4d0 0x7ffb54071990 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ffb68176a10 tx=0x7ffb60009040 comp rx=0 tx=0).stop 2024-05-21T13:36:27.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.290+0000 7ffb76809640 1 -- 172.21.15.22:0/4013722171 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffb5c003ab0 msgr2=0x7ffb680d5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:27.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.290+0000 7ffb76809640 1 --2- 172.21.15.22:0/4013722171 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffb5c003ab0 0x7ffb680d5380 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ffb7002e140 tx=0x7ffb70096810 comp rx=0 tx=0).stop 2024-05-21T13:36:27.267 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509452 got 64424509451 for osd.7 2024-05-21T13:36:27.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.294+0000 7ffb76809640 1 -- 172.21.15.22:0/4013722171 shutdown_connections 2024-05-21T13:36:27.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.294+0000 7ffb76809640 1 --2- 172.21.15.22:0/4013722171 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7ffb5406f4d0 0x7ffb54071990 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:27.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.294+0000 7ffb76809640 1 --2- 172.21.15.22:0/4013722171 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ffb680dac10 0x7ffb6804d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:27.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.294+0000 7ffb76809640 1 --2- 172.21.15.22:0/4013722171 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ffb680d58c0 0x7ffb6804caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:27.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.294+0000 7ffb76809640 1 --2- 172.21.15.22:0/4013722171 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ffb5c003ab0 0x7ffb680d5380 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:27.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.294+0000 7ffb76809640 1 -- 172.21.15.22:0/4013722171 >> 172.21.15.22:0/4013722171 conn(0x7ffb68050190 msgr2=0x7ffb680dbfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:27.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.294+0000 7ffb76809640 1 -- 172.21.15.22:0/4013722171 shutdown_connections 2024-05-21T13:36:27.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.294+0000 7ffb76809640 1 -- 172.21.15.22:0/4013722171 wait complete. 2024-05-21T13:36:27.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.294+0000 7f67edb5a640 1 -- 172.21.15.22:0/3795397041 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f67c8005590 con 0x7f67e8159fa0 2024-05-21T13:36:27.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.294+0000 7f67e57fa640 1 -- 172.21.15.22:0/3795397041 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f67e00fac10 con 0x7f67e8159fa0 2024-05-21T13:36:27.272 INFO:teuthology.orchestra.run.smithi022.stdout:60129542153 2024-05-21T13:36:27.274 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.298+0000 7f67edb5a640 1 -- 172.21.15.22:0/3795397041 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f67d406f430 msgr2=0x7f67d40718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:27.274 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.298+0000 7f67edb5a640 1 --2- 172.21.15.22:0/3795397041 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f67d406f430 0x7f67d40718f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f67dc000f70 tx=0x7f67dc007f70 comp rx=0 tx=0).stop 2024-05-21T13:36:27.274 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.298+0000 7f67edb5a640 1 -- 172.21.15.22:0/3795397041 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f67e8159fa0 msgr2=0x7f67e81495c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:27.274 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.298+0000 7f67edb5a640 1 --2- 172.21.15.22:0/3795397041 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f67e8159fa0 0x7f67e81495c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f67e8070d00 tx=0x7f67e001bee0 comp rx=0 tx=0).stop 2024-05-21T13:36:27.274 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.298+0000 7f67edb5a640 1 -- 172.21.15.22:0/3795397041 shutdown_connections 2024-05-21T13:36:27.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.298+0000 7f67edb5a640 1 --2- 172.21.15.22:0/3795397041 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f67d406f430 0x7f67d40718f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:27.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.298+0000 7f67edb5a640 1 --2- 172.21.15.22:0/3795397041 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f67e8159fa0 0x7f67e81495c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:27.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.298+0000 7f67edb5a640 1 --2- 172.21.15.22:0/3795397041 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f67e80c83f0 0x7f67e815cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:27.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.298+0000 7f67edb5a640 1 --2- 172.21.15.22:0/3795397041 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f67e806fc90 0x7f67e8157990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:27.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.298+0000 7f67edb5a640 1 -- 172.21.15.22:0/3795397041 >> 172.21.15.22:0/3795397041 conn(0x7f67e806e1c0 msgr2=0x7f67e815dbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:27.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.298+0000 7f67edb5a640 1 -- 172.21.15.22:0/3795397041 shutdown_connections 2024-05-21T13:36:27.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:27.298+0000 7f67edb5a640 1 -- 172.21.15.22:0/3795397041 wait complete. 2024-05-21T13:36:27.276 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509450 for osd.0 2024-05-21T13:36:27.276 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509450 for osd.3 2024-05-21T13:36:27.284 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509452 got 64424509451 for osd.1 2024-05-21T13:36:27.290 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.4 2024-05-21T13:36:27.291 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509452 got 64424509451 for osd.6 2024-05-21T13:36:27.297 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542153 for osd.5 2024-05-21T13:36:28.257 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-21T13:36:28.267 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-21T13:36:28.277 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-21T13:36:28.277 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-21T13:36:28.284 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-21T13:36:28.291 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-21T13:36:28.292 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-21T13:36:28.298 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-21T13:36:28.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.466+0000 7ff74ef7e640 1 Processor -- start 2024-05-21T13:36:28.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.466+0000 7ff74ef7e640 1 -- start start 2024-05-21T13:36:28.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.470+0000 7ff74ef7e640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff7480c9f40 0x7ff74815bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:28.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.470+0000 7ff74ef7e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff7480ca320 0x7ff748151a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:28.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.470+0000 7ff74ef7e640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff74815c0a0 con 0x7ff748072280 2024-05-21T13:36:28.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.470+0000 7ff74ef7e640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7ff7480c8800 con 0x7ff7480c9f40 2024-05-21T13:36:28.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.470+0000 7ff74ef7e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7ff7480c8ae0 con 0x7ff7480ca320 2024-05-21T13:36:28.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.470+0000 7ff74cd1a640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff7480c9f40 0x7ff74815bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:28.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.470+0000 7ff74cd1a640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff7480c9f40 0x7ff74815bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.22:36546/0 (socket says 172.21.15.22:36546) 2024-05-21T13:36:28.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.470+0000 7ff74cd1a640 1 -- 172.21.15.22:0/4141034948 learned_addr learned my addr 172.21.15.22:0/4141034948 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:28.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.470+0000 7ff747fff640 1 --2- 172.21.15.22:0/4141034948 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff7480ca320 0x7ff748151a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:28.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.470+0000 7ff74cd1a640 1 -- 172.21.15.22:0/4141034948 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff7480ca320 msgr2=0x7ff748151a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:28.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.470+0000 7ff74cd1a640 1 --2- 172.21.15.22:0/4141034948 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff7480ca320 0x7ff748151a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:28.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.470+0000 7ff74cd1a640 1 -- 172.21.15.22:0/4141034948 >> v1:172.21.15.115:6789/0 conn(0x7ff748072280 legacy=0x7ff748073030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:28.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.470+0000 7ff74cd1a640 1 -- 172.21.15.22:0/4141034948 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7480c8dc0 con 0x7ff7480c9f40 2024-05-21T13:36:28.452 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.474+0000 7ff74cd1a640 1 --2- 172.21.15.22:0/4141034948 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff7480c9f40 0x7ff74815bb60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff738008870 tx=0x7ff73801ea80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9091db286d8ae45 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:28.452 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.474+0000 7ff7477fe640 1 -- 172.21.15.22:0/4141034948 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff7380ad070 con 0x7ff7480c9f40 2024-05-21T13:36:28.452 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.474+0000 7ff7477fe640 1 -- 172.21.15.22:0/4141034948 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff7380a7b50 con 0x7ff7480c9f40 2024-05-21T13:36:28.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.474+0000 7ff74ef7e640 1 -- 172.21.15.22:0/4141034948 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff7480c9f40 msgr2=0x7ff74815bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:28.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.474+0000 7ff74ef7e640 1 --2- 172.21.15.22:0/4141034948 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff7480c9f40 0x7ff74815bb60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff738008870 tx=0x7ff73801ea80 comp rx=0 tx=0).stop 2024-05-21T13:36:28.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.474+0000 7ff74ef7e640 1 -- 172.21.15.22:0/4141034948 shutdown_connections 2024-05-21T13:36:28.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.474+0000 7ff74ef7e640 1 --2- 172.21.15.22:0/4141034948 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff7480ca320 0x7ff748151a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:28.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.474+0000 7ff74ef7e640 1 --2- 172.21.15.22:0/4141034948 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff7480c9f40 0x7ff74815bb60 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:28.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.474+0000 7ff74ef7e640 1 -- 172.21.15.22:0/4141034948 >> 172.21.15.22:0/4141034948 conn(0x7ff7480703a0 msgr2=0x7ff7480cd250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:28.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.474+0000 7ff74ef7e640 1 -- 172.21.15.22:0/4141034948 shutdown_connections 2024-05-21T13:36:28.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.474+0000 7ff74ef7e640 1 -- 172.21.15.22:0/4141034948 wait complete. 2024-05-21T13:36:28.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.478+0000 7ff74ef7e640 1 Processor -- start 2024-05-21T13:36:28.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.478+0000 7ff74ef7e640 1 -- start start 2024-05-21T13:36:28.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.478+0000 7ff74ef7e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff748072280 0x7ff7481f71b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:28.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.478+0000 7ff74ef7e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff7480c9f40 0x7ff7481f5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:28.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.478+0000 7ff74ef7e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff7480ca320 0x7ff7480cb710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:28.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.478+0000 7ff74ef7e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff748152100 con 0x7ff7480c9f40 2024-05-21T13:36:28.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.478+0000 7ff74ef7e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7ff748151f80 con 0x7ff748072280 2024-05-21T13:36:28.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.478+0000 7ff74ef7e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7ff748152280 con 0x7ff7480ca320 2024-05-21T13:36:28.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.478+0000 7ff747fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff7480c9f40 0x7ff7481f5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:28.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.478+0000 7ff747fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff7480c9f40 0x7ff7481f5110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48344/0 (socket says 172.21.15.22:48344) 2024-05-21T13:36:28.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.478+0000 7ff747fff640 1 -- 172.21.15.22:0/31670051 learned_addr learned my addr 172.21.15.22:0/31670051 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:28.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.478+0000 7ff74d51b640 1 --2- 172.21.15.22:0/31670051 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff7480ca320 0x7ff7480cb710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:28.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.478+0000 7ff74cd1a640 1 --2- 172.21.15.22:0/31670051 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff748072280 0x7ff7481f71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:28.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.478+0000 7ff747fff640 1 -- 172.21.15.22:0/31670051 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff7480ca320 msgr2=0x7ff7480cb710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:28.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.478+0000 7ff747fff640 1 --2- 172.21.15.22:0/31670051 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff7480ca320 0x7ff7480cb710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:28.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.478+0000 7ff747fff640 1 -- 172.21.15.22:0/31670051 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff748072280 msgr2=0x7ff7481f71b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:28.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.478+0000 7ff747fff640 1 --2- 172.21.15.22:0/31670051 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff748072280 0x7ff7481f71b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:28.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.478+0000 7ff747fff640 1 -- 172.21.15.22:0/31670051 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7481f17d0 con 0x7ff7480c9f40 2024-05-21T13:36:28.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.482+0000 7ff74d51b640 1 --2- 172.21.15.22:0/31670051 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff7480ca320 0x7ff7480cb710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T13:36:28.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.482+0000 7ff747fff640 1 --2- 172.21.15.22:0/31670051 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff7480c9f40 0x7ff7481f5110 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff74000eed0 tx=0x7ff74000b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:28.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.482+0000 7ff7457fa640 1 -- 172.21.15.22:0/31670051 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff740018020 con 0x7ff7480c9f40 2024-05-21T13:36:28.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.482+0000 7ff74ef7e640 1 -- 172.21.15.22:0/31670051 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7481f1ab0 con 0x7ff7480c9f40 2024-05-21T13:36:28.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.482+0000 7ff74ef7e640 1 -- 172.21.15.22:0/31670051 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7481f2070 con 0x7ff7480c9f40 2024-05-21T13:36:28.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.482+0000 7ff7457fa640 1 -- 172.21.15.22:0/31670051 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff74000bd30 con 0x7ff7480c9f40 2024-05-21T13:36:28.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.482+0000 7ff7457fa640 1 -- 172.21.15.22:0/31670051 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff740014620 con 0x7ff7480c9f40 2024-05-21T13:36:28.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.486+0000 7ff7457fa640 1 -- 172.21.15.22:0/31670051 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ff74001b020 con 0x7ff7480c9f40 2024-05-21T13:36:28.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.486+0000 7ff7457fa640 1 --2- 172.21.15.22:0/31670051 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7ff73006f620 0x7ff730071ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:28.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.486+0000 7ff7457fa640 1 -- 172.21.15.22:0/31670051 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7ff74008fea0 con 0x7ff7480c9f40 2024-05-21T13:36:28.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.486+0000 7ff74cd1a640 1 --2- 172.21.15.22:0/31670051 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7ff73006f620 0x7ff730071ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:28.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.486+0000 7ff74cd1a640 1 --2- 172.21.15.22:0/31670051 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7ff73006f620 0x7ff730071ae0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff7380b2000 tx=0x7ff738008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:28.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.490+0000 7ff74ef7e640 1 -- 172.21.15.22:0/31670051 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7280052a0 con 0x7ff7480c9f40 2024-05-21T13:36:28.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.498+0000 7ff7457fa640 1 -- 172.21.15.22:0/31670051 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7ff740022030 con 0x7ff7480c9f40 2024-05-21T13:36:28.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.510+0000 7fe20c737640 1 Processor -- start 2024-05-21T13:36:28.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.510+0000 7fe20c737640 1 -- start start 2024-05-21T13:36:28.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.510+0000 7f88c09ac640 1 Processor -- start 2024-05-21T13:36:28.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.510+0000 7fe20c737640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe204152120 0x7fe20415b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:28.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.510+0000 7fe20c737640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe204158a50 0x7fe20406df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:28.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.510+0000 7fe20c737640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe20415b950 con 0x7fe204158630 2024-05-21T13:36:28.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.510+0000 7fe20c737640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7fe2041581a0 con 0x7fe204158a50 2024-05-21T13:36:28.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.510+0000 7fe20c737640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7fe20415bc30 con 0x7fe204152120 2024-05-21T13:36:28.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.510+0000 7f88c09ac640 1 -- start start 2024-05-21T13:36:28.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.510+0000 7fe20acd4640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe204158a50 0x7fe20406df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:28.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.510+0000 7fe209cd2640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fe204158630 0x7fe204072690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.22:48370/0 (socket says 172.21.15.22:48370) 2024-05-21T13:36:28.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.510+0000 7fe20acd4640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe204158a50 0x7fe20406df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.22:36554/0 (socket says 172.21.15.22:36554) 2024-05-21T13:36:28.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.510+0000 7fe209cd2640 1 -- 172.21.15.22:0/3518365941 learned_addr learned my addr 172.21.15.22:0/3518365941 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-21T13:36:28.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.510+0000 7f88c09ac640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f88bc0c8310 0x7f88bc0c7080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:28.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.510+0000 7f88c09ac640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f88bc0c55f0 0x7f88bc0c75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:28.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.510+0000 7f88c09ac640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88bc0704c0 con 0x7f88bc152ab0 2024-05-21T13:36:28.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.510+0000 7f88c09ac640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f88bc0710b0 con 0x7f88bc0c8310 2024-05-21T13:36:28.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.510+0000 7f88c09ac640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f88bc1594f0 con 0x7f88bc0c55f0 2024-05-21T13:36:28.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.510+0000 7fe20a4d3640 1 --2- 172.21.15.22:0/3518365941 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe204152120 0x7fe20415b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:28.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.510+0000 7fda6f59e640 1 Processor -- start 2024-05-21T13:36:28.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.510+0000 7f88b9d9b640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f88bc0c8310 0x7f88bc0c7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:28.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.510+0000 7f88b9d9b640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f88bc0c8310 0x7f88bc0c7080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.22:36558/0 (socket says 172.21.15.22:36558) 2024-05-21T13:36:28.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.510+0000 7f88b9d9b640 1 -- 172.21.15.22:0/3108350887 learned_addr learned my addr 172.21.15.22:0/3108350887 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:28.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.510+0000 7fe2094d1640 1 -- 172.21.15.22:0/3518365941 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1438476603 0 0) 0x7fe20415b950 con 0x7fe204158630 2024-05-21T13:36:28.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.514+0000 7fe2094d1640 1 -- 172.21.15.22:0/3518365941 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe1f0005740 con 0x7fe204158630 2024-05-21T13:36:28.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.514+0000 7f88bad9d640 1 --2- 172.21.15.22:0/3108350887 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f88bc0c55f0 0x7f88bc0c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:28.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.514+0000 7f88b9d9b640 1 -- 172.21.15.22:0/3108350887 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f88bc0c55f0 msgr2=0x7f88bc0c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:28.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.514+0000 7f88b9d9b640 1 --2- 172.21.15.22:0/3108350887 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f88bc0c55f0 0x7f88bc0c75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:28.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.514+0000 7f88b9d9b640 1 -- 172.21.15.22:0/3108350887 >> v1:172.21.15.115:6789/0 conn(0x7f88bc152ab0 legacy=0x7f88bc073350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:28.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.514+0000 7f88b9d9b640 1 -- 172.21.15.22:0/3108350887 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88bc070780 con 0x7f88bc0c8310 2024-05-21T13:36:28.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.514+0000 7f452be3e640 1 Processor -- start 2024-05-21T13:36:28.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.514+0000 7fb7a68fc640 1 Processor -- start 2024-05-21T13:36:28.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.510+0000 7fda6f59e640 1 -- start start 2024-05-21T13:36:28.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.514+0000 7fda6f59e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fda700c71c0 0x7fda70072b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:28.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.514+0000 7fda6f59e640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda70160e50 con 0x7fda7015a120 2024-05-21T13:36:28.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.514+0000 7fda6f59e640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda700724b0 con 0x7fda700732b0 2024-05-21T13:36:28.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.514+0000 7fda6f59e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7fda70073090 con 0x7fda700c71c0 2024-05-21T13:36:28.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.514+0000 7fda6ed9d640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fda700732b0 0x7fda7016a7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.22:48396/0 (socket says 172.21.15.22:48396) 2024-05-21T13:36:28.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.514+0000 7fda6ed9d640 1 -- 172.21.15.22:0/688316707 learned_addr learned my addr 172.21.15.22:0/688316707 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-21T13:36:28.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.514+0000 7fda6dd9b640 1 --2- 172.21.15.22:0/688316707 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fda700c71c0 0x7fda70072b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:28.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.514+0000 7fda6d59a640 1 -- 172.21.15.22:0/688316707 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2086130291 0 0) 0x7fda700724b0 con 0x7fda700732b0 2024-05-21T13:36:28.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.514+0000 7fda6d59a640 1 -- 172.21.15.22:0/688316707 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda58003530 con 0x7fda700732b0 2024-05-21T13:36:28.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.514+0000 7f452be3e640 1 -- start start 2024-05-21T13:36:28.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.514+0000 7f452be3e640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4524153ae0 0x7f45240cb3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:28.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.514+0000 7f452be3e640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f45240cceb0 0x7f4524164290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:28.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.514+0000 7f452be3e640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f452415da90 con 0x7f45240caee0 2024-05-21T13:36:28.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.514+0000 7f452be3e640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f452415a2b0 con 0x7f4524153ae0 2024-05-21T13:36:28.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.514+0000 7f452be3e640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f452415dd70 con 0x7f45240cceb0 2024-05-21T13:36:28.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.514+0000 7fb7a68fc640 1 -- start start 2024-05-21T13:36:28.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.514+0000 7fb7a68fc640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb7a00c8650 0x7fb7a00c4da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:28.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.514+0000 7fb7a68fc640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb7a00c9a20 0x7fb7a016a720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:28.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.514+0000 7fb7a68fc640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7a0163340 con 0x7fb7a00c9640 2024-05-21T13:36:28.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.514+0000 7fb7a68fc640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fb7a0163f10 con 0x7fb7a00c8650 2024-05-21T13:36:28.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.514+0000 7fb7a68fc640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7fb7a00ca340 con 0x7fb7a00c9a20 2024-05-21T13:36:28.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.514+0000 7fda6d59a640 1 -- 172.21.15.22:0/688316707 <== mon.1 v1:172.21.15.115:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2369009753 0 0) 0x7fda58003530 con 0x7fda700732b0 2024-05-21T13:36:28.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.514+0000 7fda6d59a640 1 -- 172.21.15.22:0/688316707 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fda700c71c0 msgr2=0x7fda70072b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:28.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.514+0000 7fda6d59a640 1 --2- 172.21.15.22:0/688316707 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fda700c71c0 0x7fda70072b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:28.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.514+0000 7fda6d59a640 1 -- 172.21.15.22:0/688316707 >> v1:172.21.15.22:6789/0 conn(0x7fda7015a120 legacy=0x7fda70163460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:28.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.514+0000 7fda6d59a640 1 -- 172.21.15.22:0/688316707 --> v1:172.21.15.115:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda70160090 con 0x7fda700732b0 2024-05-21T13:36:28.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.514+0000 7fda6d59a640 1 -- 172.21.15.22:0/688316707 <== mon.1 v1:172.21.15.115:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2684847062 0 0) 0x7fda68001a80 con 0x7fda700732b0 2024-05-21T13:36:28.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.514+0000 7fda6d59a640 1 -- 172.21.15.22:0/688316707 >> v1:172.21.15.115:6789/0 conn(0x7fda700732b0 legacy=0x7fda7016a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:28.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.514+0000 7fda6d59a640 1 --2- 172.21.15.22:0/688316707 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda58003a10 0x7fda58003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:28.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.514+0000 7fda6d59a640 1 --2- 172.21.15.22:0/688316707 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fda58004810 0x7fda58004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:28.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.514+0000 7fda6d59a640 1 --2- 172.21.15.22:0/688316707 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fda580051d0 0x7fda5800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:28.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.514+0000 7fda6d59a640 1 -- 172.21.15.22:0/688316707 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fda70073090 con 0x7fda58004810 2024-05-21T13:36:28.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.514+0000 7fda6d59a640 1 -- 172.21.15.22:0/688316707 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fda5800bfc0 con 0x7fda58003a10 2024-05-21T13:36:28.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.514+0000 7fda6d59a640 1 -- 172.21.15.22:0/688316707 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7fda5800c1c0 con 0x7fda580051d0 2024-05-21T13:36:28.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.514+0000 7fe20a4d3640 1 -- 172.21.15.22:0/3518365941 >> v2:172.21.15.115:3300/0 conn(0x7fe204158a50 msgr2=0x7fe20406df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:28.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.514+0000 7fe20a4d3640 1 --2- 172.21.15.22:0/3518365941 >> v2:172.21.15.115:3300/0 conn(0x7fe204158a50 0x7fe20406df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:28.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.514+0000 7fe20a4d3640 1 -- 172.21.15.22:0/3518365941 >> v1:172.21.15.115:6789/0 conn(0x7fe204158630 legacy=0x7fe204072690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:28.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.514+0000 7fe20a4d3640 1 -- 172.21.15.22:0/3518365941 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe20415bf10 con 0x7fe204152120 2024-05-21T13:36:28.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.514+0000 7f4529bda640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4524153ae0 0x7f45240cb3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:28.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.514+0000 7f45293d9640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f45240caee0 0x7f45240c5170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:44568/0 (socket says 172.21.15.22:44568) 2024-05-21T13:36:28.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.514+0000 7f45293d9640 1 -- 172.21.15.22:0/1422615393 learned_addr learned my addr 172.21.15.22:0/1422615393 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-21T13:36:28.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.514+0000 7fb7a50f9640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb7a00c8650 0x7fb7a00c4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:28.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.514+0000 7fb7a58fa640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fb7a00c9640 0x7fb7a00c66b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:44582/0 (socket says 172.21.15.22:44582) 2024-05-21T13:36:28.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.514+0000 7fb7a58fa640 1 -- 172.21.15.22:0/2018921005 learned_addr learned my addr 172.21.15.22:0/2018921005 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-21T13:36:28.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.514+0000 7fda6dd9b640 1 --2- 172.21.15.22:0/688316707 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fda58004810 0x7fda58004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:28.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.514+0000 7f452a3db640 1 --2- 172.21.15.22:0/1422615393 >> v2:172.21.15.115:3300/0 conn(0x7f45240cceb0 0x7f4524164290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:28.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.514+0000 7fda6ed9d640 1 --2- 172.21.15.22:0/688316707 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fda580051d0 0x7fda5800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:28.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.514+0000 7fda6e59c640 1 --2- 172.21.15.22:0/688316707 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda58003a10 0x7fda58003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:28.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.514+0000 7fe20a4d3640 1 --2- 172.21.15.22:0/3518365941 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe204152120 0x7fe20415b310 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe2000097c0 tx=0x7fe20001ecb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4fc3b9be36cd5ee server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:28.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.514+0000 7f4529bda640 1 -- 172.21.15.22:0/1422615393 >> v2:172.21.15.115:3300/0 conn(0x7f45240cceb0 msgr2=0x7f4524164290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:28.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.514+0000 7f4529bda640 1 --2- 172.21.15.22:0/1422615393 >> v2:172.21.15.115:3300/0 conn(0x7f45240cceb0 0x7f4524164290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:28.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.514+0000 7f4529bda640 1 -- 172.21.15.22:0/1422615393 >> v1:172.21.15.22:6789/0 conn(0x7f45240caee0 legacy=0x7f45240c5170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:28.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.514+0000 7fda6dd9b640 1 -- 172.21.15.22:0/688316707 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fda580051d0 msgr2=0x7fda5800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:28.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.514+0000 7fda6dd9b640 1 --2- 172.21.15.22:0/688316707 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fda580051d0 0x7fda5800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:28.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.514+0000 7fda6dd9b640 1 -- 172.21.15.22:0/688316707 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda58003a10 msgr2=0x7fda58003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:28.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.514+0000 7fda6dd9b640 1 --2- 172.21.15.22:0/688316707 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda58003a10 0x7fda58003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:28.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.518+0000 7fda6dd9b640 1 -- 172.21.15.22:0/688316707 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda70160090 con 0x7fda58004810 2024-05-21T13:36:28.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.518+0000 7fe2094d1640 1 -- 172.21.15.22:0/3518365941 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2000b5070 con 0x7fe204152120 2024-05-21T13:36:28.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.518+0000 7fe2094d1640 1 -- 172.21.15.22:0/3518365941 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2000a89b0 con 0x7fe204152120 2024-05-21T13:36:28.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.518+0000 7fe2094d1640 1 -- 172.21.15.22:0/3518365941 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2000a8d80 con 0x7fe204152120 2024-05-21T13:36:28.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.514+0000 7f4529bda640 1 -- 172.21.15.22:0/1422615393 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4524159c60 con 0x7f4524153ae0 2024-05-21T13:36:28.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.518+0000 7f88b9d9b640 1 --2- 172.21.15.22:0/3108350887 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f88bc0c8310 0x7f88bc0c7080 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f88b0009870 tx=0x7f88b001ed50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88a3b1b543435505 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:28.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.518+0000 7fb7a50f9640 1 -- 172.21.15.22:0/2018921005 >> v2:172.21.15.115:3300/0 conn(0x7fb7a00c9a20 msgr2=0x7fb7a016a720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:28.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.518+0000 7fb7a48f8640 1 -- 172.21.15.22:0/2018921005 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3290097195 0 0) 0x7fb7a0163340 con 0x7fb7a00c9640 2024-05-21T13:36:28.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.518+0000 7fb7a60fb640 1 --2- 172.21.15.22:0/2018921005 >> v2:172.21.15.115:3300/0 conn(0x7fb7a00c9a20 0x7fb7a016a720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:28.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.518+0000 7fb7a50f9640 1 --2- 172.21.15.22:0/2018921005 >> v2:172.21.15.115:3300/0 conn(0x7fb7a00c9a20 0x7fb7a016a720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:28.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.518+0000 7fb7a50f9640 1 -- 172.21.15.22:0/2018921005 >> v1:172.21.15.22:6789/0 conn(0x7fb7a00c9640 legacy=0x7fb7a00c66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:28.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.518+0000 7fb7a50f9640 1 -- 172.21.15.22:0/2018921005 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7a01635e0 con 0x7fb7a00c8650 2024-05-21T13:36:28.506 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.518+0000 7f8a588d9640 1 Processor -- start 2024-05-21T13:36:28.506 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.518+0000 7f8a588d9640 1 -- start start 2024-05-21T13:36:28.506 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.518+0000 7f8a588d9640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8a54155e20 0x7f8a540c72a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:28.506 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.518+0000 7f8a588d9640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8a54068c20 0x7f8a540ccbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:28.506 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.518+0000 7f8a588d9640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a540cbeb0 con 0x7f8a5415f020 2024-05-21T13:36:28.506 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.518+0000 7f8a588d9640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f8a54069070 con 0x7f8a54155e20 2024-05-21T13:36:28.506 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.518+0000 7f8a588d9640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f8a54156200 con 0x7f8a54068c20 2024-05-21T13:36:28.506 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.518+0000 7f8a537fe640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8a54155e20 0x7f8a540c72a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:28.506 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.518+0000 7f8a537fe640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8a54155e20 0x7f8a540c72a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48372/0 (socket says 172.21.15.22:48372) 2024-05-21T13:36:28.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.518+0000 7f8a537fe640 1 -- 172.21.15.22:0/2509821398 learned_addr learned my addr 172.21.15.22:0/2509821398 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:28.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.518+0000 7fe20c737640 1 -- 172.21.15.22:0/3518365941 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe204152120 msgr2=0x7fe20415b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:28.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.518+0000 7fe20c737640 1 --2- 172.21.15.22:0/3518365941 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe204152120 0x7fe20415b310 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe2000097c0 tx=0x7fe20001ecb0 comp rx=0 tx=0).stop 2024-05-21T13:36:28.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.518+0000 7fe20c737640 1 -- 172.21.15.22:0/3518365941 shutdown_connections 2024-05-21T13:36:28.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.518+0000 7fe20c737640 1 --2- 172.21.15.22:0/3518365941 >> v2:172.21.15.115:3300/0 conn(0x7fe204158a50 0x7fe20406df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:28.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.518+0000 7fe20c737640 1 --2- 172.21.15.22:0/3518365941 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe204152120 0x7fe20415b310 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:28.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.518+0000 7fe20c737640 1 -- 172.21.15.22:0/3518365941 >> 172.21.15.22:0/3518365941 conn(0x7fe20406ce70 msgr2=0x7fe2040cd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:28.507 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.518+0000 7fe20c737640 1 -- 172.21.15.22:0/3518365941 shutdown_connections 2024-05-21T13:36:28.508 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.518+0000 7f4529bda640 1 --2- 172.21.15.22:0/1422615393 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4524153ae0 0x7f45240cb3a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f452406fe40 tx=0x7f451c01f110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19d5081bfabb083e server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:28.508 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.518+0000 7f88b959a640 1 -- 172.21.15.22:0/3108350887 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88b00b5070 con 0x7f88bc0c8310 2024-05-21T13:36:28.508 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.518+0000 7f88b959a640 1 -- 172.21.15.22:0/3108350887 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88b00a89d0 con 0x7f88bc0c8310 2024-05-21T13:36:28.508 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.518+0000 7f88b959a640 1 -- 172.21.15.22:0/3108350887 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88b00a8da0 con 0x7f88bc0c8310 2024-05-21T13:36:28.508 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.518+0000 7f88c09ac640 1 -- 172.21.15.22:0/3108350887 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f88bc0c8310 msgr2=0x7f88bc0c7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:28.508 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.518+0000 7f88c09ac640 1 --2- 172.21.15.22:0/3108350887 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f88bc0c8310 0x7f88bc0c7080 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f88b0009870 tx=0x7f88b001ed50 comp rx=0 tx=0).stop 2024-05-21T13:36:28.508 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.518+0000 7f88c09ac640 1 -- 172.21.15.22:0/3108350887 shutdown_connections 2024-05-21T13:36:28.508 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.518+0000 7f88c09ac640 1 --2- 172.21.15.22:0/3108350887 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f88bc0c55f0 0x7f88bc0c75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:28.508 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.518+0000 7f88c09ac640 1 --2- 172.21.15.22:0/3108350887 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f88bc0c8310 0x7f88bc0c7080 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:28.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.518+0000 7f88c09ac640 1 -- 172.21.15.22:0/3108350887 >> 172.21.15.22:0/3108350887 conn(0x7f88bc0cabf0 msgr2=0x7f88bc0cb000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:28.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.518+0000 7f88c09ac640 1 -- 172.21.15.22:0/3108350887 shutdown_connections 2024-05-21T13:36:28.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.518+0000 7f4528bd8640 1 -- 172.21.15.22:0/1422615393 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f451c0b4070 con 0x7f4524153ae0 2024-05-21T13:36:28.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.518+0000 7f4528bd8640 1 -- 172.21.15.22:0/1422615393 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f451c0af600 con 0x7f4524153ae0 2024-05-21T13:36:28.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.518+0000 7f4528bd8640 1 -- 172.21.15.22:0/1422615393 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f451c0af9d0 con 0x7f4524153ae0 2024-05-21T13:36:28.509 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.518+0000 7f88c09ac640 1 -- 172.21.15.22:0/3108350887 wait complete. 2024-05-21T13:36:28.510 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.518+0000 7fb7a50f9640 1 --2- 172.21.15.22:0/2018921005 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb7a00c8650 0x7fb7a00c4da0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb7a00c8d60 tx=0x7fb79801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adc9399bb4a7f8e6 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:28.510 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.518+0000 7f452be3e640 1 -- 172.21.15.22:0/1422615393 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4524153ae0 msgr2=0x7f45240cb3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:28.510 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.518+0000 7f452be3e640 1 --2- 172.21.15.22:0/1422615393 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4524153ae0 0x7f45240cb3a0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f452406fe40 tx=0x7f451c01f110 comp rx=0 tx=0).stop 2024-05-21T13:36:28.510 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.522+0000 7fb7a48f8640 1 -- 172.21.15.22:0/2018921005 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7980a66f0 con 0x7fb7a00c8650 2024-05-21T13:36:28.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.522+0000 7fb7a48f8640 1 -- 172.21.15.22:0/2018921005 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7980a6890 con 0x7fb7a00c8650 2024-05-21T13:36:28.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.522+0000 7fb7a48f8640 1 -- 172.21.15.22:0/2018921005 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7980a6c60 con 0x7fb7a00c8650 2024-05-21T13:36:28.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.522+0000 7f8a537fe640 1 -- 172.21.15.22:0/2509821398 >> v2:172.21.15.115:3300/0 conn(0x7f8a54068c20 msgr2=0x7f8a540ccbe0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-21T13:36:28.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.522+0000 7f8a537fe640 1 --2- 172.21.15.22:0/2509821398 >> v2:172.21.15.115:3300/0 conn(0x7f8a54068c20 0x7f8a540ccbe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:28.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.522+0000 7f8a537fe640 1 -- 172.21.15.22:0/2509821398 >> v1:172.21.15.115:6789/0 conn(0x7f8a5415f020 legacy=0x7f8a5415f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:28.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.522+0000 7f8a537fe640 1 -- 172.21.15.22:0/2509821398 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a5406dfa0 con 0x7f8a54155e20 2024-05-21T13:36:28.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.522+0000 7f452be3e640 1 -- 172.21.15.22:0/1422615393 shutdown_connections 2024-05-21T13:36:28.511 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.522+0000 7f452be3e640 1 --2- 172.21.15.22:0/1422615393 >> v2:172.21.15.115:3300/0 conn(0x7f45240cceb0 0x7f4524164290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:28.512 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.522+0000 7f452be3e640 1 --2- 172.21.15.22:0/1422615393 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4524153ae0 0x7f45240cb3a0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:28.512 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.522+0000 7f452be3e640 1 -- 172.21.15.22:0/1422615393 >> 172.21.15.22:0/1422615393 conn(0x7f45240722b0 msgr2=0x7f45240726c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:28.512 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.518+0000 7fe20c737640 1 -- 172.21.15.22:0/3518365941 wait complete. 2024-05-21T13:36:28.512 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.522+0000 7f88c09ac640 1 Processor -- start 2024-05-21T13:36:28.512 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.522+0000 7fb7a68fc640 1 -- 172.21.15.22:0/2018921005 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb7a00c8650 msgr2=0x7fb7a00c4da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:28.513 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.522+0000 7fb7a68fc640 1 --2- 172.21.15.22:0/2018921005 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb7a00c8650 0x7fb7a00c4da0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fb7a00c8d60 tx=0x7fb79801c930 comp rx=0 tx=0).stop 2024-05-21T13:36:28.513 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.522+0000 7fb7a68fc640 1 -- 172.21.15.22:0/2018921005 shutdown_connections 2024-05-21T13:36:28.513 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.522+0000 7fb7a68fc640 1 --2- 172.21.15.22:0/2018921005 >> v2:172.21.15.115:3300/0 conn(0x7fb7a00c9a20 0x7fb7a016a720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:28.513 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.522+0000 7fb7a68fc640 1 --2- 172.21.15.22:0/2018921005 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb7a00c8650 0x7fb7a00c4da0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:28.513 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.522+0000 7fb7a68fc640 1 -- 172.21.15.22:0/2018921005 >> 172.21.15.22:0/2018921005 conn(0x7fb7a006c720 msgr2=0x7fb7a006cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:28.513 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.522+0000 7fb7a68fc640 1 -- 172.21.15.22:0/2018921005 shutdown_connections 2024-05-21T13:36:28.513 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.522+0000 7fb7a68fc640 1 -- 172.21.15.22:0/2018921005 wait complete. 2024-05-21T13:36:28.513 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.522+0000 7fda6dd9b640 1 --2- 172.21.15.22:0/688316707 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fda58004810 0x7fda58004c90 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fda60009980 tx=0x7fda6001c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=400bdfef97079206 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:28.514 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.522+0000 7fda6d59a640 1 -- 172.21.15.22:0/688316707 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda60009650 con 0x7fda58004810 2024-05-21T13:36:28.514 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.522+0000 7fda6d59a640 1 -- 172.21.15.22:0/688316707 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda600a6510 con 0x7fda58004810 2024-05-21T13:36:28.514 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.522+0000 7fda6d59a640 1 -- 172.21.15.22:0/688316707 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda600a6940 con 0x7fda58004810 2024-05-21T13:36:28.514 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.522+0000 7fe20c737640 1 Processor -- start 2024-05-21T13:36:28.514 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.522+0000 7f452be3e640 1 -- 172.21.15.22:0/1422615393 shutdown_connections 2024-05-21T13:36:28.514 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.522+0000 7f452be3e640 1 -- 172.21.15.22:0/1422615393 wait complete. 2024-05-21T13:36:28.514 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.522+0000 7f452be3e640 1 Processor -- start 2024-05-21T13:36:28.515 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.522+0000 7f88c09ac640 1 -- start start 2024-05-21T13:36:28.515 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.522+0000 7f88c09ac640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f88bc0c55f0 0x7f88bc0c9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:28.515 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.522+0000 7f88c09ac640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f88bc0c8310 0x7f88bc158160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:28.515 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.522+0000 7f88c09ac640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88bc152ab0 0x7f88bc0cd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:28.515 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.522+0000 7f88c09ac640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f88bc06e810 con 0x7f88bc152ab0 2024-05-21T13:36:28.516 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.522+0000 7f88c09ac640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f88bc070d40 con 0x7f88bc0c8310 2024-05-21T13:36:28.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.522+0000 7f88c09ac640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f88bc073a60 con 0x7f88bc0c55f0 2024-05-21T13:36:28.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.522+0000 7f88ba59c640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f88bc0c55f0 0x7f88bc0c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:28.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.522+0000 7f88ba59c640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f88bc0c55f0 0x7f88bc0c9180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.22:42090/0 (socket says 172.21.15.22:42090) 2024-05-21T13:36:28.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.522+0000 7f88ba59c640 1 -- 172.21.15.22:0/2052224882 learned_addr learned my addr 172.21.15.22:0/2052224882 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:28.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.522+0000 7f88b9d9b640 1 --2- 172.21.15.22:0/2052224882 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f88bc0c8310 0x7f88bc158160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:28.517 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.522+0000 7f452be3e640 1 -- start start 2024-05-21T13:36:28.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.522+0000 7fb7a68fc640 1 Processor -- start 2024-05-21T13:36:28.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.522+0000 7fe20c737640 1 -- start start 2024-05-21T13:36:28.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.522+0000 7fe20c737640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe204152120 0x7fe20415afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:28.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.522+0000 7fe20c737640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe204158630 0x7fe2040c1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:28.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.522+0000 7fe20c737640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe204158a50 0x7fe2040c23b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:28.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.522+0000 7fe20c737640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe204073330 con 0x7fe204152120 2024-05-21T13:36:28.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.522+0000 7fe20c737640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fe204157e30 con 0x7fe204158a50 2024-05-21T13:36:28.518 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.522+0000 7fe20c737640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7fe204072da0 con 0x7fe204158630 2024-05-21T13:36:28.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.522+0000 7fda6f59e640 1 -- 172.21.15.22:0/688316707 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fda58004810 msgr2=0x7fda58004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:28.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.522+0000 7fda6f59e640 1 --2- 172.21.15.22:0/688316707 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fda58004810 0x7fda58004c90 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fda60009980 tx=0x7fda6001c910 comp rx=0 tx=0).stop 2024-05-21T13:36:28.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.522+0000 7fda6ed9d640 1 -- 172.21.15.22:0/688316707 reap_dead start 2024-05-21T13:36:28.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.522+0000 7fda6f59e640 1 -- 172.21.15.22:0/688316707 shutdown_connections 2024-05-21T13:36:28.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.522+0000 7fda6f59e640 1 -- 172.21.15.22:0/688316707 >> 172.21.15.22:0/688316707 conn(0x7fda700cd1e0 msgr2=0x7fda700cd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:28.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.522+0000 7fda6f59e640 1 -- 172.21.15.22:0/688316707 shutdown_connections 2024-05-21T13:36:28.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.522+0000 7f88ba59c640 1 -- 172.21.15.22:0/2052224882 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f88bc0c8310 msgr2=0x7f88bc158160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:28.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.522+0000 7f88ba59c640 1 --2- 172.21.15.22:0/2052224882 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f88bc0c8310 0x7f88bc158160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:28.519 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.522+0000 7f88ba59c640 1 -- 172.21.15.22:0/2052224882 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88bc152ab0 msgr2=0x7f88bc0cd2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:28.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.522+0000 7f88ba59c640 1 --2- 172.21.15.22:0/2052224882 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88bc152ab0 0x7f88bc0cd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:28.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.522+0000 7f88ba59c640 1 -- 172.21.15.22:0/2052224882 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88bc1573c0 con 0x7f88bc0c55f0 2024-05-21T13:36:28.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.522+0000 7f8a537fe640 1 --2- 172.21.15.22:0/2509821398 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a54155e20 0x7f8a540c72a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8a540ce910 tx=0x7f8a4801ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e163d81b3e7be81 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:28.520 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.522+0000 7fb7a68fc640 1 -- start start 2024-05-21T13:36:28.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.522+0000 7f8a527fc640 1 -- 172.21.15.22:0/2509821398 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a480b5070 con 0x7f8a54155e20 2024-05-21T13:36:28.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.522+0000 7f8a527fc640 1 -- 172.21.15.22:0/2509821398 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a480a89d0 con 0x7f8a54155e20 2024-05-21T13:36:28.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.522+0000 7f8a527fc640 1 -- 172.21.15.22:0/2509821398 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a480a8da0 con 0x7f8a54155e20 2024-05-21T13:36:28.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.522+0000 7f88ba59c640 1 --2- 172.21.15.22:0/2052224882 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f88bc0c55f0 0x7f88bc0c9180 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f88ac00b410 tx=0x7f88ac00b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:28.521 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.522+0000 7fda6f59e640 1 -- 172.21.15.22:0/688316707 wait complete. 2024-05-21T13:36:28.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.522+0000 7fe209cd2640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe204158630 0x7fe2040c1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:28.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.522+0000 7fe209cd2640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe204158630 0x7fe2040c1e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.22:42102/0 (socket says 172.21.15.22:42102) 2024-05-21T13:36:28.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.522+0000 7fe209cd2640 1 -- 172.21.15.22:0/2443144318 learned_addr learned my addr 172.21.15.22:0/2443144318 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:28.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.522+0000 7f88aaffd640 1 -- 172.21.15.22:0/2052224882 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88ac015030 con 0x7f88bc0c55f0 2024-05-21T13:36:28.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.522+0000 7f88c09ac640 1 -- 172.21.15.22:0/2052224882 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88bc14e250 con 0x7f88bc0c55f0 2024-05-21T13:36:28.522 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.526+0000 7f88c09ac640 1 -- 172.21.15.22:0/2052224882 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f88bc157960 con 0x7f88bc0c55f0 2024-05-21T13:36:28.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.526+0000 7fe20acd4640 1 --2- 172.21.15.22:0/2443144318 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe204158a50 0x7fe2040c23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:28.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.526+0000 7fe209cd2640 1 -- 172.21.15.22:0/2443144318 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe204158a50 msgr2=0x7fe2040c23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:28.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.526+0000 7fe209cd2640 1 --2- 172.21.15.22:0/2443144318 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe204158a50 0x7fe2040c23b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:28.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.526+0000 7fe209cd2640 1 -- 172.21.15.22:0/2443144318 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe204152120 msgr2=0x7fe20415afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:28.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.526+0000 7fe209cd2640 1 --2- 172.21.15.22:0/2443144318 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe204152120 0x7fe20415afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:28.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.526+0000 7fe209cd2640 1 -- 172.21.15.22:0/2443144318 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2041f5ad0 con 0x7fe204158630 2024-05-21T13:36:28.523 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.526+0000 7f8a588d9640 1 -- 172.21.15.22:0/2509821398 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a54155e20 msgr2=0x7f8a540c72a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:28.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.526+0000 7f8a588d9640 1 --2- 172.21.15.22:0/2509821398 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a54155e20 0x7f8a540c72a0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8a540ce910 tx=0x7f8a4801ed10 comp rx=0 tx=0).stop 2024-05-21T13:36:28.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.526+0000 7f8a588d9640 1 -- 172.21.15.22:0/2509821398 shutdown_connections 2024-05-21T13:36:28.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.526+0000 7f8a588d9640 1 --2- 172.21.15.22:0/2509821398 >> v2:172.21.15.115:3300/0 conn(0x7f8a54068c20 0x7f8a540ccbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:28.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.526+0000 7f8a588d9640 1 --2- 172.21.15.22:0/2509821398 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a54155e20 0x7f8a540c72a0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:28.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.526+0000 7f8a588d9640 1 -- 172.21.15.22:0/2509821398 >> 172.21.15.22:0/2509821398 conn(0x7f8a5406ee30 msgr2=0x7f8a54068260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:28.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.522+0000 7f452be3e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f45240caee0 0x7f45241e56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:28.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.522+0000 7f452be3e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45240cceb0 0x7f45241f33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:28.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.522+0000 7f452be3e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4524153ae0 0x7f452414ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:28.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.522+0000 7f452be3e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f452415a740 con 0x7f4524153ae0 2024-05-21T13:36:28.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.522+0000 7f452be3e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f4524159910 con 0x7f45240cceb0 2024-05-21T13:36:28.524 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.522+0000 7f452be3e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f452415aad0 con 0x7f45240caee0 2024-05-21T13:36:28.525 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.526+0000 7f4529bda640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f45240caee0 0x7f45241e56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:28.525 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.526+0000 7f8a588d9640 1 -- 172.21.15.22:0/2509821398 shutdown_connections 2024-05-21T13:36:28.525 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.526+0000 7fb7a68fc640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb7a00c8650 0x7fb7a0162430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:28.525 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.526+0000 7fb7a68fc640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb7a00c9640 0x7fb7a015eca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:28.525 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.526+0000 7fb7a68fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb7a00c9a20 0x7fb7a015f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:28.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.526+0000 7f8a588d9640 1 -- 172.21.15.22:0/2509821398 wait complete. 2024-05-21T13:36:28.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.526+0000 7fe209cd2640 1 --2- 172.21.15.22:0/2443144318 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe204158630 0x7fe2040c1e70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc00c8a0 tx=0x7fe1fc00cd60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:28.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.526+0000 7f4529bda640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f45240caee0 0x7f45241e56f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.22:42112/0 (socket says 172.21.15.22:42112) 2024-05-21T13:36:28.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.526+0000 7f4529bda640 1 -- 172.21.15.22:0/1356723258 learned_addr learned my addr 172.21.15.22:0/1356723258 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:28.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.526+0000 7f45293d9640 1 --2- 172.21.15.22:0/1356723258 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45240cceb0 0x7f45241f33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:28.526 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.526+0000 7f452a3db640 1 --2- 172.21.15.22:0/1356723258 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4524153ae0 0x7f452414ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:28.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.526+0000 7fb7a68fc640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb7a00cd550 con 0x7fb7a00c9a20 2024-05-21T13:36:28.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.526+0000 7fb7a68fc640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fb7a00c9e30 con 0x7fb7a00c8650 2024-05-21T13:36:28.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.526+0000 7fb7a68fc640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7fb7a00cd6d0 con 0x7fb7a00c9640 2024-05-21T13:36:28.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.526+0000 7fe1faffd640 1 -- 172.21.15.22:0/2443144318 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1fc017070 con 0x7fe204158630 2024-05-21T13:36:28.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.526+0000 7fe1faffd640 1 -- 172.21.15.22:0/2443144318 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1fc00a840 con 0x7fe204158630 2024-05-21T13:36:28.527 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.526+0000 7fb7a50f9640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb7a00c9640 0x7fb7a015eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:28.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.526+0000 7fb7a50f9640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb7a00c9640 0x7fb7a015eca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.22:42120/0 (socket says 172.21.15.22:42120) 2024-05-21T13:36:28.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.526+0000 7fb7a50f9640 1 -- 172.21.15.22:0/2437964005 learned_addr learned my addr 172.21.15.22:0/2437964005 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:28.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.526+0000 7fb7a58fa640 1 --2- 172.21.15.22:0/2437964005 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb7a00c8650 0x7fb7a0162430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:28.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.526+0000 7fb7a60fb640 1 --2- 172.21.15.22:0/2437964005 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb7a00c9a20 0x7fb7a015f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:28.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.526+0000 7fe1faffd640 1 -- 172.21.15.22:0/2443144318 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1fc007280 con 0x7fe204158630 2024-05-21T13:36:28.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.526+0000 7fe20c737640 1 -- 172.21.15.22:0/2443144318 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2041f5d90 con 0x7fe204158630 2024-05-21T13:36:28.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.526+0000 7fe20c737640 1 -- 172.21.15.22:0/2443144318 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2041f6350 con 0x7fe204158630 2024-05-21T13:36:28.528 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.526+0000 7f45293d9640 1 -- 172.21.15.22:0/1356723258 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f45240caee0 msgr2=0x7f45241e56f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:28.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.526+0000 7f45293d9640 1 --2- 172.21.15.22:0/1356723258 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f45240caee0 0x7f45241e56f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:28.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.526+0000 7f45293d9640 1 -- 172.21.15.22:0/1356723258 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4524153ae0 msgr2=0x7f452414ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:28.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.526+0000 7f45293d9640 1 --2- 172.21.15.22:0/1356723258 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4524153ae0 0x7f452414ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:28.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.526+0000 7f45293d9640 1 -- 172.21.15.22:0/1356723258 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f452415b000 con 0x7f45240cceb0 2024-05-21T13:36:28.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.526+0000 7fb7a50f9640 1 -- 172.21.15.22:0/2437964005 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb7a00c8650 msgr2=0x7fb7a0162430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:28.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.526+0000 7fb7a50f9640 1 --2- 172.21.15.22:0/2437964005 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb7a00c8650 0x7fb7a0162430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:28.529 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.526+0000 7fb7a50f9640 1 -- 172.21.15.22:0/2437964005 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb7a00c9a20 msgr2=0x7fb7a015f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:28.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.526+0000 7fb7a50f9640 1 --2- 172.21.15.22:0/2437964005 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb7a00c9a20 0x7fb7a015f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:28.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.526+0000 7fb7a50f9640 1 -- 172.21.15.22:0/2437964005 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7a01630f0 con 0x7fb7a00c9640 2024-05-21T13:36:28.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.526+0000 7fb7a60fb640 1 --2- 172.21.15.22:0/2437964005 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb7a00c9a20 0x7fb7a015f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-21T13:36:28.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.526+0000 7fda6f59e640 1 Processor -- start 2024-05-21T13:36:28.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.526+0000 7f45293d9640 1 --2- 172.21.15.22:0/1356723258 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45240cceb0 0x7f45241f33a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f452000c420 tx=0x7f452000c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:28.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.526+0000 7fb7a50f9640 1 --2- 172.21.15.22:0/2437964005 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb7a00c9640 0x7fb7a015eca0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb7980b0040 tx=0x7fb7980196d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:28.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.526+0000 7f88aaffd640 1 -- 172.21.15.22:0/2052224882 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88ac004020 con 0x7f88bc0c55f0 2024-05-21T13:36:28.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.526+0000 7f88aaffd640 1 -- 172.21.15.22:0/2052224882 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88ac004450 con 0x7f88bc0c55f0 2024-05-21T13:36:28.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.526+0000 7f8a588d9640 1 Processor -- start 2024-05-21T13:36:28.531 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.526+0000 7f451a7fc640 1 -- 172.21.15.22:0/1356723258 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4520017070 con 0x7f45240cceb0 2024-05-21T13:36:28.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.526+0000 7fda6f59e640 1 -- start start 2024-05-21T13:36:28.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.526+0000 7fda6f59e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fda58004810 0x7fda70146550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:28.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.526+0000 7fda6f59e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda7014d510 0x7fda7015f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:28.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.526+0000 7fda6f59e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fda7015f720 0x7fda7014a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:28.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.526+0000 7fda6f59e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fda70072790 con 0x7fda58004810 2024-05-21T13:36:28.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.526+0000 7fda6f59e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fda70160650 con 0x7fda7014d510 2024-05-21T13:36:28.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.526+0000 7fda6f59e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7fda70160930 con 0x7fda7015f720 2024-05-21T13:36:28.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.526+0000 7fda6e59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fda58004810 0x7fda70146550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:28.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.526+0000 7fda6dd9b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda7014d510 0x7fda7015f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:28.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.526+0000 7fda6e59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fda58004810 0x7fda70146550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48392/0 (socket says 172.21.15.22:48392) 2024-05-21T13:36:28.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.526+0000 7fda6e59c640 1 -- 172.21.15.22:0/2135221951 learned_addr learned my addr 172.21.15.22:0/2135221951 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:28.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.526+0000 7f451a7fc640 1 -- 172.21.15.22:0/1356723258 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4520005cf0 con 0x7f45240cceb0 2024-05-21T13:36:28.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.526+0000 7f451a7fc640 1 -- 172.21.15.22:0/1356723258 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45200072d0 con 0x7f45240cceb0 2024-05-21T13:36:28.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.526+0000 7f452be3e640 1 -- 172.21.15.22:0/1356723258 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45241f0310 con 0x7f45240cceb0 2024-05-21T13:36:28.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.526+0000 7f452be3e640 1 -- 172.21.15.22:0/1356723258 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45241f2ba0 con 0x7f45240cceb0 2024-05-21T13:36:28.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.526+0000 7f8a588d9640 1 -- start start 2024-05-21T13:36:28.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.526+0000 7fda6ed9d640 1 --2- 172.21.15.22:0/2135221951 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fda7015f720 0x7fda7014a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:28.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.526+0000 7fda6e59c640 1 -- 172.21.15.22:0/2135221951 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fda7015f720 msgr2=0x7fda7014a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:28.534 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.530+0000 7fda6e59c640 1 --2- 172.21.15.22:0/2135221951 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fda7015f720 0x7fda7014a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:28.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.530+0000 7fda6e59c640 1 -- 172.21.15.22:0/2135221951 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda7014d510 msgr2=0x7fda7015f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:28.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.530+0000 7fda6e59c640 1 --2- 172.21.15.22:0/2135221951 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda7014d510 0x7fda7015f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:28.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.530+0000 7fda6e59c640 1 -- 172.21.15.22:0/2135221951 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda701f9180 con 0x7fda58004810 2024-05-21T13:36:28.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.530+0000 7fda6e59c640 1 --2- 172.21.15.22:0/2135221951 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fda58004810 0x7fda70146550 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fda6400f610 tx=0x7fda6400fad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:28.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.530+0000 7fda5effd640 1 -- 172.21.15.22:0/2135221951 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda640052e0 con 0x7fda58004810 2024-05-21T13:36:28.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.530+0000 7fda5effd640 1 -- 172.21.15.22:0/2135221951 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda64018070 con 0x7fda58004810 2024-05-21T13:36:28.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.530+0000 7fda5effd640 1 -- 172.21.15.22:0/2135221951 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda64003840 con 0x7fda58004810 2024-05-21T13:36:28.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.530+0000 7fda6f59e640 1 -- 172.21.15.22:0/2135221951 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda701f5a70 con 0x7fda58004810 2024-05-21T13:36:28.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.530+0000 7fda6f59e640 1 -- 172.21.15.22:0/2135221951 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda701f5ff0 con 0x7fda58004810 2024-05-21T13:36:28.535 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.530+0000 7f452be3e640 1 -- 172.21.15.22:0/1356723258 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45240697d0 con 0x7f45240cceb0 2024-05-21T13:36:28.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.530+0000 7f8a588d9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a54068c20 0x7f8a540d0640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:28.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.530+0000 7f8a588d9640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8a5415f020 0x7f8a54158dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:28.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.530+0000 7f8a588d9640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a541f5db0 0x7f8a541f9b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:28.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.530+0000 7f8a588d9640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8a540c6aa0 con 0x7f8a54068c20 2024-05-21T13:36:28.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.530+0000 7f8a588d9640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f8a540c67c0 con 0x7f8a541f5db0 2024-05-21T13:36:28.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.530+0000 7f8a588d9640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f8a540c6d80 con 0x7f8a5415f020 2024-05-21T13:36:28.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.530+0000 7f8a537fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a54068c20 0x7f8a540d0640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:28.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.530+0000 7f8a537fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a54068c20 0x7f8a540d0640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48406/0 (socket says 172.21.15.22:48406) 2024-05-21T13:36:28.536 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.530+0000 7f8a537fe640 1 -- 172.21.15.22:0/3337504827 learned_addr learned my addr 172.21.15.22:0/3337504827 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:28.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.530+0000 7fe1faffd640 1 -- 172.21.15.22:0/2443144318 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fe1fc01a070 con 0x7fe204158630 2024-05-21T13:36:28.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.530+0000 7fe1faffd640 1 --2- 172.21.15.22:0/2443144318 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fe1e806f450 0x7fe1e8071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:28.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.530+0000 7fe1faffd640 1 -- 172.21.15.22:0/2443144318 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fe1fc08ec80 con 0x7fe204158630 2024-05-21T13:36:28.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.530+0000 7f8a537fe640 1 -- 172.21.15.22:0/3337504827 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8a5415f020 msgr2=0x7f8a54158dc0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-21T13:36:28.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.530+0000 7f8a537fe640 1 --2- 172.21.15.22:0/3337504827 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8a5415f020 0x7f8a54158dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:28.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.530+0000 7f8a537fe640 1 -- 172.21.15.22:0/3337504827 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a541f5db0 msgr2=0x7f8a541f9b80 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-21T13:36:28.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.530+0000 7f8a537fe640 1 --2- 172.21.15.22:0/3337504827 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a541f5db0 0x7f8a541f9b80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:28.537 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.530+0000 7f8a537fe640 1 -- 172.21.15.22:0/3337504827 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a541f6360 con 0x7f8a54068c20 2024-05-21T13:36:28.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.530+0000 7f8a537fe640 1 --2- 172.21.15.22:0/3337504827 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a54068c20 0x7f8a540d0640 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8a4801d3c0 tx=0x7f8a4801bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:28.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.530+0000 7fe20a4d3640 1 --2- 172.21.15.22:0/2443144318 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fe1e806f450 0x7fe1e8071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:28.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.530+0000 7f8a3bfff640 1 -- 172.21.15.22:0/3337504827 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a480b5050 con 0x7f8a54068c20 2024-05-21T13:36:28.538 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.530+0000 7f8a588d9640 1 -- 172.21.15.22:0/3337504827 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a541f6640 con 0x7f8a54068c20 2024-05-21T13:36:28.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.530+0000 7f451a7fc640 1 -- 172.21.15.22:0/1356723258 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f452001a070 con 0x7f45240cceb0 2024-05-21T13:36:28.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.530+0000 7f8a588d9640 1 -- 172.21.15.22:0/3337504827 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a541f6c00 con 0x7f8a54068c20 2024-05-21T13:36:28.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.530+0000 7f88aaffd640 1 -- 172.21.15.22:0/2052224882 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f88ac018070 con 0x7f88bc0c55f0 2024-05-21T13:36:28.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.530+0000 7f88aaffd640 1 --2- 172.21.15.22:0/2052224882 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f889c06f400 0x7f889c0718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:28.539 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.530+0000 7f88aaffd640 1 -- 172.21.15.22:0/2052224882 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f88ac08f000 con 0x7f88bc0c55f0 2024-05-21T13:36:28.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.530+0000 7fb7967fc640 1 -- 172.21.15.22:0/2437964005 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7980be070 con 0x7fb7a00c9640 2024-05-21T13:36:28.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.530+0000 7fb7967fc640 1 -- 172.21.15.22:0/2437964005 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7980b8920 con 0x7fb7a00c9640 2024-05-21T13:36:28.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.530+0000 7fb7967fc640 1 -- 172.21.15.22:0/2437964005 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7980b8d10 con 0x7fb7a00c9640 2024-05-21T13:36:28.540 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.530+0000 7fda6f59e640 1 -- 172.21.15.22:0/2135221951 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda70077bb0 con 0x7fda58004810 2024-05-21T13:36:28.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.530+0000 7f88b9d9b640 1 --2- 172.21.15.22:0/2052224882 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f889c06f400 0x7f889c0718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:28.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.530+0000 7f88c09ac640 1 -- 172.21.15.22:0/2052224882 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88a00052a0 con 0x7f88bc0c55f0 2024-05-21T13:36:28.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.530+0000 7fb7a68fc640 1 -- 172.21.15.22:0/2437964005 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7a006e9a0 con 0x7fb7a00c9640 2024-05-21T13:36:28.541 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.530+0000 7fe20c737640 1 -- 172.21.15.22:0/2443144318 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe204077bb0 con 0x7fe204158630 2024-05-21T13:36:28.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.530+0000 7f451a7fc640 1 --2- 172.21.15.22:0/1356723258 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f450806f4d0 0x7f4508071990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:28.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.530+0000 7f451a7fc640 1 -- 172.21.15.22:0/1356723258 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f452008ec80 con 0x7f45240cceb0 2024-05-21T13:36:28.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.530+0000 7fb7a68fc640 1 -- 172.21.15.22:0/2437964005 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7a0160c40 con 0x7fb7a00c9640 2024-05-21T13:36:28.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.530+0000 7f8a3bfff640 1 -- 172.21.15.22:0/3337504827 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a480bf070 con 0x7f8a54068c20 2024-05-21T13:36:28.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.530+0000 7f8a3bfff640 1 -- 172.21.15.22:0/3337504827 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a480b0c50 con 0x7f8a54068c20 2024-05-21T13:36:28.542 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.530+0000 7f8a588d9640 1 -- 172.21.15.22:0/3337504827 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a540b6100 con 0x7f8a54068c20 2024-05-21T13:36:28.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.534+0000 7f4529bda640 1 --2- 172.21.15.22:0/1356723258 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f450806f4d0 0x7f4508071990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:28.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.534+0000 7f8a3bfff640 1 -- 172.21.15.22:0/3337504827 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f8a480c4460 con 0x7f8a54068c20 2024-05-21T13:36:28.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.530+0000 7fda5effd640 1 -- 172.21.15.22:0/2135221951 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fda640039e0 con 0x7fda58004810 2024-05-21T13:36:28.543 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.534+0000 7fda5effd640 1 --2- 172.21.15.22:0/2135221951 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fda58070f80 0x7fda58073440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:28.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.534+0000 7fda5effd640 1 -- 172.21.15.22:0/2135221951 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fda6408f340 con 0x7fda58004810 2024-05-21T13:36:28.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.534+0000 7f8a3bfff640 1 --2- 172.21.15.22:0/3337504827 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f8a4006f480 0x7f8a40071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:28.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.534+0000 7f4529bda640 1 --2- 172.21.15.22:0/1356723258 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f450806f4d0 0x7f4508071990 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f451c01f150 tx=0x7f451c0aa000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:28.544 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.534+0000 7f88b9d9b640 1 --2- 172.21.15.22:0/2052224882 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f889c06f400 0x7f889c0718c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f88b00b2000 tx=0x7f88b0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:28.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.534+0000 7f8a3bfff640 1 -- 172.21.15.22:0/3337504827 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f8a4812ced0 con 0x7f8a54068c20 2024-05-21T13:36:28.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.534+0000 7f8a52ffd640 1 --2- 172.21.15.22:0/3337504827 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f8a4006f480 0x7f8a40071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:28.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.534+0000 7fb7a68fc640 1 -- 172.21.15.22:0/2437964005 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7880052a0 con 0x7fb7a00c9640 2024-05-21T13:36:28.545 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.534+0000 7fda6dd9b640 1 --2- 172.21.15.22:0/2135221951 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fda58070f80 0x7fda58073440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:28.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.534+0000 7f1a215a6640 1 Processor -- start 2024-05-21T13:36:28.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.534+0000 7f8a52ffd640 1 --2- 172.21.15.22:0/3337504827 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f8a4006f480 0x7f8a40071940 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8a541586d0 tx=0x7f8a44006be0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:28.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.534+0000 7f1a215a6640 1 -- start start 2024-05-21T13:36:28.546 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.534+0000 7fda6dd9b640 1 --2- 172.21.15.22:0/2135221951 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fda58070f80 0x7fda58073440 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fda600af000 tx=0x7fda600046d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:28.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.534+0000 7f1a215a6640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f1a1c068260 0x7f1a1c0c97a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:28.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.534+0000 7f1a215a6640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1a1c0c9ce0 0x7f1a1c15ba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:28.547 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.534+0000 7f1a215a6640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a1c072c00 con 0x7f1a1c155cb0 2024-05-21T13:36:28.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.534+0000 7f1a215a6640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f1a1c0c4a10 con 0x7f1a1c0c9ce0 2024-05-21T13:36:28.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.534+0000 7f1a215a6640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f1a1c073160 con 0x7f1a1c068260 2024-05-21T13:36:28.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.538+0000 7f1a20da5640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1a1c0c9ce0 0x7f1a1c15ba00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:28.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.538+0000 7f1a20da5640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1a1c0c9ce0 0x7f1a1c15ba00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48420/0 (socket says 172.21.15.22:48420) 2024-05-21T13:36:28.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.538+0000 7f1a20da5640 1 -- 172.21.15.22:0/2418007477 learned_addr learned my addr 172.21.15.22:0/2418007477 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:28.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.538+0000 7f1a1b7fe640 1 --2- 172.21.15.22:0/2418007477 >> v2:172.21.15.115:3300/0 conn(0x7f1a1c068260 0x7f1a1c0c97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:28.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.538+0000 7f1a20da5640 1 -- 172.21.15.22:0/2418007477 >> v2:172.21.15.115:3300/0 conn(0x7f1a1c068260 msgr2=0x7f1a1c0c97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:28.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.538+0000 7f1a20da5640 1 --2- 172.21.15.22:0/2418007477 >> v2:172.21.15.115:3300/0 conn(0x7f1a1c068260 0x7f1a1c0c97a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:28.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.538+0000 7f1a20da5640 1 -- 172.21.15.22:0/2418007477 >> v1:172.21.15.115:6789/0 conn(0x7f1a1c155cb0 legacy=0x7f1a1c06ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:28.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.538+0000 7f1a20da5640 1 -- 172.21.15.22:0/2418007477 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a1c072e80 con 0x7f1a1c0c9ce0 2024-05-21T13:36:28.548 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.538+0000 7fe20a4d3640 1 --2- 172.21.15.22:0/2443144318 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fe1e806f450 0x7fe1e8071910 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe2000b2000 tx=0x7fe200004740 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:28.549 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.538+0000 7fda5effd640 1 -- 172.21.15.22:0/2135221951 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fda6405bee0 con 0x7fda58004810 2024-05-21T13:36:28.549 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.538+0000 7f1a20da5640 1 --2- 172.21.15.22:0/2418007477 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1a1c0c9ce0 0x7f1a1c15ba00 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c0ca280 tx=0x7f1a1401f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b34d719b75882e8f server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:28.549 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.542+0000 7f1a1affd640 1 -- 172.21.15.22:0/2418007477 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a140a8bd0 con 0x7f1a1c0c9ce0 2024-05-21T13:36:28.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.542+0000 7f1a1affd640 1 -- 172.21.15.22:0/2418007477 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a140a8d70 con 0x7f1a1c0c9ce0 2024-05-21T13:36:28.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.542+0000 7f1a1affd640 1 -- 172.21.15.22:0/2418007477 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a140b0610 con 0x7f1a1c0c9ce0 2024-05-21T13:36:28.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.542+0000 7f8a3bfff640 1 -- 172.21.15.22:0/3337504827 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f8a48018870 con 0x7f8a54068c20 2024-05-21T13:36:28.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.542+0000 7f1a215a6640 1 -- 172.21.15.22:0/2418007477 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1a1c0c9ce0 msgr2=0x7f1a1c15ba00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:28.550 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.542+0000 7f1a215a6640 1 --2- 172.21.15.22:0/2418007477 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1a1c0c9ce0 0x7f1a1c15ba00 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c0ca280 tx=0x7f1a1401f000 comp rx=0 tx=0).stop 2024-05-21T13:36:28.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.542+0000 7f1a215a6640 1 -- 172.21.15.22:0/2418007477 shutdown_connections 2024-05-21T13:36:28.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.542+0000 7f1a215a6640 1 --2- 172.21.15.22:0/2418007477 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1a1c0c9ce0 0x7f1a1c15ba00 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:28.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.542+0000 7f1a215a6640 1 --2- 172.21.15.22:0/2418007477 >> v2:172.21.15.115:3300/0 conn(0x7f1a1c068260 0x7f1a1c0c97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:28.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.542+0000 7f1a215a6640 1 -- 172.21.15.22:0/2418007477 >> 172.21.15.22:0/2418007477 conn(0x7f1a1c0ca320 msgr2=0x7f1a1c0ca730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:28.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.542+0000 7f1a215a6640 1 -- 172.21.15.22:0/2418007477 shutdown_connections 2024-05-21T13:36:28.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.542+0000 7f1a215a6640 1 -- 172.21.15.22:0/2418007477 wait complete. 2024-05-21T13:36:28.551 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.546+0000 7f451a7fc640 1 -- 172.21.15.22:0/1356723258 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f4520001130 con 0x7f45240cceb0 2024-05-21T13:36:28.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.546+0000 7f1a215a6640 1 Processor -- start 2024-05-21T13:36:28.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.546+0000 7f1a215a6640 1 -- start start 2024-05-21T13:36:28.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.546+0000 7f1a215a6640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1a1c068260 0x7f1a1c1510c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:28.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.546+0000 7f1a215a6640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1a1c0c9ce0 0x7f1a1c14be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:28.552 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.546+0000 7f88aaffd640 1 -- 172.21.15.22:0/2052224882 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f88ac05bc30 con 0x7f88bc0c55f0 2024-05-21T13:36:28.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.546+0000 7f1a215a6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1a1c155cb0 0x7f1a1c1f1e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:28.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.546+0000 7f1a1bfff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1a1c068260 0x7f1a1c1510c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:28.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.546+0000 7f1a1bfff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1a1c068260 0x7f1a1c1510c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.22:36696/0 (socket says 172.21.15.22:36696) 2024-05-21T13:36:28.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.546+0000 7f1a1b7fe640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1a1c0c9ce0 0x7f1a1c14be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:28.554 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.546+0000 7f1a1b7fe640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1a1c0c9ce0 0x7f1a1c14be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.22:42162/0 (socket says 172.21.15.22:42162) 2024-05-21T13:36:28.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.546+0000 7f1a20da5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1a1c155cb0 0x7f1a1c1f1e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:28.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.546+0000 7f1a20da5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1a1c155cb0 0x7f1a1c1f1e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48424/0 (socket says 172.21.15.22:48424) 2024-05-21T13:36:28.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.546+0000 7f1a215a6640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f1a1c06e690 con 0x7f1a1c155cb0 2024-05-21T13:36:28.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.546+0000 7f1a215a6640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f1a1c06e3b0 con 0x7f1a1c068260 2024-05-21T13:36:28.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.546+0000 7f1a215a6640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f1a1c06e970 con 0x7f1a1c0c9ce0 2024-05-21T13:36:28.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.546+0000 7f1a1bfff640 1 -- 172.21.15.22:0/991640161 learned_addr learned my addr 172.21.15.22:0/991640161 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:28.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.546+0000 7f1a20da5640 1 -- 172.21.15.22:0/991640161 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1a1c0c9ce0 msgr2=0x7f1a1c14be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:28.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.546+0000 7f1a20da5640 1 --2- 172.21.15.22:0/991640161 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1a1c0c9ce0 0x7f1a1c14be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:28.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.546+0000 7f1a20da5640 1 -- 172.21.15.22:0/991640161 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1a1c068260 msgr2=0x7f1a1c1510c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:28.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.546+0000 7f1a20da5640 1 --2- 172.21.15.22:0/991640161 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1a1c068260 0x7f1a1c1510c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:28.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.546+0000 7f1a20da5640 1 -- 172.21.15.22:0/991640161 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a1c073590 con 0x7f1a1c155cb0 2024-05-21T13:36:28.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.546+0000 7f1a1bfff640 1 --2- 172.21.15.22:0/991640161 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1a1c068260 0x7f1a1c1510c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-21T13:36:28.555 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.550+0000 7f1a20da5640 1 --2- 172.21.15.22:0/991640161 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1a1c155cb0 0x7f1a1c1f1e80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1a140ae000 tx=0x7f1a1401bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:28.556 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.550+0000 7f1a18ff9640 1 -- 172.21.15.22:0/991640161 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a140a8bd0 con 0x7f1a1c155cb0 2024-05-21T13:36:28.556 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.550+0000 7f1a18ff9640 1 -- 172.21.15.22:0/991640161 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a140c1070 con 0x7f1a1c155cb0 2024-05-21T13:36:28.556 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.550+0000 7f1a18ff9640 1 -- 172.21.15.22:0/991640161 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a14009510 con 0x7f1a1c155cb0 2024-05-21T13:36:28.556 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.550+0000 7f1a215a6640 1 -- 172.21.15.22:0/991640161 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a1c14d960 con 0x7f1a1c155cb0 2024-05-21T13:36:28.556 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.550+0000 7f1a215a6640 1 -- 172.21.15.22:0/991640161 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a1c1505e0 con 0x7f1a1c155cb0 2024-05-21T13:36:28.556 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.550+0000 7f1a18ff9640 1 -- 172.21.15.22:0/991640161 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f1a140bb6b0 con 0x7f1a1c155cb0 2024-05-21T13:36:28.556 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.554+0000 7f1a18ff9640 1 --2- 172.21.15.22:0/991640161 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f19fc06f480 0x7f19fc071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:28.556 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.554+0000 7f1a18ff9640 1 -- 172.21.15.22:0/991640161 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f1a14132060 con 0x7f1a1c155cb0 2024-05-21T13:36:28.556 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.554+0000 7f1a1bfff640 1 --2- 172.21.15.22:0/991640161 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f19fc06f480 0x7f19fc071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:28.556 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.554+0000 7f1a1bfff640 1 --2- 172.21.15.22:0/991640161 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f19fc06f480 0x7f19fc071940 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c004470 tx=0x7f1a0c003700 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:28.556 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.558+0000 7fe1faffd640 1 -- 172.21.15.22:0/2443144318 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fe1fc05b260 con 0x7fe204158630 2024-05-21T13:36:28.557 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.562+0000 7fb7967fc640 1 -- 172.21.15.22:0/2437964005 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fb7980c1070 con 0x7fb7a00c9640 2024-05-21T13:36:28.557 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.562+0000 7fb7967fc640 1 --2- 172.21.15.22:0/2437964005 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fb78406f4d0 0x7fb784071990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:28.557 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.562+0000 7fb7967fc640 1 -- 172.21.15.22:0/2437964005 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb79812af30 con 0x7fb7a00c9640 2024-05-21T13:36:28.557 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.562+0000 7fb7a58fa640 1 --2- 172.21.15.22:0/2437964005 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fb78406f4d0 0x7fb784071990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:28.557 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.562+0000 7f1a0a7fc640 1 -- 172.21.15.22:0/991640161 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a1c1503d0 con 0x7f1a1c155cb0 2024-05-21T13:36:28.558 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.562+0000 7fb7a58fa640 1 --2- 172.21.15.22:0/2437964005 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fb78406f4d0 0x7fb784071990 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb79c007fd0 tx=0x7fb79c007ed0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:28.558 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.570+0000 7f1a18ff9640 1 -- 172.21.15.22:0/991640161 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f1a1c072c00 con 0x7f1a1c155cb0 2024-05-21T13:36:28.558 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.574+0000 7fb7967fc640 1 -- 172.21.15.22:0/2437964005 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fb798016520 con 0x7fb7a00c9640 2024-05-21T13:36:28.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.814+0000 7ff74ef7e640 1 -- 172.21.15.22:0/31670051 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7ff728005590 con 0x7ff7480c9f40 2024-05-21T13:36:28.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.814+0000 7ff7457fa640 1 -- 172.21.15.22:0/31670051 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff74005ca30 con 0x7ff7480c9f40 2024-05-21T13:36:28.794 INFO:teuthology.orchestra.run.smithi022.stdout:64424509451 2024-05-21T13:36:28.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.818+0000 7ff74ef7e640 1 -- 172.21.15.22:0/31670051 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7ff73006f620 msgr2=0x7ff730071ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:28.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.818+0000 7ff74ef7e640 1 --2- 172.21.15.22:0/31670051 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7ff73006f620 0x7ff730071ae0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff7380b2000 tx=0x7ff738008040 comp rx=0 tx=0).stop 2024-05-21T13:36:28.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.818+0000 7ff74ef7e640 1 -- 172.21.15.22:0/31670051 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff7480c9f40 msgr2=0x7ff7481f5110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:28.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.818+0000 7ff74ef7e640 1 --2- 172.21.15.22:0/31670051 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff7480c9f40 0x7ff7481f5110 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff74000eed0 tx=0x7ff74000b480 comp rx=0 tx=0).stop 2024-05-21T13:36:28.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.818+0000 7ff74ef7e640 1 -- 172.21.15.22:0/31670051 shutdown_connections 2024-05-21T13:36:28.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.818+0000 7ff74ef7e640 1 --2- 172.21.15.22:0/31670051 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7ff73006f620 0x7ff730071ae0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:28.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.818+0000 7ff74ef7e640 1 --2- 172.21.15.22:0/31670051 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff7480ca320 0x7ff7480cb710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:28.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.818+0000 7ff74ef7e640 1 --2- 172.21.15.22:0/31670051 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff7480c9f40 0x7ff7481f5110 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:28.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.818+0000 7ff74ef7e640 1 --2- 172.21.15.22:0/31670051 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff748072280 0x7ff7481f71b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:28.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.818+0000 7ff74ef7e640 1 -- 172.21.15.22:0/31670051 >> 172.21.15.22:0/31670051 conn(0x7ff7480703a0 msgr2=0x7ff748161c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:28.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.818+0000 7ff74ef7e640 1 -- 172.21.15.22:0/31670051 shutdown_connections 2024-05-21T13:36:28.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.818+0000 7ff74ef7e640 1 -- 172.21.15.22:0/31670051 wait complete. 2024-05-21T13:36:28.818 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509452 got 64424509451 for osd.2 2024-05-21T13:36:28.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.854+0000 7f88c09ac640 1 -- 172.21.15.22:0/2052224882 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f88a0005590 con 0x7f88bc0c55f0 2024-05-21T13:36:28.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.854+0000 7f88aaffd640 1 -- 172.21.15.22:0/2052224882 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f88ac05b530 con 0x7f88bc0c55f0 2024-05-21T13:36:28.831 INFO:teuthology.orchestra.run.smithi022.stdout:64424509451 2024-05-21T13:36:28.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.854+0000 7f88c09ac640 1 -- 172.21.15.22:0/2052224882 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f889c06f400 msgr2=0x7f889c0718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:28.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.854+0000 7f88c09ac640 1 --2- 172.21.15.22:0/2052224882 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f889c06f400 0x7f889c0718c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f88b00b2000 tx=0x7f88b0009040 comp rx=0 tx=0).stop 2024-05-21T13:36:28.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.854+0000 7f88c09ac640 1 -- 172.21.15.22:0/2052224882 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f88bc0c55f0 msgr2=0x7f88bc0c9180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:28.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.854+0000 7f88c09ac640 1 --2- 172.21.15.22:0/2052224882 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f88bc0c55f0 0x7f88bc0c9180 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f88ac00b410 tx=0x7f88ac00b8d0 comp rx=0 tx=0).stop 2024-05-21T13:36:28.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.854+0000 7f88c09ac640 1 -- 172.21.15.22:0/2052224882 shutdown_connections 2024-05-21T13:36:28.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.854+0000 7f88c09ac640 1 --2- 172.21.15.22:0/2052224882 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f889c06f400 0x7f889c0718c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:28.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.854+0000 7f88c09ac640 1 --2- 172.21.15.22:0/2052224882 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f88bc152ab0 0x7f88bc0cd2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:28.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.854+0000 7f88c09ac640 1 --2- 172.21.15.22:0/2052224882 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f88bc0c8310 0x7f88bc158160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:28.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.854+0000 7f88c09ac640 1 --2- 172.21.15.22:0/2052224882 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f88bc0c55f0 0x7f88bc0c9180 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:28.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.854+0000 7f88c09ac640 1 -- 172.21.15.22:0/2052224882 >> 172.21.15.22:0/2052224882 conn(0x7f88bc0cabf0 msgr2=0x7f88bc148c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:28.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.854+0000 7f88c09ac640 1 -- 172.21.15.22:0/2052224882 shutdown_connections 2024-05-21T13:36:28.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.854+0000 7f88c09ac640 1 -- 172.21.15.22:0/2052224882 wait complete. 2024-05-21T13:36:28.849 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509452 got 64424509451 for osd.6 2024-05-21T13:36:28.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.870+0000 7f8a588d9640 1 -- 172.21.15.22:0/3337504827 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f8a540cd980 con 0x7f8a54068c20 2024-05-21T13:36:28.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.870+0000 7f8a3bfff640 1 -- 172.21.15.22:0/3337504827 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8a480a89a0 con 0x7f8a54068c20 2024-05-21T13:36:28.850 INFO:teuthology.orchestra.run.smithi022.stdout:64424509450 2024-05-21T13:36:28.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.874+0000 7f8a588d9640 1 -- 172.21.15.22:0/3337504827 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f8a4006f480 msgr2=0x7f8a40071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:28.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.874+0000 7f8a588d9640 1 --2- 172.21.15.22:0/3337504827 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f8a4006f480 0x7f8a40071940 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f8a541586d0 tx=0x7f8a44006be0 comp rx=0 tx=0).stop 2024-05-21T13:36:28.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.874+0000 7f8a588d9640 1 -- 172.21.15.22:0/3337504827 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a54068c20 msgr2=0x7f8a540d0640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:28.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.874+0000 7f8a588d9640 1 --2- 172.21.15.22:0/3337504827 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a54068c20 0x7f8a540d0640 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f8a4801d3c0 tx=0x7f8a4801bab0 comp rx=0 tx=0).stop 2024-05-21T13:36:28.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.874+0000 7f8a588d9640 1 -- 172.21.15.22:0/3337504827 shutdown_connections 2024-05-21T13:36:28.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.874+0000 7f8a588d9640 1 --2- 172.21.15.22:0/3337504827 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f8a4006f480 0x7f8a40071940 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:28.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.874+0000 7f8a588d9640 1 --2- 172.21.15.22:0/3337504827 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a541f5db0 0x7f8a541f9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:28.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.874+0000 7f8a588d9640 1 --2- 172.21.15.22:0/3337504827 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8a5415f020 0x7f8a54158dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:28.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.874+0000 7f8a588d9640 1 --2- 172.21.15.22:0/3337504827 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a54068c20 0x7f8a540d0640 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:28.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.874+0000 7f8a588d9640 1 -- 172.21.15.22:0/3337504827 >> 172.21.15.22:0/3337504827 conn(0x7f8a5406ee30 msgr2=0x7f8a5406d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:28.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.874+0000 7f8a588d9640 1 -- 172.21.15.22:0/3337504827 shutdown_connections 2024-05-21T13:36:28.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.874+0000 7f8a588d9640 1 -- 172.21.15.22:0/3337504827 wait complete. 2024-05-21T13:36:28.860 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.882+0000 7f452be3e640 1 -- 172.21.15.22:0/1356723258 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f452415a8c0 con 0x7f45240cceb0 2024-05-21T13:36:28.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.882+0000 7f451a7fc640 1 -- 172.21.15.22:0/1356723258 <== mon.1 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f452005b2e0 con 0x7f45240cceb0 2024-05-21T13:36:28.861 INFO:teuthology.orchestra.run.smithi022.stdout:55834574857 2024-05-21T13:36:28.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.886+0000 7fda6f59e640 1 -- 172.21.15.22:0/2135221951 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fda700ce0b0 con 0x7fda58004810 2024-05-21T13:36:28.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.886+0000 7fda5effd640 1 -- 172.21.15.22:0/2135221951 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fda6405b7e0 con 0x7fda58004810 2024-05-21T13:36:28.863 INFO:teuthology.orchestra.run.smithi022.stdout:64424509450 2024-05-21T13:36:28.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.886+0000 7f452be3e640 1 -- 172.21.15.22:0/1356723258 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f450806f4d0 msgr2=0x7f4508071990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:28.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.886+0000 7f452be3e640 1 --2- 172.21.15.22:0/1356723258 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f450806f4d0 0x7f4508071990 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f451c01f150 tx=0x7f451c0aa000 comp rx=0 tx=0).stop 2024-05-21T13:36:28.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.886+0000 7f452be3e640 1 -- 172.21.15.22:0/1356723258 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45240cceb0 msgr2=0x7f45241f33a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:28.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.886+0000 7f452be3e640 1 --2- 172.21.15.22:0/1356723258 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45240cceb0 0x7f45241f33a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f452000c420 tx=0x7f452000c8e0 comp rx=0 tx=0).stop 2024-05-21T13:36:28.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.886+0000 7f452be3e640 1 -- 172.21.15.22:0/1356723258 shutdown_connections 2024-05-21T13:36:28.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.886+0000 7f452be3e640 1 --2- 172.21.15.22:0/1356723258 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f450806f4d0 0x7f4508071990 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:28.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.886+0000 7f452be3e640 1 --2- 172.21.15.22:0/1356723258 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4524153ae0 0x7f452414ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:28.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.886+0000 7f452be3e640 1 --2- 172.21.15.22:0/1356723258 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f45240cceb0 0x7f45241f33a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:28.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.886+0000 7f452be3e640 1 --2- 172.21.15.22:0/1356723258 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f45240caee0 0x7f45241e56f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:28.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.886+0000 7f452be3e640 1 -- 172.21.15.22:0/1356723258 >> 172.21.15.22:0/1356723258 conn(0x7f45240722b0 msgr2=0x7f45240c9bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:28.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.886+0000 7f452be3e640 1 -- 172.21.15.22:0/1356723258 shutdown_connections 2024-05-21T13:36:28.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.886+0000 7f452be3e640 1 -- 172.21.15.22:0/1356723258 wait complete. 2024-05-21T13:36:28.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.890+0000 7fda6f59e640 1 -- 172.21.15.22:0/2135221951 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fda58070f80 msgr2=0x7fda58073440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:28.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.890+0000 7fda6f59e640 1 --2- 172.21.15.22:0/2135221951 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fda58070f80 0x7fda58073440 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fda600af000 tx=0x7fda600046d0 comp rx=0 tx=0).stop 2024-05-21T13:36:28.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.890+0000 7fda6f59e640 1 -- 172.21.15.22:0/2135221951 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fda58004810 msgr2=0x7fda70146550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:28.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.890+0000 7fda6f59e640 1 --2- 172.21.15.22:0/2135221951 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fda58004810 0x7fda70146550 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fda6400f610 tx=0x7fda6400fad0 comp rx=0 tx=0).stop 2024-05-21T13:36:28.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.890+0000 7fda6f59e640 1 -- 172.21.15.22:0/2135221951 shutdown_connections 2024-05-21T13:36:28.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.890+0000 7fda6f59e640 1 --2- 172.21.15.22:0/2135221951 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fda58070f80 0x7fda58073440 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:28.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.890+0000 7fda6f59e640 1 --2- 172.21.15.22:0/2135221951 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fda7015f720 0x7fda7014a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:28.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.890+0000 7fda6f59e640 1 --2- 172.21.15.22:0/2135221951 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fda7014d510 0x7fda7015f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:28.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.890+0000 7fda6f59e640 1 --2- 172.21.15.22:0/2135221951 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fda58004810 0x7fda70146550 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:28.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.890+0000 7fda6f59e640 1 -- 172.21.15.22:0/2135221951 >> 172.21.15.22:0/2135221951 conn(0x7fda700cd1e0 msgr2=0x7fda700ca470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:28.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.890+0000 7fda6f59e640 1 -- 172.21.15.22:0/2135221951 shutdown_connections 2024-05-21T13:36:28.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.890+0000 7fda6f59e640 1 -- 172.21.15.22:0/2135221951 wait complete. 2024-05-21T13:36:28.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.890+0000 7fe20c737640 1 -- 172.21.15.22:0/2443144318 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fe2040c90a0 con 0x7fe204158630 2024-05-21T13:36:28.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.890+0000 7fe1faffd640 1 -- 172.21.15.22:0/2443144318 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe1fc05f560 con 0x7fe204158630 2024-05-21T13:36:28.870 INFO:teuthology.orchestra.run.smithi022.stdout:64424509451 2024-05-21T13:36:28.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.894+0000 7fe20c737640 1 -- 172.21.15.22:0/2443144318 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fe1e806f450 msgr2=0x7fe1e8071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:28.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.894+0000 7fe20c737640 1 --2- 172.21.15.22:0/2443144318 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fe1e806f450 0x7fe1e8071910 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe2000b2000 tx=0x7fe200004740 comp rx=0 tx=0).stop 2024-05-21T13:36:28.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.894+0000 7fe20c737640 1 -- 172.21.15.22:0/2443144318 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe204158630 msgr2=0x7fe2040c1e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:28.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.894+0000 7fe20c737640 1 --2- 172.21.15.22:0/2443144318 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe204158630 0x7fe2040c1e70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc00c8a0 tx=0x7fe1fc00cd60 comp rx=0 tx=0).stop 2024-05-21T13:36:28.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.894+0000 7fe20c737640 1 -- 172.21.15.22:0/2443144318 shutdown_connections 2024-05-21T13:36:28.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.894+0000 7fe20c737640 1 --2- 172.21.15.22:0/2443144318 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fe1e806f450 0x7fe1e8071910 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:28.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.894+0000 7fe20c737640 1 --2- 172.21.15.22:0/2443144318 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe204158a50 0x7fe2040c23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:28.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.894+0000 7fe20c737640 1 --2- 172.21.15.22:0/2443144318 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe204158630 0x7fe2040c1e70 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:28.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.894+0000 7fe20c737640 1 --2- 172.21.15.22:0/2443144318 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe204152120 0x7fe20415afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:28.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.894+0000 7fe20c737640 1 -- 172.21.15.22:0/2443144318 >> 172.21.15.22:0/2443144318 conn(0x7fe20406ce70 msgr2=0x7fe2040c5890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:28.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.894+0000 7fe20c737640 1 -- 172.21.15.22:0/2443144318 shutdown_connections 2024-05-21T13:36:28.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.894+0000 7fe20c737640 1 -- 172.21.15.22:0/2443144318 wait complete. 2024-05-21T13:36:28.878 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509450 for osd.0 2024-05-21T13:36:28.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.902+0000 7fb7a68fc640 1 -- 172.21.15.22:0/2437964005 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fb788005860 con 0x7fb7a00c9640 2024-05-21T13:36:28.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.902+0000 7fb7967fc640 1 -- 172.21.15.22:0/2437964005 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb7980f7590 con 0x7fb7a00c9640 2024-05-21T13:36:28.881 INFO:teuthology.orchestra.run.smithi022.stdout:64424509451 2024-05-21T13:36:28.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.906+0000 7f1a0a7fc640 1 -- 172.21.15.22:0/991640161 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f1a1c0697d0 con 0x7f1a1c155cb0 2024-05-21T13:36:28.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.906+0000 7f1a18ff9640 1 -- 172.21.15.22:0/991640161 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1a140f9ca0 con 0x7f1a1c155cb0 2024-05-21T13:36:28.883 INFO:teuthology.orchestra.run.smithi022.stdout:60129542153 2024-05-21T13:36:28.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.906+0000 7fb7a68fc640 1 -- 172.21.15.22:0/2437964005 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fb78406f4d0 msgr2=0x7fb784071990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:28.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.906+0000 7fb7a68fc640 1 --2- 172.21.15.22:0/2437964005 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fb78406f4d0 0x7fb784071990 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fb79c007fd0 tx=0x7fb79c007ed0 comp rx=0 tx=0).stop 2024-05-21T13:36:28.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.906+0000 7fb7a68fc640 1 -- 172.21.15.22:0/2437964005 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb7a00c9640 msgr2=0x7fb7a015eca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:28.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.906+0000 7fb7a68fc640 1 --2- 172.21.15.22:0/2437964005 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb7a00c9640 0x7fb7a015eca0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb7980b0040 tx=0x7fb7980196d0 comp rx=0 tx=0).stop 2024-05-21T13:36:28.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.906+0000 7fb7a68fc640 1 -- 172.21.15.22:0/2437964005 shutdown_connections 2024-05-21T13:36:28.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.906+0000 7fb7a68fc640 1 --2- 172.21.15.22:0/2437964005 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fb78406f4d0 0x7fb784071990 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:28.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.906+0000 7fb7a68fc640 1 --2- 172.21.15.22:0/2437964005 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb7a00c9a20 0x7fb7a015f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:28.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.906+0000 7fb7a68fc640 1 --2- 172.21.15.22:0/2437964005 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb7a00c9640 0x7fb7a015eca0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:28.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.906+0000 7fb7a68fc640 1 --2- 172.21.15.22:0/2437964005 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb7a00c8650 0x7fb7a0162430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:28.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.906+0000 7fb7a68fc640 1 -- 172.21.15.22:0/2437964005 >> 172.21.15.22:0/2437964005 conn(0x7fb7a006c720 msgr2=0x7fb7a00cf150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:28.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.906+0000 7f1a0a7fc640 1 -- 172.21.15.22:0/991640161 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f19fc06f480 msgr2=0x7f19fc071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:28.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.906+0000 7f1a0a7fc640 1 --2- 172.21.15.22:0/991640161 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f19fc06f480 0x7f19fc071940 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1a0c004470 tx=0x7f1a0c003700 comp rx=0 tx=0).stop 2024-05-21T13:36:28.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.906+0000 7f1a0a7fc640 1 -- 172.21.15.22:0/991640161 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1a1c155cb0 msgr2=0x7f1a1c1f1e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:28.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.906+0000 7f1a0a7fc640 1 --2- 172.21.15.22:0/991640161 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1a1c155cb0 0x7f1a1c1f1e80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1a140ae000 tx=0x7f1a1401bda0 comp rx=0 tx=0).stop 2024-05-21T13:36:28.887 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574857 for osd.4 2024-05-21T13:36:28.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.909+0000 7f1a0a7fc640 1 -- 172.21.15.22:0/991640161 shutdown_connections 2024-05-21T13:36:28.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.909+0000 7f1a0a7fc640 1 --2- 172.21.15.22:0/991640161 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f19fc06f480 0x7f19fc071940 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:28.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.909+0000 7f1a0a7fc640 1 --2- 172.21.15.22:0/991640161 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1a1c155cb0 0x7f1a1c1f1e80 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:28.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.909+0000 7f1a0a7fc640 1 --2- 172.21.15.22:0/991640161 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1a1c0c9ce0 0x7f1a1c14be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:28.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.909+0000 7f1a0a7fc640 1 --2- 172.21.15.22:0/991640161 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1a1c068260 0x7f1a1c1510c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:28.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.909+0000 7f1a0a7fc640 1 -- 172.21.15.22:0/991640161 >> 172.21.15.22:0/991640161 conn(0x7f1a1c0ca320 msgr2=0x7f1a1c14e040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:28.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.909+0000 7fb7a68fc640 1 -- 172.21.15.22:0/2437964005 shutdown_connections 2024-05-21T13:36:28.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.909+0000 7fb7a68fc640 1 -- 172.21.15.22:0/2437964005 wait complete. 2024-05-21T13:36:28.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.909+0000 7f1a0a7fc640 1 -- 172.21.15.22:0/991640161 shutdown_connections 2024-05-21T13:36:28.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:28.909+0000 7f1a0a7fc640 1 -- 172.21.15.22:0/991640161 wait complete. 2024-05-21T13:36:28.894 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509452 got 64424509451 for osd.1 2024-05-21T13:36:28.897 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509450 for osd.3 2024-05-21T13:36:28.906 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542153 for osd.5 2024-05-21T13:36:28.908 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509452 got 64424509451 for osd.7 2024-05-21T13:36:29.145 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-21T13:36:29.148 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-21T13:36:29.819 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-05-21T13:36:29.850 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-05-21T13:36:29.878 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-05-21T13:36:29.888 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-05-21T13:36:29.894 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-05-21T13:36:29.898 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-05-21T13:36:29.906 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-05-21T13:36:29.909 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-05-21T13:36:29.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:29.993+0000 7f7b70786640 1 Processor -- start 2024-05-21T13:36:29.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:29.993+0000 7f7b70786640 1 -- start start 2024-05-21T13:36:29.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:29.997+0000 7f7b70786640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7b6815a0f0 0x7f7b6815ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:29.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:29.997+0000 7f7b70786640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f7b6815a4d0 0x7f7b68072a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:29.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:29.997+0000 7f7b70786640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b680c8770 con 0x7f7b6806f2d0 2024-05-21T13:36:29.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:29.997+0000 7f7b70786640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f7b680725f0 con 0x7f7b6815a4d0 2024-05-21T13:36:29.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:29.997+0000 7f7b70786640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f7b680c7de0 con 0x7f7b6815a0f0 2024-05-21T13:36:29.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:29.997+0000 7f7b6dd21640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f7b6815a4d0 0x7f7b68072a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:29.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:29.997+0000 7f7b6dd21640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f7b6815a4d0 0x7f7b68072a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48438/0 (socket says 172.21.15.22:48438) 2024-05-21T13:36:29.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:29.997+0000 7f7b6dd21640 1 -- 172.21.15.22:0/242226579 learned_addr learned my addr 172.21.15.22:0/242226579 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:29.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:29.997+0000 7f7b6dd21640 1 -- 172.21.15.22:0/242226579 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7b6815a0f0 msgr2=0x7f7b6815ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:29.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:29.997+0000 7f7b6dd21640 1 --2- 172.21.15.22:0/242226579 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7b6815a0f0 0x7f7b6815ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:29.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:29.997+0000 7f7b6dd21640 1 -- 172.21.15.22:0/242226579 >> v1:172.21.15.115:6789/0 conn(0x7f7b6806f2d0 legacy=0x7f7b680c7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:29.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:29.997+0000 7f7b6dd21640 1 -- 172.21.15.22:0/242226579 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b680c8a50 con 0x7f7b6815a4d0 2024-05-21T13:36:29.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.001+0000 7f7b6dd21640 1 --2- 172.21.15.22:0/242226579 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7b6815a4d0 0x7f7b68072a80 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7b64009870 tx=0x7f7b6401ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bef81e202b385d1 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:29.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.001+0000 7f7b6d520640 1 -- 172.21.15.22:0/242226579 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b640b5070 con 0x7f7b6815a4d0 2024-05-21T13:36:29.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.001+0000 7f7b6d520640 1 -- 172.21.15.22:0/242226579 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b640a89f0 con 0x7f7b6815a4d0 2024-05-21T13:36:29.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.001+0000 7f7b6d520640 1 -- 172.21.15.22:0/242226579 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b640a8da0 con 0x7f7b6815a4d0 2024-05-21T13:36:29.980 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.001+0000 7f7b70786640 1 -- 172.21.15.22:0/242226579 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7b6815a4d0 msgr2=0x7f7b68072a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:29.980 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.001+0000 7f7b70786640 1 --2- 172.21.15.22:0/242226579 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7b6815a4d0 0x7f7b68072a80 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7b64009870 tx=0x7f7b6401ed70 comp rx=0 tx=0).stop 2024-05-21T13:36:29.981 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.001+0000 7f7b70786640 1 -- 172.21.15.22:0/242226579 shutdown_connections 2024-05-21T13:36:29.981 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.001+0000 7f7b70786640 1 --2- 172.21.15.22:0/242226579 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7b6815a4d0 0x7f7b68072a80 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:29.981 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.001+0000 7f7b70786640 1 --2- 172.21.15.22:0/242226579 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7b6815a0f0 0x7f7b6815ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:29.981 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.001+0000 7f7b70786640 1 -- 172.21.15.22:0/242226579 >> 172.21.15.22:0/242226579 conn(0x7f7b680703a0 msgr2=0x7f7b680cd250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:29.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.005+0000 7f7b70786640 1 -- 172.21.15.22:0/242226579 shutdown_connections 2024-05-21T13:36:29.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.005+0000 7f7b70786640 1 -- 172.21.15.22:0/242226579 wait complete. 2024-05-21T13:36:29.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.005+0000 7f7b70786640 1 Processor -- start 2024-05-21T13:36:29.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.005+0000 7f7b70786640 1 -- start start 2024-05-21T13:36:29.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.005+0000 7f7b70786640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7b6806f2d0 0x7f7b6815e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:29.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.005+0000 7f7b70786640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7b6815a0f0 0x7f7b6815bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:29.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.005+0000 7f7b70786640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7b6815a4d0 0x7f7b681e6d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:29.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.005+0000 7f7b70786640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f7b68072280 con 0x7f7b6815a0f0 2024-05-21T13:36:29.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.005+0000 7f7b70786640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f7b680c9010 con 0x7f7b6815a4d0 2024-05-21T13:36:29.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.005+0000 7f7b70786640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f7b680c9ce0 con 0x7f7b6806f2d0 2024-05-21T13:36:29.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.005+0000 7f7b6e522640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7b6806f2d0 0x7f7b6815e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:29.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.005+0000 7f7b6dd21640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7b6815a0f0 0x7f7b6815bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:29.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.005+0000 7f7b6dd21640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7b6815a0f0 0x7f7b6815bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48440/0 (socket says 172.21.15.22:48440) 2024-05-21T13:36:29.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.005+0000 7f7b6dd21640 1 -- 172.21.15.22:0/3106606718 learned_addr learned my addr 172.21.15.22:0/3106606718 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:29.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.005+0000 7f7b6ed23640 1 --2- 172.21.15.22:0/3106606718 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7b6815a4d0 0x7f7b681e6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:29.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.009+0000 7f7b6ed23640 1 -- 172.21.15.22:0/3106606718 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7b6806f2d0 msgr2=0x7f7b6815e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:29.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.009+0000 7f7b6ed23640 1 --2- 172.21.15.22:0/3106606718 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7b6806f2d0 0x7f7b6815e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:29.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.009+0000 7f7b6ed23640 1 -- 172.21.15.22:0/3106606718 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7b6815a0f0 msgr2=0x7f7b6815bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:29.988 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.009+0000 7f7b6ed23640 1 --2- 172.21.15.22:0/3106606718 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7b6815a0f0 0x7f7b6815bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:29.988 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.009+0000 7f7b6ed23640 1 -- 172.21.15.22:0/3106606718 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b681e6440 con 0x7f7b6815a4d0 2024-05-21T13:36:29.988 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.009+0000 7f7b6dd21640 1 --2- 172.21.15.22:0/3106606718 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7b6815a0f0 0x7f7b6815bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-21T13:36:29.988 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.009+0000 7f7b6ed23640 1 --2- 172.21.15.22:0/3106606718 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7b6815a4d0 0x7f7b681e6d50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7b6000c780 tx=0x7f7b6000cc40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:29.988 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.009+0000 7f7b5effd640 1 -- 172.21.15.22:0/3106606718 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b60016020 con 0x7f7b6815a4d0 2024-05-21T13:36:29.988 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.009+0000 7f7b5effd640 1 -- 172.21.15.22:0/3106606718 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b6000a9f0 con 0x7f7b6815a4d0 2024-05-21T13:36:29.988 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.009+0000 7f7b5effd640 1 -- 172.21.15.22:0/3106606718 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b6000ade0 con 0x7f7b6815a4d0 2024-05-21T13:36:29.988 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.009+0000 7f7b70786640 1 -- 172.21.15.22:0/3106606718 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b681f8b10 con 0x7f7b6815a4d0 2024-05-21T13:36:29.988 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.009+0000 7f7b70786640 1 -- 172.21.15.22:0/3106606718 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b681f90d0 con 0x7f7b6815a4d0 2024-05-21T13:36:29.989 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.009+0000 7f7b70786640 1 -- 172.21.15.22:0/3106606718 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b68077bb0 con 0x7f7b6815a4d0 2024-05-21T13:36:29.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.013+0000 7f7b5effd640 1 -- 172.21.15.22:0/3106606718 <== mon.1 v2:172.21.15.115:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f7b60019020 con 0x7f7b6815a4d0 2024-05-21T13:36:29.994 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.013+0000 7f7b5effd640 1 --2- 172.21.15.22:0/3106606718 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f7b4c06f400 0x7f7b4c0718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:29.994 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.013+0000 7f7b5effd640 1 -- 172.21.15.22:0/3106606718 <== mon.1 v2:172.21.15.115:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f7b6008f660 con 0x7f7b6815a4d0 2024-05-21T13:36:29.994 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.013+0000 7f7b6e522640 1 --2- 172.21.15.22:0/3106606718 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f7b4c06f400 0x7f7b4c0718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:29.994 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.013+0000 7f7b6e522640 1 --2- 172.21.15.22:0/3106606718 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f7b4c06f400 0x7f7b4c0718c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7b58009990 tx=0x7f7b58009110 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:30.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.025+0000 7f7b5effd640 1 -- 172.21.15.22:0/3106606718 <== mon.1 v2:172.21.15.115:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f7b60020030 con 0x7f7b6815a4d0 2024-05-21T13:36:30.058 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.077+0000 7f3775cfd640 1 Processor -- start 2024-05-21T13:36:30.059 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.077+0000 7f3775cfd640 1 -- start start 2024-05-21T13:36:30.059 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.077+0000 7f3775cfd640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f377015a0f0 0x7f377015ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:30.059 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.077+0000 7f3775cfd640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f377015a4d0 0x7f3770072a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:30.059 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.077+0000 7f3775cfd640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37700c8770 con 0x7f377006f2d0 2024-05-21T13:36:30.059 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.077+0000 7f3775cfd640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f37700725f0 con 0x7f377015a0f0 2024-05-21T13:36:30.059 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.077+0000 7f3775cfd640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f37700c7de0 con 0x7f377015a4d0 2024-05-21T13:36:30.059 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.077+0000 7f376ffff640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f377006f2d0 0x7f37700c7110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:44588/0 (socket says 172.21.15.22:44588) 2024-05-21T13:36:30.059 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.077+0000 7f376ffff640 1 -- 172.21.15.22:0/2548189932 learned_addr learned my addr 172.21.15.22:0/2548189932 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-21T13:36:30.059 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.077+0000 7f376effd640 1 --2- 172.21.15.22:0/2548189932 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f377015a4d0 0x7f3770072a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:30.059 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.081+0000 7f376effd640 1 -- 172.21.15.22:0/2548189932 >> v2:172.21.15.22:3300/0 conn(0x7f377015a0f0 msgr2=0x7f377015ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:30.059 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.081+0000 7f376f7fe640 1 --2- 172.21.15.22:0/2548189932 >> v2:172.21.15.22:3300/0 conn(0x7f377015a0f0 0x7f377015ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:30.059 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.081+0000 7f376effd640 1 --2- 172.21.15.22:0/2548189932 >> v2:172.21.15.22:3300/0 conn(0x7f377015a0f0 0x7f377015ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:30.059 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.081+0000 7f376effd640 1 -- 172.21.15.22:0/2548189932 >> v1:172.21.15.22:6789/0 conn(0x7f377006f2d0 legacy=0x7f37700c7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:30.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.081+0000 7f376effd640 1 -- 172.21.15.22:0/2548189932 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37700c8a50 con 0x7f377015a4d0 2024-05-21T13:36:30.060 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.081+0000 7f376f7fe640 1 --2- 172.21.15.22:0/2548189932 >> v2:172.21.15.22:3300/0 conn(0x7f377015a0f0 0x7f377015ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:36:30.062 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.085+0000 7f376effd640 1 --2- 172.21.15.22:0/2548189932 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f377015a4d0 0x7f3770072a80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f37600097c0 tx=0x7f376001c3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a2bb5abee99e437 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:30.062 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.085+0000 7f376e7fc640 1 -- 172.21.15.22:0/2548189932 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37600b0070 con 0x7f377015a4d0 2024-05-21T13:36:30.062 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.085+0000 7f376e7fc640 1 -- 172.21.15.22:0/2548189932 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37600ab600 con 0x7f377015a4d0 2024-05-21T13:36:30.064 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.085+0000 7f3775cfd640 1 -- 172.21.15.22:0/2548189932 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f377015a4d0 msgr2=0x7f3770072a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:30.064 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.085+0000 7f3775cfd640 1 --2- 172.21.15.22:0/2548189932 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f377015a4d0 0x7f3770072a80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f37600097c0 tx=0x7f376001c3c0 comp rx=0 tx=0).stop 2024-05-21T13:36:30.064 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.085+0000 7f3775cfd640 1 -- 172.21.15.22:0/2548189932 shutdown_connections 2024-05-21T13:36:30.064 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.085+0000 7f3775cfd640 1 --2- 172.21.15.22:0/2548189932 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f377015a4d0 0x7f3770072a80 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:30.064 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.085+0000 7f3775cfd640 1 --2- 172.21.15.22:0/2548189932 >> v2:172.21.15.22:3300/0 conn(0x7f377015a0f0 0x7f377015ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:30.064 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.085+0000 7f3775cfd640 1 -- 172.21.15.22:0/2548189932 >> 172.21.15.22:0/2548189932 conn(0x7f37700703a0 msgr2=0x7f37700cd250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:30.064 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.085+0000 7f3775cfd640 1 -- 172.21.15.22:0/2548189932 shutdown_connections 2024-05-21T13:36:30.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.085+0000 7f3775cfd640 1 -- 172.21.15.22:0/2548189932 wait complete. 2024-05-21T13:36:30.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.089+0000 7f3775cfd640 1 Processor -- start 2024-05-21T13:36:30.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.089+0000 7f3775cfd640 1 -- start start 2024-05-21T13:36:30.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.089+0000 7f3775cfd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f377006f2d0 0x7f377014bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:30.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.089+0000 7f3775cfd640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f377015a0f0 0x7f3770137ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:30.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.089+0000 7f3775cfd640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f377015a4d0 0x7f37700c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:30.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.089+0000 7f3775cfd640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f3770072280 con 0x7f377006f2d0 2024-05-21T13:36:30.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.089+0000 7f3775cfd640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f37700c9010 con 0x7f377015a4d0 2024-05-21T13:36:30.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.089+0000 7f3775cfd640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f37700c9ce0 con 0x7f377015a0f0 2024-05-21T13:36:30.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.089+0000 7f376f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f377006f2d0 0x7f377014bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:30.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.089+0000 7f376effd640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f377015a0f0 0x7f3770137ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:30.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.089+0000 7f376f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f377006f2d0 0x7f377014bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48452/0 (socket says 172.21.15.22:48452) 2024-05-21T13:36:30.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.089+0000 7f376f7fe640 1 -- 172.21.15.22:0/2178411748 learned_addr learned my addr 172.21.15.22:0/2178411748 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:30.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.089+0000 7f376ffff640 1 --2- 172.21.15.22:0/2178411748 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f377015a4d0 0x7f37700c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:30.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.089+0000 7f376f7fe640 1 -- 172.21.15.22:0/2178411748 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f377015a0f0 msgr2=0x7f3770137ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:30.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.089+0000 7f376f7fe640 1 --2- 172.21.15.22:0/2178411748 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f377015a0f0 0x7f3770137ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:30.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.089+0000 7f376f7fe640 1 -- 172.21.15.22:0/2178411748 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f377015a4d0 msgr2=0x7f37700c6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:30.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.089+0000 7f376f7fe640 1 --2- 172.21.15.22:0/2178411748 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f377015a4d0 0x7f37700c6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:30.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.089+0000 7f376f7fe640 1 -- 172.21.15.22:0/2178411748 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f377015dfe0 con 0x7f377006f2d0 2024-05-21T13:36:30.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.089+0000 7f376ffff640 1 --2- 172.21.15.22:0/2178411748 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f377015a4d0 0x7f37700c6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T13:36:30.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.089+0000 7f376f7fe640 1 --2- 172.21.15.22:0/2178411748 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f377006f2d0 0x7f377014bb80 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f376400c7f0 tx=0x7f376400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:30.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.093+0000 7f3757fff640 1 -- 172.21.15.22:0/2178411748 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3764015070 con 0x7f377006f2d0 2024-05-21T13:36:30.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.093+0000 7f3757fff640 1 -- 172.21.15.22:0/2178411748 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3764007a30 con 0x7f377006f2d0 2024-05-21T13:36:30.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.093+0000 7f3757fff640 1 -- 172.21.15.22:0/2178411748 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3764007e00 con 0x7f377006f2d0 2024-05-21T13:36:30.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.093+0000 7f3775cfd640 1 -- 172.21.15.22:0/2178411748 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3770149170 con 0x7f377006f2d0 2024-05-21T13:36:30.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.093+0000 7f3775cfd640 1 -- 172.21.15.22:0/2178411748 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f377014c8d0 con 0x7f377006f2d0 2024-05-21T13:36:30.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.097+0000 7f3775cfd640 1 -- 172.21.15.22:0/2178411748 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3770077bb0 con 0x7f377006f2d0 2024-05-21T13:36:30.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.097+0000 7f3757fff640 1 -- 172.21.15.22:0/2178411748 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f3764018070 con 0x7f377006f2d0 2024-05-21T13:36:30.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.097+0000 7f3757fff640 1 --2- 172.21.15.22:0/2178411748 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f375c06f500 0x7f375c0719c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:30.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.097+0000 7f3757fff640 1 -- 172.21.15.22:0/2178411748 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f376408f370 con 0x7f377006f2d0 2024-05-21T13:36:30.077 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.097+0000 7f376effd640 1 --2- 172.21.15.22:0/2178411748 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f375c06f500 0x7f375c0719c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:30.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.097+0000 7f376effd640 1 --2- 172.21.15.22:0/2178411748 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f375c06f500 0x7f375c0719c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f37600ad000 tx=0x7f37600a6000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:30.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.105+0000 7f3757fff640 1 -- 172.21.15.22:0/2178411748 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f376405b9d0 con 0x7f377006f2d0 2024-05-21T13:36:30.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.113+0000 7fb3142f3640 1 Processor -- start 2024-05-21T13:36:30.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.113+0000 7fb3142f3640 1 -- start start 2024-05-21T13:36:30.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.113+0000 7f9338b73640 1 Processor -- start 2024-05-21T13:36:30.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.113+0000 7f9338b73640 1 -- start start 2024-05-21T13:36:30.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.113+0000 7f9338b73640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f93340c6d40 0x7f93340c80f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:30.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.113+0000 7f9338b73640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93340c7120 con 0x7f93340c9230 2024-05-21T13:36:30.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.113+0000 7f9338b73640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93340c8830 con 0x7f93340c9990 2024-05-21T13:36:30.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.113+0000 7f9338b73640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f933416ca60 con 0x7f93340c6d40 2024-05-21T13:36:30.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.113+0000 7f933259c640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f93340c6d40 0x7f93340c80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:30.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.113+0000 7f933259c640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f93340c6d40 0x7f93340c80f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48456/0 (socket says 172.21.15.22:48456) 2024-05-21T13:36:30.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.113+0000 7f933259c640 1 -- 172.21.15.22:0/3885035197 learned_addr learned my addr 172.21.15.22:0/3885035197 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:30.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.113+0000 7fb3142f3640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb30c152120 0x7fb30c15b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:30.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.113+0000 7fb3142f3640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb30c158630 0x7fb30c072690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:30.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.113+0000 7fb3142f3640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb30c15b950 con 0x7fb30c158a50 2024-05-21T13:36:30.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.113+0000 7fb3142f3640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fb30c1581a0 con 0x7fb30c158630 2024-05-21T13:36:30.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.113+0000 7fb3142f3640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7fb30c15bc30 con 0x7fb30c152120 2024-05-21T13:36:30.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.117+0000 7fb312890640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fb30c158a50 0x7fb30c06df50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:44598/0 (socket says 172.21.15.22:44598) 2024-05-21T13:36:30.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.117+0000 7fb312890640 1 -- 172.21.15.22:0/2409129061 learned_addr learned my addr 172.21.15.22:0/2409129061 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-21T13:36:30.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.117+0000 7fb31188e640 1 --2- 172.21.15.22:0/2409129061 >> v2:172.21.15.22:3300/0 conn(0x7fb30c158630 0x7fb30c072690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:30.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.117+0000 7fb31208f640 1 --2- 172.21.15.22:0/2409129061 >> v2:172.21.15.115:3300/0 conn(0x7fb30c152120 0x7fb30c15b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:30.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.117+0000 7fb31188e640 1 -- 172.21.15.22:0/2409129061 >> v2:172.21.15.115:3300/0 conn(0x7fb30c152120 msgr2=0x7fb30c15b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:30.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.117+0000 7fb31188e640 1 --2- 172.21.15.22:0/2409129061 >> v2:172.21.15.115:3300/0 conn(0x7fb30c152120 0x7fb30c15b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:30.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.117+0000 7fb31188e640 1 -- 172.21.15.22:0/2409129061 >> v1:172.21.15.22:6789/0 conn(0x7fb30c158a50 legacy=0x7fb30c06df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:30.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.117+0000 7fb31188e640 1 -- 172.21.15.22:0/2409129061 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb30c15bf10 con 0x7fb30c158630 2024-05-21T13:36:30.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.113+0000 7f933259c640 1 -- 172.21.15.22:0/3885035197 >> v1:172.21.15.115:6789/0 conn(0x7f93340c9990 legacy=0x7f933406df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:30.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.117+0000 7fd2f8fcc640 1 Processor -- start 2024-05-21T13:36:30.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.117+0000 7fd2f8fcc640 1 -- start start 2024-05-21T13:36:30.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.117+0000 7fd2f8fcc640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd2f40c6d40 0x7fd2f40c80f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:30.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.113+0000 7f933259c640 1 -- 172.21.15.22:0/3885035197 >> v1:172.21.15.22:6789/0 conn(0x7f93340c9230 legacy=0x7f9334168a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:30.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.113+0000 7f933259c640 1 -- 172.21.15.22:0/3885035197 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f933416c130 con 0x7f93340c6d40 2024-05-21T13:36:30.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.117+0000 7efdd8be7640 1 Processor -- start 2024-05-21T13:36:30.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.117+0000 7f933259c640 1 --2- 172.21.15.22:0/3885035197 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f93340c6d40 0x7f93340c80f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9324009cd0 tx=0x7f932401e460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70adc9bf807b0bae server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:30.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.117+0000 7f933159a640 1 -- 172.21.15.22:0/3885035197 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93240092d0 con 0x7f93340c6d40 2024-05-21T13:36:30.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.117+0000 7f933159a640 1 -- 172.21.15.22:0/3885035197 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93240b0070 con 0x7f93340c6d40 2024-05-21T13:36:30.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.117+0000 7f933159a640 1 -- 172.21.15.22:0/3885035197 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93240076b0 con 0x7f93340c6d40 2024-05-21T13:36:30.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.117+0000 7fb31188e640 1 --2- 172.21.15.22:0/2409129061 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb30c158630 0x7fb30c072690 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb30c06eb40 tx=0x7fb2fc01ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f9ecc3f066bfb5b server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:30.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.117+0000 7efdd8be7640 1 -- start start 2024-05-21T13:36:30.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.121+0000 7f9338b73640 1 -- 172.21.15.22:0/3885035197 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f93340c6d40 msgr2=0x7f93340c80f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:30.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.117+0000 7fd2f8fcc640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd2f40c9990 0x7fd2f406df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:30.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.117+0000 7fd2f8fcc640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2f40c7120 con 0x7fd2f40c9230 2024-05-21T13:36:30.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.117+0000 7fd2f8fcc640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7fd2f416ca60 con 0x7fd2f40c6d40 2024-05-21T13:36:30.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.117+0000 7fd2f8fcc640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7fd2f40c8830 con 0x7fd2f40c9990 2024-05-21T13:36:30.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.121+0000 7f7063fff640 1 Processor -- start 2024-05-21T13:36:30.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.117+0000 7fd2f259c640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd2f40c6d40 0x7fd2f40c80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:30.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.117+0000 7fd2f2d9d640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fd2f40c9230 0x7fd2f4168a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.22:48422/0 (socket says 172.21.15.22:48422) 2024-05-21T13:36:30.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.117+0000 7fd2f2d9d640 1 -- 172.21.15.22:0/285953160 learned_addr learned my addr 172.21.15.22:0/285953160 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-21T13:36:30.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.121+0000 7f9338b73640 1 --2- 172.21.15.22:0/3885035197 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f93340c6d40 0x7f93340c80f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f9324009cd0 tx=0x7f932401e460 comp rx=0 tx=0).stop 2024-05-21T13:36:30.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.117+0000 7fd2f1d9b640 1 --2- 172.21.15.22:0/285953160 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd2f40c9990 0x7fd2f406df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:30.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.121+0000 7fd2f259c640 1 -- 172.21.15.22:0/285953160 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd2f40c9990 msgr2=0x7fd2f406df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:30.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.121+0000 7fd2f259c640 1 --2- 172.21.15.22:0/285953160 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd2f40c9990 0x7fd2f406df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:30.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.121+0000 7fd2f259c640 1 -- 172.21.15.22:0/285953160 >> v1:172.21.15.115:6789/0 conn(0x7fd2f40c9230 legacy=0x7fd2f4168a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:30.103 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.121+0000 7fd2f259c640 1 -- 172.21.15.22:0/285953160 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2f416c130 con 0x7fd2f40c6d40 2024-05-21T13:36:30.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.121+0000 7f9338b73640 1 -- 172.21.15.22:0/3885035197 shutdown_connections 2024-05-21T13:36:30.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.121+0000 7f9338b73640 1 --2- 172.21.15.22:0/3885035197 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f93340c6d40 0x7f93340c80f0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:30.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.121+0000 7f9338b73640 1 -- 172.21.15.22:0/3885035197 >> 172.21.15.22:0/3885035197 conn(0x7f933406ce70 msgr2=0x7f93340cd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:30.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.121+0000 7f7063fff640 1 -- start start 2024-05-21T13:36:30.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.121+0000 7f7063fff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f705c0d5000 0x7f705c04c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:30.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.121+0000 7f7063fff640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f705c0347a0 0x7f705c0dad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:30.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.121+0000 7f7063fff640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f705c04c820 con 0x7f705c0db270 2024-05-21T13:36:30.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.121+0000 7f7063fff640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f705c04b990 con 0x7f705c0347a0 2024-05-21T13:36:30.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.121+0000 7f7063fff640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f705c04bc70 con 0x7f705c0d5000 2024-05-21T13:36:30.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.121+0000 7efdd8be7640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efdd415ba90 0x7efdd4158520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:30.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.121+0000 7efdd8be7640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7efdd4072280 0x7efdd4151dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:30.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.121+0000 7efdd8be7640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdd40736e0 con 0x7efdd40cdd00 2024-05-21T13:36:30.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.121+0000 7efdd8be7640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7efdd4073290 con 0x7efdd4072280 2024-05-21T13:36:30.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.121+0000 7efdd8be7640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7efdd40739c0 con 0x7efdd415ba90 2024-05-21T13:36:30.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.121+0000 7efdd37fe640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7efdd40cdd00 0x7efdd415b380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:44602/0 (socket says 172.21.15.22:44602) 2024-05-21T13:36:30.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.121+0000 7efdd37fe640 1 -- 172.21.15.22:0/628144407 learned_addr learned my addr 172.21.15.22:0/628144407 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-21T13:36:30.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.121+0000 7efdd2ffd640 1 --2- 172.21.15.22:0/628144407 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efdd415ba90 0x7efdd4158520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:30.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.121+0000 7efdd27fc640 1 -- 172.21.15.22:0/628144407 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1057293432 0 0) 0x7efdd40736e0 con 0x7efdd40cdd00 2024-05-21T13:36:30.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.121+0000 7efdd27fc640 1 -- 172.21.15.22:0/628144407 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efdbc003530 con 0x7efdd40cdd00 2024-05-21T13:36:30.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.121+0000 7fb92a4ca640 1 Processor -- start 2024-05-21T13:36:30.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.121+0000 7fb92a4ca640 1 -- start start 2024-05-21T13:36:30.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.121+0000 7f70627fc640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f705c0347a0 0x7f705c0dad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:30.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.121+0000 7f9338b73640 1 -- 172.21.15.22:0/3885035197 shutdown_connections 2024-05-21T13:36:30.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.121+0000 7f9338b73640 1 -- 172.21.15.22:0/3885035197 wait complete. 2024-05-21T13:36:30.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.121+0000 7fb31108d640 1 -- 172.21.15.22:0/2409129061 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2fc0b5070 con 0x7fb30c158630 2024-05-21T13:36:30.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.121+0000 7fb31108d640 1 -- 172.21.15.22:0/2409129061 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2fc0a8970 con 0x7fb30c158630 2024-05-21T13:36:30.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.121+0000 7fb31108d640 1 -- 172.21.15.22:0/2409129061 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2fc0a8d40 con 0x7fb30c158630 2024-05-21T13:36:30.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.121+0000 7fd2f259c640 1 --2- 172.21.15.22:0/285953160 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd2f40c6d40 0x7fd2f40c80f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd2e400b9e0 tx=0x7fd2e4027520 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c3a3a910ccd5a96f server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:30.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.121+0000 7f7062ffd640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f705c0d5000 0x7f705c04c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:30.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.121+0000 7f70637fe640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f705c0db270 0x7f705c0de2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.22:48432/0 (socket says 172.21.15.22:48432) 2024-05-21T13:36:30.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.121+0000 7f70637fe640 1 -- 172.21.15.22:0/1099728527 learned_addr learned my addr 172.21.15.22:0/1099728527 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-21T13:36:30.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.121+0000 7efdd2ffd640 1 -- 172.21.15.22:0/628144407 >> v2:172.21.15.115:3300/0 conn(0x7efdd4072280 msgr2=0x7efdd4151dd0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-21T13:36:30.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.121+0000 7efdd2ffd640 1 --2- 172.21.15.22:0/628144407 >> v2:172.21.15.115:3300/0 conn(0x7efdd4072280 0x7efdd4151dd0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:30.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.121+0000 7efdd2ffd640 1 -- 172.21.15.22:0/628144407 >> v1:172.21.15.22:6789/0 conn(0x7efdd40cdd00 legacy=0x7efdd415b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:30.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.121+0000 7efdd2ffd640 1 -- 172.21.15.22:0/628144407 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdd4073ca0 con 0x7efdd415ba90 2024-05-21T13:36:30.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.121+0000 7fd2f159a640 1 -- 172.21.15.22:0/285953160 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e40b6070 con 0x7fd2f40c6d40 2024-05-21T13:36:30.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.121+0000 7fb92a4ca640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb924152880 0x7fb9240c9c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:30.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.121+0000 7fb3142f3640 1 -- 172.21.15.22:0/2409129061 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb30c158630 msgr2=0x7fb30c072690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:30.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.121+0000 7fb3142f3640 1 --2- 172.21.15.22:0/2409129061 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb30c158630 0x7fb30c072690 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb30c06eb40 tx=0x7fb2fc01ec90 comp rx=0 tx=0).stop 2024-05-21T13:36:30.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.121+0000 7fb92a4ca640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb9240c46e0 0x7fb9240ca1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:30.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.121+0000 7f7061ffb640 1 -- 172.21.15.22:0/1099728527 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 528778017 0 0) 0x7f7064051780 con 0x7f705c0db270 2024-05-21T13:36:30.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.121+0000 7f7061ffb640 1 -- 172.21.15.22:0/1099728527 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f704c005740 con 0x7f705c0db270 2024-05-21T13:36:30.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.121+0000 7f7062ffd640 1 -- 172.21.15.22:0/1099728527 >> v2:172.21.15.115:3300/0 conn(0x7f705c0347a0 msgr2=0x7f705c0dad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:30.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.121+0000 7f7062ffd640 1 --2- 172.21.15.22:0/1099728527 >> v2:172.21.15.115:3300/0 conn(0x7f705c0347a0 0x7f705c0dad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:30.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.121+0000 7f7062ffd640 1 -- 172.21.15.22:0/1099728527 >> v1:172.21.15.115:6789/0 conn(0x7f705c0db270 legacy=0x7f705c0de2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:30.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.121+0000 7f7062ffd640 1 -- 172.21.15.22:0/1099728527 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f705c006a50 con 0x7f705c0d5000 2024-05-21T13:36:30.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.121+0000 7fd2f159a640 1 -- 172.21.15.22:0/285953160 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2e40ba600 con 0x7fd2f40c6d40 2024-05-21T13:36:30.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.121+0000 7fd2f159a640 1 -- 172.21.15.22:0/285953160 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e40ba9d0 con 0x7fd2f40c6d40 2024-05-21T13:36:30.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.125+0000 7fd2f8fcc640 1 -- 172.21.15.22:0/285953160 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd2f40c6d40 msgr2=0x7fd2f40c80f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:30.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.125+0000 7fd2f8fcc640 1 --2- 172.21.15.22:0/285953160 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd2f40c6d40 0x7fd2f40c80f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd2e400b9e0 tx=0x7fd2e4027520 comp rx=0 tx=0).stop 2024-05-21T13:36:30.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.125+0000 7fb92a4ca640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9240722f0 con 0x7fb9240c7310 2024-05-21T13:36:30.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.125+0000 7fb92a4ca640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7fb9240725b0 con 0x7fb9240c46e0 2024-05-21T13:36:30.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.125+0000 7f9338b73640 1 Processor -- start 2024-05-21T13:36:30.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.125+0000 7fb92a4ca640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7fb9241589d0 con 0x7fb924152880 2024-05-21T13:36:30.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.125+0000 7fb3142f3640 1 -- 172.21.15.22:0/2409129061 shutdown_connections 2024-05-21T13:36:30.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.125+0000 7fb3142f3640 1 --2- 172.21.15.22:0/2409129061 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb30c158630 0x7fb30c072690 secure :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb30c06eb40 tx=0x7fb2fc01ec90 comp rx=0 tx=0).stop 2024-05-21T13:36:30.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.125+0000 7fb3142f3640 1 --2- 172.21.15.22:0/2409129061 >> v2:172.21.15.115:3300/0 conn(0x7fb30c152120 0x7fb30c15b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:30.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.125+0000 7fb3142f3640 1 -- 172.21.15.22:0/2409129061 >> 172.21.15.22:0/2409129061 conn(0x7fb30c06ce70 msgr2=0x7fb30c0cd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:30.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.125+0000 7fb9294c8640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb924152880 0x7fb9240c9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:30.114 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.125+0000 7fd2f8fcc640 1 -- 172.21.15.22:0/285953160 shutdown_connections 2024-05-21T13:36:30.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.125+0000 7fb9294c8640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb924152880 0x7fb9240c9c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.22:42246/0 (socket says 172.21.15.22:42246) 2024-05-21T13:36:30.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.125+0000 7fb9294c8640 1 -- 172.21.15.22:0/79454592 learned_addr learned my addr 172.21.15.22:0/79454592 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:30.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.125+0000 7fd2f8fcc640 1 --2- 172.21.15.22:0/285953160 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd2f40c9990 0x7fd2f406df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:30.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.125+0000 7fd2f8fcc640 1 --2- 172.21.15.22:0/285953160 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd2f40c6d40 0x7fd2f40c80f0 secure :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fd2e400b9e0 tx=0x7fd2e4027520 comp rx=0 tx=0).stop 2024-05-21T13:36:30.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.125+0000 7fd2f8fcc640 1 -- 172.21.15.22:0/285953160 >> 172.21.15.22:0/285953160 conn(0x7fd2f406ce70 msgr2=0x7fd2f40cd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:30.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.125+0000 7fd2f8fcc640 1 -- 172.21.15.22:0/285953160 shutdown_connections 2024-05-21T13:36:30.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.125+0000 7fd2f8fcc640 1 -- 172.21.15.22:0/285953160 wait complete. 2024-05-21T13:36:30.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.125+0000 7efdd2ffd640 1 --2- 172.21.15.22:0/628144407 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efdd415ba90 0x7efdd4158520 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7efdc4013050 tx=0x7efdc40273b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16bff1a6cc24a843 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:30.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.125+0000 7fb9294c8640 1 -- 172.21.15.22:0/79454592 >> v2:172.21.15.115:3300/0 conn(0x7fb9240c46e0 msgr2=0x7fb9240ca1b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-21T13:36:30.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.125+0000 7fb9294c8640 1 --2- 172.21.15.22:0/79454592 >> v2:172.21.15.115:3300/0 conn(0x7fb9240c46e0 0x7fb9240ca1b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:30.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.125+0000 7fb9294c8640 1 -- 172.21.15.22:0/79454592 >> v1:172.21.15.115:6789/0 conn(0x7fb9240c7310 legacy=0x7fb9240c7be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:30.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.125+0000 7fb9294c8640 1 -- 172.21.15.22:0/79454592 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb924158cb0 con 0x7fb924152880 2024-05-21T13:36:30.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.125+0000 7fb3142f3640 1 -- 172.21.15.22:0/2409129061 shutdown_connections 2024-05-21T13:36:30.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.125+0000 7f9338b73640 1 -- start start 2024-05-21T13:36:30.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.125+0000 7f9338b73640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f93340c6d40 0x7f9334164660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:30.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.125+0000 7f9338b73640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f93340c9230 0x7f93341f4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:30.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.125+0000 7f9338b73640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f93340c9990 0x7f9334162e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:30.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.125+0000 7f9338b73640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f933406e660 con 0x7f93340c9230 2024-05-21T13:36:30.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.125+0000 7f9338b73640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f933416c6f0 con 0x7f93340c9990 2024-05-21T13:36:30.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.125+0000 7f9338b73640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f933406e7e0 con 0x7f93340c6d40 2024-05-21T13:36:30.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.125+0000 7f933259c640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f93340c6d40 0x7f9334164660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:30.118 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.125+0000 7fd2f8fcc640 1 Processor -- start 2024-05-21T13:36:30.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.125+0000 7efdd27fc640 1 -- 172.21.15.22:0/628144407 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc40bc070 con 0x7efdd415ba90 2024-05-21T13:36:30.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.125+0000 7efdd27fc640 1 -- 172.21.15.22:0/628144407 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdc40112d0 con 0x7efdd415ba90 2024-05-21T13:36:30.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.125+0000 7efdd27fc640 1 -- 172.21.15.22:0/628144407 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc40116a0 con 0x7efdd415ba90 2024-05-21T13:36:30.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.125+0000 7f9332d9d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f93340c9990 0x7f9334162e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:30.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.125+0000 7f933259c640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f93340c6d40 0x7f9334164660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.22:42252/0 (socket says 172.21.15.22:42252) 2024-05-21T13:36:30.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.125+0000 7f933259c640 1 -- 172.21.15.22:0/3782847794 learned_addr learned my addr 172.21.15.22:0/3782847794 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:30.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.125+0000 7f9331d9b640 1 --2- 172.21.15.22:0/3782847794 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f93340c9230 0x7f93341f4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:30.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.125+0000 7f7062ffd640 1 --2- 172.21.15.22:0/1099728527 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f705c0d5000 0x7f705c04c2e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f705400c1e0 tx=0x7f70540273e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d61459d14bdb9724 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:30.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.125+0000 7efdd8be7640 1 -- 172.21.15.22:0/628144407 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efdd415ba90 msgr2=0x7efdd4158520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:30.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.125+0000 7efdd8be7640 1 --2- 172.21.15.22:0/628144407 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efdd415ba90 0x7efdd4158520 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7efdc4013050 tx=0x7efdc40273b0 comp rx=0 tx=0).stop 2024-05-21T13:36:30.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.125+0000 7efdd8be7640 1 -- 172.21.15.22:0/628144407 shutdown_connections 2024-05-21T13:36:30.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.125+0000 7efdd8be7640 1 --2- 172.21.15.22:0/628144407 >> v2:172.21.15.115:3300/0 conn(0x7efdd4072280 0x7efdd4151dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:30.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.125+0000 7efdd8be7640 1 --2- 172.21.15.22:0/628144407 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efdd415ba90 0x7efdd4158520 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:30.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.125+0000 7efdd8be7640 1 -- 172.21.15.22:0/628144407 >> 172.21.15.22:0/628144407 conn(0x7efdd40cd1e0 msgr2=0x7efdd40cd5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:30.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.125+0000 7f9331d9b640 1 -- 172.21.15.22:0/3782847794 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f93340c6d40 msgr2=0x7f9334164660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:30.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.125+0000 7f9331d9b640 1 --2- 172.21.15.22:0/3782847794 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f93340c6d40 0x7f9334164660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:30.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.125+0000 7f9331d9b640 1 -- 172.21.15.22:0/3782847794 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f93340c9990 msgr2=0x7f9334162e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:30.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.125+0000 7f9331d9b640 1 --2- 172.21.15.22:0/3782847794 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f93340c9990 0x7f9334162e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:30.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.125+0000 7f9331d9b640 1 -- 172.21.15.22:0/3782847794 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93342067a0 con 0x7f93340c9230 2024-05-21T13:36:30.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.125+0000 7f9331d9b640 1 --2- 172.21.15.22:0/3782847794 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f93340c9230 0x7f93341f4da0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f932c00c8a0 tx=0x7f932c00cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:30.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.125+0000 7fd2f8fcc640 1 -- start start 2024-05-21T13:36:30.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.125+0000 7efdd8be7640 1 -- 172.21.15.22:0/628144407 shutdown_connections 2024-05-21T13:36:30.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.125+0000 7efdd8be7640 1 -- 172.21.15.22:0/628144407 wait complete. 2024-05-21T13:36:30.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.125+0000 7fb3142f3640 1 -- 172.21.15.22:0/2409129061 wait complete. 2024-05-21T13:36:30.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.129+0000 7fb3142f3640 1 Processor -- start 2024-05-21T13:36:30.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.129+0000 7efdd8be7640 1 Processor -- start 2024-05-21T13:36:30.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.129+0000 7fb9294c8640 1 --2- 172.21.15.22:0/79454592 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb924152880 0x7fb9240c9c70 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb914009870 tx=0x7fb91401c5a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5413f34f03471ead server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:30.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.129+0000 7f7061ffb640 1 -- 172.21.15.22:0/1099728527 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70540bc070 con 0x7f705c0d5000 2024-05-21T13:36:30.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.129+0000 7f7061ffb640 1 -- 172.21.15.22:0/1099728527 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7054008be0 con 0x7f705c0d5000 2024-05-21T13:36:30.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.129+0000 7f7061ffb640 1 -- 172.21.15.22:0/1099728527 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f705400a0d0 con 0x7f705c0d5000 2024-05-21T13:36:30.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.129+0000 7fd2f8fcc640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd2f40c9230 0x7fd2f40c5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:30.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.129+0000 7fd2f8fcc640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd2f40c9990 0x7fd2f41fffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:30.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.129+0000 7fd2f8fcc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd2f42004e0 0x7fd2f4202290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:30.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.129+0000 7fd2f8fcc640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd2f4169110 con 0x7fd2f42004e0 2024-05-21T13:36:30.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.129+0000 7fd2f8fcc640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fd2f416c6f0 con 0x7fd2f40c9230 2024-05-21T13:36:30.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.129+0000 7fd2f8fcc640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7fd2f4169290 con 0x7fd2f40c9990 2024-05-21T13:36:30.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.129+0000 7fd2f2d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd2f42004e0 0x7fd2f4202290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:30.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.129+0000 7fb91bfff640 1 -- 172.21.15.22:0/79454592 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9140aa5f0 con 0x7fb924152880 2024-05-21T13:36:30.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.129+0000 7fd2f2d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd2f42004e0 0x7fd2f4202290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48494/0 (socket says 172.21.15.22:48494) 2024-05-21T13:36:30.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.129+0000 7fd2f2d9d640 1 -- 172.21.15.22:0/3852671548 learned_addr learned my addr 172.21.15.22:0/3852671548 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:30.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.129+0000 7fd2f1d9b640 1 --2- 172.21.15.22:0/3852671548 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd2f40c9990 0x7fd2f41fffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:30.126 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.129+0000 7fb91bfff640 1 -- 172.21.15.22:0/79454592 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9140af070 con 0x7fb924152880 2024-05-21T13:36:30.126 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.129+0000 7fb91bfff640 1 -- 172.21.15.22:0/79454592 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9140aa9b0 con 0x7fb924152880 2024-05-21T13:36:30.126 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.129+0000 7fd2f2d9d640 1 -- 172.21.15.22:0/3852671548 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd2f40c9990 msgr2=0x7fd2f41fffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:30.126 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.129+0000 7fd2f2d9d640 1 --2- 172.21.15.22:0/3852671548 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd2f40c9990 0x7fd2f41fffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:30.126 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.129+0000 7fd2f2d9d640 1 -- 172.21.15.22:0/3852671548 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd2f40c9230 msgr2=0x7fd2f40c5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:30.126 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.129+0000 7fd2f2d9d640 1 --2- 172.21.15.22:0/3852671548 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd2f40c9230 0x7fd2f40c5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:30.126 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.129+0000 7fd2f2d9d640 1 -- 172.21.15.22:0/3852671548 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2f4200970 con 0x7fd2f42004e0 2024-05-21T13:36:30.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.129+0000 7f7063fff640 1 -- 172.21.15.22:0/1099728527 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f705c0d5000 msgr2=0x7f705c04c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:30.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.129+0000 7f7063fff640 1 --2- 172.21.15.22:0/1099728527 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f705c0d5000 0x7f705c04c2e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f705400c1e0 tx=0x7f70540273e0 comp rx=0 tx=0).stop 2024-05-21T13:36:30.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.129+0000 7f9322ffd640 1 -- 172.21.15.22:0/3782847794 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f932c017070 con 0x7f93340c9230 2024-05-21T13:36:30.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.129+0000 7efdd8be7640 1 -- start start 2024-05-21T13:36:30.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.129+0000 7fb3142f3640 1 -- start start 2024-05-21T13:36:30.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.129+0000 7fb3142f3640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb30c152120 0x7fb30c15a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:30.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.129+0000 7fb3142f3640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb30c158a50 0x7fb30c0c5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:30.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.129+0000 7fb3142f3640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb30c15ac30 0x7fb30c1f1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:30.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.129+0000 7fb3142f3640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb30c073330 con 0x7fb30c158a50 2024-05-21T13:36:30.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.129+0000 7fb3142f3640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fb30c157e30 con 0x7fb30c152120 2024-05-21T13:36:30.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.129+0000 7fb3142f3640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7fb30c06e660 con 0x7fb30c15ac30 2024-05-21T13:36:30.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.129+0000 7fd2f2d9d640 1 --2- 172.21.15.22:0/3852671548 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd2f42004e0 0x7fd2f4202290 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec00c770 tx=0x7fd2ec00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:30.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.129+0000 7fb92a4ca640 1 -- 172.21.15.22:0/79454592 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb924152880 msgr2=0x7fb9240c9c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:30.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.129+0000 7fb92a4ca640 1 --2- 172.21.15.22:0/79454592 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb924152880 0x7fb9240c9c70 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb914009870 tx=0x7fb91401c5a0 comp rx=0 tx=0).stop 2024-05-21T13:36:30.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.129+0000 7fb312890640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb30c15ac30 0x7fb30c1f1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:30.129 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.129+0000 7fb31208f640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb30c152120 0x7fb30c15a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:30.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.129+0000 7fb31188e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb30c158a50 0x7fb30c0c5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:30.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.129+0000 7fb31188e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb30c158a50 0x7fb30c0c5790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48498/0 (socket says 172.21.15.22:48498) 2024-05-21T13:36:30.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.129+0000 7fb312890640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb30c15ac30 0x7fb30c1f1990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.22:42274/0 (socket says 172.21.15.22:42274) 2024-05-21T13:36:30.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.129+0000 7fb31188e640 1 -- 172.21.15.22:0/2158514116 learned_addr learned my addr 172.21.15.22:0/2158514116 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:30.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.129+0000 7fd2e2ffd640 1 -- 172.21.15.22:0/3852671548 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2ec017070 con 0x7fd2f42004e0 2024-05-21T13:36:30.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.129+0000 7fd2e2ffd640 1 -- 172.21.15.22:0/3852671548 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2ec00a840 con 0x7fd2f42004e0 2024-05-21T13:36:30.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.129+0000 7fd2e2ffd640 1 -- 172.21.15.22:0/3852671548 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2ec007280 con 0x7fd2f42004e0 2024-05-21T13:36:30.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.129+0000 7fb92a4ca640 1 -- 172.21.15.22:0/79454592 shutdown_connections 2024-05-21T13:36:30.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.129+0000 7fb92a4ca640 1 --2- 172.21.15.22:0/79454592 >> v2:172.21.15.115:3300/0 conn(0x7fb9240c46e0 0x7fb9240ca1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:30.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.129+0000 7fb92a4ca640 1 --2- 172.21.15.22:0/79454592 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb924152880 0x7fb9240c9c70 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:30.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.129+0000 7fb92a4ca640 1 -- 172.21.15.22:0/79454592 >> 172.21.15.22:0/79454592 conn(0x7fb92406c4f0 msgr2=0x7fb92406c900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:30.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.129+0000 7fb92a4ca640 1 -- 172.21.15.22:0/79454592 shutdown_connections 2024-05-21T13:36:30.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.129+0000 7fb92a4ca640 1 -- 172.21.15.22:0/79454592 wait complete. 2024-05-21T13:36:30.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.129+0000 7efdd8be7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efdd4072280 0x7efdd41edb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:30.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.129+0000 7efdd8be7640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efdd40cdd00 0x7efdd41529e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:30.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.129+0000 7efdd8be7640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efdd415ba90 0x7efdd4152f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:30.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.129+0000 7efdd8be7640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7efdd40c9910 con 0x7efdd4072280 2024-05-21T13:36:30.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.129+0000 7efdd8be7640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7efdd4072f20 con 0x7efdd40cdd00 2024-05-21T13:36:30.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.129+0000 7efdd8be7640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7efdd40c9a90 con 0x7efdd415ba90 2024-05-21T13:36:30.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.129+0000 7fd2f8fcc640 1 -- 172.21.15.22:0/3852671548 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2f40c2440 con 0x7fd2f42004e0 2024-05-21T13:36:30.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.129+0000 7fd2f8fcc640 1 -- 172.21.15.22:0/3852671548 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2f40c2a00 con 0x7fd2f42004e0 2024-05-21T13:36:30.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.129+0000 7f7063fff640 1 -- 172.21.15.22:0/1099728527 shutdown_connections 2024-05-21T13:36:30.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.129+0000 7f7063fff640 1 --2- 172.21.15.22:0/1099728527 >> v2:172.21.15.115:3300/0 conn(0x7f705c0347a0 0x7f705c0dad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:30.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.129+0000 7f7063fff640 1 --2- 172.21.15.22:0/1099728527 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f705c0d5000 0x7f705c04c2e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:30.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.129+0000 7f7063fff640 1 -- 172.21.15.22:0/1099728527 >> 172.21.15.22:0/1099728527 conn(0x7f705c050190 msgr2=0x7f705c0505a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:30.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.129+0000 7f7063fff640 1 -- 172.21.15.22:0/1099728527 shutdown_connections 2024-05-21T13:36:30.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.129+0000 7efdd3fff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efdd415ba90 0x7efdd4152f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:30.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.129+0000 7efdd3fff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efdd415ba90 0x7efdd4152f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.22:42280/0 (socket says 172.21.15.22:42280) 2024-05-21T13:36:30.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.129+0000 7efdd3fff640 1 -- 172.21.15.22:0/1507884110 learned_addr learned my addr 172.21.15.22:0/1507884110 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:30.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.129+0000 7efdd2ffd640 1 --2- 172.21.15.22:0/1507884110 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efdd40cdd00 0x7efdd41529e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:30.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.129+0000 7fd2f8fcc640 1 -- 172.21.15.22:0/3852671548 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2f4077bb0 con 0x7fd2f42004e0 2024-05-21T13:36:30.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.129+0000 7efdd3fff640 1 -- 172.21.15.22:0/1507884110 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efdd40cdd00 msgr2=0x7efdd41529e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:30.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.129+0000 7efdd3fff640 1 --2- 172.21.15.22:0/1507884110 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efdd40cdd00 0x7efdd41529e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:30.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.129+0000 7efdd3fff640 1 -- 172.21.15.22:0/1507884110 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efdd4072280 msgr2=0x7efdd41edb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:30.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.129+0000 7efdd3fff640 1 --2- 172.21.15.22:0/1507884110 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efdd4072280 0x7efdd41edb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:30.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.129+0000 7efdd3fff640 1 -- 172.21.15.22:0/1507884110 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdd40cbbd0 con 0x7efdd415ba90 2024-05-21T13:36:30.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.133+0000 7efdd3fff640 1 --2- 172.21.15.22:0/1507884110 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efdd415ba90 0x7efdd4152f20 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7efdc800b440 tx=0x7efdc800b900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:30.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.133+0000 7fb92a4ca640 1 Processor -- start 2024-05-21T13:36:30.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.129+0000 7fb31188e640 1 -- 172.21.15.22:0/2158514116 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb30c15ac30 msgr2=0x7fb30c1f1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:30.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.129+0000 7fb31188e640 1 --2- 172.21.15.22:0/2158514116 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb30c15ac30 0x7fb30c1f1990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:30.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.129+0000 7fb31188e640 1 -- 172.21.15.22:0/2158514116 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb30c152120 msgr2=0x7fb30c15a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:30.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.129+0000 7fb31188e640 1 --2- 172.21.15.22:0/2158514116 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb30c152120 0x7fb30c15a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:30.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.129+0000 7fb31188e640 1 -- 172.21.15.22:0/2158514116 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb30c1ff410 con 0x7fb30c158a50 2024-05-21T13:36:30.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.129+0000 7fb31188e640 1 --2- 172.21.15.22:0/2158514116 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb30c158a50 0x7fb30c0c5790 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc01b8a0 tx=0x7fb2fc01ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:30.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.133+0000 7fb302ffd640 1 -- 172.21.15.22:0/2158514116 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2fc0c0070 con 0x7fb30c158a50 2024-05-21T13:36:30.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.133+0000 7fb302ffd640 1 -- 172.21.15.22:0/2158514116 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2fc004230 con 0x7fb30c158a50 2024-05-21T13:36:30.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.133+0000 7fb302ffd640 1 -- 172.21.15.22:0/2158514116 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2fc0b5040 con 0x7fb30c158a50 2024-05-21T13:36:30.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.133+0000 7efdbbfff640 1 -- 172.21.15.22:0/1507884110 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc8015020 con 0x7efdd415ba90 2024-05-21T13:36:30.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.133+0000 7efdbbfff640 1 -- 172.21.15.22:0/1507884110 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdc8011890 con 0x7efdd415ba90 2024-05-21T13:36:30.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.133+0000 7efdbbfff640 1 -- 172.21.15.22:0/1507884110 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc8011c80 con 0x7efdd415ba90 2024-05-21T13:36:30.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.133+0000 7efdd8be7640 1 -- 172.21.15.22:0/1507884110 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdd41e0e80 con 0x7efdd415ba90 2024-05-21T13:36:30.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.129+0000 7f7063fff640 1 -- 172.21.15.22:0/1099728527 wait complete. 2024-05-21T13:36:30.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.133+0000 7f7063fff640 1 Processor -- start 2024-05-21T13:36:30.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.133+0000 7efdd8be7640 1 -- 172.21.15.22:0/1507884110 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7efdd41521e0 con 0x7efdd415ba90 2024-05-21T13:36:30.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.133+0000 7f9322ffd640 1 -- 172.21.15.22:0/3782847794 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f932c003db0 con 0x7f93340c9230 2024-05-21T13:36:30.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.133+0000 7f9338b73640 1 -- 172.21.15.22:0/3782847794 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9334206a80 con 0x7f93340c9230 2024-05-21T13:36:30.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.133+0000 7fd2e2ffd640 1 -- 172.21.15.22:0/3852671548 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fd2ec01a070 con 0x7fd2f42004e0 2024-05-21T13:36:30.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.133+0000 7f9338b73640 1 -- 172.21.15.22:0/3782847794 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9334207040 con 0x7f93340c9230 2024-05-21T13:36:30.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.133+0000 7fb92a4ca640 1 -- start start 2024-05-21T13:36:30.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.133+0000 7f9322ffd640 1 -- 172.21.15.22:0/3782847794 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f932c0052b0 con 0x7f93340c9230 2024-05-21T13:36:30.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.133+0000 7f7063fff640 1 -- start start 2024-05-21T13:36:30.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.133+0000 7f7063fff640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f705c0347a0 0x7f705c0d60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:30.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.133+0000 7f7063fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f705c0d5000 0x7f705c0d8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:30.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.133+0000 7f7063fff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f705c0db270 0x7f705c0d7ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:30.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.133+0000 7f7063fff640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f705c045130 con 0x7f705c0d5000 2024-05-21T13:36:30.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.133+0000 7f7063fff640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f705c007010 con 0x7f705c0db270 2024-05-21T13:36:30.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.133+0000 7f7063fff640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f705c0d53e0 con 0x7f705c0347a0 2024-05-21T13:36:30.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.133+0000 7f7062ffd640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f705c0347a0 0x7f705c0d60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:30.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.133+0000 7f7062ffd640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f705c0347a0 0x7f705c0d60b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.22:42290/0 (socket says 172.21.15.22:42290) 2024-05-21T13:36:30.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.133+0000 7f7062ffd640 1 -- 172.21.15.22:0/1663017413 learned_addr learned my addr 172.21.15.22:0/1663017413 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:30.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.133+0000 7f70637fe640 1 --2- 172.21.15.22:0/1663017413 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f705c0db270 0x7f705c0d7ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:30.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.133+0000 7efdd8be7640 1 -- 172.21.15.22:0/1507884110 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdd4077bb0 con 0x7efdd415ba90 2024-05-21T13:36:30.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.133+0000 7fb92a4ca640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb9240c46e0 0x7fb9241f3140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:30.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.133+0000 7fb92a4ca640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb9240c7310 0x7fb924156790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:30.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.133+0000 7fb92a4ca640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb924152880 0x7fb9241f5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:30.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.133+0000 7fb92a4ca640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb9240c94e0 con 0x7fb9240c7310 2024-05-21T13:36:30.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.133+0000 7fb92a4ca640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fb9240c9360 con 0x7fb924152880 2024-05-21T13:36:30.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.133+0000 7fb92a4ca640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7fb9240c82f0 con 0x7fb9240c46e0 2024-05-21T13:36:30.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.133+0000 7f9338b73640 1 -- 172.21.15.22:0/3782847794 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93180052a0 con 0x7f93340c9230 2024-05-21T13:36:30.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.133+0000 7fb3142f3640 1 -- 172.21.15.22:0/2158514116 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb30c1ff6b0 con 0x7fb30c158a50 2024-05-21T13:36:30.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.133+0000 7fb3142f3640 1 -- 172.21.15.22:0/2158514116 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb30c1efdc0 con 0x7fb30c158a50 2024-05-21T13:36:30.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.133+0000 7f7062ffd640 1 -- 172.21.15.22:0/1663017413 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f705c0db270 msgr2=0x7f705c0d7ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:30.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.133+0000 7f7062ffd640 1 --2- 172.21.15.22:0/1663017413 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f705c0db270 0x7f705c0d7ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:30.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.133+0000 7f7062ffd640 1 -- 172.21.15.22:0/1663017413 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f705c0d5000 msgr2=0x7f705c0d8990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:30.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.133+0000 7f7062ffd640 1 --2- 172.21.15.22:0/1663017413 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f705c0d5000 0x7f705c0d8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:30.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.133+0000 7f7062ffd640 1 -- 172.21.15.22:0/1663017413 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f705c045600 con 0x7f705c0347a0 2024-05-21T13:36:30.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.133+0000 7f7062ffd640 1 --2- 172.21.15.22:0/1663017413 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f705c0347a0 0x7f705c0d60b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7054025010 tx=0x7f7054024180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:30.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.133+0000 7fb3142f3640 1 -- 172.21.15.22:0/2158514116 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb30c077bb0 con 0x7fb30c158a50 2024-05-21T13:36:30.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.133+0000 7fd2e2ffd640 1 --2- 172.21.15.22:0/3852671548 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fd2d406f430 0x7fd2d40718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:30.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.133+0000 7fd2e2ffd640 1 -- 172.21.15.22:0/3852671548 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd2ec08ec50 con 0x7fd2f42004e0 2024-05-21T13:36:30.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.133+0000 7fd2f259c640 1 --2- 172.21.15.22:0/3852671548 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fd2d406f430 0x7fd2d40718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:30.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.133+0000 7fd2f259c640 1 --2- 172.21.15.22:0/3852671548 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fd2d406f430 0x7fd2d40718f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd2e40bb000 tx=0x7fd2e4004740 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:30.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.137+0000 7efdbbfff640 1 -- 172.21.15.22:0/1507884110 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7efdc8018020 con 0x7efdd415ba90 2024-05-21T13:36:30.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.137+0000 7fb9294c8640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb9240c46e0 0x7fb9241f3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:30.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.137+0000 7fb9294c8640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb9240c46e0 0x7fb9241f3140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.22:42302/0 (socket says 172.21.15.22:42302) 2024-05-21T13:36:30.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.137+0000 7fb9294c8640 1 -- 172.21.15.22:0/3935112581 learned_addr learned my addr 172.21.15.22:0/3935112581 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:30.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.137+0000 7efdbbfff640 1 --2- 172.21.15.22:0/1507884110 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7efdc006f400 0x7efdc00718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:30.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.137+0000 7efdbbfff640 1 -- 172.21.15.22:0/1507884110 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7efdc808fbe0 con 0x7efdd415ba90 2024-05-21T13:36:30.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.137+0000 7fb9294c8640 1 -- 172.21.15.22:0/3935112581 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb924152880 msgr2=0x7fb9241f5b60 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-05-21T13:36:30.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.137+0000 7fb9294c8640 1 --2- 172.21.15.22:0/3935112581 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb924152880 0x7fb9241f5b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:30.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.137+0000 7fb9294c8640 1 -- 172.21.15.22:0/3935112581 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb9240c7310 msgr2=0x7fb924156790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:30.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.137+0000 7fb9294c8640 1 --2- 172.21.15.22:0/3935112581 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb9240c7310 0x7fb924156790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:30.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.137+0000 7fb9294c8640 1 -- 172.21.15.22:0/3935112581 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb924149870 con 0x7fb9240c46e0 2024-05-21T13:36:30.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.137+0000 7efdd37fe640 1 --2- 172.21.15.22:0/1507884110 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7efdc006f400 0x7efdc00718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:30.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.137+0000 7fb9294c8640 1 --2- 172.21.15.22:0/3935112581 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb9240c46e0 0x7fb9241f3140 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb91401ac50 tx=0x7fb914019340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:30.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.137+0000 7efdd37fe640 1 --2- 172.21.15.22:0/1507884110 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7efdc006f400 0x7efdc00718c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7efdcc0015b0 tx=0x7efdcc0016a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:30.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.137+0000 7fd2e2ffd640 1 -- 172.21.15.22:0/3852671548 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fd2ec094020 con 0x7fd2f42004e0 2024-05-21T13:36:30.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.141+0000 7f9322ffd640 1 -- 172.21.15.22:0/3782847794 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f932c01a070 con 0x7f93340c9230 2024-05-21T13:36:30.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.141+0000 7f9322ffd640 1 --2- 172.21.15.22:0/3782847794 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f931406f4d0 0x7f9314071990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:30.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.141+0000 7f9322ffd640 1 -- 172.21.15.22:0/3782847794 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f932c08f180 con 0x7f93340c9230 2024-05-21T13:36:30.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.141+0000 7f933259c640 1 --2- 172.21.15.22:0/3782847794 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f931406f4d0 0x7f9314071990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:30.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.141+0000 7f933259c640 1 --2- 172.21.15.22:0/3782847794 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f931406f4d0 0x7f9314071990 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f932401cb10 tx=0x7f93240a9000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:30.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.141+0000 7fb302ffd640 1 -- 172.21.15.22:0/2158514116 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fb2fc003620 con 0x7fb30c158a50 2024-05-21T13:36:30.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.141+0000 7fb302ffd640 1 --2- 172.21.15.22:0/2158514116 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fb2f006f400 0x7fb2f00718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:30.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.145+0000 7fb302ffd640 1 -- 172.21.15.22:0/2158514116 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb2fc12c530 con 0x7fb30c158a50 2024-05-21T13:36:30.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.145+0000 7fb31208f640 1 --2- 172.21.15.22:0/2158514116 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fb2f006f400 0x7fb2f00718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:30.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.145+0000 7fb31208f640 1 --2- 172.21.15.22:0/2158514116 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fb2f006f400 0x7fb2f00718c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb308003a50 tx=0x7fb30800f040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:30.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.145+0000 7f9322ffd640 1 -- 172.21.15.22:0/3782847794 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f932c021020 con 0x7f93340c9230 2024-05-21T13:36:30.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.149+0000 7f704b7fe640 1 -- 172.21.15.22:0/1663017413 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70540bc070 con 0x7f705c0347a0 2024-05-21T13:36:30.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.149+0000 7f704b7fe640 1 -- 172.21.15.22:0/1663017413 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7054015390 con 0x7f705c0347a0 2024-05-21T13:36:30.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.149+0000 7f704b7fe640 1 -- 172.21.15.22:0/1663017413 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70540b7400 con 0x7f705c0347a0 2024-05-21T13:36:30.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.149+0000 7f7063fff640 1 -- 172.21.15.22:0/1663017413 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f705c0d91d0 con 0x7f705c0347a0 2024-05-21T13:36:30.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.149+0000 7f7063fff640 1 -- 172.21.15.22:0/1663017413 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f705c185540 con 0x7f705c0347a0 2024-05-21T13:36:30.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.149+0000 7efdbbfff640 1 -- 172.21.15.22:0/1507884110 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7efdc801f020 con 0x7efdd415ba90 2024-05-21T13:36:30.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.149+0000 7fb302ffd640 1 -- 172.21.15.22:0/2158514116 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fb2fc0187f0 con 0x7fb30c158a50 2024-05-21T13:36:30.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.149+0000 7fb919ffb640 1 -- 172.21.15.22:0/3935112581 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9140be610 con 0x7fb9240c46e0 2024-05-21T13:36:30.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.149+0000 7fb92a4ca640 1 -- 172.21.15.22:0/3935112581 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb924144480 con 0x7fb9240c46e0 2024-05-21T13:36:30.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.149+0000 7fb92a4ca640 1 -- 172.21.15.22:0/3935112581 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fb924144740 con 0x7fb9240c46e0 2024-05-21T13:36:30.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.149+0000 7fb919ffb640 1 -- 172.21.15.22:0/3935112581 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9140be7b0 con 0x7fb9240c46e0 2024-05-21T13:36:30.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.149+0000 7fb919ffb640 1 -- 172.21.15.22:0/3935112581 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9140beba0 con 0x7fb9240c46e0 2024-05-21T13:36:30.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.149+0000 7fb92a4ca640 1 -- 172.21.15.22:0/3935112581 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb924076eb0 con 0x7fb9240c46e0 2024-05-21T13:36:30.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.149+0000 7f7063fff640 1 -- 172.21.15.22:0/1663017413 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f705c0053a0 con 0x7f705c0347a0 2024-05-21T13:36:30.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.153+0000 7fb919ffb640 1 -- 172.21.15.22:0/3935112581 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fb9140bc020 con 0x7fb9240c46e0 2024-05-21T13:36:30.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.153+0000 7fb919ffb640 1 --2- 172.21.15.22:0/3935112581 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fb90806f430 0x7fb9080718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:30.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.153+0000 7fb919ffb640 1 -- 172.21.15.22:0/3935112581 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb91412a4b0 con 0x7fb9240c46e0 2024-05-21T13:36:30.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.153+0000 7fb928cc7640 1 --2- 172.21.15.22:0/3935112581 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fb90806f430 0x7fb9080718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:30.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.153+0000 7f704b7fe640 1 -- 172.21.15.22:0/1663017413 <== mon.2 v2:172.21.15.115:3301/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f70540b75a0 con 0x7f705c0347a0 2024-05-21T13:36:30.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.153+0000 7f704b7fe640 1 --2- 172.21.15.22:0/1663017413 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f705006f480 0x7f7050071940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:30.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.157+0000 7f70627fc640 1 --2- 172.21.15.22:0/1663017413 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f705006f480 0x7f7050071940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:30.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.157+0000 7fb928cc7640 1 --2- 172.21.15.22:0/3935112581 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fb90806f430 0x7fb9080718f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb924163010 tx=0x7fb920006c50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:30.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.157+0000 7f70627fc640 1 --2- 172.21.15.22:0/1663017413 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f705006f480 0x7f7050071940 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7058006aa0 tx=0x7f7058006a30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:30.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.165+0000 7f704b7fe640 1 -- 172.21.15.22:0/1663017413 <== mon.2 v2:172.21.15.115:3301/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f70540f5950 con 0x7f705c0347a0 2024-05-21T13:36:30.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.165+0000 7fb919ffb640 1 -- 172.21.15.22:0/3935112581 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fb9140c3060 con 0x7fb9240c46e0 2024-05-21T13:36:30.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.177+0000 7f704b7fe640 1 -- 172.21.15.22:0/1663017413 <== mon.2 v2:172.21.15.115:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f7054020f40 con 0x7f705c0347a0 2024-05-21T13:36:30.308 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.329+0000 7f7b70786640 1 -- 172.21.15.22:0/3106606718 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f7b681f95a0 con 0x7f7b6815a4d0 2024-05-21T13:36:30.308 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.329+0000 7f7b5effd640 1 -- 172.21.15.22:0/3106606718 <== mon.1 v2:172.21.15.115:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7b6005bdc0 con 0x7f7b6815a4d0 2024-05-21T13:36:30.310 INFO:teuthology.orchestra.run.smithi022.stdout:64424509452 2024-05-21T13:36:30.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.333+0000 7f7b70786640 1 -- 172.21.15.22:0/3106606718 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f7b4c06f400 msgr2=0x7f7b4c0718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:30.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.333+0000 7f7b70786640 1 --2- 172.21.15.22:0/3106606718 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f7b4c06f400 0x7f7b4c0718c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f7b58009990 tx=0x7f7b58009110 comp rx=0 tx=0).stop 2024-05-21T13:36:30.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.333+0000 7f7b70786640 1 -- 172.21.15.22:0/3106606718 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7b6815a4d0 msgr2=0x7f7b681e6d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:30.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.333+0000 7f7b70786640 1 --2- 172.21.15.22:0/3106606718 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7b6815a4d0 0x7f7b681e6d50 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7b6000c780 tx=0x7f7b6000cc40 comp rx=0 tx=0).stop 2024-05-21T13:36:30.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.333+0000 7f7b70786640 1 -- 172.21.15.22:0/3106606718 shutdown_connections 2024-05-21T13:36:30.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.333+0000 7f7b70786640 1 --2- 172.21.15.22:0/3106606718 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f7b4c06f400 0x7f7b4c0718c0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:30.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.333+0000 7f7b70786640 1 --2- 172.21.15.22:0/3106606718 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f7b6815a4d0 0x7f7b681e6d50 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:30.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.333+0000 7f7b70786640 1 --2- 172.21.15.22:0/3106606718 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f7b6815a0f0 0x7f7b6815bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:30.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.333+0000 7f7b70786640 1 --2- 172.21.15.22:0/3106606718 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f7b6806f2d0 0x7f7b6815e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:30.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.333+0000 7f7b70786640 1 -- 172.21.15.22:0/3106606718 >> 172.21.15.22:0/3106606718 conn(0x7f7b680703a0 msgr2=0x7f7b680c5d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:30.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.333+0000 7f7b70786640 1 -- 172.21.15.22:0/3106606718 shutdown_connections 2024-05-21T13:36:30.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.333+0000 7f7b70786640 1 -- 172.21.15.22:0/3106606718 wait complete. 2024-05-21T13:36:30.334 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509452 got 64424509452 for osd.2 2024-05-21T13:36:30.334 DEBUG:teuthology.parallel:result is None 2024-05-21T13:36:30.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.429+0000 7f3775cfd640 1 -- 172.21.15.22:0/2178411748 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f37700735a0 con 0x7f377006f2d0 2024-05-21T13:36:30.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.429+0000 7f3757fff640 1 -- 172.21.15.22:0/2178411748 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f376405fcd0 con 0x7f377006f2d0 2024-05-21T13:36:30.407 INFO:teuthology.orchestra.run.smithi022.stdout:64424509452 2024-05-21T13:36:30.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.433+0000 7f7063fff640 1 -- 172.21.15.22:0/1663017413 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f705c032e70 con 0x7f705c0347a0 2024-05-21T13:36:30.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.433+0000 7f3775cfd640 1 -- 172.21.15.22:0/2178411748 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f375c06f500 msgr2=0x7f375c0719c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:30.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.433+0000 7f3775cfd640 1 --2- 172.21.15.22:0/2178411748 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f375c06f500 0x7f375c0719c0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f37600ad000 tx=0x7f37600a6000 comp rx=0 tx=0).stop 2024-05-21T13:36:30.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.433+0000 7f3775cfd640 1 -- 172.21.15.22:0/2178411748 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f377006f2d0 msgr2=0x7f377014bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:30.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.433+0000 7f3775cfd640 1 --2- 172.21.15.22:0/2178411748 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f377006f2d0 0x7f377014bb80 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f376400c7f0 tx=0x7f376400ccb0 comp rx=0 tx=0).stop 2024-05-21T13:36:30.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.433+0000 7f3775cfd640 1 -- 172.21.15.22:0/2178411748 shutdown_connections 2024-05-21T13:36:30.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.433+0000 7f3775cfd640 1 --2- 172.21.15.22:0/2178411748 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f375c06f500 0x7f375c0719c0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:30.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.433+0000 7f3775cfd640 1 --2- 172.21.15.22:0/2178411748 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f377015a4d0 0x7f37700c6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:30.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.433+0000 7f3775cfd640 1 --2- 172.21.15.22:0/2178411748 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f377015a0f0 0x7f3770137ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:30.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.433+0000 7f3775cfd640 1 --2- 172.21.15.22:0/2178411748 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f377006f2d0 0x7f377014bb80 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:30.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.433+0000 7f3775cfd640 1 -- 172.21.15.22:0/2178411748 >> 172.21.15.22:0/2178411748 conn(0x7f37700703a0 msgr2=0x7f377015e640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:30.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.433+0000 7f3775cfd640 1 -- 172.21.15.22:0/2178411748 shutdown_connections 2024-05-21T13:36:30.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.433+0000 7f3775cfd640 1 -- 172.21.15.22:0/2178411748 wait complete. 2024-05-21T13:36:30.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.433+0000 7f704b7fe640 1 -- 172.21.15.22:0/1663017413 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f70540f9dc0 con 0x7f705c0347a0 2024-05-21T13:36:30.413 INFO:teuthology.orchestra.run.smithi022.stdout:64424509452 2024-05-21T13:36:30.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.433+0000 7f70497fa640 1 -- 172.21.15.22:0/1663017413 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f705006f480 msgr2=0x7f7050071940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:30.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.433+0000 7f70497fa640 1 --2- 172.21.15.22:0/1663017413 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f705006f480 0x7f7050071940 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7058006aa0 tx=0x7f7058006a30 comp rx=0 tx=0).stop 2024-05-21T13:36:30.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.433+0000 7f70497fa640 1 -- 172.21.15.22:0/1663017413 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f705c0347a0 msgr2=0x7f705c0d60b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:30.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.433+0000 7f70497fa640 1 --2- 172.21.15.22:0/1663017413 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f705c0347a0 0x7f705c0d60b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7054025010 tx=0x7f7054024180 comp rx=0 tx=0).stop 2024-05-21T13:36:30.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.433+0000 7f70497fa640 1 -- 172.21.15.22:0/1663017413 shutdown_connections 2024-05-21T13:36:30.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.433+0000 7f70497fa640 1 --2- 172.21.15.22:0/1663017413 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f705006f480 0x7f7050071940 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:30.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.433+0000 7f70497fa640 1 --2- 172.21.15.22:0/1663017413 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f705c0db270 0x7f705c0d7ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:30.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.433+0000 7f70497fa640 1 --2- 172.21.15.22:0/1663017413 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f705c0d5000 0x7f705c0d8990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:30.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.433+0000 7f70497fa640 1 --2- 172.21.15.22:0/1663017413 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f705c0347a0 0x7f705c0d60b0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:30.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.433+0000 7f70497fa640 1 -- 172.21.15.22:0/1663017413 >> 172.21.15.22:0/1663017413 conn(0x7f705c050190 msgr2=0x7f705c0d2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:30.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.433+0000 7f70497fa640 1 -- 172.21.15.22:0/1663017413 shutdown_connections 2024-05-21T13:36:30.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.433+0000 7f70497fa640 1 -- 172.21.15.22:0/1663017413 wait complete. 2024-05-21T13:36:30.431 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509452 got 64424509452 for osd.1 2024-05-21T13:36:30.431 DEBUG:teuthology.parallel:result is None 2024-05-21T13:36:30.437 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509452 got 64424509452 for osd.6 2024-05-21T13:36:30.437 DEBUG:teuthology.parallel:result is None 2024-05-21T13:36:30.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.469+0000 7fd2f8fcc640 1 -- 172.21.15.22:0/3852671548 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fd2f40c8c30 con 0x7fd2f42004e0 2024-05-21T13:36:30.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.469+0000 7fd2e2ffd640 1 -- 172.21.15.22:0/3852671548 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd2ec05b890 con 0x7fd2f42004e0 2024-05-21T13:36:30.447 INFO:teuthology.orchestra.run.smithi022.stdout:55834574858 2024-05-21T13:36:30.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.469+0000 7fd2f8fcc640 1 -- 172.21.15.22:0/3852671548 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fd2d406f430 msgr2=0x7fd2d40718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:30.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.469+0000 7fd2f8fcc640 1 --2- 172.21.15.22:0/3852671548 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fd2d406f430 0x7fd2d40718f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd2e40bb000 tx=0x7fd2e4004740 comp rx=0 tx=0).stop 2024-05-21T13:36:30.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.469+0000 7fd2f8fcc640 1 -- 172.21.15.22:0/3852671548 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd2f42004e0 msgr2=0x7fd2f4202290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:30.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.469+0000 7fd2f8fcc640 1 --2- 172.21.15.22:0/3852671548 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd2f42004e0 0x7fd2f4202290 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec00c770 tx=0x7fd2ec00cc30 comp rx=0 tx=0).stop 2024-05-21T13:36:30.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.469+0000 7fd2f8fcc640 1 -- 172.21.15.22:0/3852671548 shutdown_connections 2024-05-21T13:36:30.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.469+0000 7fd2f8fcc640 1 --2- 172.21.15.22:0/3852671548 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fd2d406f430 0x7fd2d40718f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:30.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.469+0000 7fd2f8fcc640 1 --2- 172.21.15.22:0/3852671548 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd2f42004e0 0x7fd2f4202290 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:30.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.469+0000 7fd2f8fcc640 1 --2- 172.21.15.22:0/3852671548 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd2f40c9990 0x7fd2f41fffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:30.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.469+0000 7fd2f8fcc640 1 --2- 172.21.15.22:0/3852671548 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd2f40c9230 0x7fd2f40c5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:30.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.469+0000 7fd2f8fcc640 1 -- 172.21.15.22:0/3852671548 >> 172.21.15.22:0/3852671548 conn(0x7fd2f406ce70 msgr2=0x7fd2f4072ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:30.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.469+0000 7fd2f8fcc640 1 -- 172.21.15.22:0/3852671548 shutdown_connections 2024-05-21T13:36:30.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.469+0000 7fd2f8fcc640 1 -- 172.21.15.22:0/3852671548 wait complete. 2024-05-21T13:36:30.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.477+0000 7fb92a4ca640 1 -- 172.21.15.22:0/3935112581 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fb924156310 con 0x7fb9240c46e0 2024-05-21T13:36:30.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.477+0000 7fb919ffb640 1 -- 172.21.15.22:0/3935112581 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb924156310 con 0x7fb9240c46e0 2024-05-21T13:36:30.455 INFO:teuthology.orchestra.run.smithi022.stdout:60129542154 2024-05-21T13:36:30.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.477+0000 7fb92a4ca640 1 -- 172.21.15.22:0/3935112581 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fb90806f430 msgr2=0x7fb9080718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:30.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.477+0000 7fb92a4ca640 1 --2- 172.21.15.22:0/3935112581 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fb90806f430 0x7fb9080718f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fb924163010 tx=0x7fb920006c50 comp rx=0 tx=0).stop 2024-05-21T13:36:30.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.477+0000 7fb92a4ca640 1 -- 172.21.15.22:0/3935112581 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb9240c46e0 msgr2=0x7fb9241f3140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:30.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.477+0000 7fb92a4ca640 1 --2- 172.21.15.22:0/3935112581 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb9240c46e0 0x7fb9241f3140 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb91401ac50 tx=0x7fb914019340 comp rx=0 tx=0).stop 2024-05-21T13:36:30.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.477+0000 7fb92a4ca640 1 -- 172.21.15.22:0/3935112581 shutdown_connections 2024-05-21T13:36:30.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.477+0000 7fb92a4ca640 1 --2- 172.21.15.22:0/3935112581 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fb90806f430 0x7fb9080718f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:30.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.477+0000 7fb92a4ca640 1 --2- 172.21.15.22:0/3935112581 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb924152880 0x7fb9241f5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:30.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.477+0000 7fb92a4ca640 1 --2- 172.21.15.22:0/3935112581 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb9240c7310 0x7fb924156790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:30.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.477+0000 7fb92a4ca640 1 --2- 172.21.15.22:0/3935112581 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb9240c46e0 0x7fb9241f3140 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:30.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.477+0000 7fb92a4ca640 1 -- 172.21.15.22:0/3935112581 >> 172.21.15.22:0/3935112581 conn(0x7fb92406c4f0 msgr2=0x7fb92406fac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:30.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.477+0000 7fb92a4ca640 1 -- 172.21.15.22:0/3935112581 shutdown_connections 2024-05-21T13:36:30.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.477+0000 7fb92a4ca640 1 -- 172.21.15.22:0/3935112581 wait complete. 2024-05-21T13:36:30.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.477+0000 7fb3142f3640 1 -- 172.21.15.22:0/2158514116 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fb30c0747c0 con 0x7fb30c158a50 2024-05-21T13:36:30.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.481+0000 7fb302ffd640 1 -- 172.21.15.22:0/2158514116 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb2fc101240 con 0x7fb30c158a50 2024-05-21T13:36:30.459 INFO:teuthology.orchestra.run.smithi022.stdout:64424509451 2024-05-21T13:36:30.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.481+0000 7fb3142f3640 1 -- 172.21.15.22:0/2158514116 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fb2f006f400 msgr2=0x7fb2f00718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:30.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.481+0000 7fb3142f3640 1 --2- 172.21.15.22:0/2158514116 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fb2f006f400 0x7fb2f00718c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fb308003a50 tx=0x7fb30800f040 comp rx=0 tx=0).stop 2024-05-21T13:36:30.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.481+0000 7fb3142f3640 1 -- 172.21.15.22:0/2158514116 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb30c158a50 msgr2=0x7fb30c0c5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:30.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.481+0000 7fb3142f3640 1 --2- 172.21.15.22:0/2158514116 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb30c158a50 0x7fb30c0c5790 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc01b8a0 tx=0x7fb2fc01ba30 comp rx=0 tx=0).stop 2024-05-21T13:36:30.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.481+0000 7fb3142f3640 1 -- 172.21.15.22:0/2158514116 shutdown_connections 2024-05-21T13:36:30.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.481+0000 7fb3142f3640 1 --2- 172.21.15.22:0/2158514116 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fb2f006f400 0x7fb2f00718c0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:30.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.481+0000 7fb3142f3640 1 --2- 172.21.15.22:0/2158514116 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb30c15ac30 0x7fb30c1f1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:30.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.481+0000 7fb3142f3640 1 --2- 172.21.15.22:0/2158514116 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb30c158a50 0x7fb30c0c5790 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:30.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.481+0000 7fb3142f3640 1 --2- 172.21.15.22:0/2158514116 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb30c152120 0x7fb30c15a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:30.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.481+0000 7fb3142f3640 1 -- 172.21.15.22:0/2158514116 >> 172.21.15.22:0/2158514116 conn(0x7fb30c06ce70 msgr2=0x7fb30c072360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:30.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.481+0000 7fb3142f3640 1 -- 172.21.15.22:0/2158514116 shutdown_connections 2024-05-21T13:36:30.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.481+0000 7fb3142f3640 1 -- 172.21.15.22:0/2158514116 wait complete. 2024-05-21T13:36:30.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.485+0000 7f9338b73640 1 -- 172.21.15.22:0/3782847794 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f9318005860 con 0x7f93340c9230 2024-05-21T13:36:30.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.485+0000 7f9322ffd640 1 -- 172.21.15.22:0/3782847794 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f932c05b6c0 con 0x7f93340c9230 2024-05-21T13:36:30.464 INFO:teuthology.orchestra.run.smithi022.stdout:64424509452 2024-05-21T13:36:30.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.489+0000 7f9338b73640 1 -- 172.21.15.22:0/3782847794 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f931406f4d0 msgr2=0x7f9314071990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:30.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.489+0000 7f9338b73640 1 --2- 172.21.15.22:0/3782847794 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f931406f4d0 0x7f9314071990 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f932401cb10 tx=0x7f93240a9000 comp rx=0 tx=0).stop 2024-05-21T13:36:30.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.489+0000 7f9338b73640 1 -- 172.21.15.22:0/3782847794 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f93340c9230 msgr2=0x7f93341f4da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:30.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.489+0000 7f9338b73640 1 --2- 172.21.15.22:0/3782847794 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f93340c9230 0x7f93341f4da0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f932c00c8a0 tx=0x7f932c00cd60 comp rx=0 tx=0).stop 2024-05-21T13:36:30.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.489+0000 7f9338b73640 1 -- 172.21.15.22:0/3782847794 shutdown_connections 2024-05-21T13:36:30.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.489+0000 7f9338b73640 1 --2- 172.21.15.22:0/3782847794 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f931406f4d0 0x7f9314071990 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:30.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.489+0000 7f9338b73640 1 --2- 172.21.15.22:0/3782847794 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f93340c9990 0x7f9334162e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:30.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.489+0000 7f9338b73640 1 --2- 172.21.15.22:0/3782847794 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f93340c9230 0x7f93341f4da0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:30.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.489+0000 7f9338b73640 1 --2- 172.21.15.22:0/3782847794 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f93340c6d40 0x7f9334164660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:30.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.489+0000 7f9338b73640 1 -- 172.21.15.22:0/3782847794 >> 172.21.15.22:0/3782847794 conn(0x7f933406ce70 msgr2=0x7f9334070510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:30.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.489+0000 7f9338b73640 1 -- 172.21.15.22:0/3782847794 shutdown_connections 2024-05-21T13:36:30.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.489+0000 7f9338b73640 1 -- 172.21.15.22:0/3782847794 wait complete. 2024-05-21T13:36:30.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.489+0000 7efdd8be7640 1 -- 172.21.15.22:0/1507884110 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7efdd4072980 con 0x7efdd415ba90 2024-05-21T13:36:30.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.489+0000 7efdbbfff640 1 -- 172.21.15.22:0/1507884110 <== mon.2 v2:172.21.15.115:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7efdd40cbbd0 con 0x7efdd415ba90 2024-05-21T13:36:30.470 INFO:teuthology.orchestra.run.smithi022.stdout:64424509451 2024-05-21T13:36:30.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.493+0000 7efdd8be7640 1 -- 172.21.15.22:0/1507884110 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7efdc006f400 msgr2=0x7efdc00718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:30.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.493+0000 7efdd8be7640 1 --2- 172.21.15.22:0/1507884110 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7efdc006f400 0x7efdc00718c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7efdcc0015b0 tx=0x7efdcc0016a0 comp rx=0 tx=0).stop 2024-05-21T13:36:30.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.493+0000 7efdd8be7640 1 -- 172.21.15.22:0/1507884110 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efdd415ba90 msgr2=0x7efdd4152f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:30.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.493+0000 7efdd8be7640 1 --2- 172.21.15.22:0/1507884110 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efdd415ba90 0x7efdd4152f20 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7efdc800b440 tx=0x7efdc800b900 comp rx=0 tx=0).stop 2024-05-21T13:36:30.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.493+0000 7efdd8be7640 1 -- 172.21.15.22:0/1507884110 shutdown_connections 2024-05-21T13:36:30.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.493+0000 7efdd8be7640 1 --2- 172.21.15.22:0/1507884110 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7efdc006f400 0x7efdc00718c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:30.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.493+0000 7efdd8be7640 1 --2- 172.21.15.22:0/1507884110 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efdd415ba90 0x7efdd4152f20 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:30.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.493+0000 7efdd8be7640 1 --2- 172.21.15.22:0/1507884110 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efdd40cdd00 0x7efdd41529e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:30.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.493+0000 7efdd8be7640 1 --2- 172.21.15.22:0/1507884110 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efdd4072280 0x7efdd41edb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:30.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.493+0000 7efdd8be7640 1 -- 172.21.15.22:0/1507884110 >> 172.21.15.22:0/1507884110 conn(0x7efdd40cd1e0 msgr2=0x7efdd40c8760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:30.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.493+0000 7efdd8be7640 1 -- 172.21.15.22:0/1507884110 shutdown_connections 2024-05-21T13:36:30.473 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.493+0000 7efdd8be7640 1 -- 172.21.15.22:0/1507884110 wait complete. 2024-05-21T13:36:30.476 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.4 2024-05-21T13:36:30.476 DEBUG:teuthology.parallel:result is None 2024-05-21T13:36:30.478 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542154 for osd.5 2024-05-21T13:36:30.478 DEBUG:teuthology.parallel:result is None 2024-05-21T13:36:30.487 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509451 for osd.0 2024-05-21T13:36:30.487 DEBUG:teuthology.parallel:result is None 2024-05-21T13:36:30.496 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509452 got 64424509452 for osd.7 2024-05-21T13:36:30.496 DEBUG:teuthology.parallel:result is None 2024-05-21T13:36:30.497 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509451 got 64424509451 for osd.3 2024-05-21T13:36:30.497 DEBUG:teuthology.parallel:result is None 2024-05-21T13:36:30.497 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-21T13:36:30.498 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-21T13:36:30.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.669+0000 7f29f0373640 1 Processor -- start 2024-05-21T13:36:30.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.669+0000 7f29f0373640 1 -- start start 2024-05-21T13:36:30.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.673+0000 7f29f0373640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f29e8152df0 0x7f29e815c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:30.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.673+0000 7f29f0373640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f29e80c54e0 0x7f29e80ce4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:30.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.673+0000 7f29f0373640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f29e80cea20 0x7f29e80ca370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:30.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.673+0000 7f29f0373640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f29e8073f10 con 0x7f29e80cea20 2024-05-21T13:36:30.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.673+0000 7f29f0373640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f29e80741f0 con 0x7f29e8152df0 2024-05-21T13:36:30.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.673+0000 7f29f0373640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f29e80744d0 con 0x7f29e80c54e0 2024-05-21T13:36:30.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.673+0000 7f29ee910640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f29e80cea20 0x7f29e80ca370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:30.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.673+0000 7f29ee910640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f29e80cea20 0x7f29e80ca370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48536/0 (socket says 172.21.15.22:48536) 2024-05-21T13:36:30.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.673+0000 7f29ee910640 1 -- 172.21.15.22:0/2202172768 learned_addr learned my addr 172.21.15.22:0/2202172768 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:30.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.673+0000 7f29ee10f640 1 --2- 172.21.15.22:0/2202172768 >> v2:172.21.15.115:3300/0 conn(0x7f29e8152df0 0x7f29e815c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:30.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.673+0000 7f29ed90e640 1 --2- 172.21.15.22:0/2202172768 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f29e80c54e0 0x7f29e80ce4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:30.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.673+0000 7f29ee910640 1 -- 172.21.15.22:0/2202172768 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f29e80c54e0 msgr2=0x7f29e80ce4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:30.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.673+0000 7f29ee910640 1 --2- 172.21.15.22:0/2202172768 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f29e80c54e0 0x7f29e80ce4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:30.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.673+0000 7f29ee910640 1 -- 172.21.15.22:0/2202172768 >> v2:172.21.15.115:3300/0 conn(0x7f29e8152df0 msgr2=0x7f29e815c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:30.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.673+0000 7f29ee910640 1 --2- 172.21.15.22:0/2202172768 >> v2:172.21.15.115:3300/0 conn(0x7f29e8152df0 0x7f29e815c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:30.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.673+0000 7f29ee910640 1 -- 172.21.15.22:0/2202172768 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29e80c9890 con 0x7f29e80cea20 2024-05-21T13:36:30.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.673+0000 7f29ee10f640 1 --2- 172.21.15.22:0/2202172768 >> v2:172.21.15.115:3300/0 conn(0x7f29e8152df0 0x7f29e815c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T13:36:30.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.673+0000 7f29ee910640 1 --2- 172.21.15.22:0/2202172768 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29e80cea20 0x7f29e80ca370 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f29e80cc080 tx=0x7f29e401f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e008b7ab38a0c0c server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:30.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.677+0000 7f29ed10d640 1 -- 172.21.15.22:0/2202172768 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e40b4070 con 0x7f29e80cea20 2024-05-21T13:36:30.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.677+0000 7f29ed10d640 1 -- 172.21.15.22:0/2202172768 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29e40af400 con 0x7f29e80cea20 2024-05-21T13:36:30.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.677+0000 7f29ed10d640 1 -- 172.21.15.22:0/2202172768 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e40af7d0 con 0x7f29e80cea20 2024-05-21T13:36:30.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.677+0000 7f29f0373640 1 -- 172.21.15.22:0/2202172768 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29e80cea20 msgr2=0x7f29e80ca370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:30.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.677+0000 7f29f0373640 1 --2- 172.21.15.22:0/2202172768 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29e80cea20 0x7f29e80ca370 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f29e80cc080 tx=0x7f29e401f1e0 comp rx=0 tx=0).stop 2024-05-21T13:36:30.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.677+0000 7f29f0373640 1 -- 172.21.15.22:0/2202172768 shutdown_connections 2024-05-21T13:36:30.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.677+0000 7f29f0373640 1 --2- 172.21.15.22:0/2202172768 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f29e80c54e0 0x7f29e80ce4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:30.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.677+0000 7f29f0373640 1 --2- 172.21.15.22:0/2202172768 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29e80cea20 0x7f29e80ca370 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:30.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.677+0000 7f29f0373640 1 --2- 172.21.15.22:0/2202172768 >> v2:172.21.15.115:3300/0 conn(0x7f29e8152df0 0x7f29e815c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:30.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.677+0000 7f29f0373640 1 -- 172.21.15.22:0/2202172768 >> 172.21.15.22:0/2202172768 conn(0x7f29e806fd30 msgr2=0x7f29e806d600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:30.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.677+0000 7f29f0373640 1 -- 172.21.15.22:0/2202172768 shutdown_connections 2024-05-21T13:36:30.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.677+0000 7f29f0373640 1 -- 172.21.15.22:0/2202172768 wait complete. 2024-05-21T13:36:30.658 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.677+0000 7f29f0373640 1 Processor -- start 2024-05-21T13:36:30.658 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.677+0000 7f29f0373640 1 -- start start 2024-05-21T13:36:30.658 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.677+0000 7f29f0373640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29e80c54e0 0x7f29e81edc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:30.658 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.677+0000 7f29f0373640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f29e80cea20 0x7f29e80ce140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:30.658 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.677+0000 7f29f0373640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29e8152df0 0x7f29e8157580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:30.658 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.677+0000 7f29f0373640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f29e81531d0 con 0x7f29e8152df0 2024-05-21T13:36:30.659 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.677+0000 7f29f0373640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f29e80c9e50 con 0x7f29e80c54e0 2024-05-21T13:36:30.659 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.677+0000 7f29f0373640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f29e8073bb0 con 0x7f29e80cea20 2024-05-21T13:36:30.659 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.677+0000 7f29ee910640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29e8152df0 0x7f29e8157580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:30.659 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.677+0000 7f29ee910640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29e8152df0 0x7f29e8157580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48548/0 (socket says 172.21.15.22:48548) 2024-05-21T13:36:30.659 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.677+0000 7f29ee910640 1 -- 172.21.15.22:0/3397554534 learned_addr learned my addr 172.21.15.22:0/3397554534 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:30.659 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.677+0000 7f29ee10f640 1 --2- 172.21.15.22:0/3397554534 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29e80c54e0 0x7f29e81edc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:30.659 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.677+0000 7f29ed90e640 1 --2- 172.21.15.22:0/3397554534 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f29e80cea20 0x7f29e80ce140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:30.659 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.677+0000 7f29ee910640 1 -- 172.21.15.22:0/3397554534 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f29e80cea20 msgr2=0x7f29e80ce140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:30.659 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.677+0000 7f29ee910640 1 --2- 172.21.15.22:0/3397554534 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f29e80cea20 0x7f29e80ce140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:30.659 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.677+0000 7f29ee910640 1 -- 172.21.15.22:0/3397554534 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29e80c54e0 msgr2=0x7f29e81edc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:30.659 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.677+0000 7f29ee910640 1 --2- 172.21.15.22:0/3397554534 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29e80c54e0 0x7f29e81edc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:30.659 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.677+0000 7f29ee910640 1 -- 172.21.15.22:0/3397554534 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29e81591b0 con 0x7f29e8152df0 2024-05-21T13:36:30.659 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.677+0000 7f29ee10f640 1 --2- 172.21.15.22:0/3397554534 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29e80c54e0 0x7f29e81edc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:36:30.659 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.677+0000 7f29ee910640 1 --2- 172.21.15.22:0/3397554534 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29e8152df0 0x7f29e8157580 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f29e40b2040 tx=0x7f29e401bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:30.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.677+0000 7f29deffd640 1 -- 172.21.15.22:0/3397554534 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e40c0070 con 0x7f29e8152df0 2024-05-21T13:36:30.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.677+0000 7f29deffd640 1 -- 172.21.15.22:0/3397554534 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f29e40090d0 con 0x7f29e8152df0 2024-05-21T13:36:30.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.677+0000 7f29f0373640 1 -- 172.21.15.22:0/3397554534 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29e81ee1a0 con 0x7f29e8152df0 2024-05-21T13:36:30.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.677+0000 7f29deffd640 1 -- 172.21.15.22:0/3397554534 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29e40b4040 con 0x7f29e8152df0 2024-05-21T13:36:30.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.677+0000 7f29f0373640 1 -- 172.21.15.22:0/3397554534 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29e8159420 con 0x7f29e8152df0 2024-05-21T13:36:30.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.681+0000 7f29f0373640 1 -- 172.21.15.22:0/3397554534 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29e80697d0 con 0x7f29e8152df0 2024-05-21T13:36:30.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.681+0000 7f29deffd640 1 -- 172.21.15.22:0/3397554534 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f29e40c3070 con 0x7f29e8152df0 2024-05-21T13:36:30.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.681+0000 7f29deffd640 1 --2- 172.21.15.22:0/3397554534 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f29cc06f400 0x7f29cc0718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:30.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.681+0000 7f29deffd640 1 -- 172.21.15.22:0/3397554534 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f29e412cce0 con 0x7f29e8152df0 2024-05-21T13:36:30.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.681+0000 7f29ee10f640 1 --2- 172.21.15.22:0/3397554534 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f29cc06f400 0x7f29cc0718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:30.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.681+0000 7f29ee10f640 1 --2- 172.21.15.22:0/3397554534 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f29cc06f400 0x7f29cc0718c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f29e00097a0 tx=0x7f29e0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:30.663 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.685+0000 7f29deffd640 1 -- 172.21.15.22:0/3397554534 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f29e4018d40 con 0x7f29e8152df0 2024-05-21T13:36:30.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.837+0000 7f29f0373640 1 -- 172.21.15.22:0/3397554534 --> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f29e8074760 con 0x7f29cc06f400 2024-05-21T13:36:30.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.861+0000 7f29deffd640 1 -- 172.21.15.22:0/3397554534 <== mgr.4103 v2:172.21.15.115:6832/184591771 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332643 (secure 0 0 0) 0x7f29e8074760 con 0x7f29cc06f400 2024-05-21T13:36:30.845 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-21T13:36:30.848 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-05-21T13:36:30.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.869+0000 7f29f0373640 1 -- 172.21.15.22:0/3397554534 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f29cc06f400 msgr2=0x7f29cc0718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:30.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.869+0000 7f29f0373640 1 --2- 172.21.15.22:0/3397554534 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f29cc06f400 0x7f29cc0718c0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f29e00097a0 tx=0x7f29e0008040 comp rx=0 tx=0).stop 2024-05-21T13:36:30.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.869+0000 7f29f0373640 1 -- 172.21.15.22:0/3397554534 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29e8152df0 msgr2=0x7f29e8157580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:30.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.869+0000 7f29f0373640 1 --2- 172.21.15.22:0/3397554534 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29e8152df0 0x7f29e8157580 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f29e40b2040 tx=0x7f29e401bf80 comp rx=0 tx=0).stop 2024-05-21T13:36:30.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.869+0000 7f29f0373640 1 -- 172.21.15.22:0/3397554534 shutdown_connections 2024-05-21T13:36:30.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.869+0000 7f29f0373640 1 --2- 172.21.15.22:0/3397554534 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f29cc06f400 0x7f29cc0718c0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:30.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.869+0000 7f29f0373640 1 --2- 172.21.15.22:0/3397554534 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f29e8152df0 0x7f29e8157580 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:30.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.869+0000 7f29f0373640 1 --2- 172.21.15.22:0/3397554534 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f29e80cea20 0x7f29e80ce140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:30.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.869+0000 7f29f0373640 1 --2- 172.21.15.22:0/3397554534 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f29e80c54e0 0x7f29e81edc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:30.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.869+0000 7f29f0373640 1 -- 172.21.15.22:0/3397554534 >> 172.21.15.22:0/3397554534 conn(0x7f29e806fd30 msgr2=0x7f29e806d230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:30.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.869+0000 7f29f0373640 1 -- 172.21.15.22:0/3397554534 shutdown_connections 2024-05-21T13:36:30.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:30.869+0000 7f29f0373640 1 -- 172.21.15.22:0/3397554534 wait complete. 2024-05-21T13:36:30.864 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":42,"stamp":"2024-05-21T13:36:30.510662+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595720,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":158,"num_write_kb":1649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":123,"ondisk_log_size":123,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235048,"kb_used_data":2232,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739672,"statfs":{"total":773094113280,"available":772853424128,"internally_reserved":0,"allocated":2285568,"data_stored":2003446,"data_compressed":66916,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":712,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005509"},"pg_stats":[{"pgid":"2.1f","version":"24'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.808373+0000","last_change":"2024-05-21T13:35:56.739488+0000","last_active":"2024-05-21T13:36:02.808373+0000","last_peered":"2024-05-21T13:36:02.808373+0000","last_clean":"2024-05-21T13:36:02.808373+0000","last_became_active":"2024-05-21T13:35:56.738481+0000","last_became_peered":"2024-05-21T13:35:56.738481+0000","last_unstale":"2024-05-21T13:36:02.808373+0000","last_undegraded":"2024-05-21T13:36:02.808373+0000","last_fullsized":"2024-05-21T13:36:02.808373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:20:48.149770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.965919+0000","last_change":"2024-05-21T13:35:57.779462+0000","last_active":"2024-05-21T13:36:02.965919+0000","last_peered":"2024-05-21T13:36:02.965919+0000","last_clean":"2024-05-21T13:36:02.965919+0000","last_became_active":"2024-05-21T13:35:57.778721+0000","last_became_peered":"2024-05-21T13:35:57.778721+0000","last_unstale":"2024-05-21T13:36:02.965919+0000","last_undegraded":"2024-05-21T13:36:02.965919+0000","last_fullsized":"2024-05-21T13:36:02.965919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:13:05.005747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.963696+0000","last_change":"2024-05-21T13:36:01.868203+0000","last_active":"2024-05-21T13:36:02.963696+0000","last_peered":"2024-05-21T13:36:02.963696+0000","last_clean":"2024-05-21T13:36:02.963696+0000","last_became_active":"2024-05-21T13:36:01.864148+0000","last_became_peered":"2024-05-21T13:36:01.864148+0000","last_unstale":"2024-05-21T13:36:02.963696+0000","last_undegraded":"2024-05-21T13:36:02.963696+0000","last_fullsized":"2024-05-21T13:36:02.963696+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T13:57:33.088920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"24'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.966254+0000","last_change":"2024-05-21T13:35:56.775054+0000","last_active":"2024-05-21T13:36:02.966254+0000","last_peered":"2024-05-21T13:36:02.966254+0000","last_clean":"2024-05-21T13:36:02.966254+0000","last_became_active":"2024-05-21T13:35:56.770566+0000","last_became_peered":"2024-05-21T13:35:56.770566+0000","last_unstale":"2024-05-21T13:36:02.966254+0000","last_undegraded":"2024-05-21T13:36:02.966254+0000","last_fullsized":"2024-05-21T13:36:02.966254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:05:11.539201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.965771+0000","last_change":"2024-05-21T13:35:57.782094+0000","last_active":"2024-05-21T13:36:02.965771+0000","last_peered":"2024-05-21T13:36:02.965771+0000","last_clean":"2024-05-21T13:36:02.965771+0000","last_became_active":"2024-05-21T13:35:57.780590+0000","last_became_peered":"2024-05-21T13:35:57.780590+0000","last_unstale":"2024-05-21T13:36:02.965771+0000","last_undegraded":"2024-05-21T13:36:02.965771+0000","last_fullsized":"2024-05-21T13:36:02.965771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:30:50.929103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.960911+0000","last_change":"2024-05-21T13:36:01.852092+0000","last_active":"2024-05-21T13:36:02.960911+0000","last_peered":"2024-05-21T13:36:02.960911+0000","last_clean":"2024-05-21T13:36:02.960911+0000","last_became_active":"2024-05-21T13:36:01.851745+0000","last_became_peered":"2024-05-21T13:36:01.851745+0000","last_unstale":"2024-05-21T13:36:02.960911+0000","last_undegraded":"2024-05-21T13:36:02.960911+0000","last_fullsized":"2024-05-21T13:36:02.960911+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:57:21.599860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"24'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.961222+0000","last_change":"2024-05-21T13:35:56.731106+0000","last_active":"2024-05-21T13:36:02.961222+0000","last_peered":"2024-05-21T13:36:02.961222+0000","last_clean":"2024-05-21T13:36:02.961222+0000","last_became_active":"2024-05-21T13:35:56.730746+0000","last_became_peered":"2024-05-21T13:35:56.730746+0000","last_unstale":"2024-05-21T13:36:02.961222+0000","last_undegraded":"2024-05-21T13:36:02.961222+0000","last_fullsized":"2024-05-21T13:36:02.961222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:23:17.798397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.963099+0000","last_change":"2024-05-21T13:35:57.771371+0000","last_active":"2024-05-21T13:36:02.963099+0000","last_peered":"2024-05-21T13:36:02.963099+0000","last_clean":"2024-05-21T13:36:02.963099+0000","last_became_active":"2024-05-21T13:35:57.770595+0000","last_became_peered":"2024-05-21T13:35:57.770595+0000","last_unstale":"2024-05-21T13:36:02.963099+0000","last_undegraded":"2024-05-21T13:36:02.963099+0000","last_fullsized":"2024-05-21T13:36:02.963099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:53:17.771310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.961202+0000","last_change":"2024-05-21T13:36:01.849638+0000","last_active":"2024-05-21T13:36:02.961202+0000","last_peered":"2024-05-21T13:36:02.961202+0000","last_clean":"2024-05-21T13:36:02.961202+0000","last_became_active":"2024-05-21T13:36:01.848996+0000","last_became_peered":"2024-05-21T13:36:01.848996+0000","last_unstale":"2024-05-21T13:36:02.961202+0000","last_undegraded":"2024-05-21T13:36:02.961202+0000","last_fullsized":"2024-05-21T13:36:02.961202+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:24:31.613874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.960165+0000","last_change":"2024-05-21T13:35:56.737279+0000","last_active":"2024-05-21T13:36:02.960165+0000","last_peered":"2024-05-21T13:36:02.960165+0000","last_clean":"2024-05-21T13:36:02.960165+0000","last_became_active":"2024-05-21T13:35:56.731150+0000","last_became_peered":"2024-05-21T13:35:56.731150+0000","last_unstale":"2024-05-21T13:36:02.960165+0000","last_undegraded":"2024-05-21T13:36:02.960165+0000","last_fullsized":"2024-05-21T13:36:02.960165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:17:07.571294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.806009+0000","last_change":"2024-05-21T13:35:57.799803+0000","last_active":"2024-05-21T13:36:02.806009+0000","last_peered":"2024-05-21T13:36:02.806009+0000","last_clean":"2024-05-21T13:36:02.806009+0000","last_became_active":"2024-05-21T13:35:57.799043+0000","last_became_peered":"2024-05-21T13:35:57.799043+0000","last_unstale":"2024-05-21T13:36:02.806009+0000","last_undegraded":"2024-05-21T13:36:02.806009+0000","last_fullsized":"2024-05-21T13:36:02.806009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:22:48.607953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.961831+0000","last_change":"2024-05-21T13:36:01.852469+0000","last_active":"2024-05-21T13:36:02.961831+0000","last_peered":"2024-05-21T13:36:02.961831+0000","last_clean":"2024-05-21T13:36:02.961831+0000","last_became_active":"2024-05-21T13:36:01.851913+0000","last_became_peered":"2024-05-21T13:36:01.851913+0000","last_unstale":"2024-05-21T13:36:02.961831+0000","last_undegraded":"2024-05-21T13:36:02.961831+0000","last_fullsized":"2024-05-21T13:36:02.961831+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:42:58.062540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.805533+0000","last_change":"2024-05-21T13:35:57.796516+0000","last_active":"2024-05-21T13:36:02.805533+0000","last_peered":"2024-05-21T13:36:02.805533+0000","last_clean":"2024-05-21T13:36:02.805533+0000","last_became_active":"2024-05-21T13:35:57.795638+0000","last_became_peered":"2024-05-21T13:35:57.795638+0000","last_unstale":"2024-05-21T13:36:02.805533+0000","last_undegraded":"2024-05-21T13:36:02.805533+0000","last_fullsized":"2024-05-21T13:36:02.805533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:46:40.541835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"24'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.805922+0000","last_change":"2024-05-21T13:35:56.748046+0000","last_active":"2024-05-21T13:36:02.805922+0000","last_peered":"2024-05-21T13:36:02.805922+0000","last_clean":"2024-05-21T13:36:02.805922+0000","last_became_active":"2024-05-21T13:35:56.747635+0000","last_became_peered":"2024-05-21T13:35:56.747635+0000","last_unstale":"2024-05-21T13:36:02.805922+0000","last_undegraded":"2024-05-21T13:36:02.805922+0000","last_fullsized":"2024-05-21T13:36:02.805922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:52:28.665244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.805864+0000","last_change":"2024-05-21T13:36:01.862153+0000","last_active":"2024-05-21T13:36:02.805864+0000","last_peered":"2024-05-21T13:36:02.805864+0000","last_clean":"2024-05-21T13:36:02.805864+0000","last_became_active":"2024-05-21T13:36:01.861520+0000","last_became_peered":"2024-05-21T13:36:01.861520+0000","last_unstale":"2024-05-21T13:36:02.805864+0000","last_undegraded":"2024-05-21T13:36:02.805864+0000","last_fullsized":"2024-05-21T13:36:02.805864+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:04:37.306132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.964897+0000","last_change":"2024-05-21T13:35:57.786463+0000","last_active":"2024-05-21T13:36:02.964897+0000","last_peered":"2024-05-21T13:36:02.964897+0000","last_clean":"2024-05-21T13:36:02.964897+0000","last_became_active":"2024-05-21T13:35:57.786126+0000","last_became_peered":"2024-05-21T13:35:57.786126+0000","last_unstale":"2024-05-21T13:36:02.964897+0000","last_undegraded":"2024-05-21T13:36:02.964897+0000","last_fullsized":"2024-05-21T13:36:02.964897+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:39:32.076464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.966843+0000","last_change":"2024-05-21T13:35:56.765178+0000","last_active":"2024-05-21T13:36:02.966843+0000","last_peered":"2024-05-21T13:36:02.966843+0000","last_clean":"2024-05-21T13:36:02.966843+0000","last_became_active":"2024-05-21T13:35:56.764551+0000","last_became_peered":"2024-05-21T13:35:56.764551+0000","last_unstale":"2024-05-21T13:36:02.966843+0000","last_undegraded":"2024-05-21T13:36:02.966843+0000","last_fullsized":"2024-05-21T13:36:02.966843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:34:28.955222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.959609+0000","last_change":"2024-05-21T13:36:01.854410+0000","last_active":"2024-05-21T13:36:02.959609+0000","last_peered":"2024-05-21T13:36:02.959609+0000","last_clean":"2024-05-21T13:36:02.959609+0000","last_became_active":"2024-05-21T13:36:01.853975+0000","last_became_peered":"2024-05-21T13:36:01.853975+0000","last_unstale":"2024-05-21T13:36:02.959609+0000","last_undegraded":"2024-05-21T13:36:02.959609+0000","last_fullsized":"2024-05-21T13:36:02.959609+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:15:34.710504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.807180+0000","last_change":"2024-05-21T13:35:57.762509+0000","last_active":"2024-05-21T13:36:02.807180+0000","last_peered":"2024-05-21T13:36:02.807180+0000","last_clean":"2024-05-21T13:36:02.807180+0000","last_became_active":"2024-05-21T13:35:57.761739+0000","last_became_peered":"2024-05-21T13:35:57.761739+0000","last_unstale":"2024-05-21T13:36:02.807180+0000","last_undegraded":"2024-05-21T13:36:02.807180+0000","last_fullsized":"2024-05-21T13:36:02.807180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:41:17.911126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"25'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:26.908898+0000","last_change":"2024-05-21T13:35:56.734017+0000","last_active":"2024-05-21T13:36:26.908898+0000","last_peered":"2024-05-21T13:36:26.908898+0000","last_clean":"2024-05-21T13:36:26.908898+0000","last_became_active":"2024-05-21T13:35:56.733249+0000","last_became_peered":"2024-05-21T13:35:56.733249+0000","last_unstale":"2024-05-21T13:36:26.908898+0000","last_undegraded":"2024-05-21T13:36:26.908898+0000","last_fullsized":"2024-05-21T13:36:26.908898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:13:27.279557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.967145+0000","last_change":"2024-05-21T13:36:01.868669+0000","last_active":"2024-05-21T13:36:02.967145+0000","last_peered":"2024-05-21T13:36:02.967145+0000","last_clean":"2024-05-21T13:36:02.967145+0000","last_became_active":"2024-05-21T13:36:01.867701+0000","last_became_peered":"2024-05-21T13:36:01.867701+0000","last_unstale":"2024-05-21T13:36:02.967145+0000","last_undegraded":"2024-05-21T13:36:02.967145+0000","last_fullsized":"2024-05-21T13:36:02.967145+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:09:21.615570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.804889+0000","last_change":"2024-05-21T13:35:57.789966+0000","last_active":"2024-05-21T13:36:02.804889+0000","last_peered":"2024-05-21T13:36:02.804889+0000","last_clean":"2024-05-21T13:36:02.804889+0000","last_became_active":"2024-05-21T13:35:57.789213+0000","last_became_peered":"2024-05-21T13:35:57.789213+0000","last_unstale":"2024-05-21T13:36:02.804889+0000","last_undegraded":"2024-05-21T13:36:02.804889+0000","last_fullsized":"2024-05-21T13:36:02.804889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:33:24.183958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.959018+0000","last_change":"2024-05-21T13:35:56.746878+0000","last_active":"2024-05-21T13:36:02.959018+0000","last_peered":"2024-05-21T13:36:02.959018+0000","last_clean":"2024-05-21T13:36:02.959018+0000","last_became_active":"2024-05-21T13:35:56.746534+0000","last_became_peered":"2024-05-21T13:35:56.746534+0000","last_unstale":"2024-05-21T13:36:02.959018+0000","last_undegraded":"2024-05-21T13:36:02.959018+0000","last_fullsized":"2024-05-21T13:36:02.959018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:45:56.935415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.961481+0000","last_change":"2024-05-21T13:36:01.841632+0000","last_active":"2024-05-21T13:36:02.961481+0000","last_peered":"2024-05-21T13:36:02.961481+0000","last_clean":"2024-05-21T13:36:02.961481+0000","last_became_active":"2024-05-21T13:36:01.841216+0000","last_became_peered":"2024-05-21T13:36:01.841216+0000","last_unstale":"2024-05-21T13:36:02.961481+0000","last_undegraded":"2024-05-21T13:36:02.961481+0000","last_fullsized":"2024-05-21T13:36:02.961481+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:49:05.576221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.807962+0000","last_change":"2024-05-21T13:35:57.764793+0000","last_active":"2024-05-21T13:36:02.807962+0000","last_peered":"2024-05-21T13:36:02.807962+0000","last_clean":"2024-05-21T13:36:02.807962+0000","last_became_active":"2024-05-21T13:35:57.764017+0000","last_became_peered":"2024-05-21T13:35:57.764017+0000","last_unstale":"2024-05-21T13:36:02.807962+0000","last_undegraded":"2024-05-21T13:36:02.807962+0000","last_fullsized":"2024-05-21T13:36:02.807962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:25:45.006614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"24'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.808160+0000","last_change":"2024-05-21T13:35:56.752278+0000","last_active":"2024-05-21T13:36:02.808160+0000","last_peered":"2024-05-21T13:36:02.808160+0000","last_clean":"2024-05-21T13:36:02.808160+0000","last_became_active":"2024-05-21T13:35:56.751883+0000","last_became_peered":"2024-05-21T13:35:56.751883+0000","last_unstale":"2024-05-21T13:36:02.808160+0000","last_undegraded":"2024-05-21T13:36:02.808160+0000","last_fullsized":"2024-05-21T13:36:02.808160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:08:05.279701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.961503+0000","last_change":"2024-05-21T13:36:01.832621+0000","last_active":"2024-05-21T13:36:02.961503+0000","last_peered":"2024-05-21T13:36:02.961503+0000","last_clean":"2024-05-21T13:36:02.961503+0000","last_became_active":"2024-05-21T13:36:01.831609+0000","last_became_peered":"2024-05-21T13:36:01.831609+0000","last_unstale":"2024-05-21T13:36:02.961503+0000","last_undegraded":"2024-05-21T13:36:02.961503+0000","last_fullsized":"2024-05-21T13:36:02.961503+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:26:43.075259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.808212+0000","last_change":"2024-05-21T13:35:57.783487+0000","last_active":"2024-05-21T13:36:02.808212+0000","last_peered":"2024-05-21T13:36:02.808212+0000","last_clean":"2024-05-21T13:36:02.808212+0000","last_became_active":"2024-05-21T13:35:57.783150+0000","last_became_peered":"2024-05-21T13:35:57.783150+0000","last_unstale":"2024-05-21T13:36:02.808212+0000","last_undegraded":"2024-05-21T13:36:02.808212+0000","last_fullsized":"2024-05-21T13:36:02.808212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:14:56.991945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.808184+0000","last_change":"2024-05-21T13:35:56.745122+0000","last_active":"2024-05-21T13:36:02.808184+0000","last_peered":"2024-05-21T13:36:02.808184+0000","last_clean":"2024-05-21T13:36:02.808184+0000","last_became_active":"2024-05-21T13:35:56.744218+0000","last_became_peered":"2024-05-21T13:35:56.744218+0000","last_unstale":"2024-05-21T13:36:02.808184+0000","last_undegraded":"2024-05-21T13:36:02.808184+0000","last_fullsized":"2024-05-21T13:36:02.808184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:45:03.790591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.807106+0000","last_change":"2024-05-21T13:36:01.838971+0000","last_active":"2024-05-21T13:36:02.807106+0000","last_peered":"2024-05-21T13:36:02.807106+0000","last_clean":"2024-05-21T13:36:02.807106+0000","last_became_active":"2024-05-21T13:36:01.837401+0000","last_became_peered":"2024-05-21T13:36:01.837401+0000","last_unstale":"2024-05-21T13:36:02.807106+0000","last_undegraded":"2024-05-21T13:36:02.807106+0000","last_fullsized":"2024-05-21T13:36:02.807106+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:16:25.666568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.967981+0000","last_change":"2024-05-21T13:35:57.784993+0000","last_active":"2024-05-21T13:36:02.967981+0000","last_peered":"2024-05-21T13:36:02.967981+0000","last_clean":"2024-05-21T13:36:02.967981+0000","last_became_active":"2024-05-21T13:35:57.784664+0000","last_became_peered":"2024-05-21T13:35:57.784664+0000","last_unstale":"2024-05-21T13:36:02.967981+0000","last_undegraded":"2024-05-21T13:36:02.967981+0000","last_fullsized":"2024-05-21T13:36:02.967981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:58:20.045901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.806794+0000","last_change":"2024-05-21T13:35:56.741285+0000","last_active":"2024-05-21T13:36:02.806794+0000","last_peered":"2024-05-21T13:36:02.806794+0000","last_clean":"2024-05-21T13:36:02.806794+0000","last_became_active":"2024-05-21T13:35:56.740846+0000","last_became_peered":"2024-05-21T13:35:56.740846+0000","last_unstale":"2024-05-21T13:36:02.806794+0000","last_undegraded":"2024-05-21T13:36:02.806794+0000","last_fullsized":"2024-05-21T13:36:02.806794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:34:17.960870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.963587+0000","last_change":"2024-05-21T13:36:01.873172+0000","last_active":"2024-05-21T13:36:02.963587+0000","last_peered":"2024-05-21T13:36:02.963587+0000","last_clean":"2024-05-21T13:36:02.963587+0000","last_became_active":"2024-05-21T13:36:01.872085+0000","last_became_peered":"2024-05-21T13:36:01.872085+0000","last_unstale":"2024-05-21T13:36:02.963587+0000","last_undegraded":"2024-05-21T13:36:02.963587+0000","last_fullsized":"2024-05-21T13:36:02.963587+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:24:57.031323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.961092+0000","last_change":"2024-05-21T13:35:57.783176+0000","last_active":"2024-05-21T13:36:02.961092+0000","last_peered":"2024-05-21T13:36:02.961092+0000","last_clean":"2024-05-21T13:36:02.961092+0000","last_became_active":"2024-05-21T13:35:57.782517+0000","last_became_peered":"2024-05-21T13:35:57.782517+0000","last_unstale":"2024-05-21T13:36:02.961092+0000","last_undegraded":"2024-05-21T13:36:02.961092+0000","last_fullsized":"2024-05-21T13:36:02.961092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:06:58.203996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.964483+0000","last_change":"2024-05-21T13:35:56.767544+0000","last_active":"2024-05-21T13:36:02.964483+0000","last_peered":"2024-05-21T13:36:02.964483+0000","last_clean":"2024-05-21T13:36:02.964483+0000","last_became_active":"2024-05-21T13:35:56.764987+0000","last_became_peered":"2024-05-21T13:35:56.764987+0000","last_unstale":"2024-05-21T13:36:02.964483+0000","last_undegraded":"2024-05-21T13:36:02.964483+0000","last_fullsized":"2024-05-21T13:36:02.964483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:12:46.828769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.966223+0000","last_change":"2024-05-21T13:36:01.872215+0000","last_active":"2024-05-21T13:36:02.966223+0000","last_peered":"2024-05-21T13:36:02.966223+0000","last_clean":"2024-05-21T13:36:02.966223+0000","last_became_active":"2024-05-21T13:36:01.870831+0000","last_became_peered":"2024-05-21T13:36:01.870831+0000","last_unstale":"2024-05-21T13:36:02.966223+0000","last_undegraded":"2024-05-21T13:36:02.966223+0000","last_fullsized":"2024-05-21T13:36:02.966223+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:04:09.689206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.959882+0000","last_change":"2024-05-21T13:35:57.783616+0000","last_active":"2024-05-21T13:36:02.959882+0000","last_peered":"2024-05-21T13:36:02.959882+0000","last_clean":"2024-05-21T13:36:02.959882+0000","last_became_active":"2024-05-21T13:35:57.780521+0000","last_became_peered":"2024-05-21T13:35:57.780521+0000","last_unstale":"2024-05-21T13:36:02.959882+0000","last_undegraded":"2024-05-21T13:36:02.959882+0000","last_fullsized":"2024-05-21T13:36:02.959882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:59:44.121631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.806771+0000","last_change":"2024-05-21T13:35:56.750341+0000","last_active":"2024-05-21T13:36:02.806771+0000","last_peered":"2024-05-21T13:36:02.806771+0000","last_clean":"2024-05-21T13:36:02.806771+0000","last_became_active":"2024-05-21T13:35:56.750006+0000","last_became_peered":"2024-05-21T13:35:56.750006+0000","last_unstale":"2024-05-21T13:36:02.806771+0000","last_undegraded":"2024-05-21T13:36:02.806771+0000","last_fullsized":"2024-05-21T13:36:02.806771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:15:21.416234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.967726+0000","last_change":"2024-05-21T13:36:01.873693+0000","last_active":"2024-05-21T13:36:02.967726+0000","last_peered":"2024-05-21T13:36:02.967726+0000","last_clean":"2024-05-21T13:36:02.967726+0000","last_became_active":"2024-05-21T13:36:01.872363+0000","last_became_peered":"2024-05-21T13:36:01.872363+0000","last_unstale":"2024-05-21T13:36:02.967726+0000","last_undegraded":"2024-05-21T13:36:02.967726+0000","last_fullsized":"2024-05-21T13:36:02.967726+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:27:25.974289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.961878+0000","last_change":"2024-05-21T13:35:57.780809+0000","last_active":"2024-05-21T13:36:02.961878+0000","last_peered":"2024-05-21T13:36:02.961878+0000","last_clean":"2024-05-21T13:36:02.961878+0000","last_became_active":"2024-05-21T13:35:57.780313+0000","last_became_peered":"2024-05-21T13:35:57.780313+0000","last_unstale":"2024-05-21T13:36:02.961878+0000","last_undegraded":"2024-05-21T13:36:02.961878+0000","last_fullsized":"2024-05-21T13:36:02.961878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:43:11.778238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.964084+0000","last_change":"2024-05-21T13:35:56.771138+0000","last_active":"2024-05-21T13:36:02.964084+0000","last_peered":"2024-05-21T13:36:02.964084+0000","last_clean":"2024-05-21T13:36:02.964084+0000","last_became_active":"2024-05-21T13:35:56.770465+0000","last_became_peered":"2024-05-21T13:35:56.770465+0000","last_unstale":"2024-05-21T13:36:02.964084+0000","last_undegraded":"2024-05-21T13:36:02.964084+0000","last_fullsized":"2024-05-21T13:36:02.964084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:21:16.702309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.968200+0000","last_change":"2024-05-21T13:36:01.871328+0000","last_active":"2024-05-21T13:36:02.968200+0000","last_peered":"2024-05-21T13:36:02.968200+0000","last_clean":"2024-05-21T13:36:02.968200+0000","last_became_active":"2024-05-21T13:36:01.870678+0000","last_became_peered":"2024-05-21T13:36:01.870678+0000","last_unstale":"2024-05-21T13:36:02.968200+0000","last_undegraded":"2024-05-21T13:36:02.968200+0000","last_fullsized":"2024-05-21T13:36:02.968200+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:22:47.393065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.962506+0000","last_change":"2024-05-21T13:35:57.782665+0000","last_active":"2024-05-21T13:36:02.962506+0000","last_peered":"2024-05-21T13:36:02.962506+0000","last_clean":"2024-05-21T13:36:02.962506+0000","last_became_active":"2024-05-21T13:35:57.781299+0000","last_became_peered":"2024-05-21T13:35:57.781299+0000","last_unstale":"2024-05-21T13:36:02.962506+0000","last_undegraded":"2024-05-21T13:36:02.962506+0000","last_fullsized":"2024-05-21T13:36:02.962506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:21:22.721124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.805211+0000","last_change":"2024-05-21T13:35:56.768193+0000","last_active":"2024-05-21T13:36:02.805211+0000","last_peered":"2024-05-21T13:36:02.805211+0000","last_clean":"2024-05-21T13:36:02.805211+0000","last_became_active":"2024-05-21T13:35:56.767788+0000","last_became_peered":"2024-05-21T13:35:56.767788+0000","last_unstale":"2024-05-21T13:36:02.805211+0000","last_undegraded":"2024-05-21T13:36:02.805211+0000","last_fullsized":"2024-05-21T13:36:02.805211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:12:52.911816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.965762+0000","last_change":"2024-05-21T13:36:01.860305+0000","last_active":"2024-05-21T13:36:02.965762+0000","last_peered":"2024-05-21T13:36:02.965762+0000","last_clean":"2024-05-21T13:36:02.965762+0000","last_became_active":"2024-05-21T13:36:01.859141+0000","last_became_peered":"2024-05-21T13:36:01.859141+0000","last_unstale":"2024-05-21T13:36:02.965762+0000","last_undegraded":"2024-05-21T13:36:02.965762+0000","last_fullsized":"2024-05-21T13:36:02.965762+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:05:45.203241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.807817+0000","last_change":"2024-05-21T13:35:57.775523+0000","last_active":"2024-05-21T13:36:02.807817+0000","last_peered":"2024-05-21T13:36:02.807817+0000","last_clean":"2024-05-21T13:36:02.807817+0000","last_became_active":"2024-05-21T13:35:57.774322+0000","last_became_peered":"2024-05-21T13:35:57.774322+0000","last_unstale":"2024-05-21T13:36:02.807817+0000","last_undegraded":"2024-05-21T13:36:02.807817+0000","last_fullsized":"2024-05-21T13:36:02.807817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:06:35.118540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.806599+0000","last_change":"2024-05-21T13:35:56.748185+0000","last_active":"2024-05-21T13:36:02.806599+0000","last_peered":"2024-05-21T13:36:02.806599+0000","last_clean":"2024-05-21T13:36:02.806599+0000","last_became_active":"2024-05-21T13:35:56.747823+0000","last_became_peered":"2024-05-21T13:35:56.747823+0000","last_unstale":"2024-05-21T13:36:02.806599+0000","last_undegraded":"2024-05-21T13:36:02.806599+0000","last_fullsized":"2024-05-21T13:36:02.806599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:38:00.235330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":117,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.963125+0000","last_change":"2024-05-21T13:35:45.682484+0000","last_active":"2024-05-21T13:36:02.963125+0000","last_peered":"2024-05-21T13:36:02.963125+0000","last_clean":"2024-05-21T13:36:02.963125+0000","last_became_active":"2024-05-21T13:35:45.680732+0000","last_became_peered":"2024-05-21T13:35:45.680732+0000","last_unstale":"2024-05-21T13:36:02.963125+0000","last_undegraded":"2024-05-21T13:36:02.963125+0000","last_fullsized":"2024-05-21T13:36:02.963125+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:44.542324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:44.542324+0000","last_clean_scrub_stamp":"2024-05-21T13:35:44.542324+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:16:05.034161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.806631+0000","last_change":"2024-05-21T13:36:01.830034+0000","last_active":"2024-05-21T13:36:02.806631+0000","last_peered":"2024-05-21T13:36:02.806631+0000","last_clean":"2024-05-21T13:36:02.806631+0000","last_became_active":"2024-05-21T13:36:01.828957+0000","last_became_peered":"2024-05-21T13:36:01.828957+0000","last_unstale":"2024-05-21T13:36:02.806631+0000","last_undegraded":"2024-05-21T13:36:02.806631+0000","last_fullsized":"2024-05-21T13:36:02.806631+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:21:59.514268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.806258+0000","last_change":"2024-05-21T13:35:57.796419+0000","last_active":"2024-05-21T13:36:02.806258+0000","last_peered":"2024-05-21T13:36:02.806258+0000","last_clean":"2024-05-21T13:36:02.806258+0000","last_became_active":"2024-05-21T13:35:57.796050+0000","last_became_peered":"2024-05-21T13:35:57.796050+0000","last_unstale":"2024-05-21T13:36:02.806258+0000","last_undegraded":"2024-05-21T13:36:02.806258+0000","last_fullsized":"2024-05-21T13:36:02.806258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:56:07.121391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.968145+0000","last_change":"2024-05-21T13:35:56.751619+0000","last_active":"2024-05-21T13:36:02.968145+0000","last_peered":"2024-05-21T13:36:02.968145+0000","last_clean":"2024-05-21T13:36:02.968145+0000","last_became_active":"2024-05-21T13:35:56.748604+0000","last_became_peered":"2024-05-21T13:35:56.748604+0000","last_unstale":"2024-05-21T13:36:02.968145+0000","last_undegraded":"2024-05-21T13:36:02.968145+0000","last_fullsized":"2024-05-21T13:36:02.968145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:19:03.052434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.961835+0000","last_change":"2024-05-21T13:36:01.825464+0000","last_active":"2024-05-21T13:36:02.961835+0000","last_peered":"2024-05-21T13:36:02.961835+0000","last_clean":"2024-05-21T13:36:02.961835+0000","last_became_active":"2024-05-21T13:36:01.824653+0000","last_became_peered":"2024-05-21T13:36:01.824653+0000","last_unstale":"2024-05-21T13:36:02.961835+0000","last_undegraded":"2024-05-21T13:36:02.961835+0000","last_fullsized":"2024-05-21T13:36:02.961835+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:29:32.830052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.960114+0000","last_change":"2024-05-21T13:35:57.784031+0000","last_active":"2024-05-21T13:36:02.960114+0000","last_peered":"2024-05-21T13:36:02.960114+0000","last_clean":"2024-05-21T13:36:02.960114+0000","last_became_active":"2024-05-21T13:35:57.771695+0000","last_became_peered":"2024-05-21T13:35:57.771695+0000","last_unstale":"2024-05-21T13:36:02.960114+0000","last_undegraded":"2024-05-21T13:36:02.960114+0000","last_fullsized":"2024-05-21T13:36:02.960114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:46:33.308257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.965392+0000","last_change":"2024-05-21T13:35:56.768166+0000","last_active":"2024-05-21T13:36:02.965392+0000","last_peered":"2024-05-21T13:36:02.965392+0000","last_clean":"2024-05-21T13:36:02.965392+0000","last_became_active":"2024-05-21T13:35:56.767053+0000","last_became_peered":"2024-05-21T13:35:56.767053+0000","last_unstale":"2024-05-21T13:36:02.965392+0000","last_undegraded":"2024-05-21T13:36:02.965392+0000","last_fullsized":"2024-05-21T13:36:02.965392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:10:16.639491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.963683+0000","last_change":"2024-05-21T13:36:01.834253+0000","last_active":"2024-05-21T13:36:02.963683+0000","last_peered":"2024-05-21T13:36:02.963683+0000","last_clean":"2024-05-21T13:36:02.963683+0000","last_became_active":"2024-05-21T13:36:01.832972+0000","last_became_peered":"2024-05-21T13:36:01.832972+0000","last_unstale":"2024-05-21T13:36:02.963683+0000","last_undegraded":"2024-05-21T13:36:02.963683+0000","last_fullsized":"2024-05-21T13:36:02.963683+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:52:05.576063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.960150+0000","last_change":"2024-05-21T13:35:57.766504+0000","last_active":"2024-05-21T13:36:02.960150+0000","last_peered":"2024-05-21T13:36:02.960150+0000","last_clean":"2024-05-21T13:36:02.960150+0000","last_became_active":"2024-05-21T13:35:57.765756+0000","last_became_peered":"2024-05-21T13:35:57.765756+0000","last_unstale":"2024-05-21T13:36:02.960150+0000","last_undegraded":"2024-05-21T13:36:02.960150+0000","last_fullsized":"2024-05-21T13:36:02.960150+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:52:13.025110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.808071+0000","last_change":"2024-05-21T13:35:56.770347+0000","last_active":"2024-05-21T13:36:02.808071+0000","last_peered":"2024-05-21T13:36:02.808071+0000","last_clean":"2024-05-21T13:36:02.808071+0000","last_became_active":"2024-05-21T13:35:56.769767+0000","last_became_peered":"2024-05-21T13:35:56.769767+0000","last_unstale":"2024-05-21T13:36:02.808071+0000","last_undegraded":"2024-05-21T13:36:02.808071+0000","last_fullsized":"2024-05-21T13:36:02.808071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:40:01.698967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.804632+0000","last_change":"2024-05-21T13:36:01.827091+0000","last_active":"2024-05-21T13:36:02.804632+0000","last_peered":"2024-05-21T13:36:02.804632+0000","last_clean":"2024-05-21T13:36:02.804632+0000","last_became_active":"2024-05-21T13:36:01.826686+0000","last_became_peered":"2024-05-21T13:36:01.826686+0000","last_unstale":"2024-05-21T13:36:02.804632+0000","last_undegraded":"2024-05-21T13:36:02.804632+0000","last_fullsized":"2024-05-21T13:36:02.804632+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:42:47.638921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.962149+0000","last_change":"2024-05-21T13:35:57.781528+0000","last_active":"2024-05-21T13:36:02.962149+0000","last_peered":"2024-05-21T13:36:02.962149+0000","last_clean":"2024-05-21T13:36:02.962149+0000","last_became_active":"2024-05-21T13:35:57.781111+0000","last_became_peered":"2024-05-21T13:35:57.781111+0000","last_unstale":"2024-05-21T13:36:02.962149+0000","last_undegraded":"2024-05-21T13:36:02.962149+0000","last_fullsized":"2024-05-21T13:36:02.962149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:15:43.847640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"24'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.960114+0000","last_change":"2024-05-21T13:35:56.755413+0000","last_active":"2024-05-21T13:36:02.960114+0000","last_peered":"2024-05-21T13:36:02.960114+0000","last_clean":"2024-05-21T13:36:02.960114+0000","last_became_active":"2024-05-21T13:35:56.755158+0000","last_became_peered":"2024-05-21T13:35:56.755158+0000","last_unstale":"2024-05-21T13:36:02.960114+0000","last_undegraded":"2024-05-21T13:36:02.960114+0000","last_fullsized":"2024-05-21T13:36:02.960114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:23:05.102098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.962809+0000","last_change":"2024-05-21T13:36:01.827237+0000","last_active":"2024-05-21T13:36:02.962809+0000","last_peered":"2024-05-21T13:36:02.962809+0000","last_clean":"2024-05-21T13:36:02.962809+0000","last_became_active":"2024-05-21T13:36:01.826374+0000","last_became_peered":"2024-05-21T13:36:01.826374+0000","last_unstale":"2024-05-21T13:36:02.962809+0000","last_undegraded":"2024-05-21T13:36:02.962809+0000","last_fullsized":"2024-05-21T13:36:02.962809+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:12:33.528068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.804889+0000","last_change":"2024-05-21T13:35:57.787940+0000","last_active":"2024-05-21T13:36:02.804889+0000","last_peered":"2024-05-21T13:36:02.804889+0000","last_clean":"2024-05-21T13:36:02.804889+0000","last_became_active":"2024-05-21T13:35:57.787544+0000","last_became_peered":"2024-05-21T13:35:57.787544+0000","last_unstale":"2024-05-21T13:36:02.804889+0000","last_undegraded":"2024-05-21T13:36:02.804889+0000","last_fullsized":"2024-05-21T13:36:02.804889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:46:20.335316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"25'10","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:26.900770+0000","last_change":"2024-05-21T13:35:56.756262+0000","last_active":"2024-05-21T13:36:26.900770+0000","last_peered":"2024-05-21T13:36:26.900770+0000","last_clean":"2024-05-21T13:36:26.900770+0000","last_became_active":"2024-05-21T13:35:56.752342+0000","last_became_peered":"2024-05-21T13:35:56.752342+0000","last_unstale":"2024-05-21T13:36:26.900770+0000","last_undegraded":"2024-05-21T13:36:26.900770+0000","last_fullsized":"2024-05-21T13:36:26.900770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:59:09.541382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.966115+0000","last_change":"2024-05-21T13:36:01.859498+0000","last_active":"2024-05-21T13:36:02.966115+0000","last_peered":"2024-05-21T13:36:02.966115+0000","last_clean":"2024-05-21T13:36:02.966115+0000","last_became_active":"2024-05-21T13:36:01.857707+0000","last_became_peered":"2024-05-21T13:36:01.857707+0000","last_unstale":"2024-05-21T13:36:02.966115+0000","last_undegraded":"2024-05-21T13:36:02.966115+0000","last_fullsized":"2024-05-21T13:36:02.966115+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:38:06.966814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.962835+0000","last_change":"2024-05-21T13:35:57.783007+0000","last_active":"2024-05-21T13:36:02.962835+0000","last_peered":"2024-05-21T13:36:02.962835+0000","last_clean":"2024-05-21T13:36:02.962835+0000","last_became_active":"2024-05-21T13:35:57.782330+0000","last_became_peered":"2024-05-21T13:35:57.782330+0000","last_unstale":"2024-05-21T13:36:02.962835+0000","last_undegraded":"2024-05-21T13:36:02.962835+0000","last_fullsized":"2024-05-21T13:36:02.962835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:26:14.697766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.959369+0000","last_change":"2024-05-21T13:35:56.745787+0000","last_active":"2024-05-21T13:36:02.959369+0000","last_peered":"2024-05-21T13:36:02.959369+0000","last_clean":"2024-05-21T13:36:02.959369+0000","last_became_active":"2024-05-21T13:35:56.745202+0000","last_became_peered":"2024-05-21T13:35:56.745202+0000","last_unstale":"2024-05-21T13:36:02.959369+0000","last_undegraded":"2024-05-21T13:36:02.959369+0000","last_fullsized":"2024-05-21T13:36:02.959369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:31:13.498003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.965870+0000","last_change":"2024-05-21T13:36:01.858550+0000","last_active":"2024-05-21T13:36:02.965870+0000","last_peered":"2024-05-21T13:36:02.965870+0000","last_clean":"2024-05-21T13:36:02.965870+0000","last_became_active":"2024-05-21T13:36:01.857716+0000","last_became_peered":"2024-05-21T13:36:01.857716+0000","last_unstale":"2024-05-21T13:36:02.965870+0000","last_undegraded":"2024-05-21T13:36:02.965870+0000","last_fullsized":"2024-05-21T13:36:02.965870+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:48:32.490678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.805527+0000","last_change":"2024-05-21T13:35:57.799702+0000","last_active":"2024-05-21T13:36:02.805527+0000","last_peered":"2024-05-21T13:36:02.805527+0000","last_clean":"2024-05-21T13:36:02.805527+0000","last_became_active":"2024-05-21T13:35:57.799225+0000","last_became_peered":"2024-05-21T13:35:57.799225+0000","last_unstale":"2024-05-21T13:36:02.805527+0000","last_undegraded":"2024-05-21T13:36:02.805527+0000","last_fullsized":"2024-05-21T13:36:02.805527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:29:54.094448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.806444+0000","last_change":"2024-05-21T13:35:56.742650+0000","last_active":"2024-05-21T13:36:02.806444+0000","last_peered":"2024-05-21T13:36:02.806444+0000","last_clean":"2024-05-21T13:36:02.806444+0000","last_became_active":"2024-05-21T13:35:56.742296+0000","last_became_peered":"2024-05-21T13:35:56.742296+0000","last_unstale":"2024-05-21T13:36:02.806444+0000","last_undegraded":"2024-05-21T13:36:02.806444+0000","last_fullsized":"2024-05-21T13:36:02.806444+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:18:55.514845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.967634+0000","last_change":"2024-05-21T13:36:01.873708+0000","last_active":"2024-05-21T13:36:02.967634+0000","last_peered":"2024-05-21T13:36:02.967634+0000","last_clean":"2024-05-21T13:36:02.967634+0000","last_became_active":"2024-05-21T13:36:01.872320+0000","last_became_peered":"2024-05-21T13:36:01.872320+0000","last_unstale":"2024-05-21T13:36:02.967634+0000","last_undegraded":"2024-05-21T13:36:02.967634+0000","last_fullsized":"2024-05-21T13:36:02.967634+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:01:15.545756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.966606+0000","last_change":"2024-05-21T13:35:57.802763+0000","last_active":"2024-05-21T13:36:02.966606+0000","last_peered":"2024-05-21T13:36:02.966606+0000","last_clean":"2024-05-21T13:36:02.966606+0000","last_became_active":"2024-05-21T13:35:57.802433+0000","last_became_peered":"2024-05-21T13:35:57.802433+0000","last_unstale":"2024-05-21T13:36:02.966606+0000","last_undegraded":"2024-05-21T13:36:02.966606+0000","last_fullsized":"2024-05-21T13:36:02.966606+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:09:48.463186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.965357+0000","last_change":"2024-05-21T13:35:56.754087+0000","last_active":"2024-05-21T13:36:02.965357+0000","last_peered":"2024-05-21T13:36:02.965357+0000","last_clean":"2024-05-21T13:36:02.965357+0000","last_became_active":"2024-05-21T13:35:56.753319+0000","last_became_peered":"2024-05-21T13:35:56.753319+0000","last_unstale":"2024-05-21T13:36:02.965357+0000","last_undegraded":"2024-05-21T13:36:02.965357+0000","last_fullsized":"2024-05-21T13:36:02.965357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:19:21.276993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.806089+0000","last_change":"2024-05-21T13:36:01.836017+0000","last_active":"2024-05-21T13:36:02.806089+0000","last_peered":"2024-05-21T13:36:02.806089+0000","last_clean":"2024-05-21T13:36:02.806089+0000","last_became_active":"2024-05-21T13:36:01.835450+0000","last_became_peered":"2024-05-21T13:36:01.835450+0000","last_unstale":"2024-05-21T13:36:02.806089+0000","last_undegraded":"2024-05-21T13:36:02.806089+0000","last_fullsized":"2024-05-21T13:36:02.806089+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:05:56.077605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.962152+0000","last_change":"2024-05-21T13:35:57.787177+0000","last_active":"2024-05-21T13:36:02.962152+0000","last_peered":"2024-05-21T13:36:02.962152+0000","last_clean":"2024-05-21T13:36:02.962152+0000","last_became_active":"2024-05-21T13:35:57.786401+0000","last_became_peered":"2024-05-21T13:35:57.786401+0000","last_unstale":"2024-05-21T13:36:02.962152+0000","last_undegraded":"2024-05-21T13:36:02.962152+0000","last_fullsized":"2024-05-21T13:36:02.962152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:17:18.939002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:12.171576+0000","last_change":"2024-05-21T13:35:56.751229+0000","last_active":"2024-05-21T13:36:12.171576+0000","last_peered":"2024-05-21T13:36:12.171576+0000","last_clean":"2024-05-21T13:36:12.171576+0000","last_became_active":"2024-05-21T13:35:56.750831+0000","last_became_peered":"2024-05-21T13:35:56.750831+0000","last_unstale":"2024-05-21T13:36:12.171576+0000","last_undegraded":"2024-05-21T13:36:12.171576+0000","last_fullsized":"2024-05-21T13:36:12.171576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:03:40.186241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.807730+0000","last_change":"2024-05-21T13:36:01.832691+0000","last_active":"2024-05-21T13:36:02.807730+0000","last_peered":"2024-05-21T13:36:02.807730+0000","last_clean":"2024-05-21T13:36:02.807730+0000","last_became_active":"2024-05-21T13:36:01.831476+0000","last_became_peered":"2024-05-21T13:36:01.831476+0000","last_unstale":"2024-05-21T13:36:02.807730+0000","last_undegraded":"2024-05-21T13:36:02.807730+0000","last_fullsized":"2024-05-21T13:36:02.807730+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:08:38.092592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.805422+0000","last_change":"2024-05-21T13:35:57.788547+0000","last_active":"2024-05-21T13:36:02.805422+0000","last_peered":"2024-05-21T13:36:02.805422+0000","last_clean":"2024-05-21T13:36:02.805422+0000","last_became_active":"2024-05-21T13:35:57.787785+0000","last_became_peered":"2024-05-21T13:35:57.787785+0000","last_unstale":"2024-05-21T13:36:02.805422+0000","last_undegraded":"2024-05-21T13:36:02.805422+0000","last_fullsized":"2024-05-21T13:36:02.805422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:51:08.781399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"24'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.964609+0000","last_change":"2024-05-21T13:35:56.760557+0000","last_active":"2024-05-21T13:36:02.964609+0000","last_peered":"2024-05-21T13:36:02.964609+0000","last_clean":"2024-05-21T13:36:02.964609+0000","last_became_active":"2024-05-21T13:35:56.759728+0000","last_became_peered":"2024-05-21T13:35:56.759728+0000","last_unstale":"2024-05-21T13:36:02.964609+0000","last_undegraded":"2024-05-21T13:36:02.964609+0000","last_fullsized":"2024-05-21T13:36:02.964609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:56:19.754940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.962040+0000","last_change":"2024-05-21T13:36:01.861622+0000","last_active":"2024-05-21T13:36:02.962040+0000","last_peered":"2024-05-21T13:36:02.962040+0000","last_clean":"2024-05-21T13:36:02.962040+0000","last_became_active":"2024-05-21T13:36:01.861172+0000","last_became_peered":"2024-05-21T13:36:01.861172+0000","last_unstale":"2024-05-21T13:36:02.962040+0000","last_undegraded":"2024-05-21T13:36:02.962040+0000","last_fullsized":"2024-05-21T13:36:02.962040+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:39:53.211812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.966013+0000","last_change":"2024-05-21T13:35:57.804520+0000","last_active":"2024-05-21T13:36:02.966013+0000","last_peered":"2024-05-21T13:36:02.966013+0000","last_clean":"2024-05-21T13:36:02.966013+0000","last_became_active":"2024-05-21T13:35:57.804139+0000","last_became_peered":"2024-05-21T13:35:57.804139+0000","last_unstale":"2024-05-21T13:36:02.966013+0000","last_undegraded":"2024-05-21T13:36:02.966013+0000","last_fullsized":"2024-05-21T13:36:02.966013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:21:52.433019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.959802+0000","last_change":"2024-05-21T13:35:56.733821+0000","last_active":"2024-05-21T13:36:02.959802+0000","last_peered":"2024-05-21T13:36:02.959802+0000","last_clean":"2024-05-21T13:36:02.959802+0000","last_became_active":"2024-05-21T13:35:56.732488+0000","last_became_peered":"2024-05-21T13:35:56.732488+0000","last_unstale":"2024-05-21T13:36:02.959802+0000","last_undegraded":"2024-05-21T13:36:02.959802+0000","last_fullsized":"2024-05-21T13:36:02.959802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:10:01.786931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.961990+0000","last_change":"2024-05-21T13:36:01.868781+0000","last_active":"2024-05-21T13:36:02.961990+0000","last_peered":"2024-05-21T13:36:02.961990+0000","last_clean":"2024-05-21T13:36:02.961990+0000","last_became_active":"2024-05-21T13:36:01.864254+0000","last_became_peered":"2024-05-21T13:36:01.864254+0000","last_unstale":"2024-05-21T13:36:02.961990+0000","last_undegraded":"2024-05-21T13:36:02.961990+0000","last_fullsized":"2024-05-21T13:36:02.961990+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:34:12.632333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.962094+0000","last_change":"2024-05-21T13:35:57.788313+0000","last_active":"2024-05-21T13:36:02.962094+0000","last_peered":"2024-05-21T13:36:02.962094+0000","last_clean":"2024-05-21T13:36:02.962094+0000","last_became_active":"2024-05-21T13:35:57.787963+0000","last_became_peered":"2024-05-21T13:35:57.787963+0000","last_unstale":"2024-05-21T13:36:02.962094+0000","last_undegraded":"2024-05-21T13:36:02.962094+0000","last_fullsized":"2024-05-21T13:36:02.962094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:16:21.586571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.963973+0000","last_change":"2024-05-21T13:35:56.748334+0000","last_active":"2024-05-21T13:36:02.963973+0000","last_peered":"2024-05-21T13:36:02.963973+0000","last_clean":"2024-05-21T13:36:02.963973+0000","last_became_active":"2024-05-21T13:35:56.748049+0000","last_became_peered":"2024-05-21T13:35:56.748049+0000","last_unstale":"2024-05-21T13:36:02.963973+0000","last_undegraded":"2024-05-21T13:36:02.963973+0000","last_fullsized":"2024-05-21T13:36:02.963973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:59:02.802905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.807330+0000","last_change":"2024-05-21T13:36:01.856216+0000","last_active":"2024-05-21T13:36:02.807330+0000","last_peered":"2024-05-21T13:36:02.807330+0000","last_clean":"2024-05-21T13:36:02.807330+0000","last_became_active":"2024-05-21T13:36:01.855417+0000","last_became_peered":"2024-05-21T13:36:01.855417+0000","last_unstale":"2024-05-21T13:36:02.807330+0000","last_undegraded":"2024-05-21T13:36:02.807330+0000","last_fullsized":"2024-05-21T13:36:02.807330+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:36:01.423944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.807915+0000","last_change":"2024-05-21T13:36:01.838966+0000","last_active":"2024-05-21T13:36:02.807915+0000","last_peered":"2024-05-21T13:36:02.807915+0000","last_clean":"2024-05-21T13:36:02.807915+0000","last_became_active":"2024-05-21T13:36:01.837777+0000","last_became_peered":"2024-05-21T13:36:01.837777+0000","last_unstale":"2024-05-21T13:36:02.807915+0000","last_undegraded":"2024-05-21T13:36:02.807915+0000","last_fullsized":"2024-05-21T13:36:02.807915+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:40:55.688338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.807274+0000","last_change":"2024-05-21T13:35:57.762719+0000","last_active":"2024-05-21T13:36:02.807274+0000","last_peered":"2024-05-21T13:36:02.807274+0000","last_clean":"2024-05-21T13:36:02.807274+0000","last_became_active":"2024-05-21T13:35:57.762071+0000","last_became_peered":"2024-05-21T13:35:57.762071+0000","last_unstale":"2024-05-21T13:36:02.807274+0000","last_undegraded":"2024-05-21T13:36:02.807274+0000","last_fullsized":"2024-05-21T13:36:02.807274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:55:37.631695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.805108+0000","last_change":"2024-05-21T13:35:56.751481+0000","last_active":"2024-05-21T13:36:02.805108+0000","last_peered":"2024-05-21T13:36:02.805108+0000","last_clean":"2024-05-21T13:36:02.805108+0000","last_became_active":"2024-05-21T13:35:56.751201+0000","last_became_peered":"2024-05-21T13:35:56.751201+0000","last_unstale":"2024-05-21T13:36:02.805108+0000","last_undegraded":"2024-05-21T13:36:02.805108+0000","last_fullsized":"2024-05-21T13:36:02.805108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:33:28.720246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.806144+0000","last_change":"2024-05-21T13:36:01.837042+0000","last_active":"2024-05-21T13:36:02.806144+0000","last_peered":"2024-05-21T13:36:02.806144+0000","last_clean":"2024-05-21T13:36:02.806144+0000","last_became_active":"2024-05-21T13:36:01.836194+0000","last_became_peered":"2024-05-21T13:36:01.836194+0000","last_unstale":"2024-05-21T13:36:02.806144+0000","last_undegraded":"2024-05-21T13:36:02.806144+0000","last_fullsized":"2024-05-21T13:36:02.806144+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:15:50.751693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.962036+0000","last_change":"2024-05-21T13:35:57.788838+0000","last_active":"2024-05-21T13:36:02.962036+0000","last_peered":"2024-05-21T13:36:02.962036+0000","last_clean":"2024-05-21T13:36:02.962036+0000","last_became_active":"2024-05-21T13:35:57.786307+0000","last_became_peered":"2024-05-21T13:35:57.786307+0000","last_unstale":"2024-05-21T13:36:02.962036+0000","last_undegraded":"2024-05-21T13:36:02.962036+0000","last_fullsized":"2024-05-21T13:36:02.962036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:52:09.086807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.962585+0000","last_change":"2024-05-21T13:35:56.746564+0000","last_active":"2024-05-21T13:36:02.962585+0000","last_peered":"2024-05-21T13:36:02.962585+0000","last_clean":"2024-05-21T13:36:02.962585+0000","last_became_active":"2024-05-21T13:35:56.745884+0000","last_became_peered":"2024-05-21T13:35:56.745884+0000","last_unstale":"2024-05-21T13:36:02.962585+0000","last_undegraded":"2024-05-21T13:36:02.962585+0000","last_fullsized":"2024-05-21T13:36:02.962585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:01:44.738607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"24'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.806093+0000","last_change":"2024-05-21T13:35:56.753930+0000","last_active":"2024-05-21T13:36:02.806093+0000","last_peered":"2024-05-21T13:36:02.806093+0000","last_clean":"2024-05-21T13:36:02.806093+0000","last_became_active":"2024-05-21T13:35:56.753499+0000","last_became_peered":"2024-05-21T13:35:56.753499+0000","last_unstale":"2024-05-21T13:36:02.806093+0000","last_undegraded":"2024-05-21T13:36:02.806093+0000","last_fullsized":"2024-05-21T13:36:02.806093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:40:51.516544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.808045+0000","last_change":"2024-05-21T13:35:57.780101+0000","last_active":"2024-05-21T13:36:02.808045+0000","last_peered":"2024-05-21T13:36:02.808045+0000","last_clean":"2024-05-21T13:36:02.808045+0000","last_became_active":"2024-05-21T13:35:57.779368+0000","last_became_peered":"2024-05-21T13:35:57.779368+0000","last_unstale":"2024-05-21T13:36:02.808045+0000","last_undegraded":"2024-05-21T13:36:02.808045+0000","last_fullsized":"2024-05-21T13:36:02.808045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:37:39.347067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.808272+0000","last_change":"2024-05-21T13:36:01.844240+0000","last_active":"2024-05-21T13:36:02.808272+0000","last_peered":"2024-05-21T13:36:02.808272+0000","last_clean":"2024-05-21T13:36:02.808272+0000","last_became_active":"2024-05-21T13:36:01.842792+0000","last_became_peered":"2024-05-21T13:36:01.842792+0000","last_unstale":"2024-05-21T13:36:02.808272+0000","last_undegraded":"2024-05-21T13:36:02.808272+0000","last_fullsized":"2024-05-21T13:36:02.808272+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:19:54.016465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"25'5","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:26.903362+0000","last_change":"2024-05-21T13:35:56.770864+0000","last_active":"2024-05-21T13:36:26.903362+0000","last_peered":"2024-05-21T13:36:26.903362+0000","last_clean":"2024-05-21T13:36:26.903362+0000","last_became_active":"2024-05-21T13:35:56.766873+0000","last_became_peered":"2024-05-21T13:35:56.766873+0000","last_unstale":"2024-05-21T13:36:26.903362+0000","last_undegraded":"2024-05-21T13:36:26.903362+0000","last_fullsized":"2024-05-21T13:36:26.903362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:13:02.633858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.963803+0000","last_change":"2024-05-21T13:35:57.787563+0000","last_active":"2024-05-21T13:36:02.963803+0000","last_peered":"2024-05-21T13:36:02.963803+0000","last_clean":"2024-05-21T13:36:02.963803+0000","last_became_active":"2024-05-21T13:35:57.787255+0000","last_became_peered":"2024-05-21T13:35:57.787255+0000","last_unstale":"2024-05-21T13:36:02.963803+0000","last_undegraded":"2024-05-21T13:36:02.963803+0000","last_fullsized":"2024-05-21T13:36:02.963803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:32:49.325049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.964068+0000","last_change":"2024-05-21T13:36:01.868514+0000","last_active":"2024-05-21T13:36:02.964068+0000","last_peered":"2024-05-21T13:36:02.964068+0000","last_clean":"2024-05-21T13:36:02.964068+0000","last_became_active":"2024-05-21T13:36:01.867522+0000","last_became_peered":"2024-05-21T13:36:01.867522+0000","last_unstale":"2024-05-21T13:36:02.964068+0000","last_undegraded":"2024-05-21T13:36:02.964068+0000","last_fullsized":"2024-05-21T13:36:02.964068+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:19:13.533784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.960872+0000","last_change":"2024-05-21T13:35:57.782641+0000","last_active":"2024-05-21T13:36:02.960872+0000","last_peered":"2024-05-21T13:36:02.960872+0000","last_clean":"2024-05-21T13:36:02.960872+0000","last_became_active":"2024-05-21T13:35:57.782233+0000","last_became_peered":"2024-05-21T13:35:57.782233+0000","last_unstale":"2024-05-21T13:36:02.960872+0000","last_undegraded":"2024-05-21T13:36:02.960872+0000","last_fullsized":"2024-05-21T13:36:02.960872+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:55:18.808229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.963845+0000","last_change":"2024-05-21T13:35:57.770591+0000","last_active":"2024-05-21T13:36:02.963845+0000","last_peered":"2024-05-21T13:36:02.963845+0000","last_clean":"2024-05-21T13:36:02.963845+0000","last_became_active":"2024-05-21T13:35:57.769785+0000","last_became_peered":"2024-05-21T13:35:57.769785+0000","last_unstale":"2024-05-21T13:36:02.963845+0000","last_undegraded":"2024-05-21T13:36:02.963845+0000","last_fullsized":"2024-05-21T13:36:02.963845+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:18:28.168393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.805267+0000","last_change":"2024-05-21T13:35:57.799153+0000","last_active":"2024-05-21T13:36:02.805267+0000","last_peered":"2024-05-21T13:36:02.805267+0000","last_clean":"2024-05-21T13:36:02.805267+0000","last_became_active":"2024-05-21T13:35:57.796495+0000","last_became_peered":"2024-05-21T13:35:57.796495+0000","last_unstale":"2024-05-21T13:36:02.805267+0000","last_undegraded":"2024-05-21T13:36:02.805267+0000","last_fullsized":"2024-05-21T13:36:02.805267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:53:04.109036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.963840+0000","last_change":"2024-05-21T13:35:57.784335+0000","last_active":"2024-05-21T13:36:02.963840+0000","last_peered":"2024-05-21T13:36:02.963840+0000","last_clean":"2024-05-21T13:36:02.963840+0000","last_became_active":"2024-05-21T13:35:57.783968+0000","last_became_peered":"2024-05-21T13:35:57.783968+0000","last_unstale":"2024-05-21T13:36:02.963840+0000","last_undegraded":"2024-05-21T13:36:02.963840+0000","last_fullsized":"2024-05-21T13:36:02.963840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:57:20.832617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.967890+0000","last_change":"2024-05-21T13:35:57.795153+0000","last_active":"2024-05-21T13:36:02.967890+0000","last_peered":"2024-05-21T13:36:02.967890+0000","last_clean":"2024-05-21T13:36:02.967890+0000","last_became_active":"2024-05-21T13:35:57.794885+0000","last_became_peered":"2024-05-21T13:35:57.794885+0000","last_unstale":"2024-05-21T13:36:02.967890+0000","last_undegraded":"2024-05-21T13:36:02.967890+0000","last_fullsized":"2024-05-21T13:36:02.967890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:17:00.454371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.967778+0000","last_change":"2024-05-21T13:35:57.778916+0000","last_active":"2024-05-21T13:36:02.967778+0000","last_peered":"2024-05-21T13:36:02.967778+0000","last_clean":"2024-05-21T13:36:02.967778+0000","last_became_active":"2024-05-21T13:35:57.778171+0000","last_became_peered":"2024-05-21T13:35:57.778171+0000","last_unstale":"2024-05-21T13:36:02.967778+0000","last_undegraded":"2024-05-21T13:36:02.967778+0000","last_fullsized":"2024-05-21T13:36:02.967778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:15:37.425836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.961364+0000","last_change":"2024-05-21T13:35:57.791367+0000","last_active":"2024-05-21T13:36:02.961364+0000","last_peered":"2024-05-21T13:36:02.961364+0000","last_clean":"2024-05-21T13:36:02.961364+0000","last_became_active":"2024-05-21T13:35:57.790971+0000","last_became_peered":"2024-05-21T13:35:57.790971+0000","last_unstale":"2024-05-21T13:36:02.961364+0000","last_undegraded":"2024-05-21T13:36:02.961364+0000","last_fullsized":"2024-05-21T13:36:02.961364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:14:47.428631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.965591+0000","last_change":"2024-05-21T13:35:57.785257+0000","last_active":"2024-05-21T13:36:02.965591+0000","last_peered":"2024-05-21T13:36:02.965591+0000","last_clean":"2024-05-21T13:36:02.965591+0000","last_became_active":"2024-05-21T13:35:57.781533+0000","last_became_peered":"2024-05-21T13:35:57.781533+0000","last_unstale":"2024-05-21T13:36:02.965591+0000","last_undegraded":"2024-05-21T13:36:02.965591+0000","last_fullsized":"2024-05-21T13:36:02.965591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:18:32.591803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.804917+0000","last_change":"2024-05-21T13:35:57.799128+0000","last_active":"2024-05-21T13:36:02.804917+0000","last_peered":"2024-05-21T13:36:02.804917+0000","last_clean":"2024-05-21T13:36:02.804917+0000","last_became_active":"2024-05-21T13:35:57.797044+0000","last_became_peered":"2024-05-21T13:35:57.797044+0000","last_unstale":"2024-05-21T13:36:02.804917+0000","last_undegraded":"2024-05-21T13:36:02.804917+0000","last_fullsized":"2024-05-21T13:36:02.804917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:57:13.472309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.962393+0000","last_change":"2024-05-21T13:35:57.789768+0000","last_active":"2024-05-21T13:36:02.962393+0000","last_peered":"2024-05-21T13:36:02.962393+0000","last_clean":"2024-05-21T13:36:02.962393+0000","last_became_active":"2024-05-21T13:35:57.789474+0000","last_became_peered":"2024-05-21T13:35:57.789474+0000","last_unstale":"2024-05-21T13:36:02.962393+0000","last_undegraded":"2024-05-21T13:36:02.962393+0000","last_fullsized":"2024-05-21T13:36:02.962393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:42:53.993281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.963561+0000","last_change":"2024-05-21T13:35:57.756607+0000","last_active":"2024-05-21T13:36:02.963561+0000","last_peered":"2024-05-21T13:36:02.963561+0000","last_clean":"2024-05-21T13:36:02.963561+0000","last_became_active":"2024-05-21T13:35:57.755889+0000","last_became_peered":"2024-05-21T13:35:57.755889+0000","last_unstale":"2024-05-21T13:36:02.963561+0000","last_undegraded":"2024-05-21T13:36:02.963561+0000","last_fullsized":"2024-05-21T13:36:02.963561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:16:19.541597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.808181+0000","last_change":"2024-05-21T13:35:57.775322+0000","last_active":"2024-05-21T13:36:02.808181+0000","last_peered":"2024-05-21T13:36:02.808181+0000","last_clean":"2024-05-21T13:36:02.808181+0000","last_became_active":"2024-05-21T13:35:57.774386+0000","last_became_peered":"2024-05-21T13:35:57.774386+0000","last_unstale":"2024-05-21T13:36:02.808181+0000","last_undegraded":"2024-05-21T13:36:02.808181+0000","last_fullsized":"2024-05-21T13:36:02.808181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:01:02.106172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.959969+0000","last_change":"2024-05-21T13:35:57.769931+0000","last_active":"2024-05-21T13:36:02.959969+0000","last_peered":"2024-05-21T13:36:02.959969+0000","last_clean":"2024-05-21T13:36:02.959969+0000","last_became_active":"2024-05-21T13:35:57.769149+0000","last_became_peered":"2024-05-21T13:35:57.769149+0000","last_unstale":"2024-05-21T13:36:02.959969+0000","last_undegraded":"2024-05-21T13:36:02.959969+0000","last_fullsized":"2024-05-21T13:36:02.959969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:55:56.268307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.806502+0000","last_change":"2024-05-21T13:35:57.796153+0000","last_active":"2024-05-21T13:36:02.806502+0000","last_peered":"2024-05-21T13:36:02.806502+0000","last_clean":"2024-05-21T13:36:02.806502+0000","last_became_active":"2024-05-21T13:35:57.795799+0000","last_became_peered":"2024-05-21T13:35:57.795799+0000","last_unstale":"2024-05-21T13:36:02.806502+0000","last_undegraded":"2024-05-21T13:36:02.806502+0000","last_fullsized":"2024-05-21T13:36:02.806502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:52:04.794391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.966824+0000","last_change":"2024-05-21T13:35:57.776414+0000","last_active":"2024-05-21T13:36:02.966824+0000","last_peered":"2024-05-21T13:36:02.966824+0000","last_clean":"2024-05-21T13:36:02.966824+0000","last_became_active":"2024-05-21T13:35:57.775573+0000","last_became_peered":"2024-05-21T13:35:57.775573+0000","last_unstale":"2024-05-21T13:36:02.966824+0000","last_undegraded":"2024-05-21T13:36:02.966824+0000","last_fullsized":"2024-05-21T13:36:02.966824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:47:47.624662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.808011+0000","last_change":"2024-05-21T13:35:57.799673+0000","last_active":"2024-05-21T13:36:02.808011+0000","last_peered":"2024-05-21T13:36:02.808011+0000","last_clean":"2024-05-21T13:36:02.808011+0000","last_became_active":"2024-05-21T13:35:57.799313+0000","last_became_peered":"2024-05-21T13:35:57.799313+0000","last_unstale":"2024-05-21T13:36:02.808011+0000","last_undegraded":"2024-05-21T13:36:02.808011+0000","last_fullsized":"2024-05-21T13:36:02.808011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:40:52.516216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.804786+0000","last_change":"2024-05-21T13:35:57.790705+0000","last_active":"2024-05-21T13:36:02.804786+0000","last_peered":"2024-05-21T13:36:02.804786+0000","last_clean":"2024-05-21T13:36:02.804786+0000","last_became_active":"2024-05-21T13:35:57.787735+0000","last_became_peered":"2024-05-21T13:35:57.787735+0000","last_unstale":"2024-05-21T13:36:02.804786+0000","last_undegraded":"2024-05-21T13:36:02.804786+0000","last_fullsized":"2024-05-21T13:36:02.804786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:17:24.376182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.961973+0000","last_change":"2024-05-21T13:35:57.786838+0000","last_active":"2024-05-21T13:36:02.961973+0000","last_peered":"2024-05-21T13:36:02.961973+0000","last_clean":"2024-05-21T13:36:02.961973+0000","last_became_active":"2024-05-21T13:35:57.786403+0000","last_became_peered":"2024-05-21T13:35:57.786403+0000","last_unstale":"2024-05-21T13:36:02.961973+0000","last_undegraded":"2024-05-21T13:36:02.961973+0000","last_fullsized":"2024-05-21T13:36:02.961973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:29:28.760793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.966410+0000","last_change":"2024-05-21T13:35:57.783561+0000","last_active":"2024-05-21T13:36:02.966410+0000","last_peered":"2024-05-21T13:36:02.966410+0000","last_clean":"2024-05-21T13:36:02.966410+0000","last_became_active":"2024-05-21T13:35:57.783060+0000","last_became_peered":"2024-05-21T13:35:57.783060+0000","last_unstale":"2024-05-21T13:36:02.966410+0000","last_undegraded":"2024-05-21T13:36:02.966410+0000","last_fullsized":"2024-05-21T13:36:02.966410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:27:27.261449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.964046+0000","last_change":"2024-05-21T13:35:57.788210+0000","last_active":"2024-05-21T13:36:02.964046+0000","last_peered":"2024-05-21T13:36:02.964046+0000","last_clean":"2024-05-21T13:36:02.964046+0000","last_became_active":"2024-05-21T13:35:57.787508+0000","last_became_peered":"2024-05-21T13:35:57.787508+0000","last_unstale":"2024-05-21T13:36:02.964046+0000","last_undegraded":"2024-05-21T13:36:02.964046+0000","last_fullsized":"2024-05-21T13:36:02.964046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:12:56.914580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.959869+0000","last_change":"2024-05-21T13:35:57.787335+0000","last_active":"2024-05-21T13:36:02.959869+0000","last_peered":"2024-05-21T13:36:02.959869+0000","last_clean":"2024-05-21T13:36:02.959869+0000","last_became_active":"2024-05-21T13:35:57.786292+0000","last_became_peered":"2024-05-21T13:35:57.786292+0000","last_unstale":"2024-05-21T13:36:02.959869+0000","last_undegraded":"2024-05-21T13:36:02.959869+0000","last_fullsized":"2024-05-21T13:36:02.959869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:49:40.480948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.960610+0000","last_change":"2024-05-21T13:35:57.801121+0000","last_active":"2024-05-21T13:36:02.960610+0000","last_peered":"2024-05-21T13:36:02.960610+0000","last_clean":"2024-05-21T13:36:02.960610+0000","last_became_active":"2024-05-21T13:35:57.800858+0000","last_became_peered":"2024-05-21T13:35:57.800858+0000","last_unstale":"2024-05-21T13:36:02.960610+0000","last_undegraded":"2024-05-21T13:36:02.960610+0000","last_fullsized":"2024-05-21T13:36:02.960610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:41:08.765821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.959709+0000","last_change":"2024-05-21T13:35:57.778753+0000","last_active":"2024-05-21T13:36:02.959709+0000","last_peered":"2024-05-21T13:36:02.959709+0000","last_clean":"2024-05-21T13:36:02.959709+0000","last_became_active":"2024-05-21T13:35:57.777962+0000","last_became_peered":"2024-05-21T13:35:57.777962+0000","last_unstale":"2024-05-21T13:36:02.959709+0000","last_undegraded":"2024-05-21T13:36:02.959709+0000","last_fullsized":"2024-05-21T13:36:02.959709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:51:49.102945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.963934+0000","last_change":"2024-05-21T13:35:57.798312+0000","last_active":"2024-05-21T13:36:02.963934+0000","last_peered":"2024-05-21T13:36:02.963934+0000","last_clean":"2024-05-21T13:36:02.963934+0000","last_became_active":"2024-05-21T13:35:57.797793+0000","last_became_peered":"2024-05-21T13:35:57.797793+0000","last_unstale":"2024-05-21T13:36:02.963934+0000","last_undegraded":"2024-05-21T13:36:02.963934+0000","last_fullsized":"2024-05-21T13:36:02.963934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:28:47.276868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.961736+0000","last_change":"2024-05-21T13:35:57.782412+0000","last_active":"2024-05-21T13:36:02.961736+0000","last_peered":"2024-05-21T13:36:02.961736+0000","last_clean":"2024-05-21T13:36:02.961736+0000","last_became_active":"2024-05-21T13:35:57.782058+0000","last_became_peered":"2024-05-21T13:35:57.782058+0000","last_unstale":"2024-05-21T13:36:02.961736+0000","last_undegraded":"2024-05-21T13:36:02.961736+0000","last_fullsized":"2024-05-21T13:36:02.961736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:39:49.142554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.959879+0000","last_change":"2024-05-21T13:35:57.779771+0000","last_active":"2024-05-21T13:36:02.959879+0000","last_peered":"2024-05-21T13:36:02.959879+0000","last_clean":"2024-05-21T13:36:02.959879+0000","last_became_active":"2024-05-21T13:35:57.779168+0000","last_became_peered":"2024-05-21T13:35:57.779168+0000","last_unstale":"2024-05-21T13:36:02.959879+0000","last_undegraded":"2024-05-21T13:36:02.959879+0000","last_fullsized":"2024-05-21T13:36:02.959879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T13:59:58.966203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.961896+0000","last_change":"2024-05-21T13:35:57.773098+0000","last_active":"2024-05-21T13:36:02.961896+0000","last_peered":"2024-05-21T13:36:02.961896+0000","last_clean":"2024-05-21T13:36:02.961896+0000","last_became_active":"2024-05-21T13:35:57.772268+0000","last_became_peered":"2024-05-21T13:35:57.772268+0000","last_unstale":"2024-05-21T13:36:02.961896+0000","last_undegraded":"2024-05-21T13:36:02.961896+0000","last_fullsized":"2024-05-21T13:36:02.961896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:05:25.482434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.960610+0000","last_change":"2024-05-21T13:35:57.788980+0000","last_active":"2024-05-21T13:36:02.960610+0000","last_peered":"2024-05-21T13:36:02.960610+0000","last_clean":"2024-05-21T13:36:02.960610+0000","last_became_active":"2024-05-21T13:35:57.788689+0000","last_became_peered":"2024-05-21T13:35:57.788689+0000","last_unstale":"2024-05-21T13:36:02.960610+0000","last_undegraded":"2024-05-21T13:36:02.960610+0000","last_fullsized":"2024-05-21T13:36:02.960610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:15:07.615363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.961136+0000","last_change":"2024-05-21T13:35:57.772867+0000","last_active":"2024-05-21T13:36:02.961136+0000","last_peered":"2024-05-21T13:36:02.961136+0000","last_clean":"2024-05-21T13:36:02.961136+0000","last_became_active":"2024-05-21T13:35:57.772160+0000","last_became_peered":"2024-05-21T13:35:57.772160+0000","last_unstale":"2024-05-21T13:36:02.961136+0000","last_undegraded":"2024-05-21T13:36:02.961136+0000","last_fullsized":"2024-05-21T13:36:02.961136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:11:24.428796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.964773+0000","last_change":"2024-05-21T13:35:57.785297+0000","last_active":"2024-05-21T13:36:02.964773+0000","last_peered":"2024-05-21T13:36:02.964773+0000","last_clean":"2024-05-21T13:36:02.964773+0000","last_became_active":"2024-05-21T13:35:57.784741+0000","last_became_peered":"2024-05-21T13:35:57.784741+0000","last_unstale":"2024-05-21T13:36:02.964773+0000","last_undegraded":"2024-05-21T13:36:02.964773+0000","last_fullsized":"2024-05-21T13:36:02.964773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:45:08.507286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.965566+0000","last_change":"2024-05-21T13:35:57.788875+0000","last_active":"2024-05-21T13:36:02.965566+0000","last_peered":"2024-05-21T13:36:02.965566+0000","last_clean":"2024-05-21T13:36:02.965566+0000","last_became_active":"2024-05-21T13:35:57.786629+0000","last_became_peered":"2024-05-21T13:35:57.786629+0000","last_unstale":"2024-05-21T13:36:02.965566+0000","last_undegraded":"2024-05-21T13:36:02.965566+0000","last_fullsized":"2024-05-21T13:36:02.965566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:40:07.549210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.959984+0000","last_change":"2024-05-21T13:35:57.803316+0000","last_active":"2024-05-21T13:36:02.959984+0000","last_peered":"2024-05-21T13:36:02.959984+0000","last_clean":"2024-05-21T13:36:02.959984+0000","last_became_active":"2024-05-21T13:35:57.802925+0000","last_became_peered":"2024-05-21T13:35:57.802925+0000","last_unstale":"2024-05-21T13:36:02.959984+0000","last_undegraded":"2024-05-21T13:36:02.959984+0000","last_fullsized":"2024-05-21T13:36:02.959984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:17:16.304097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":5352,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":10686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66916,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509452,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":101627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509452,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":101503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509451,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":262144,"data_stored":102085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509452,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":270336,"data_stored":105345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509452,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31504,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340336,"statfs":{"total":96636764160,"available":96604504064,"internally_reserved":0,"allocated":327680,"data_stored":691941,"data_compressed":33458,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509451,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":266240,"data_stored":101559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542155,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":339968,"data_stored":692585,"data_compressed":33458,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":106801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33458,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33458,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":5298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-21T13:36:30.874 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-21T13:36:31.026 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.049+0000 7fa29fb37640 1 Processor -- start 2024-05-21T13:36:31.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.049+0000 7fa29fb37640 1 -- start start 2024-05-21T13:36:31.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.049+0000 7fa29fb37640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa2980c48f0 0x7fa2980c7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:31.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.049+0000 7fa29fb37640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa298159cf0 con 0x7fa298153cb0 2024-05-21T13:36:31.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.049+0000 7fa29fb37640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa298159fd0 con 0x7fa2980c4d00 2024-05-21T13:36:31.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.049+0000 7fa29fb37640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7fa2980c9c60 con 0x7fa2980c48f0 2024-05-21T13:36:31.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.049+0000 7fa29d8d3640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fa298153cb0 0x7fa2980c9440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:44606/0 (socket says 172.21.15.22:44606) 2024-05-21T13:36:31.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.049+0000 7fa29d8d3640 1 -- 172.21.15.22:0/2233630162 learned_addr learned my addr 172.21.15.22:0/2233630162 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-21T13:36:31.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.049+0000 7fa29c8d1640 1 -- 172.21.15.22:0/2233630162 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1073846700 0 0) 0x7fa298159cf0 con 0x7fa298153cb0 2024-05-21T13:36:31.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.049+0000 7fa29c8d1640 1 -- 172.21.15.22:0/2233630162 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa284003530 con 0x7fa298153cb0 2024-05-21T13:36:31.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.049+0000 7fa29d0d2640 1 --2- 172.21.15.22:0/2233630162 >> v2:172.21.15.115:3300/0 conn(0x7fa2980c48f0 0x7fa2980c7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:31.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.049+0000 7fa29c8d1640 1 -- 172.21.15.22:0/2233630162 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 200118394 0 0) 0x7fa284003530 con 0x7fa298153cb0 2024-05-21T13:36:31.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.049+0000 7fa29c8d1640 1 -- 172.21.15.22:0/2233630162 >> v2:172.21.15.115:3300/0 conn(0x7fa2980c48f0 msgr2=0x7fa2980c7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:31.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.049+0000 7fa29c8d1640 1 --2- 172.21.15.22:0/2233630162 >> v2:172.21.15.115:3300/0 conn(0x7fa2980c48f0 0x7fa2980c7ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:31.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.049+0000 7fa29c8d1640 1 -- 172.21.15.22:0/2233630162 >> v1:172.21.15.115:6789/0 conn(0x7fa2980c4d00 legacy=0x7fa29815d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:31.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.049+0000 7fa29c8d1640 1 -- 172.21.15.22:0/2233630162 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa29815a2b0 con 0x7fa298153cb0 2024-05-21T13:36:31.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.049+0000 7fa29c8d1640 1 -- 172.21.15.22:0/2233630162 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2684847062 0 0) 0x7fa288001700 con 0x7fa298153cb0 2024-05-21T13:36:31.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.049+0000 7fa29c8d1640 1 -- 172.21.15.22:0/2233630162 >> v1:172.21.15.22:6789/0 conn(0x7fa298153cb0 legacy=0x7fa2980c9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:31.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.049+0000 7fa29c8d1640 1 --2- 172.21.15.22:0/2233630162 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa284003a10 0x7fa284003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:31.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.049+0000 7fa29c8d1640 1 --2- 172.21.15.22:0/2233630162 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa284004810 0x7fa284004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:31.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.049+0000 7fa29c8d1640 1 --2- 172.21.15.22:0/2233630162 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa284005220 0x7fa28400fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:31.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.049+0000 7fa29c8d1640 1 -- 172.21.15.22:0/2233630162 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa2980c9c60 con 0x7fa284003a10 2024-05-21T13:36:31.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.049+0000 7fa29c8d1640 1 -- 172.21.15.22:0/2233630162 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fa284010560 con 0x7fa284004810 2024-05-21T13:36:31.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.049+0000 7fa29c8d1640 1 -- 172.21.15.22:0/2233630162 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7fa284010760 con 0x7fa284005220 2024-05-21T13:36:31.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.049+0000 7fa29d8d3640 1 --2- 172.21.15.22:0/2233630162 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa284003a10 0x7fa284003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:31.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.049+0000 7fa29d0d2640 1 --2- 172.21.15.22:0/2233630162 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa284004810 0x7fa284004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:31.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.049+0000 7fa29e0d4640 1 --2- 172.21.15.22:0/2233630162 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa284005220 0x7fa28400fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:31.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.049+0000 7fa29d8d3640 1 -- 172.21.15.22:0/2233630162 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa284005220 msgr2=0x7fa28400fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:31.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.049+0000 7fa29d8d3640 1 --2- 172.21.15.22:0/2233630162 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa284005220 0x7fa28400fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:31.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.049+0000 7fa29d8d3640 1 -- 172.21.15.22:0/2233630162 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa284004810 msgr2=0x7fa284004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:31.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.049+0000 7fa29d8d3640 1 --2- 172.21.15.22:0/2233630162 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa284004810 0x7fa284004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:31.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.049+0000 7fa29e0d4640 1 -- 172.21.15.22:0/2233630162 reap_dead start 2024-05-21T13:36:31.031 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.049+0000 7fa29d8d3640 1 -- 172.21.15.22:0/2233630162 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa284003530 con 0x7fa284003a10 2024-05-21T13:36:31.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.053+0000 7fa29d8d3640 1 --2- 172.21.15.22:0/2233630162 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa284003a10 0x7fa284003e10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa28800c290 tx=0x7fa28801cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c960b3d3b1fc94b0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:31.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.053+0000 7fa29c8d1640 1 -- 172.21.15.22:0/2233630162 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa288007d60 con 0x7fa284003a10 2024-05-21T13:36:31.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.053+0000 7fa29c8d1640 1 -- 172.21.15.22:0/2233630162 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2880a9020 con 0x7fa284003a10 2024-05-21T13:36:31.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.053+0000 7fa29c8d1640 1 -- 172.21.15.22:0/2233630162 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa288005b00 con 0x7fa284003a10 2024-05-21T13:36:31.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.053+0000 7fa29fb37640 1 -- 172.21.15.22:0/2233630162 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa284003a10 msgr2=0x7fa284003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:31.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.053+0000 7fa29fb37640 1 --2- 172.21.15.22:0/2233630162 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa284003a10 0x7fa284003e10 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa28800c290 tx=0x7fa28801cc60 comp rx=0 tx=0).stop 2024-05-21T13:36:31.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.053+0000 7fa29fb37640 1 -- 172.21.15.22:0/2233630162 shutdown_connections 2024-05-21T13:36:31.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.053+0000 7fa29fb37640 1 --2- 172.21.15.22:0/2233630162 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa284003a10 0x7fa284003e10 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:31.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.053+0000 7fa29fb37640 1 -- 172.21.15.22:0/2233630162 >> 172.21.15.22:0/2233630162 conn(0x7fa29806ea10 msgr2=0x7fa29806ff50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:31.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.053+0000 7fa29fb37640 1 -- 172.21.15.22:0/2233630162 shutdown_connections 2024-05-21T13:36:31.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.053+0000 7fa29fb37640 1 -- 172.21.15.22:0/2233630162 wait complete. 2024-05-21T13:36:31.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.057+0000 7fa29fb37640 1 Processor -- start 2024-05-21T13:36:31.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.057+0000 7fa29fb37640 1 -- start start 2024-05-21T13:36:31.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.057+0000 7fa29fb37640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa284003a10 0x7fa298147f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:31.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.057+0000 7fa29fb37640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa2981e4c00 0x7fa2980cda40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:31.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.057+0000 7fa29fb37640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa29815bf00 0x7fa29815c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:31.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.057+0000 7fa29fb37640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa298154210 con 0x7fa284003a10 2024-05-21T13:36:31.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.057+0000 7fa29fb37640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fa298154090 con 0x7fa29815bf00 2024-05-21T13:36:31.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.057+0000 7fa29fb37640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7fa29815d1b0 con 0x7fa2981e4c00 2024-05-21T13:36:31.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.057+0000 7fa29d8d3640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa284003a10 0x7fa298147f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:31.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.057+0000 7fa29d8d3640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa284003a10 0x7fa298147f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48560/0 (socket says 172.21.15.22:48560) 2024-05-21T13:36:31.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.057+0000 7fa29d8d3640 1 -- 172.21.15.22:0/1597086860 learned_addr learned my addr 172.21.15.22:0/1597086860 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:31.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.057+0000 7fa29e0d4640 1 --2- 172.21.15.22:0/1597086860 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa29815bf00 0x7fa29815c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:31.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.057+0000 7fa29d8d3640 1 -- 172.21.15.22:0/1597086860 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa2981e4c00 msgr2=0x7fa2980cda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:31.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.057+0000 7fa29d8d3640 1 --2- 172.21.15.22:0/1597086860 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa2981e4c00 0x7fa2980cda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:31.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.057+0000 7fa29d8d3640 1 -- 172.21.15.22:0/1597086860 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa29815bf00 msgr2=0x7fa29815c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:31.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.057+0000 7fa29d8d3640 1 --2- 172.21.15.22:0/1597086860 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa29815bf00 0x7fa29815c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:31.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.057+0000 7fa29d8d3640 1 -- 172.21.15.22:0/1597086860 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2980cb530 con 0x7fa284003a10 2024-05-21T13:36:31.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.057+0000 7fa29d8d3640 1 --2- 172.21.15.22:0/1597086860 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa284003a10 0x7fa298147f60 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa28801b360 tx=0x7fa284005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:31.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.057+0000 7fa28e7fc640 1 -- 172.21.15.22:0/1597086860 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2880b4070 con 0x7fa284003a10 2024-05-21T13:36:31.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.057+0000 7fa28e7fc640 1 -- 172.21.15.22:0/1597086860 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2880070d0 con 0x7fa284003a10 2024-05-21T13:36:31.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.057+0000 7fa29fb37640 1 -- 172.21.15.22:0/1597086860 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2980cad50 con 0x7fa284003a10 2024-05-21T13:36:31.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.057+0000 7fa28e7fc640 1 -- 172.21.15.22:0/1597086860 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa288007d60 con 0x7fa284003a10 2024-05-21T13:36:31.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.057+0000 7fa29fb37640 1 -- 172.21.15.22:0/1597086860 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2980cc800 con 0x7fa284003a10 2024-05-21T13:36:31.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.057+0000 7fa29fb37640 1 -- 172.21.15.22:0/1597086860 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2980cca40 con 0x7fa284003a10 2024-05-21T13:36:31.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.057+0000 7fa28e7fc640 1 -- 172.21.15.22:0/1597086860 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fa2880bf060 con 0x7fa284003a10 2024-05-21T13:36:31.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.057+0000 7fa28e7fc640 1 --2- 172.21.15.22:0/1597086860 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fa27c06f430 0x7fa27c0718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:31.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.057+0000 7fa28e7fc640 1 -- 172.21.15.22:0/1597086860 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fa288128290 con 0x7fa284003a10 2024-05-21T13:36:31.038 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.061+0000 7fa29d0d2640 1 --2- 172.21.15.22:0/1597086860 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fa27c06f430 0x7fa27c0718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:31.039 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.061+0000 7fa29d0d2640 1 --2- 172.21.15.22:0/1597086860 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fa27c06f430 0x7fa27c0718f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa2980ce310 tx=0x7fa29400d280 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:31.041 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.061+0000 7fa28e7fc640 1 -- 172.21.15.22:0/1597086860 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fa2980cca40 con 0x7fa284003a10 2024-05-21T13:36:31.197 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.217+0000 7fa29fb37640 1 -- 172.21.15.22:0/1597086860 --> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa2980cb800 con 0x7fa27c06f430 2024-05-21T13:36:31.221 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.241+0000 7fa28e7fc640 1 -- 172.21.15.22:0/1597086860 <== mgr.4103 v2:172.21.15.115:6832/184591771 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332643 (secure 0 0 0) 0x7fa2980cb800 con 0x7fa27c06f430 2024-05-21T13:36:31.224 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-21T13:36:31.226 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-05-21T13:36:31.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.245+0000 7fa29fb37640 1 -- 172.21.15.22:0/1597086860 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fa27c06f430 msgr2=0x7fa27c0718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:31.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.245+0000 7fa29fb37640 1 --2- 172.21.15.22:0/1597086860 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fa27c06f430 0x7fa27c0718f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa2980ce310 tx=0x7fa29400d280 comp rx=0 tx=0).stop 2024-05-21T13:36:31.227 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.245+0000 7fa29fb37640 1 -- 172.21.15.22:0/1597086860 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa284003a10 msgr2=0x7fa298147f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:31.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.245+0000 7fa29fb37640 1 --2- 172.21.15.22:0/1597086860 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa284003a10 0x7fa298147f60 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa28801b360 tx=0x7fa284005840 comp rx=0 tx=0).stop 2024-05-21T13:36:31.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.245+0000 7fa29fb37640 1 -- 172.21.15.22:0/1597086860 shutdown_connections 2024-05-21T13:36:31.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.245+0000 7fa29fb37640 1 --2- 172.21.15.22:0/1597086860 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fa27c06f430 0x7fa27c0718f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:31.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.245+0000 7fa29fb37640 1 --2- 172.21.15.22:0/1597086860 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa29815bf00 0x7fa29815c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:31.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.245+0000 7fa29fb37640 1 --2- 172.21.15.22:0/1597086860 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa2981e4c00 0x7fa2980cda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:31.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.245+0000 7fa29fb37640 1 --2- 172.21.15.22:0/1597086860 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa284003a10 0x7fa298147f60 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:31.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.245+0000 7fa29fb37640 1 -- 172.21.15.22:0/1597086860 >> 172.21.15.22:0/1597086860 conn(0x7fa29806ea10 msgr2=0x7fa29814a090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:31.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.245+0000 7fa29fb37640 1 -- 172.21.15.22:0/1597086860 shutdown_connections 2024-05-21T13:36:31.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.245+0000 7fa29fb37640 1 -- 172.21.15.22:0/1597086860 wait complete. 2024-05-21T13:36:31.240 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":42,"stamp":"2024-05-21T13:36:30.510662+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595720,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":158,"num_write_kb":1649,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":123,"ondisk_log_size":123,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235048,"kb_used_data":2232,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739672,"statfs":{"total":773094113280,"available":772853424128,"internally_reserved":0,"allocated":2285568,"data_stored":2003446,"data_compressed":66916,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":712,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005509"},"pg_stats":[{"pgid":"2.1f","version":"24'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.808373+0000","last_change":"2024-05-21T13:35:56.739488+0000","last_active":"2024-05-21T13:36:02.808373+0000","last_peered":"2024-05-21T13:36:02.808373+0000","last_clean":"2024-05-21T13:36:02.808373+0000","last_became_active":"2024-05-21T13:35:56.738481+0000","last_became_peered":"2024-05-21T13:35:56.738481+0000","last_unstale":"2024-05-21T13:36:02.808373+0000","last_undegraded":"2024-05-21T13:36:02.808373+0000","last_fullsized":"2024-05-21T13:36:02.808373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:20:48.149770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.965919+0000","last_change":"2024-05-21T13:35:57.779462+0000","last_active":"2024-05-21T13:36:02.965919+0000","last_peered":"2024-05-21T13:36:02.965919+0000","last_clean":"2024-05-21T13:36:02.965919+0000","last_became_active":"2024-05-21T13:35:57.778721+0000","last_became_peered":"2024-05-21T13:35:57.778721+0000","last_unstale":"2024-05-21T13:36:02.965919+0000","last_undegraded":"2024-05-21T13:36:02.965919+0000","last_fullsized":"2024-05-21T13:36:02.965919+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:13:05.005747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.963696+0000","last_change":"2024-05-21T13:36:01.868203+0000","last_active":"2024-05-21T13:36:02.963696+0000","last_peered":"2024-05-21T13:36:02.963696+0000","last_clean":"2024-05-21T13:36:02.963696+0000","last_became_active":"2024-05-21T13:36:01.864148+0000","last_became_peered":"2024-05-21T13:36:01.864148+0000","last_unstale":"2024-05-21T13:36:02.963696+0000","last_undegraded":"2024-05-21T13:36:02.963696+0000","last_fullsized":"2024-05-21T13:36:02.963696+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T13:57:33.088920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"24'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.966254+0000","last_change":"2024-05-21T13:35:56.775054+0000","last_active":"2024-05-21T13:36:02.966254+0000","last_peered":"2024-05-21T13:36:02.966254+0000","last_clean":"2024-05-21T13:36:02.966254+0000","last_became_active":"2024-05-21T13:35:56.770566+0000","last_became_peered":"2024-05-21T13:35:56.770566+0000","last_unstale":"2024-05-21T13:36:02.966254+0000","last_undegraded":"2024-05-21T13:36:02.966254+0000","last_fullsized":"2024-05-21T13:36:02.966254+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:05:11.539201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.965771+0000","last_change":"2024-05-21T13:35:57.782094+0000","last_active":"2024-05-21T13:36:02.965771+0000","last_peered":"2024-05-21T13:36:02.965771+0000","last_clean":"2024-05-21T13:36:02.965771+0000","last_became_active":"2024-05-21T13:35:57.780590+0000","last_became_peered":"2024-05-21T13:35:57.780590+0000","last_unstale":"2024-05-21T13:36:02.965771+0000","last_undegraded":"2024-05-21T13:36:02.965771+0000","last_fullsized":"2024-05-21T13:36:02.965771+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:30:50.929103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.960911+0000","last_change":"2024-05-21T13:36:01.852092+0000","last_active":"2024-05-21T13:36:02.960911+0000","last_peered":"2024-05-21T13:36:02.960911+0000","last_clean":"2024-05-21T13:36:02.960911+0000","last_became_active":"2024-05-21T13:36:01.851745+0000","last_became_peered":"2024-05-21T13:36:01.851745+0000","last_unstale":"2024-05-21T13:36:02.960911+0000","last_undegraded":"2024-05-21T13:36:02.960911+0000","last_fullsized":"2024-05-21T13:36:02.960911+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:57:21.599860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"24'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.961222+0000","last_change":"2024-05-21T13:35:56.731106+0000","last_active":"2024-05-21T13:36:02.961222+0000","last_peered":"2024-05-21T13:36:02.961222+0000","last_clean":"2024-05-21T13:36:02.961222+0000","last_became_active":"2024-05-21T13:35:56.730746+0000","last_became_peered":"2024-05-21T13:35:56.730746+0000","last_unstale":"2024-05-21T13:36:02.961222+0000","last_undegraded":"2024-05-21T13:36:02.961222+0000","last_fullsized":"2024-05-21T13:36:02.961222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:23:17.798397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.963099+0000","last_change":"2024-05-21T13:35:57.771371+0000","last_active":"2024-05-21T13:36:02.963099+0000","last_peered":"2024-05-21T13:36:02.963099+0000","last_clean":"2024-05-21T13:36:02.963099+0000","last_became_active":"2024-05-21T13:35:57.770595+0000","last_became_peered":"2024-05-21T13:35:57.770595+0000","last_unstale":"2024-05-21T13:36:02.963099+0000","last_undegraded":"2024-05-21T13:36:02.963099+0000","last_fullsized":"2024-05-21T13:36:02.963099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:53:17.771310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.961202+0000","last_change":"2024-05-21T13:36:01.849638+0000","last_active":"2024-05-21T13:36:02.961202+0000","last_peered":"2024-05-21T13:36:02.961202+0000","last_clean":"2024-05-21T13:36:02.961202+0000","last_became_active":"2024-05-21T13:36:01.848996+0000","last_became_peered":"2024-05-21T13:36:01.848996+0000","last_unstale":"2024-05-21T13:36:02.961202+0000","last_undegraded":"2024-05-21T13:36:02.961202+0000","last_fullsized":"2024-05-21T13:36:02.961202+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:24:31.613874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.960165+0000","last_change":"2024-05-21T13:35:56.737279+0000","last_active":"2024-05-21T13:36:02.960165+0000","last_peered":"2024-05-21T13:36:02.960165+0000","last_clean":"2024-05-21T13:36:02.960165+0000","last_became_active":"2024-05-21T13:35:56.731150+0000","last_became_peered":"2024-05-21T13:35:56.731150+0000","last_unstale":"2024-05-21T13:36:02.960165+0000","last_undegraded":"2024-05-21T13:36:02.960165+0000","last_fullsized":"2024-05-21T13:36:02.960165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:17:07.571294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.806009+0000","last_change":"2024-05-21T13:35:57.799803+0000","last_active":"2024-05-21T13:36:02.806009+0000","last_peered":"2024-05-21T13:36:02.806009+0000","last_clean":"2024-05-21T13:36:02.806009+0000","last_became_active":"2024-05-21T13:35:57.799043+0000","last_became_peered":"2024-05-21T13:35:57.799043+0000","last_unstale":"2024-05-21T13:36:02.806009+0000","last_undegraded":"2024-05-21T13:36:02.806009+0000","last_fullsized":"2024-05-21T13:36:02.806009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:22:48.607953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.961831+0000","last_change":"2024-05-21T13:36:01.852469+0000","last_active":"2024-05-21T13:36:02.961831+0000","last_peered":"2024-05-21T13:36:02.961831+0000","last_clean":"2024-05-21T13:36:02.961831+0000","last_became_active":"2024-05-21T13:36:01.851913+0000","last_became_peered":"2024-05-21T13:36:01.851913+0000","last_unstale":"2024-05-21T13:36:02.961831+0000","last_undegraded":"2024-05-21T13:36:02.961831+0000","last_fullsized":"2024-05-21T13:36:02.961831+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:42:58.062540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.805533+0000","last_change":"2024-05-21T13:35:57.796516+0000","last_active":"2024-05-21T13:36:02.805533+0000","last_peered":"2024-05-21T13:36:02.805533+0000","last_clean":"2024-05-21T13:36:02.805533+0000","last_became_active":"2024-05-21T13:35:57.795638+0000","last_became_peered":"2024-05-21T13:35:57.795638+0000","last_unstale":"2024-05-21T13:36:02.805533+0000","last_undegraded":"2024-05-21T13:36:02.805533+0000","last_fullsized":"2024-05-21T13:36:02.805533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:46:40.541835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"24'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.805922+0000","last_change":"2024-05-21T13:35:56.748046+0000","last_active":"2024-05-21T13:36:02.805922+0000","last_peered":"2024-05-21T13:36:02.805922+0000","last_clean":"2024-05-21T13:36:02.805922+0000","last_became_active":"2024-05-21T13:35:56.747635+0000","last_became_peered":"2024-05-21T13:35:56.747635+0000","last_unstale":"2024-05-21T13:36:02.805922+0000","last_undegraded":"2024-05-21T13:36:02.805922+0000","last_fullsized":"2024-05-21T13:36:02.805922+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:52:28.665244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.805864+0000","last_change":"2024-05-21T13:36:01.862153+0000","last_active":"2024-05-21T13:36:02.805864+0000","last_peered":"2024-05-21T13:36:02.805864+0000","last_clean":"2024-05-21T13:36:02.805864+0000","last_became_active":"2024-05-21T13:36:01.861520+0000","last_became_peered":"2024-05-21T13:36:01.861520+0000","last_unstale":"2024-05-21T13:36:02.805864+0000","last_undegraded":"2024-05-21T13:36:02.805864+0000","last_fullsized":"2024-05-21T13:36:02.805864+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:04:37.306132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.964897+0000","last_change":"2024-05-21T13:35:57.786463+0000","last_active":"2024-05-21T13:36:02.964897+0000","last_peered":"2024-05-21T13:36:02.964897+0000","last_clean":"2024-05-21T13:36:02.964897+0000","last_became_active":"2024-05-21T13:35:57.786126+0000","last_became_peered":"2024-05-21T13:35:57.786126+0000","last_unstale":"2024-05-21T13:36:02.964897+0000","last_undegraded":"2024-05-21T13:36:02.964897+0000","last_fullsized":"2024-05-21T13:36:02.964897+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:39:32.076464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.966843+0000","last_change":"2024-05-21T13:35:56.765178+0000","last_active":"2024-05-21T13:36:02.966843+0000","last_peered":"2024-05-21T13:36:02.966843+0000","last_clean":"2024-05-21T13:36:02.966843+0000","last_became_active":"2024-05-21T13:35:56.764551+0000","last_became_peered":"2024-05-21T13:35:56.764551+0000","last_unstale":"2024-05-21T13:36:02.966843+0000","last_undegraded":"2024-05-21T13:36:02.966843+0000","last_fullsized":"2024-05-21T13:36:02.966843+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:34:28.955222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.959609+0000","last_change":"2024-05-21T13:36:01.854410+0000","last_active":"2024-05-21T13:36:02.959609+0000","last_peered":"2024-05-21T13:36:02.959609+0000","last_clean":"2024-05-21T13:36:02.959609+0000","last_became_active":"2024-05-21T13:36:01.853975+0000","last_became_peered":"2024-05-21T13:36:01.853975+0000","last_unstale":"2024-05-21T13:36:02.959609+0000","last_undegraded":"2024-05-21T13:36:02.959609+0000","last_fullsized":"2024-05-21T13:36:02.959609+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:15:34.710504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.807180+0000","last_change":"2024-05-21T13:35:57.762509+0000","last_active":"2024-05-21T13:36:02.807180+0000","last_peered":"2024-05-21T13:36:02.807180+0000","last_clean":"2024-05-21T13:36:02.807180+0000","last_became_active":"2024-05-21T13:35:57.761739+0000","last_became_peered":"2024-05-21T13:35:57.761739+0000","last_unstale":"2024-05-21T13:36:02.807180+0000","last_undegraded":"2024-05-21T13:36:02.807180+0000","last_fullsized":"2024-05-21T13:36:02.807180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:41:17.911126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"25'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:26.908898+0000","last_change":"2024-05-21T13:35:56.734017+0000","last_active":"2024-05-21T13:36:26.908898+0000","last_peered":"2024-05-21T13:36:26.908898+0000","last_clean":"2024-05-21T13:36:26.908898+0000","last_became_active":"2024-05-21T13:35:56.733249+0000","last_became_peered":"2024-05-21T13:35:56.733249+0000","last_unstale":"2024-05-21T13:36:26.908898+0000","last_undegraded":"2024-05-21T13:36:26.908898+0000","last_fullsized":"2024-05-21T13:36:26.908898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:13:27.279557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.967145+0000","last_change":"2024-05-21T13:36:01.868669+0000","last_active":"2024-05-21T13:36:02.967145+0000","last_peered":"2024-05-21T13:36:02.967145+0000","last_clean":"2024-05-21T13:36:02.967145+0000","last_became_active":"2024-05-21T13:36:01.867701+0000","last_became_peered":"2024-05-21T13:36:01.867701+0000","last_unstale":"2024-05-21T13:36:02.967145+0000","last_undegraded":"2024-05-21T13:36:02.967145+0000","last_fullsized":"2024-05-21T13:36:02.967145+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:09:21.615570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.804889+0000","last_change":"2024-05-21T13:35:57.789966+0000","last_active":"2024-05-21T13:36:02.804889+0000","last_peered":"2024-05-21T13:36:02.804889+0000","last_clean":"2024-05-21T13:36:02.804889+0000","last_became_active":"2024-05-21T13:35:57.789213+0000","last_became_peered":"2024-05-21T13:35:57.789213+0000","last_unstale":"2024-05-21T13:36:02.804889+0000","last_undegraded":"2024-05-21T13:36:02.804889+0000","last_fullsized":"2024-05-21T13:36:02.804889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:33:24.183958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.959018+0000","last_change":"2024-05-21T13:35:56.746878+0000","last_active":"2024-05-21T13:36:02.959018+0000","last_peered":"2024-05-21T13:36:02.959018+0000","last_clean":"2024-05-21T13:36:02.959018+0000","last_became_active":"2024-05-21T13:35:56.746534+0000","last_became_peered":"2024-05-21T13:35:56.746534+0000","last_unstale":"2024-05-21T13:36:02.959018+0000","last_undegraded":"2024-05-21T13:36:02.959018+0000","last_fullsized":"2024-05-21T13:36:02.959018+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:45:56.935415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.961481+0000","last_change":"2024-05-21T13:36:01.841632+0000","last_active":"2024-05-21T13:36:02.961481+0000","last_peered":"2024-05-21T13:36:02.961481+0000","last_clean":"2024-05-21T13:36:02.961481+0000","last_became_active":"2024-05-21T13:36:01.841216+0000","last_became_peered":"2024-05-21T13:36:01.841216+0000","last_unstale":"2024-05-21T13:36:02.961481+0000","last_undegraded":"2024-05-21T13:36:02.961481+0000","last_fullsized":"2024-05-21T13:36:02.961481+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:49:05.576221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.807962+0000","last_change":"2024-05-21T13:35:57.764793+0000","last_active":"2024-05-21T13:36:02.807962+0000","last_peered":"2024-05-21T13:36:02.807962+0000","last_clean":"2024-05-21T13:36:02.807962+0000","last_became_active":"2024-05-21T13:35:57.764017+0000","last_became_peered":"2024-05-21T13:35:57.764017+0000","last_unstale":"2024-05-21T13:36:02.807962+0000","last_undegraded":"2024-05-21T13:36:02.807962+0000","last_fullsized":"2024-05-21T13:36:02.807962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:25:45.006614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"24'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.808160+0000","last_change":"2024-05-21T13:35:56.752278+0000","last_active":"2024-05-21T13:36:02.808160+0000","last_peered":"2024-05-21T13:36:02.808160+0000","last_clean":"2024-05-21T13:36:02.808160+0000","last_became_active":"2024-05-21T13:35:56.751883+0000","last_became_peered":"2024-05-21T13:35:56.751883+0000","last_unstale":"2024-05-21T13:36:02.808160+0000","last_undegraded":"2024-05-21T13:36:02.808160+0000","last_fullsized":"2024-05-21T13:36:02.808160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:08:05.279701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.961503+0000","last_change":"2024-05-21T13:36:01.832621+0000","last_active":"2024-05-21T13:36:02.961503+0000","last_peered":"2024-05-21T13:36:02.961503+0000","last_clean":"2024-05-21T13:36:02.961503+0000","last_became_active":"2024-05-21T13:36:01.831609+0000","last_became_peered":"2024-05-21T13:36:01.831609+0000","last_unstale":"2024-05-21T13:36:02.961503+0000","last_undegraded":"2024-05-21T13:36:02.961503+0000","last_fullsized":"2024-05-21T13:36:02.961503+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:26:43.075259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.808212+0000","last_change":"2024-05-21T13:35:57.783487+0000","last_active":"2024-05-21T13:36:02.808212+0000","last_peered":"2024-05-21T13:36:02.808212+0000","last_clean":"2024-05-21T13:36:02.808212+0000","last_became_active":"2024-05-21T13:35:57.783150+0000","last_became_peered":"2024-05-21T13:35:57.783150+0000","last_unstale":"2024-05-21T13:36:02.808212+0000","last_undegraded":"2024-05-21T13:36:02.808212+0000","last_fullsized":"2024-05-21T13:36:02.808212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:14:56.991945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"25'1","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.808184+0000","last_change":"2024-05-21T13:35:56.745122+0000","last_active":"2024-05-21T13:36:02.808184+0000","last_peered":"2024-05-21T13:36:02.808184+0000","last_clean":"2024-05-21T13:36:02.808184+0000","last_became_active":"2024-05-21T13:35:56.744218+0000","last_became_peered":"2024-05-21T13:35:56.744218+0000","last_unstale":"2024-05-21T13:36:02.808184+0000","last_undegraded":"2024-05-21T13:36:02.808184+0000","last_fullsized":"2024-05-21T13:36:02.808184+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:45:03.790591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.807106+0000","last_change":"2024-05-21T13:36:01.838971+0000","last_active":"2024-05-21T13:36:02.807106+0000","last_peered":"2024-05-21T13:36:02.807106+0000","last_clean":"2024-05-21T13:36:02.807106+0000","last_became_active":"2024-05-21T13:36:01.837401+0000","last_became_peered":"2024-05-21T13:36:01.837401+0000","last_unstale":"2024-05-21T13:36:02.807106+0000","last_undegraded":"2024-05-21T13:36:02.807106+0000","last_fullsized":"2024-05-21T13:36:02.807106+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:16:25.666568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.967981+0000","last_change":"2024-05-21T13:35:57.784993+0000","last_active":"2024-05-21T13:36:02.967981+0000","last_peered":"2024-05-21T13:36:02.967981+0000","last_clean":"2024-05-21T13:36:02.967981+0000","last_became_active":"2024-05-21T13:35:57.784664+0000","last_became_peered":"2024-05-21T13:35:57.784664+0000","last_unstale":"2024-05-21T13:36:02.967981+0000","last_undegraded":"2024-05-21T13:36:02.967981+0000","last_fullsized":"2024-05-21T13:36:02.967981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:58:20.045901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.806794+0000","last_change":"2024-05-21T13:35:56.741285+0000","last_active":"2024-05-21T13:36:02.806794+0000","last_peered":"2024-05-21T13:36:02.806794+0000","last_clean":"2024-05-21T13:36:02.806794+0000","last_became_active":"2024-05-21T13:35:56.740846+0000","last_became_peered":"2024-05-21T13:35:56.740846+0000","last_unstale":"2024-05-21T13:36:02.806794+0000","last_undegraded":"2024-05-21T13:36:02.806794+0000","last_fullsized":"2024-05-21T13:36:02.806794+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:34:17.960870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.963587+0000","last_change":"2024-05-21T13:36:01.873172+0000","last_active":"2024-05-21T13:36:02.963587+0000","last_peered":"2024-05-21T13:36:02.963587+0000","last_clean":"2024-05-21T13:36:02.963587+0000","last_became_active":"2024-05-21T13:36:01.872085+0000","last_became_peered":"2024-05-21T13:36:01.872085+0000","last_unstale":"2024-05-21T13:36:02.963587+0000","last_undegraded":"2024-05-21T13:36:02.963587+0000","last_fullsized":"2024-05-21T13:36:02.963587+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:24:57.031323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.961092+0000","last_change":"2024-05-21T13:35:57.783176+0000","last_active":"2024-05-21T13:36:02.961092+0000","last_peered":"2024-05-21T13:36:02.961092+0000","last_clean":"2024-05-21T13:36:02.961092+0000","last_became_active":"2024-05-21T13:35:57.782517+0000","last_became_peered":"2024-05-21T13:35:57.782517+0000","last_unstale":"2024-05-21T13:36:02.961092+0000","last_undegraded":"2024-05-21T13:36:02.961092+0000","last_fullsized":"2024-05-21T13:36:02.961092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:06:58.203996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.964483+0000","last_change":"2024-05-21T13:35:56.767544+0000","last_active":"2024-05-21T13:36:02.964483+0000","last_peered":"2024-05-21T13:36:02.964483+0000","last_clean":"2024-05-21T13:36:02.964483+0000","last_became_active":"2024-05-21T13:35:56.764987+0000","last_became_peered":"2024-05-21T13:35:56.764987+0000","last_unstale":"2024-05-21T13:36:02.964483+0000","last_undegraded":"2024-05-21T13:36:02.964483+0000","last_fullsized":"2024-05-21T13:36:02.964483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:12:46.828769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.966223+0000","last_change":"2024-05-21T13:36:01.872215+0000","last_active":"2024-05-21T13:36:02.966223+0000","last_peered":"2024-05-21T13:36:02.966223+0000","last_clean":"2024-05-21T13:36:02.966223+0000","last_became_active":"2024-05-21T13:36:01.870831+0000","last_became_peered":"2024-05-21T13:36:01.870831+0000","last_unstale":"2024-05-21T13:36:02.966223+0000","last_undegraded":"2024-05-21T13:36:02.966223+0000","last_fullsized":"2024-05-21T13:36:02.966223+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:04:09.689206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.959882+0000","last_change":"2024-05-21T13:35:57.783616+0000","last_active":"2024-05-21T13:36:02.959882+0000","last_peered":"2024-05-21T13:36:02.959882+0000","last_clean":"2024-05-21T13:36:02.959882+0000","last_became_active":"2024-05-21T13:35:57.780521+0000","last_became_peered":"2024-05-21T13:35:57.780521+0000","last_unstale":"2024-05-21T13:36:02.959882+0000","last_undegraded":"2024-05-21T13:36:02.959882+0000","last_fullsized":"2024-05-21T13:36:02.959882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:59:44.121631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.806771+0000","last_change":"2024-05-21T13:35:56.750341+0000","last_active":"2024-05-21T13:36:02.806771+0000","last_peered":"2024-05-21T13:36:02.806771+0000","last_clean":"2024-05-21T13:36:02.806771+0000","last_became_active":"2024-05-21T13:35:56.750006+0000","last_became_peered":"2024-05-21T13:35:56.750006+0000","last_unstale":"2024-05-21T13:36:02.806771+0000","last_undegraded":"2024-05-21T13:36:02.806771+0000","last_fullsized":"2024-05-21T13:36:02.806771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:15:21.416234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.967726+0000","last_change":"2024-05-21T13:36:01.873693+0000","last_active":"2024-05-21T13:36:02.967726+0000","last_peered":"2024-05-21T13:36:02.967726+0000","last_clean":"2024-05-21T13:36:02.967726+0000","last_became_active":"2024-05-21T13:36:01.872363+0000","last_became_peered":"2024-05-21T13:36:01.872363+0000","last_unstale":"2024-05-21T13:36:02.967726+0000","last_undegraded":"2024-05-21T13:36:02.967726+0000","last_fullsized":"2024-05-21T13:36:02.967726+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:27:25.974289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.961878+0000","last_change":"2024-05-21T13:35:57.780809+0000","last_active":"2024-05-21T13:36:02.961878+0000","last_peered":"2024-05-21T13:36:02.961878+0000","last_clean":"2024-05-21T13:36:02.961878+0000","last_became_active":"2024-05-21T13:35:57.780313+0000","last_became_peered":"2024-05-21T13:35:57.780313+0000","last_unstale":"2024-05-21T13:36:02.961878+0000","last_undegraded":"2024-05-21T13:36:02.961878+0000","last_fullsized":"2024-05-21T13:36:02.961878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:43:11.778238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.964084+0000","last_change":"2024-05-21T13:35:56.771138+0000","last_active":"2024-05-21T13:36:02.964084+0000","last_peered":"2024-05-21T13:36:02.964084+0000","last_clean":"2024-05-21T13:36:02.964084+0000","last_became_active":"2024-05-21T13:35:56.770465+0000","last_became_peered":"2024-05-21T13:35:56.770465+0000","last_unstale":"2024-05-21T13:36:02.964084+0000","last_undegraded":"2024-05-21T13:36:02.964084+0000","last_fullsized":"2024-05-21T13:36:02.964084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:21:16.702309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.968200+0000","last_change":"2024-05-21T13:36:01.871328+0000","last_active":"2024-05-21T13:36:02.968200+0000","last_peered":"2024-05-21T13:36:02.968200+0000","last_clean":"2024-05-21T13:36:02.968200+0000","last_became_active":"2024-05-21T13:36:01.870678+0000","last_became_peered":"2024-05-21T13:36:01.870678+0000","last_unstale":"2024-05-21T13:36:02.968200+0000","last_undegraded":"2024-05-21T13:36:02.968200+0000","last_fullsized":"2024-05-21T13:36:02.968200+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:22:47.393065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.962506+0000","last_change":"2024-05-21T13:35:57.782665+0000","last_active":"2024-05-21T13:36:02.962506+0000","last_peered":"2024-05-21T13:36:02.962506+0000","last_clean":"2024-05-21T13:36:02.962506+0000","last_became_active":"2024-05-21T13:35:57.781299+0000","last_became_peered":"2024-05-21T13:35:57.781299+0000","last_unstale":"2024-05-21T13:36:02.962506+0000","last_undegraded":"2024-05-21T13:36:02.962506+0000","last_fullsized":"2024-05-21T13:36:02.962506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:21:22.721124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.805211+0000","last_change":"2024-05-21T13:35:56.768193+0000","last_active":"2024-05-21T13:36:02.805211+0000","last_peered":"2024-05-21T13:36:02.805211+0000","last_clean":"2024-05-21T13:36:02.805211+0000","last_became_active":"2024-05-21T13:35:56.767788+0000","last_became_peered":"2024-05-21T13:35:56.767788+0000","last_unstale":"2024-05-21T13:36:02.805211+0000","last_undegraded":"2024-05-21T13:36:02.805211+0000","last_fullsized":"2024-05-21T13:36:02.805211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:12:52.911816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.965762+0000","last_change":"2024-05-21T13:36:01.860305+0000","last_active":"2024-05-21T13:36:02.965762+0000","last_peered":"2024-05-21T13:36:02.965762+0000","last_clean":"2024-05-21T13:36:02.965762+0000","last_became_active":"2024-05-21T13:36:01.859141+0000","last_became_peered":"2024-05-21T13:36:01.859141+0000","last_unstale":"2024-05-21T13:36:02.965762+0000","last_undegraded":"2024-05-21T13:36:02.965762+0000","last_fullsized":"2024-05-21T13:36:02.965762+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:05:45.203241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.807817+0000","last_change":"2024-05-21T13:35:57.775523+0000","last_active":"2024-05-21T13:36:02.807817+0000","last_peered":"2024-05-21T13:36:02.807817+0000","last_clean":"2024-05-21T13:36:02.807817+0000","last_became_active":"2024-05-21T13:35:57.774322+0000","last_became_peered":"2024-05-21T13:35:57.774322+0000","last_unstale":"2024-05-21T13:36:02.807817+0000","last_undegraded":"2024-05-21T13:36:02.807817+0000","last_fullsized":"2024-05-21T13:36:02.807817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:06:35.118540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.806599+0000","last_change":"2024-05-21T13:35:56.748185+0000","last_active":"2024-05-21T13:36:02.806599+0000","last_peered":"2024-05-21T13:36:02.806599+0000","last_clean":"2024-05-21T13:36:02.806599+0000","last_became_active":"2024-05-21T13:35:56.747823+0000","last_became_peered":"2024-05-21T13:35:56.747823+0000","last_unstale":"2024-05-21T13:36:02.806599+0000","last_undegraded":"2024-05-21T13:36:02.806599+0000","last_fullsized":"2024-05-21T13:36:02.806599+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:38:00.235330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":117,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.963125+0000","last_change":"2024-05-21T13:35:45.682484+0000","last_active":"2024-05-21T13:36:02.963125+0000","last_peered":"2024-05-21T13:36:02.963125+0000","last_clean":"2024-05-21T13:36:02.963125+0000","last_became_active":"2024-05-21T13:35:45.680732+0000","last_became_peered":"2024-05-21T13:35:45.680732+0000","last_unstale":"2024-05-21T13:36:02.963125+0000","last_undegraded":"2024-05-21T13:36:02.963125+0000","last_fullsized":"2024-05-21T13:36:02.963125+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:44.542324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:44.542324+0000","last_clean_scrub_stamp":"2024-05-21T13:35:44.542324+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:16:05.034161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.806631+0000","last_change":"2024-05-21T13:36:01.830034+0000","last_active":"2024-05-21T13:36:02.806631+0000","last_peered":"2024-05-21T13:36:02.806631+0000","last_clean":"2024-05-21T13:36:02.806631+0000","last_became_active":"2024-05-21T13:36:01.828957+0000","last_became_peered":"2024-05-21T13:36:01.828957+0000","last_unstale":"2024-05-21T13:36:02.806631+0000","last_undegraded":"2024-05-21T13:36:02.806631+0000","last_fullsized":"2024-05-21T13:36:02.806631+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:21:59.514268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.806258+0000","last_change":"2024-05-21T13:35:57.796419+0000","last_active":"2024-05-21T13:36:02.806258+0000","last_peered":"2024-05-21T13:36:02.806258+0000","last_clean":"2024-05-21T13:36:02.806258+0000","last_became_active":"2024-05-21T13:35:57.796050+0000","last_became_peered":"2024-05-21T13:35:57.796050+0000","last_unstale":"2024-05-21T13:36:02.806258+0000","last_undegraded":"2024-05-21T13:36:02.806258+0000","last_fullsized":"2024-05-21T13:36:02.806258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:56:07.121391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.968145+0000","last_change":"2024-05-21T13:35:56.751619+0000","last_active":"2024-05-21T13:36:02.968145+0000","last_peered":"2024-05-21T13:36:02.968145+0000","last_clean":"2024-05-21T13:36:02.968145+0000","last_became_active":"2024-05-21T13:35:56.748604+0000","last_became_peered":"2024-05-21T13:35:56.748604+0000","last_unstale":"2024-05-21T13:36:02.968145+0000","last_undegraded":"2024-05-21T13:36:02.968145+0000","last_fullsized":"2024-05-21T13:36:02.968145+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:19:03.052434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.961835+0000","last_change":"2024-05-21T13:36:01.825464+0000","last_active":"2024-05-21T13:36:02.961835+0000","last_peered":"2024-05-21T13:36:02.961835+0000","last_clean":"2024-05-21T13:36:02.961835+0000","last_became_active":"2024-05-21T13:36:01.824653+0000","last_became_peered":"2024-05-21T13:36:01.824653+0000","last_unstale":"2024-05-21T13:36:02.961835+0000","last_undegraded":"2024-05-21T13:36:02.961835+0000","last_fullsized":"2024-05-21T13:36:02.961835+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:29:32.830052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.960114+0000","last_change":"2024-05-21T13:35:57.784031+0000","last_active":"2024-05-21T13:36:02.960114+0000","last_peered":"2024-05-21T13:36:02.960114+0000","last_clean":"2024-05-21T13:36:02.960114+0000","last_became_active":"2024-05-21T13:35:57.771695+0000","last_became_peered":"2024-05-21T13:35:57.771695+0000","last_unstale":"2024-05-21T13:36:02.960114+0000","last_undegraded":"2024-05-21T13:36:02.960114+0000","last_fullsized":"2024-05-21T13:36:02.960114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:46:33.308257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.965392+0000","last_change":"2024-05-21T13:35:56.768166+0000","last_active":"2024-05-21T13:36:02.965392+0000","last_peered":"2024-05-21T13:36:02.965392+0000","last_clean":"2024-05-21T13:36:02.965392+0000","last_became_active":"2024-05-21T13:35:56.767053+0000","last_became_peered":"2024-05-21T13:35:56.767053+0000","last_unstale":"2024-05-21T13:36:02.965392+0000","last_undegraded":"2024-05-21T13:36:02.965392+0000","last_fullsized":"2024-05-21T13:36:02.965392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:10:16.639491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.963683+0000","last_change":"2024-05-21T13:36:01.834253+0000","last_active":"2024-05-21T13:36:02.963683+0000","last_peered":"2024-05-21T13:36:02.963683+0000","last_clean":"2024-05-21T13:36:02.963683+0000","last_became_active":"2024-05-21T13:36:01.832972+0000","last_became_peered":"2024-05-21T13:36:01.832972+0000","last_unstale":"2024-05-21T13:36:02.963683+0000","last_undegraded":"2024-05-21T13:36:02.963683+0000","last_fullsized":"2024-05-21T13:36:02.963683+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:52:05.576063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.960150+0000","last_change":"2024-05-21T13:35:57.766504+0000","last_active":"2024-05-21T13:36:02.960150+0000","last_peered":"2024-05-21T13:36:02.960150+0000","last_clean":"2024-05-21T13:36:02.960150+0000","last_became_active":"2024-05-21T13:35:57.765756+0000","last_became_peered":"2024-05-21T13:35:57.765756+0000","last_unstale":"2024-05-21T13:36:02.960150+0000","last_undegraded":"2024-05-21T13:36:02.960150+0000","last_fullsized":"2024-05-21T13:36:02.960150+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:52:13.025110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.808071+0000","last_change":"2024-05-21T13:35:56.770347+0000","last_active":"2024-05-21T13:36:02.808071+0000","last_peered":"2024-05-21T13:36:02.808071+0000","last_clean":"2024-05-21T13:36:02.808071+0000","last_became_active":"2024-05-21T13:35:56.769767+0000","last_became_peered":"2024-05-21T13:35:56.769767+0000","last_unstale":"2024-05-21T13:36:02.808071+0000","last_undegraded":"2024-05-21T13:36:02.808071+0000","last_fullsized":"2024-05-21T13:36:02.808071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:40:01.698967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.804632+0000","last_change":"2024-05-21T13:36:01.827091+0000","last_active":"2024-05-21T13:36:02.804632+0000","last_peered":"2024-05-21T13:36:02.804632+0000","last_clean":"2024-05-21T13:36:02.804632+0000","last_became_active":"2024-05-21T13:36:01.826686+0000","last_became_peered":"2024-05-21T13:36:01.826686+0000","last_unstale":"2024-05-21T13:36:02.804632+0000","last_undegraded":"2024-05-21T13:36:02.804632+0000","last_fullsized":"2024-05-21T13:36:02.804632+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:42:47.638921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.962149+0000","last_change":"2024-05-21T13:35:57.781528+0000","last_active":"2024-05-21T13:36:02.962149+0000","last_peered":"2024-05-21T13:36:02.962149+0000","last_clean":"2024-05-21T13:36:02.962149+0000","last_became_active":"2024-05-21T13:35:57.781111+0000","last_became_peered":"2024-05-21T13:35:57.781111+0000","last_unstale":"2024-05-21T13:36:02.962149+0000","last_undegraded":"2024-05-21T13:36:02.962149+0000","last_fullsized":"2024-05-21T13:36:02.962149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:15:43.847640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"24'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.960114+0000","last_change":"2024-05-21T13:35:56.755413+0000","last_active":"2024-05-21T13:36:02.960114+0000","last_peered":"2024-05-21T13:36:02.960114+0000","last_clean":"2024-05-21T13:36:02.960114+0000","last_became_active":"2024-05-21T13:35:56.755158+0000","last_became_peered":"2024-05-21T13:35:56.755158+0000","last_unstale":"2024-05-21T13:36:02.960114+0000","last_undegraded":"2024-05-21T13:36:02.960114+0000","last_fullsized":"2024-05-21T13:36:02.960114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:23:05.102098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.962809+0000","last_change":"2024-05-21T13:36:01.827237+0000","last_active":"2024-05-21T13:36:02.962809+0000","last_peered":"2024-05-21T13:36:02.962809+0000","last_clean":"2024-05-21T13:36:02.962809+0000","last_became_active":"2024-05-21T13:36:01.826374+0000","last_became_peered":"2024-05-21T13:36:01.826374+0000","last_unstale":"2024-05-21T13:36:02.962809+0000","last_undegraded":"2024-05-21T13:36:02.962809+0000","last_fullsized":"2024-05-21T13:36:02.962809+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:12:33.528068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.804889+0000","last_change":"2024-05-21T13:35:57.787940+0000","last_active":"2024-05-21T13:36:02.804889+0000","last_peered":"2024-05-21T13:36:02.804889+0000","last_clean":"2024-05-21T13:36:02.804889+0000","last_became_active":"2024-05-21T13:35:57.787544+0000","last_became_peered":"2024-05-21T13:35:57.787544+0000","last_unstale":"2024-05-21T13:36:02.804889+0000","last_undegraded":"2024-05-21T13:36:02.804889+0000","last_fullsized":"2024-05-21T13:36:02.804889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:46:20.335316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"25'10","reported_seq":32,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:26.900770+0000","last_change":"2024-05-21T13:35:56.756262+0000","last_active":"2024-05-21T13:36:26.900770+0000","last_peered":"2024-05-21T13:36:26.900770+0000","last_clean":"2024-05-21T13:36:26.900770+0000","last_became_active":"2024-05-21T13:35:56.752342+0000","last_became_peered":"2024-05-21T13:35:56.752342+0000","last_unstale":"2024-05-21T13:36:26.900770+0000","last_undegraded":"2024-05-21T13:36:26.900770+0000","last_fullsized":"2024-05-21T13:36:26.900770+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:59:09.541382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.966115+0000","last_change":"2024-05-21T13:36:01.859498+0000","last_active":"2024-05-21T13:36:02.966115+0000","last_peered":"2024-05-21T13:36:02.966115+0000","last_clean":"2024-05-21T13:36:02.966115+0000","last_became_active":"2024-05-21T13:36:01.857707+0000","last_became_peered":"2024-05-21T13:36:01.857707+0000","last_unstale":"2024-05-21T13:36:02.966115+0000","last_undegraded":"2024-05-21T13:36:02.966115+0000","last_fullsized":"2024-05-21T13:36:02.966115+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:38:06.966814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.962835+0000","last_change":"2024-05-21T13:35:57.783007+0000","last_active":"2024-05-21T13:36:02.962835+0000","last_peered":"2024-05-21T13:36:02.962835+0000","last_clean":"2024-05-21T13:36:02.962835+0000","last_became_active":"2024-05-21T13:35:57.782330+0000","last_became_peered":"2024-05-21T13:35:57.782330+0000","last_unstale":"2024-05-21T13:36:02.962835+0000","last_undegraded":"2024-05-21T13:36:02.962835+0000","last_fullsized":"2024-05-21T13:36:02.962835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:26:14.697766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.959369+0000","last_change":"2024-05-21T13:35:56.745787+0000","last_active":"2024-05-21T13:36:02.959369+0000","last_peered":"2024-05-21T13:36:02.959369+0000","last_clean":"2024-05-21T13:36:02.959369+0000","last_became_active":"2024-05-21T13:35:56.745202+0000","last_became_peered":"2024-05-21T13:35:56.745202+0000","last_unstale":"2024-05-21T13:36:02.959369+0000","last_undegraded":"2024-05-21T13:36:02.959369+0000","last_fullsized":"2024-05-21T13:36:02.959369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:31:13.498003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.965870+0000","last_change":"2024-05-21T13:36:01.858550+0000","last_active":"2024-05-21T13:36:02.965870+0000","last_peered":"2024-05-21T13:36:02.965870+0000","last_clean":"2024-05-21T13:36:02.965870+0000","last_became_active":"2024-05-21T13:36:01.857716+0000","last_became_peered":"2024-05-21T13:36:01.857716+0000","last_unstale":"2024-05-21T13:36:02.965870+0000","last_undegraded":"2024-05-21T13:36:02.965870+0000","last_fullsized":"2024-05-21T13:36:02.965870+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:48:32.490678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.805527+0000","last_change":"2024-05-21T13:35:57.799702+0000","last_active":"2024-05-21T13:36:02.805527+0000","last_peered":"2024-05-21T13:36:02.805527+0000","last_clean":"2024-05-21T13:36:02.805527+0000","last_became_active":"2024-05-21T13:35:57.799225+0000","last_became_peered":"2024-05-21T13:35:57.799225+0000","last_unstale":"2024-05-21T13:36:02.805527+0000","last_undegraded":"2024-05-21T13:36:02.805527+0000","last_fullsized":"2024-05-21T13:36:02.805527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:29:54.094448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.806444+0000","last_change":"2024-05-21T13:35:56.742650+0000","last_active":"2024-05-21T13:36:02.806444+0000","last_peered":"2024-05-21T13:36:02.806444+0000","last_clean":"2024-05-21T13:36:02.806444+0000","last_became_active":"2024-05-21T13:35:56.742296+0000","last_became_peered":"2024-05-21T13:35:56.742296+0000","last_unstale":"2024-05-21T13:36:02.806444+0000","last_undegraded":"2024-05-21T13:36:02.806444+0000","last_fullsized":"2024-05-21T13:36:02.806444+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:18:55.514845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.967634+0000","last_change":"2024-05-21T13:36:01.873708+0000","last_active":"2024-05-21T13:36:02.967634+0000","last_peered":"2024-05-21T13:36:02.967634+0000","last_clean":"2024-05-21T13:36:02.967634+0000","last_became_active":"2024-05-21T13:36:01.872320+0000","last_became_peered":"2024-05-21T13:36:01.872320+0000","last_unstale":"2024-05-21T13:36:02.967634+0000","last_undegraded":"2024-05-21T13:36:02.967634+0000","last_fullsized":"2024-05-21T13:36:02.967634+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:01:15.545756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.966606+0000","last_change":"2024-05-21T13:35:57.802763+0000","last_active":"2024-05-21T13:36:02.966606+0000","last_peered":"2024-05-21T13:36:02.966606+0000","last_clean":"2024-05-21T13:36:02.966606+0000","last_became_active":"2024-05-21T13:35:57.802433+0000","last_became_peered":"2024-05-21T13:35:57.802433+0000","last_unstale":"2024-05-21T13:36:02.966606+0000","last_undegraded":"2024-05-21T13:36:02.966606+0000","last_fullsized":"2024-05-21T13:36:02.966606+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:09:48.463186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.965357+0000","last_change":"2024-05-21T13:35:56.754087+0000","last_active":"2024-05-21T13:36:02.965357+0000","last_peered":"2024-05-21T13:36:02.965357+0000","last_clean":"2024-05-21T13:36:02.965357+0000","last_became_active":"2024-05-21T13:35:56.753319+0000","last_became_peered":"2024-05-21T13:35:56.753319+0000","last_unstale":"2024-05-21T13:36:02.965357+0000","last_undegraded":"2024-05-21T13:36:02.965357+0000","last_fullsized":"2024-05-21T13:36:02.965357+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:19:21.276993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.806089+0000","last_change":"2024-05-21T13:36:01.836017+0000","last_active":"2024-05-21T13:36:02.806089+0000","last_peered":"2024-05-21T13:36:02.806089+0000","last_clean":"2024-05-21T13:36:02.806089+0000","last_became_active":"2024-05-21T13:36:01.835450+0000","last_became_peered":"2024-05-21T13:36:01.835450+0000","last_unstale":"2024-05-21T13:36:02.806089+0000","last_undegraded":"2024-05-21T13:36:02.806089+0000","last_fullsized":"2024-05-21T13:36:02.806089+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:05:56.077605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.962152+0000","last_change":"2024-05-21T13:35:57.787177+0000","last_active":"2024-05-21T13:36:02.962152+0000","last_peered":"2024-05-21T13:36:02.962152+0000","last_clean":"2024-05-21T13:36:02.962152+0000","last_became_active":"2024-05-21T13:35:57.786401+0000","last_became_peered":"2024-05-21T13:35:57.786401+0000","last_unstale":"2024-05-21T13:36:02.962152+0000","last_undegraded":"2024-05-21T13:36:02.962152+0000","last_fullsized":"2024-05-21T13:36:02.962152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:17:18.939002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"25'9","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:12.171576+0000","last_change":"2024-05-21T13:35:56.751229+0000","last_active":"2024-05-21T13:36:12.171576+0000","last_peered":"2024-05-21T13:36:12.171576+0000","last_clean":"2024-05-21T13:36:12.171576+0000","last_became_active":"2024-05-21T13:35:56.750831+0000","last_became_peered":"2024-05-21T13:35:56.750831+0000","last_unstale":"2024-05-21T13:36:12.171576+0000","last_undegraded":"2024-05-21T13:36:12.171576+0000","last_fullsized":"2024-05-21T13:36:12.171576+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:03:40.186241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.807730+0000","last_change":"2024-05-21T13:36:01.832691+0000","last_active":"2024-05-21T13:36:02.807730+0000","last_peered":"2024-05-21T13:36:02.807730+0000","last_clean":"2024-05-21T13:36:02.807730+0000","last_became_active":"2024-05-21T13:36:01.831476+0000","last_became_peered":"2024-05-21T13:36:01.831476+0000","last_unstale":"2024-05-21T13:36:02.807730+0000","last_undegraded":"2024-05-21T13:36:02.807730+0000","last_fullsized":"2024-05-21T13:36:02.807730+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:08:38.092592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.805422+0000","last_change":"2024-05-21T13:35:57.788547+0000","last_active":"2024-05-21T13:36:02.805422+0000","last_peered":"2024-05-21T13:36:02.805422+0000","last_clean":"2024-05-21T13:36:02.805422+0000","last_became_active":"2024-05-21T13:35:57.787785+0000","last_became_peered":"2024-05-21T13:35:57.787785+0000","last_unstale":"2024-05-21T13:36:02.805422+0000","last_undegraded":"2024-05-21T13:36:02.805422+0000","last_fullsized":"2024-05-21T13:36:02.805422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:51:08.781399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"24'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.964609+0000","last_change":"2024-05-21T13:35:56.760557+0000","last_active":"2024-05-21T13:36:02.964609+0000","last_peered":"2024-05-21T13:36:02.964609+0000","last_clean":"2024-05-21T13:36:02.964609+0000","last_became_active":"2024-05-21T13:35:56.759728+0000","last_became_peered":"2024-05-21T13:35:56.759728+0000","last_unstale":"2024-05-21T13:36:02.964609+0000","last_undegraded":"2024-05-21T13:36:02.964609+0000","last_fullsized":"2024-05-21T13:36:02.964609+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:56:19.754940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.962040+0000","last_change":"2024-05-21T13:36:01.861622+0000","last_active":"2024-05-21T13:36:02.962040+0000","last_peered":"2024-05-21T13:36:02.962040+0000","last_clean":"2024-05-21T13:36:02.962040+0000","last_became_active":"2024-05-21T13:36:01.861172+0000","last_became_peered":"2024-05-21T13:36:01.861172+0000","last_unstale":"2024-05-21T13:36:02.962040+0000","last_undegraded":"2024-05-21T13:36:02.962040+0000","last_fullsized":"2024-05-21T13:36:02.962040+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:39:53.211812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.966013+0000","last_change":"2024-05-21T13:35:57.804520+0000","last_active":"2024-05-21T13:36:02.966013+0000","last_peered":"2024-05-21T13:36:02.966013+0000","last_clean":"2024-05-21T13:36:02.966013+0000","last_became_active":"2024-05-21T13:35:57.804139+0000","last_became_peered":"2024-05-21T13:35:57.804139+0000","last_unstale":"2024-05-21T13:36:02.966013+0000","last_undegraded":"2024-05-21T13:36:02.966013+0000","last_fullsized":"2024-05-21T13:36:02.966013+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:21:52.433019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.959802+0000","last_change":"2024-05-21T13:35:56.733821+0000","last_active":"2024-05-21T13:36:02.959802+0000","last_peered":"2024-05-21T13:36:02.959802+0000","last_clean":"2024-05-21T13:36:02.959802+0000","last_became_active":"2024-05-21T13:35:56.732488+0000","last_became_peered":"2024-05-21T13:35:56.732488+0000","last_unstale":"2024-05-21T13:36:02.959802+0000","last_undegraded":"2024-05-21T13:36:02.959802+0000","last_fullsized":"2024-05-21T13:36:02.959802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:10:01.786931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.961990+0000","last_change":"2024-05-21T13:36:01.868781+0000","last_active":"2024-05-21T13:36:02.961990+0000","last_peered":"2024-05-21T13:36:02.961990+0000","last_clean":"2024-05-21T13:36:02.961990+0000","last_became_active":"2024-05-21T13:36:01.864254+0000","last_became_peered":"2024-05-21T13:36:01.864254+0000","last_unstale":"2024-05-21T13:36:02.961990+0000","last_undegraded":"2024-05-21T13:36:02.961990+0000","last_fullsized":"2024-05-21T13:36:02.961990+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:34:12.632333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.962094+0000","last_change":"2024-05-21T13:35:57.788313+0000","last_active":"2024-05-21T13:36:02.962094+0000","last_peered":"2024-05-21T13:36:02.962094+0000","last_clean":"2024-05-21T13:36:02.962094+0000","last_became_active":"2024-05-21T13:35:57.787963+0000","last_became_peered":"2024-05-21T13:35:57.787963+0000","last_unstale":"2024-05-21T13:36:02.962094+0000","last_undegraded":"2024-05-21T13:36:02.962094+0000","last_fullsized":"2024-05-21T13:36:02.962094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:16:21.586571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.963973+0000","last_change":"2024-05-21T13:35:56.748334+0000","last_active":"2024-05-21T13:36:02.963973+0000","last_peered":"2024-05-21T13:36:02.963973+0000","last_clean":"2024-05-21T13:36:02.963973+0000","last_became_active":"2024-05-21T13:35:56.748049+0000","last_became_peered":"2024-05-21T13:35:56.748049+0000","last_unstale":"2024-05-21T13:36:02.963973+0000","last_undegraded":"2024-05-21T13:36:02.963973+0000","last_fullsized":"2024-05-21T13:36:02.963973+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:59:02.802905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.807330+0000","last_change":"2024-05-21T13:36:01.856216+0000","last_active":"2024-05-21T13:36:02.807330+0000","last_peered":"2024-05-21T13:36:02.807330+0000","last_clean":"2024-05-21T13:36:02.807330+0000","last_became_active":"2024-05-21T13:36:01.855417+0000","last_became_peered":"2024-05-21T13:36:01.855417+0000","last_unstale":"2024-05-21T13:36:02.807330+0000","last_undegraded":"2024-05-21T13:36:02.807330+0000","last_fullsized":"2024-05-21T13:36:02.807330+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:36:01.423944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.807915+0000","last_change":"2024-05-21T13:36:01.838966+0000","last_active":"2024-05-21T13:36:02.807915+0000","last_peered":"2024-05-21T13:36:02.807915+0000","last_clean":"2024-05-21T13:36:02.807915+0000","last_became_active":"2024-05-21T13:36:01.837777+0000","last_became_peered":"2024-05-21T13:36:01.837777+0000","last_unstale":"2024-05-21T13:36:02.807915+0000","last_undegraded":"2024-05-21T13:36:02.807915+0000","last_fullsized":"2024-05-21T13:36:02.807915+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:40:55.688338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.807274+0000","last_change":"2024-05-21T13:35:57.762719+0000","last_active":"2024-05-21T13:36:02.807274+0000","last_peered":"2024-05-21T13:36:02.807274+0000","last_clean":"2024-05-21T13:36:02.807274+0000","last_became_active":"2024-05-21T13:35:57.762071+0000","last_became_peered":"2024-05-21T13:35:57.762071+0000","last_unstale":"2024-05-21T13:36:02.807274+0000","last_undegraded":"2024-05-21T13:36:02.807274+0000","last_fullsized":"2024-05-21T13:36:02.807274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:55:37.631695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.805108+0000","last_change":"2024-05-21T13:35:56.751481+0000","last_active":"2024-05-21T13:36:02.805108+0000","last_peered":"2024-05-21T13:36:02.805108+0000","last_clean":"2024-05-21T13:36:02.805108+0000","last_became_active":"2024-05-21T13:35:56.751201+0000","last_became_peered":"2024-05-21T13:35:56.751201+0000","last_unstale":"2024-05-21T13:36:02.805108+0000","last_undegraded":"2024-05-21T13:36:02.805108+0000","last_fullsized":"2024-05-21T13:36:02.805108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:33:28.720246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.806144+0000","last_change":"2024-05-21T13:36:01.837042+0000","last_active":"2024-05-21T13:36:02.806144+0000","last_peered":"2024-05-21T13:36:02.806144+0000","last_clean":"2024-05-21T13:36:02.806144+0000","last_became_active":"2024-05-21T13:36:01.836194+0000","last_became_peered":"2024-05-21T13:36:01.836194+0000","last_unstale":"2024-05-21T13:36:02.806144+0000","last_undegraded":"2024-05-21T13:36:02.806144+0000","last_fullsized":"2024-05-21T13:36:02.806144+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:15:50.751693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.962036+0000","last_change":"2024-05-21T13:35:57.788838+0000","last_active":"2024-05-21T13:36:02.962036+0000","last_peered":"2024-05-21T13:36:02.962036+0000","last_clean":"2024-05-21T13:36:02.962036+0000","last_became_active":"2024-05-21T13:35:57.786307+0000","last_became_peered":"2024-05-21T13:35:57.786307+0000","last_unstale":"2024-05-21T13:36:02.962036+0000","last_undegraded":"2024-05-21T13:36:02.962036+0000","last_fullsized":"2024-05-21T13:36:02.962036+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:52:09.086807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.962585+0000","last_change":"2024-05-21T13:35:56.746564+0000","last_active":"2024-05-21T13:36:02.962585+0000","last_peered":"2024-05-21T13:36:02.962585+0000","last_clean":"2024-05-21T13:36:02.962585+0000","last_became_active":"2024-05-21T13:35:56.745884+0000","last_became_peered":"2024-05-21T13:35:56.745884+0000","last_unstale":"2024-05-21T13:36:02.962585+0000","last_undegraded":"2024-05-21T13:36:02.962585+0000","last_fullsized":"2024-05-21T13:36:02.962585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:01:44.738607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"24'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.806093+0000","last_change":"2024-05-21T13:35:56.753930+0000","last_active":"2024-05-21T13:36:02.806093+0000","last_peered":"2024-05-21T13:36:02.806093+0000","last_clean":"2024-05-21T13:36:02.806093+0000","last_became_active":"2024-05-21T13:35:56.753499+0000","last_became_peered":"2024-05-21T13:35:56.753499+0000","last_unstale":"2024-05-21T13:36:02.806093+0000","last_undegraded":"2024-05-21T13:36:02.806093+0000","last_fullsized":"2024-05-21T13:36:02.806093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:40:51.516544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.808045+0000","last_change":"2024-05-21T13:35:57.780101+0000","last_active":"2024-05-21T13:36:02.808045+0000","last_peered":"2024-05-21T13:36:02.808045+0000","last_clean":"2024-05-21T13:36:02.808045+0000","last_became_active":"2024-05-21T13:35:57.779368+0000","last_became_peered":"2024-05-21T13:35:57.779368+0000","last_unstale":"2024-05-21T13:36:02.808045+0000","last_undegraded":"2024-05-21T13:36:02.808045+0000","last_fullsized":"2024-05-21T13:36:02.808045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:37:39.347067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.808272+0000","last_change":"2024-05-21T13:36:01.844240+0000","last_active":"2024-05-21T13:36:02.808272+0000","last_peered":"2024-05-21T13:36:02.808272+0000","last_clean":"2024-05-21T13:36:02.808272+0000","last_became_active":"2024-05-21T13:36:01.842792+0000","last_became_peered":"2024-05-21T13:36:01.842792+0000","last_unstale":"2024-05-21T13:36:02.808272+0000","last_undegraded":"2024-05-21T13:36:02.808272+0000","last_fullsized":"2024-05-21T13:36:02.808272+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:19:54.016465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"25'5","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:26.903362+0000","last_change":"2024-05-21T13:35:56.770864+0000","last_active":"2024-05-21T13:36:26.903362+0000","last_peered":"2024-05-21T13:36:26.903362+0000","last_clean":"2024-05-21T13:36:26.903362+0000","last_became_active":"2024-05-21T13:35:56.766873+0000","last_became_peered":"2024-05-21T13:35:56.766873+0000","last_unstale":"2024-05-21T13:36:26.903362+0000","last_undegraded":"2024-05-21T13:36:26.903362+0000","last_fullsized":"2024-05-21T13:36:26.903362+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:13:02.633858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.963803+0000","last_change":"2024-05-21T13:35:57.787563+0000","last_active":"2024-05-21T13:36:02.963803+0000","last_peered":"2024-05-21T13:36:02.963803+0000","last_clean":"2024-05-21T13:36:02.963803+0000","last_became_active":"2024-05-21T13:35:57.787255+0000","last_became_peered":"2024-05-21T13:35:57.787255+0000","last_unstale":"2024-05-21T13:36:02.963803+0000","last_undegraded":"2024-05-21T13:36:02.963803+0000","last_fullsized":"2024-05-21T13:36:02.963803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:32:49.325049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.964068+0000","last_change":"2024-05-21T13:36:01.868514+0000","last_active":"2024-05-21T13:36:02.964068+0000","last_peered":"2024-05-21T13:36:02.964068+0000","last_clean":"2024-05-21T13:36:02.964068+0000","last_became_active":"2024-05-21T13:36:01.867522+0000","last_became_peered":"2024-05-21T13:36:01.867522+0000","last_unstale":"2024-05-21T13:36:02.964068+0000","last_undegraded":"2024-05-21T13:36:02.964068+0000","last_fullsized":"2024-05-21T13:36:02.964068+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:19:13.533784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.960872+0000","last_change":"2024-05-21T13:35:57.782641+0000","last_active":"2024-05-21T13:36:02.960872+0000","last_peered":"2024-05-21T13:36:02.960872+0000","last_clean":"2024-05-21T13:36:02.960872+0000","last_became_active":"2024-05-21T13:35:57.782233+0000","last_became_peered":"2024-05-21T13:35:57.782233+0000","last_unstale":"2024-05-21T13:36:02.960872+0000","last_undegraded":"2024-05-21T13:36:02.960872+0000","last_fullsized":"2024-05-21T13:36:02.960872+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:55:18.808229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.963845+0000","last_change":"2024-05-21T13:35:57.770591+0000","last_active":"2024-05-21T13:36:02.963845+0000","last_peered":"2024-05-21T13:36:02.963845+0000","last_clean":"2024-05-21T13:36:02.963845+0000","last_became_active":"2024-05-21T13:35:57.769785+0000","last_became_peered":"2024-05-21T13:35:57.769785+0000","last_unstale":"2024-05-21T13:36:02.963845+0000","last_undegraded":"2024-05-21T13:36:02.963845+0000","last_fullsized":"2024-05-21T13:36:02.963845+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:18:28.168393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.805267+0000","last_change":"2024-05-21T13:35:57.799153+0000","last_active":"2024-05-21T13:36:02.805267+0000","last_peered":"2024-05-21T13:36:02.805267+0000","last_clean":"2024-05-21T13:36:02.805267+0000","last_became_active":"2024-05-21T13:35:57.796495+0000","last_became_peered":"2024-05-21T13:35:57.796495+0000","last_unstale":"2024-05-21T13:36:02.805267+0000","last_undegraded":"2024-05-21T13:36:02.805267+0000","last_fullsized":"2024-05-21T13:36:02.805267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:53:04.109036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.963840+0000","last_change":"2024-05-21T13:35:57.784335+0000","last_active":"2024-05-21T13:36:02.963840+0000","last_peered":"2024-05-21T13:36:02.963840+0000","last_clean":"2024-05-21T13:36:02.963840+0000","last_became_active":"2024-05-21T13:35:57.783968+0000","last_became_peered":"2024-05-21T13:35:57.783968+0000","last_unstale":"2024-05-21T13:36:02.963840+0000","last_undegraded":"2024-05-21T13:36:02.963840+0000","last_fullsized":"2024-05-21T13:36:02.963840+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:57:20.832617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.967890+0000","last_change":"2024-05-21T13:35:57.795153+0000","last_active":"2024-05-21T13:36:02.967890+0000","last_peered":"2024-05-21T13:36:02.967890+0000","last_clean":"2024-05-21T13:36:02.967890+0000","last_became_active":"2024-05-21T13:35:57.794885+0000","last_became_peered":"2024-05-21T13:35:57.794885+0000","last_unstale":"2024-05-21T13:36:02.967890+0000","last_undegraded":"2024-05-21T13:36:02.967890+0000","last_fullsized":"2024-05-21T13:36:02.967890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:17:00.454371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.967778+0000","last_change":"2024-05-21T13:35:57.778916+0000","last_active":"2024-05-21T13:36:02.967778+0000","last_peered":"2024-05-21T13:36:02.967778+0000","last_clean":"2024-05-21T13:36:02.967778+0000","last_became_active":"2024-05-21T13:35:57.778171+0000","last_became_peered":"2024-05-21T13:35:57.778171+0000","last_unstale":"2024-05-21T13:36:02.967778+0000","last_undegraded":"2024-05-21T13:36:02.967778+0000","last_fullsized":"2024-05-21T13:36:02.967778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:15:37.425836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.961364+0000","last_change":"2024-05-21T13:35:57.791367+0000","last_active":"2024-05-21T13:36:02.961364+0000","last_peered":"2024-05-21T13:36:02.961364+0000","last_clean":"2024-05-21T13:36:02.961364+0000","last_became_active":"2024-05-21T13:35:57.790971+0000","last_became_peered":"2024-05-21T13:35:57.790971+0000","last_unstale":"2024-05-21T13:36:02.961364+0000","last_undegraded":"2024-05-21T13:36:02.961364+0000","last_fullsized":"2024-05-21T13:36:02.961364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:14:47.428631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.965591+0000","last_change":"2024-05-21T13:35:57.785257+0000","last_active":"2024-05-21T13:36:02.965591+0000","last_peered":"2024-05-21T13:36:02.965591+0000","last_clean":"2024-05-21T13:36:02.965591+0000","last_became_active":"2024-05-21T13:35:57.781533+0000","last_became_peered":"2024-05-21T13:35:57.781533+0000","last_unstale":"2024-05-21T13:36:02.965591+0000","last_undegraded":"2024-05-21T13:36:02.965591+0000","last_fullsized":"2024-05-21T13:36:02.965591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:18:32.591803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.804917+0000","last_change":"2024-05-21T13:35:57.799128+0000","last_active":"2024-05-21T13:36:02.804917+0000","last_peered":"2024-05-21T13:36:02.804917+0000","last_clean":"2024-05-21T13:36:02.804917+0000","last_became_active":"2024-05-21T13:35:57.797044+0000","last_became_peered":"2024-05-21T13:35:57.797044+0000","last_unstale":"2024-05-21T13:36:02.804917+0000","last_undegraded":"2024-05-21T13:36:02.804917+0000","last_fullsized":"2024-05-21T13:36:02.804917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:57:13.472309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.962393+0000","last_change":"2024-05-21T13:35:57.789768+0000","last_active":"2024-05-21T13:36:02.962393+0000","last_peered":"2024-05-21T13:36:02.962393+0000","last_clean":"2024-05-21T13:36:02.962393+0000","last_became_active":"2024-05-21T13:35:57.789474+0000","last_became_peered":"2024-05-21T13:35:57.789474+0000","last_unstale":"2024-05-21T13:36:02.962393+0000","last_undegraded":"2024-05-21T13:36:02.962393+0000","last_fullsized":"2024-05-21T13:36:02.962393+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:42:53.993281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.963561+0000","last_change":"2024-05-21T13:35:57.756607+0000","last_active":"2024-05-21T13:36:02.963561+0000","last_peered":"2024-05-21T13:36:02.963561+0000","last_clean":"2024-05-21T13:36:02.963561+0000","last_became_active":"2024-05-21T13:35:57.755889+0000","last_became_peered":"2024-05-21T13:35:57.755889+0000","last_unstale":"2024-05-21T13:36:02.963561+0000","last_undegraded":"2024-05-21T13:36:02.963561+0000","last_fullsized":"2024-05-21T13:36:02.963561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:16:19.541597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.808181+0000","last_change":"2024-05-21T13:35:57.775322+0000","last_active":"2024-05-21T13:36:02.808181+0000","last_peered":"2024-05-21T13:36:02.808181+0000","last_clean":"2024-05-21T13:36:02.808181+0000","last_became_active":"2024-05-21T13:35:57.774386+0000","last_became_peered":"2024-05-21T13:35:57.774386+0000","last_unstale":"2024-05-21T13:36:02.808181+0000","last_undegraded":"2024-05-21T13:36:02.808181+0000","last_fullsized":"2024-05-21T13:36:02.808181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:01:02.106172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.959969+0000","last_change":"2024-05-21T13:35:57.769931+0000","last_active":"2024-05-21T13:36:02.959969+0000","last_peered":"2024-05-21T13:36:02.959969+0000","last_clean":"2024-05-21T13:36:02.959969+0000","last_became_active":"2024-05-21T13:35:57.769149+0000","last_became_peered":"2024-05-21T13:35:57.769149+0000","last_unstale":"2024-05-21T13:36:02.959969+0000","last_undegraded":"2024-05-21T13:36:02.959969+0000","last_fullsized":"2024-05-21T13:36:02.959969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:55:56.268307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.806502+0000","last_change":"2024-05-21T13:35:57.796153+0000","last_active":"2024-05-21T13:36:02.806502+0000","last_peered":"2024-05-21T13:36:02.806502+0000","last_clean":"2024-05-21T13:36:02.806502+0000","last_became_active":"2024-05-21T13:35:57.795799+0000","last_became_peered":"2024-05-21T13:35:57.795799+0000","last_unstale":"2024-05-21T13:36:02.806502+0000","last_undegraded":"2024-05-21T13:36:02.806502+0000","last_fullsized":"2024-05-21T13:36:02.806502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:52:04.794391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.966824+0000","last_change":"2024-05-21T13:35:57.776414+0000","last_active":"2024-05-21T13:36:02.966824+0000","last_peered":"2024-05-21T13:36:02.966824+0000","last_clean":"2024-05-21T13:36:02.966824+0000","last_became_active":"2024-05-21T13:35:57.775573+0000","last_became_peered":"2024-05-21T13:35:57.775573+0000","last_unstale":"2024-05-21T13:36:02.966824+0000","last_undegraded":"2024-05-21T13:36:02.966824+0000","last_fullsized":"2024-05-21T13:36:02.966824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:47:47.624662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.808011+0000","last_change":"2024-05-21T13:35:57.799673+0000","last_active":"2024-05-21T13:36:02.808011+0000","last_peered":"2024-05-21T13:36:02.808011+0000","last_clean":"2024-05-21T13:36:02.808011+0000","last_became_active":"2024-05-21T13:35:57.799313+0000","last_became_peered":"2024-05-21T13:35:57.799313+0000","last_unstale":"2024-05-21T13:36:02.808011+0000","last_undegraded":"2024-05-21T13:36:02.808011+0000","last_fullsized":"2024-05-21T13:36:02.808011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:40:52.516216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.804786+0000","last_change":"2024-05-21T13:35:57.790705+0000","last_active":"2024-05-21T13:36:02.804786+0000","last_peered":"2024-05-21T13:36:02.804786+0000","last_clean":"2024-05-21T13:36:02.804786+0000","last_became_active":"2024-05-21T13:35:57.787735+0000","last_became_peered":"2024-05-21T13:35:57.787735+0000","last_unstale":"2024-05-21T13:36:02.804786+0000","last_undegraded":"2024-05-21T13:36:02.804786+0000","last_fullsized":"2024-05-21T13:36:02.804786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:17:24.376182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.961973+0000","last_change":"2024-05-21T13:35:57.786838+0000","last_active":"2024-05-21T13:36:02.961973+0000","last_peered":"2024-05-21T13:36:02.961973+0000","last_clean":"2024-05-21T13:36:02.961973+0000","last_became_active":"2024-05-21T13:35:57.786403+0000","last_became_peered":"2024-05-21T13:35:57.786403+0000","last_unstale":"2024-05-21T13:36:02.961973+0000","last_undegraded":"2024-05-21T13:36:02.961973+0000","last_fullsized":"2024-05-21T13:36:02.961973+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:29:28.760793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.966410+0000","last_change":"2024-05-21T13:35:57.783561+0000","last_active":"2024-05-21T13:36:02.966410+0000","last_peered":"2024-05-21T13:36:02.966410+0000","last_clean":"2024-05-21T13:36:02.966410+0000","last_became_active":"2024-05-21T13:35:57.783060+0000","last_became_peered":"2024-05-21T13:35:57.783060+0000","last_unstale":"2024-05-21T13:36:02.966410+0000","last_undegraded":"2024-05-21T13:36:02.966410+0000","last_fullsized":"2024-05-21T13:36:02.966410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:27:27.261449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.964046+0000","last_change":"2024-05-21T13:35:57.788210+0000","last_active":"2024-05-21T13:36:02.964046+0000","last_peered":"2024-05-21T13:36:02.964046+0000","last_clean":"2024-05-21T13:36:02.964046+0000","last_became_active":"2024-05-21T13:35:57.787508+0000","last_became_peered":"2024-05-21T13:35:57.787508+0000","last_unstale":"2024-05-21T13:36:02.964046+0000","last_undegraded":"2024-05-21T13:36:02.964046+0000","last_fullsized":"2024-05-21T13:36:02.964046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:12:56.914580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.959869+0000","last_change":"2024-05-21T13:35:57.787335+0000","last_active":"2024-05-21T13:36:02.959869+0000","last_peered":"2024-05-21T13:36:02.959869+0000","last_clean":"2024-05-21T13:36:02.959869+0000","last_became_active":"2024-05-21T13:35:57.786292+0000","last_became_peered":"2024-05-21T13:35:57.786292+0000","last_unstale":"2024-05-21T13:36:02.959869+0000","last_undegraded":"2024-05-21T13:36:02.959869+0000","last_fullsized":"2024-05-21T13:36:02.959869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:49:40.480948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.960610+0000","last_change":"2024-05-21T13:35:57.801121+0000","last_active":"2024-05-21T13:36:02.960610+0000","last_peered":"2024-05-21T13:36:02.960610+0000","last_clean":"2024-05-21T13:36:02.960610+0000","last_became_active":"2024-05-21T13:35:57.800858+0000","last_became_peered":"2024-05-21T13:35:57.800858+0000","last_unstale":"2024-05-21T13:36:02.960610+0000","last_undegraded":"2024-05-21T13:36:02.960610+0000","last_fullsized":"2024-05-21T13:36:02.960610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:41:08.765821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.959709+0000","last_change":"2024-05-21T13:35:57.778753+0000","last_active":"2024-05-21T13:36:02.959709+0000","last_peered":"2024-05-21T13:36:02.959709+0000","last_clean":"2024-05-21T13:36:02.959709+0000","last_became_active":"2024-05-21T13:35:57.777962+0000","last_became_peered":"2024-05-21T13:35:57.777962+0000","last_unstale":"2024-05-21T13:36:02.959709+0000","last_undegraded":"2024-05-21T13:36:02.959709+0000","last_fullsized":"2024-05-21T13:36:02.959709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:51:49.102945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.963934+0000","last_change":"2024-05-21T13:35:57.798312+0000","last_active":"2024-05-21T13:36:02.963934+0000","last_peered":"2024-05-21T13:36:02.963934+0000","last_clean":"2024-05-21T13:36:02.963934+0000","last_became_active":"2024-05-21T13:35:57.797793+0000","last_became_peered":"2024-05-21T13:35:57.797793+0000","last_unstale":"2024-05-21T13:36:02.963934+0000","last_undegraded":"2024-05-21T13:36:02.963934+0000","last_fullsized":"2024-05-21T13:36:02.963934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:28:47.276868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.961736+0000","last_change":"2024-05-21T13:35:57.782412+0000","last_active":"2024-05-21T13:36:02.961736+0000","last_peered":"2024-05-21T13:36:02.961736+0000","last_clean":"2024-05-21T13:36:02.961736+0000","last_became_active":"2024-05-21T13:35:57.782058+0000","last_became_peered":"2024-05-21T13:35:57.782058+0000","last_unstale":"2024-05-21T13:36:02.961736+0000","last_undegraded":"2024-05-21T13:36:02.961736+0000","last_fullsized":"2024-05-21T13:36:02.961736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:39:49.142554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.959879+0000","last_change":"2024-05-21T13:35:57.779771+0000","last_active":"2024-05-21T13:36:02.959879+0000","last_peered":"2024-05-21T13:36:02.959879+0000","last_clean":"2024-05-21T13:36:02.959879+0000","last_became_active":"2024-05-21T13:35:57.779168+0000","last_became_peered":"2024-05-21T13:35:57.779168+0000","last_unstale":"2024-05-21T13:36:02.959879+0000","last_undegraded":"2024-05-21T13:36:02.959879+0000","last_fullsized":"2024-05-21T13:36:02.959879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T13:59:58.966203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.961896+0000","last_change":"2024-05-21T13:35:57.773098+0000","last_active":"2024-05-21T13:36:02.961896+0000","last_peered":"2024-05-21T13:36:02.961896+0000","last_clean":"2024-05-21T13:36:02.961896+0000","last_became_active":"2024-05-21T13:35:57.772268+0000","last_became_peered":"2024-05-21T13:35:57.772268+0000","last_unstale":"2024-05-21T13:36:02.961896+0000","last_undegraded":"2024-05-21T13:36:02.961896+0000","last_fullsized":"2024-05-21T13:36:02.961896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:05:25.482434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.960610+0000","last_change":"2024-05-21T13:35:57.788980+0000","last_active":"2024-05-21T13:36:02.960610+0000","last_peered":"2024-05-21T13:36:02.960610+0000","last_clean":"2024-05-21T13:36:02.960610+0000","last_became_active":"2024-05-21T13:35:57.788689+0000","last_became_peered":"2024-05-21T13:35:57.788689+0000","last_unstale":"2024-05-21T13:36:02.960610+0000","last_undegraded":"2024-05-21T13:36:02.960610+0000","last_fullsized":"2024-05-21T13:36:02.960610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:15:07.615363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.961136+0000","last_change":"2024-05-21T13:35:57.772867+0000","last_active":"2024-05-21T13:36:02.961136+0000","last_peered":"2024-05-21T13:36:02.961136+0000","last_clean":"2024-05-21T13:36:02.961136+0000","last_became_active":"2024-05-21T13:35:57.772160+0000","last_became_peered":"2024-05-21T13:35:57.772160+0000","last_unstale":"2024-05-21T13:36:02.961136+0000","last_undegraded":"2024-05-21T13:36:02.961136+0000","last_fullsized":"2024-05-21T13:36:02.961136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:11:24.428796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.964773+0000","last_change":"2024-05-21T13:35:57.785297+0000","last_active":"2024-05-21T13:36:02.964773+0000","last_peered":"2024-05-21T13:36:02.964773+0000","last_clean":"2024-05-21T13:36:02.964773+0000","last_became_active":"2024-05-21T13:35:57.784741+0000","last_became_peered":"2024-05-21T13:35:57.784741+0000","last_unstale":"2024-05-21T13:36:02.964773+0000","last_undegraded":"2024-05-21T13:36:02.964773+0000","last_fullsized":"2024-05-21T13:36:02.964773+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:45:08.507286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.965566+0000","last_change":"2024-05-21T13:35:57.788875+0000","last_active":"2024-05-21T13:36:02.965566+0000","last_peered":"2024-05-21T13:36:02.965566+0000","last_clean":"2024-05-21T13:36:02.965566+0000","last_became_active":"2024-05-21T13:35:57.786629+0000","last_became_peered":"2024-05-21T13:35:57.786629+0000","last_unstale":"2024-05-21T13:36:02.965566+0000","last_undegraded":"2024-05-21T13:36:02.965566+0000","last_fullsized":"2024-05-21T13:36:02.965566+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:40:07.549210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.959984+0000","last_change":"2024-05-21T13:35:57.803316+0000","last_active":"2024-05-21T13:36:02.959984+0000","last_peered":"2024-05-21T13:36:02.959984+0000","last_clean":"2024-05-21T13:36:02.959984+0000","last_became_active":"2024-05-21T13:35:57.802925+0000","last_became_peered":"2024-05-21T13:35:57.802925+0000","last_unstale":"2024-05-21T13:36:02.959984+0000","last_undegraded":"2024-05-21T13:36:02.959984+0000","last_fullsized":"2024-05-21T13:36:02.959984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:17:16.304097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":5352,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":57,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":16,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":10686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":51,"ondisk_log_size":51,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66916,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509452,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":266240,"data_stored":101627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509452,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":258048,"data_stored":101503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509451,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":262144,"data_stored":102085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509452,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31440,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340400,"statfs":{"total":96636764160,"available":96604569600,"internally_reserved":0,"allocated":270336,"data_stored":105345,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509452,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31504,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340336,"statfs":{"total":96636764160,"available":96604504064,"internally_reserved":0,"allocated":327680,"data_stored":691941,"data_compressed":33458,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509451,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":266240,"data_stored":101559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542155,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":339968,"data_stored":692585,"data_compressed":33458,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574859,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27304,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344536,"statfs":{"total":96636764160,"available":96608804864,"internally_reserved":0,"allocated":294912,"data_stored":106801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33458,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33458,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":5298,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":714,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-21T13:36:31.246 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-21T13:36:31.247 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-21T13:36:31.247 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-05-21T13:36:31.247 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-05-21T13:36:31.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.425+0000 7fbeb2464640 1 Processor -- start 2024-05-21T13:36:31.404 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.425+0000 7fbeb2464640 1 -- start start 2024-05-21T13:36:31.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.425+0000 7fbeb2464640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbeac153cb0 0x7fbeac0c9440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:31.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.425+0000 7fbeb2464640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbeac159cf0 con 0x7fbeac0c4cf0 2024-05-21T13:36:31.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.425+0000 7fbeb2464640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbeac159fd0 con 0x7fbeac0c48f0 2024-05-21T13:36:31.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.425+0000 7fbeb2464640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7fbeac0c9c60 con 0x7fbeac153cb0 2024-05-21T13:36:31.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.425+0000 7fbeb0a01640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fbeac0c4cf0 0x7fbeac15d1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:44614/0 (socket says 172.21.15.22:44614) 2024-05-21T13:36:31.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.425+0000 7fbeb0a01640 1 -- 172.21.15.22:0/1726782564 learned_addr learned my addr 172.21.15.22:0/1726782564 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-21T13:36:31.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.429+0000 7fbeabfff640 1 --2- 172.21.15.22:0/1726782564 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbeac153cb0 0x7fbeac0c9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:31.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.429+0000 7fbeaaffd640 1 -- 172.21.15.22:0/1726782564 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4236860401 0 0) 0x7fbeac159cf0 con 0x7fbeac0c4cf0 2024-05-21T13:36:31.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.429+0000 7fbeaaffd640 1 -- 172.21.15.22:0/1726782564 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe94003530 con 0x7fbeac0c4cf0 2024-05-21T13:36:31.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.429+0000 7fbeaaffd640 1 -- 172.21.15.22:0/1726782564 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2701446072 0 0) 0x7fbe94003530 con 0x7fbeac0c4cf0 2024-05-21T13:36:31.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.429+0000 7fbeaaffd640 1 -- 172.21.15.22:0/1726782564 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbeac153cb0 msgr2=0x7fbeac0c9440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:31.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.429+0000 7fbeaaffd640 1 --2- 172.21.15.22:0/1726782564 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbeac153cb0 0x7fbeac0c9440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:31.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.429+0000 7fbeaaffd640 1 -- 172.21.15.22:0/1726782564 >> v1:172.21.15.115:6789/0 conn(0x7fbeac0c48f0 legacy=0x7fbeac0c7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:31.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.429+0000 7fbeaaffd640 1 -- 172.21.15.22:0/1726782564 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbeac15a2b0 con 0x7fbeac0c4cf0 2024-05-21T13:36:31.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.429+0000 7fbeaaffd640 1 -- 172.21.15.22:0/1726782564 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2684847062 0 0) 0x7fbea4001a80 con 0x7fbeac0c4cf0 2024-05-21T13:36:31.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.429+0000 7fbeaaffd640 1 -- 172.21.15.22:0/1726782564 >> v1:172.21.15.22:6789/0 conn(0x7fbeac0c4cf0 legacy=0x7fbeac15d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:31.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.429+0000 7fbeaaffd640 1 --2- 172.21.15.22:0/1726782564 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe94003a40 0x7fbe94003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:31.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.429+0000 7fbeaaffd640 1 --2- 172.21.15.22:0/1726782564 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbeac153cb0 0x7fbe94004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:31.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.429+0000 7fbeaaffd640 1 --2- 172.21.15.22:0/1726782564 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbe94004d50 0x7fbe940051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:31.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.429+0000 7fbeaaffd640 1 -- 172.21.15.22:0/1726782564 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fbeac0c9c60 con 0x7fbe94004d50 2024-05-21T13:36:31.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.429+0000 7fbeaaffd640 1 -- 172.21.15.22:0/1726782564 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fbe9400bb00 con 0x7fbe94003a40 2024-05-21T13:36:31.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.429+0000 7fbeaaffd640 1 -- 172.21.15.22:0/1726782564 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7fbe9400bd00 con 0x7fbeac153cb0 2024-05-21T13:36:31.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.429+0000 7fbeb0a01640 1 --2- 172.21.15.22:0/1726782564 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbe94004d50 0x7fbe940051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:31.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.429+0000 7fbeabfff640 1 --2- 172.21.15.22:0/1726782564 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe94003a40 0x7fbe94003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:31.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.429+0000 7fbeab7fe640 1 --2- 172.21.15.22:0/1726782564 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbeac153cb0 0x7fbe94004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:31.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.429+0000 7fbeb0a01640 1 -- 172.21.15.22:0/1726782564 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbeac153cb0 msgr2=0x7fbe94004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:31.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.429+0000 7fbeb0a01640 1 --2- 172.21.15.22:0/1726782564 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbeac153cb0 0x7fbe94004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:31.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.429+0000 7fbeb0a01640 1 -- 172.21.15.22:0/1726782564 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe94003a40 msgr2=0x7fbe94003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:31.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.429+0000 7fbeb0a01640 1 --2- 172.21.15.22:0/1726782564 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbe94003a40 0x7fbe94003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:31.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.429+0000 7fbeb0a01640 1 -- 172.21.15.22:0/1726782564 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe94003530 con 0x7fbe94004d50 2024-05-21T13:36:31.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.429+0000 7fbeb0a01640 1 --2- 172.21.15.22:0/1726782564 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbe94004d50 0x7fbe940051d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fbea400a830 tx=0x7fbea401d2c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ac6267522f7a8c5 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:31.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.429+0000 7fbeaaffd640 1 -- 172.21.15.22:0/1726782564 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbea400a450 con 0x7fbe94004d50 2024-05-21T13:36:31.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.429+0000 7fbeaaffd640 1 -- 172.21.15.22:0/1726782564 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbea40072d0 con 0x7fbe94004d50 2024-05-21T13:36:31.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.429+0000 7fbeaaffd640 1 -- 172.21.15.22:0/1726782564 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbea40076c0 con 0x7fbe94004d50 2024-05-21T13:36:31.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.429+0000 7fbeb2464640 1 -- 172.21.15.22:0/1726782564 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbe94004d50 msgr2=0x7fbe940051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:31.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.429+0000 7fbeb2464640 1 --2- 172.21.15.22:0/1726782564 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbe94004d50 0x7fbe940051d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fbea400a830 tx=0x7fbea401d2c0 comp rx=0 tx=0).stop 2024-05-21T13:36:31.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.429+0000 7fbeb0a01640 1 -- 172.21.15.22:0/1726782564 reap_dead start 2024-05-21T13:36:31.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.429+0000 7fbeb2464640 1 -- 172.21.15.22:0/1726782564 shutdown_connections 2024-05-21T13:36:31.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.429+0000 7fbeb2464640 1 -- 172.21.15.22:0/1726782564 >> 172.21.15.22:0/1726782564 conn(0x7fbeac06ea10 msgr2=0x7fbeac06ff50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:31.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.433+0000 7fbeb2464640 1 -- 172.21.15.22:0/1726782564 shutdown_connections 2024-05-21T13:36:31.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.433+0000 7fbeb2464640 1 -- 172.21.15.22:0/1726782564 wait complete. 2024-05-21T13:36:31.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.433+0000 7fbeb2464640 1 Processor -- start 2024-05-21T13:36:31.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.433+0000 7fbeb2464640 1 -- start start 2024-05-21T13:36:31.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.433+0000 7fbeb2464640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbe94004d50 0x7fbeac1e6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:31.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.433+0000 7fbeb2464640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbeac14b3b0 0x7fbeac14cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:31.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.433+0000 7fbeb2464640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbeac14d0b0 0x7fbeac1499d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:31.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.433+0000 7fbeb2464640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fbeac154090 con 0x7fbe94004d50 2024-05-21T13:36:31.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.433+0000 7fbeb2464640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fbeac15a870 con 0x7fbeac14b3b0 2024-05-21T13:36:31.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.433+0000 7fbeb2464640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7fbeac154210 con 0x7fbeac14d0b0 2024-05-21T13:36:31.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.433+0000 7fbeabfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbe94004d50 0x7fbeac1e6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:31.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.433+0000 7fbeabfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbe94004d50 0x7fbeac1e6820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48586/0 (socket says 172.21.15.22:48586) 2024-05-21T13:36:31.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.433+0000 7fbeabfff640 1 -- 172.21.15.22:0/2787231378 learned_addr learned my addr 172.21.15.22:0/2787231378 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:31.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.433+0000 7fbeab7fe640 1 --2- 172.21.15.22:0/2787231378 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbeac14b3b0 0x7fbeac14cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:31.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.433+0000 7fbeabfff640 1 -- 172.21.15.22:0/2787231378 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbeac14d0b0 msgr2=0x7fbeac1499d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:31.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.433+0000 7fbeb0a01640 1 --2- 172.21.15.22:0/2787231378 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbeac14d0b0 0x7fbeac1499d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:31.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.433+0000 7fbeabfff640 1 --2- 172.21.15.22:0/2787231378 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbeac14d0b0 0x7fbeac1499d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:31.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.433+0000 7fbeabfff640 1 -- 172.21.15.22:0/2787231378 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbeac14b3b0 msgr2=0x7fbeac14cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:31.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.433+0000 7fbeabfff640 1 --2- 172.21.15.22:0/2787231378 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbeac14b3b0 0x7fbeac14cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:31.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.433+0000 7fbeabfff640 1 -- 172.21.15.22:0/2787231378 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbeac1efa80 con 0x7fbe94004d50 2024-05-21T13:36:31.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.433+0000 7fbeb0a01640 1 --2- 172.21.15.22:0/2787231378 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbeac14d0b0 0x7fbeac1499d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:36:31.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.433+0000 7fbeab7fe640 1 --2- 172.21.15.22:0/2787231378 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbeac14b3b0 0x7fbeac14cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T13:36:31.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.433+0000 7fbeabfff640 1 --2- 172.21.15.22:0/2787231378 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbe94004d50 0x7fbeac1e6820 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fbe9c011610 tx=0x7fbe9c011ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:31.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.433+0000 7fbea8ff9640 1 -- 172.21.15.22:0/2787231378 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe9c00f8f0 con 0x7fbe94004d50 2024-05-21T13:36:31.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.433+0000 7fbea8ff9640 1 -- 172.21.15.22:0/2787231378 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe9c00fa90 con 0x7fbe94004d50 2024-05-21T13:36:31.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.433+0000 7fbeb2464640 1 -- 172.21.15.22:0/2787231378 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbeac1e5a90 con 0x7fbe94004d50 2024-05-21T13:36:31.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.433+0000 7fbea8ff9640 1 -- 172.21.15.22:0/2787231378 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe9c00fe40 con 0x7fbe94004d50 2024-05-21T13:36:31.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.433+0000 7fbeb2464640 1 -- 172.21.15.22:0/2787231378 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbeac1effd0 con 0x7fbe94004d50 2024-05-21T13:36:31.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.433+0000 7fbeb2464640 1 -- 172.21.15.22:0/2787231378 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbeac077bb0 con 0x7fbe94004d50 2024-05-21T13:36:31.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.437+0000 7fbea8ff9640 1 -- 172.21.15.22:0/2787231378 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fbe9c015460 con 0x7fbe94004d50 2024-05-21T13:36:31.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.437+0000 7fbea8ff9640 1 --2- 172.21.15.22:0/2787231378 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fbe9806f400 0x7fbe980718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:31.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.437+0000 7fbea8ff9640 1 -- 172.21.15.22:0/2787231378 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fbe9c08ff40 con 0x7fbe94004d50 2024-05-21T13:36:31.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.437+0000 7fbeab7fe640 1 --2- 172.21.15.22:0/2787231378 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fbe9806f400 0x7fbe980718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:31.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.437+0000 7fbeab7fe640 1 --2- 172.21.15.22:0/2787231378 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fbe9806f400 0x7fbe980718c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbeac0c5c70 tx=0x7fbea0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:31.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.441+0000 7fbea8ff9640 1 -- 172.21.15.22:0/2787231378 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fbe9c019030 con 0x7fbe94004d50 2024-05-21T13:36:31.610 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.633+0000 7fbeb2464640 1 -- 172.21.15.22:0/2787231378 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fbeac0cce40 con 0x7fbe94004d50 2024-05-21T13:36:31.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.633+0000 7fbea8ff9640 1 -- 172.21.15.22:0/2787231378 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fbe9c05cb70 con 0x7fbe94004d50 2024-05-21T13:36:31.611 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-21T13:36:31.611 INFO:teuthology.orchestra.run.smithi022.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-21T13:36:31.613 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.633+0000 7fbeb2464640 1 -- 172.21.15.22:0/2787231378 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fbe9806f400 msgr2=0x7fbe980718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:31.613 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.633+0000 7fbeb2464640 1 --2- 172.21.15.22:0/2787231378 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fbe9806f400 0x7fbe980718c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fbeac0c5c70 tx=0x7fbea0009040 comp rx=0 tx=0).stop 2024-05-21T13:36:31.613 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.633+0000 7fbeb2464640 1 -- 172.21.15.22:0/2787231378 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbe94004d50 msgr2=0x7fbeac1e6820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:31.613 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.633+0000 7fbeb2464640 1 --2- 172.21.15.22:0/2787231378 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbe94004d50 0x7fbeac1e6820 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fbe9c011610 tx=0x7fbe9c011ad0 comp rx=0 tx=0).stop 2024-05-21T13:36:31.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.633+0000 7fbeb2464640 1 -- 172.21.15.22:0/2787231378 shutdown_connections 2024-05-21T13:36:31.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.633+0000 7fbeb2464640 1 --2- 172.21.15.22:0/2787231378 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fbe9806f400 0x7fbe980718c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:31.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.633+0000 7fbeb2464640 1 --2- 172.21.15.22:0/2787231378 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbeac14d0b0 0x7fbeac1499d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:31.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.633+0000 7fbeb2464640 1 --2- 172.21.15.22:0/2787231378 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbeac14b3b0 0x7fbeac14cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:31.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.633+0000 7fbeb2464640 1 --2- 172.21.15.22:0/2787231378 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbe94004d50 0x7fbeac1e6820 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:31.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.633+0000 7fbeb2464640 1 -- 172.21.15.22:0/2787231378 >> 172.21.15.22:0/2787231378 conn(0x7fbeac06ea10 msgr2=0x7fbeac14df60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:31.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.633+0000 7fbeb2464640 1 -- 172.21.15.22:0/2787231378 shutdown_connections 2024-05-21T13:36:31.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.633+0000 7fbeb2464640 1 -- 172.21.15.22:0/2787231378 wait complete. 2024-05-21T13:36:31.628 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-05-21T13:36:31.628 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-21T13:36:31.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.769+0000 7f592c0cb640 1 Processor -- start 2024-05-21T13:36:31.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.769+0000 7f592c0cb640 1 -- start start 2024-05-21T13:36:31.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.769+0000 7f592c0cb640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f5924153d10 0x7f5924070630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:31.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.769+0000 7f592c0cb640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f59240ca670 0x7f59240cf470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:31.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.769+0000 7f592c0cb640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59240cb6d0 con 0x7f59240c4520 2024-05-21T13:36:31.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.769+0000 7f592c0cb640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f59240cbce0 con 0x7f5924153d10 2024-05-21T13:36:31.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.769+0000 7f592c0cb640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f5924070b70 con 0x7f59240ca670 2024-05-21T13:36:31.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.769+0000 7f5929e67640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f5924153d10 0x7f5924070630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:31.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.769+0000 7f592a668640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f59240c4520 0x7f59240cbf90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:44628/0 (socket says 172.21.15.22:44628) 2024-05-21T13:36:31.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.769+0000 7f592a668640 1 -- 172.21.15.22:0/594652032 learned_addr learned my addr 172.21.15.22:0/594652032 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-21T13:36:31.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.769+0000 7f5929666640 1 --2- 172.21.15.22:0/594652032 >> v2:172.21.15.115:3300/0 conn(0x7f59240ca670 0x7f59240cf470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:31.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.769+0000 7f5928e65640 1 -- 172.21.15.22:0/594652032 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2851153861 0 0) 0x7f59240cb6d0 con 0x7f59240c4520 2024-05-21T13:36:31.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.769+0000 7f5928e65640 1 -- 172.21.15.22:0/594652032 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f590c003530 con 0x7f59240c4520 2024-05-21T13:36:31.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.769+0000 7f5929e67640 1 -- 172.21.15.22:0/594652032 >> v2:172.21.15.115:3300/0 conn(0x7f59240ca670 msgr2=0x7f59240cf470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:31.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.769+0000 7f5929e67640 1 --2- 172.21.15.22:0/594652032 >> v2:172.21.15.115:3300/0 conn(0x7f59240ca670 0x7f59240cf470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:31.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.769+0000 7f5929e67640 1 -- 172.21.15.22:0/594652032 >> v1:172.21.15.22:6789/0 conn(0x7f59240c4520 legacy=0x7f59240cbf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:31.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.769+0000 7f5929e67640 1 -- 172.21.15.22:0/594652032 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f592415db20 con 0x7f5924153d10 2024-05-21T13:36:31.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.773+0000 7f5929e67640 1 --2- 172.21.15.22:0/594652032 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5924153d10 0x7f5924070630 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f592406d030 tx=0x7f591c01f110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=421c6f0429086d91 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:31.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.773+0000 7f5928e65640 1 -- 172.21.15.22:0/594652032 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f591c0b4070 con 0x7f5924153d10 2024-05-21T13:36:31.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.773+0000 7f5928e65640 1 -- 172.21.15.22:0/594652032 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f591c0af600 con 0x7f5924153d10 2024-05-21T13:36:31.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.773+0000 7f5928e65640 1 -- 172.21.15.22:0/594652032 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f591c0af9b0 con 0x7f5924153d10 2024-05-21T13:36:31.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.773+0000 7f592c0cb640 1 -- 172.21.15.22:0/594652032 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5924153d10 msgr2=0x7f5924070630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:31.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.773+0000 7f592c0cb640 1 --2- 172.21.15.22:0/594652032 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5924153d10 0x7f5924070630 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f592406d030 tx=0x7f591c01f110 comp rx=0 tx=0).stop 2024-05-21T13:36:31.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.773+0000 7f592c0cb640 1 -- 172.21.15.22:0/594652032 shutdown_connections 2024-05-21T13:36:31.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.773+0000 7f592c0cb640 1 --2- 172.21.15.22:0/594652032 >> v2:172.21.15.115:3300/0 conn(0x7f59240ca670 0x7f59240cf470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:31.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.773+0000 7f592c0cb640 1 --2- 172.21.15.22:0/594652032 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5924153d10 0x7f5924070630 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:31.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.773+0000 7f592c0cb640 1 -- 172.21.15.22:0/594652032 >> 172.21.15.22:0/594652032 conn(0x7f592406c8f0 msgr2=0x7f5924068260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:31.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.773+0000 7f592c0cb640 1 -- 172.21.15.22:0/594652032 shutdown_connections 2024-05-21T13:36:31.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.773+0000 7f592c0cb640 1 -- 172.21.15.22:0/594652032 wait complete. 2024-05-21T13:36:31.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.773+0000 7f592c0cb640 1 Processor -- start 2024-05-21T13:36:31.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.773+0000 7f592c0cb640 1 -- start start 2024-05-21T13:36:31.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.773+0000 7f592c0cb640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f59240c4520 0x7f5924156d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:31.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.773+0000 7f592c0cb640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f59240ca670 0x7f5924152d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:31.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.773+0000 7f592c0cb640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5924153d10 0x7f59241f2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:31.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.773+0000 7f592c0cb640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f59241540f0 con 0x7f59240ca670 2024-05-21T13:36:31.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.773+0000 7f592c0cb640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f592415de00 con 0x7f5924153d10 2024-05-21T13:36:31.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.773+0000 7f592c0cb640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f59240cb330 con 0x7f59240c4520 2024-05-21T13:36:31.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.773+0000 7f5929666640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f59240ca670 0x7f5924152d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:31.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.773+0000 7f5929666640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f59240ca670 0x7f5924152d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48604/0 (socket says 172.21.15.22:48604) 2024-05-21T13:36:31.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.773+0000 7f5929666640 1 -- 172.21.15.22:0/3698139855 learned_addr learned my addr 172.21.15.22:0/3698139855 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:31.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.773+0000 7f5929e67640 1 --2- 172.21.15.22:0/3698139855 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f59240c4520 0x7f5924156d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:31.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.773+0000 7f592a668640 1 --2- 172.21.15.22:0/3698139855 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5924153d10 0x7f59241f2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:31.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.773+0000 7f5929666640 1 -- 172.21.15.22:0/3698139855 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f59240c4520 msgr2=0x7f5924156d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:31.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.773+0000 7f5929666640 1 --2- 172.21.15.22:0/3698139855 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f59240c4520 0x7f5924156d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:31.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.773+0000 7f5929666640 1 -- 172.21.15.22:0/3698139855 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5924153d10 msgr2=0x7f59241f2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:31.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.773+0000 7f5929666640 1 --2- 172.21.15.22:0/3698139855 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5924153d10 0x7f59241f2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:31.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.773+0000 7f5929666640 1 -- 172.21.15.22:0/3698139855 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5924157280 con 0x7f59240ca670 2024-05-21T13:36:31.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.777+0000 7f5929666640 1 --2- 172.21.15.22:0/3698139855 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f59240ca670 0x7f5924152d70 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f591800d800 tx=0x7f591800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:31.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.777+0000 7f59227fc640 1 -- 172.21.15.22:0/3698139855 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f591800b6c0 con 0x7f59240ca670 2024-05-21T13:36:31.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.777+0000 7f59227fc640 1 -- 172.21.15.22:0/3698139855 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5918019070 con 0x7f59240ca670 2024-05-21T13:36:31.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.777+0000 7f592c0cb640 1 -- 172.21.15.22:0/3698139855 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59241497c0 con 0x7f59240ca670 2024-05-21T13:36:31.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.777+0000 7f59227fc640 1 -- 172.21.15.22:0/3698139855 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f591800baa0 con 0x7f59240ca670 2024-05-21T13:36:31.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.777+0000 7f592c0cb640 1 -- 172.21.15.22:0/3698139855 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f592414c530 con 0x7f59240ca670 2024-05-21T13:36:31.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.777+0000 7f592c0cb640 1 -- 172.21.15.22:0/3698139855 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5924077bb0 con 0x7f59240ca670 2024-05-21T13:36:31.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.777+0000 7f59227fc640 1 -- 172.21.15.22:0/3698139855 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f591800bc40 con 0x7f59240ca670 2024-05-21T13:36:31.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.777+0000 7f59227fc640 1 --2- 172.21.15.22:0/3698139855 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f591006f400 0x7f59100718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:31.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.777+0000 7f59227fc640 1 -- 172.21.15.22:0/3698139855 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f591808fa80 con 0x7f59240ca670 2024-05-21T13:36:31.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.777+0000 7f5929e67640 1 --2- 172.21.15.22:0/3698139855 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f591006f400 0x7f59100718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:31.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.777+0000 7f5929e67640 1 --2- 172.21.15.22:0/3698139855 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f591006f400 0x7f59100718c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f591c0b1000 tx=0x7f591c0aa000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:31.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.781+0000 7f59227fc640 1 -- 172.21.15.22:0/3698139855 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f591805c6c0 con 0x7f59240ca670 2024-05-21T13:36:31.949 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.969+0000 7f592c0cb640 1 -- 172.21.15.22:0/3698139855 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f59240ce300 con 0x7f59240ca670 2024-05-21T13:36:31.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.973+0000 7f59227fc640 1 -- 172.21.15.22:0/3698139855 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+6871 (secure 0 0 0) 0x7f591805bfc0 con 0x7f59240ca670 2024-05-21T13:36:31.951 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-21T13:36:31.951 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4224,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/355756580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":355756580},{"type":"v1","addr":"172.21.15.22:6833","nonce":355756580}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4230,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3277017116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":3277017116},{"type":"v1","addr":"172.21.15.22:6835","nonce":3277017116}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4233,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3840772609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3840772609},{"type":"v1","addr":"172.21.15.22:6837","nonce":3840772609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-21T13:35:57.106892+0000","modified":"2024-05-21T13:36:26.994036+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4300,"mds_1":4294,"mds_2":4248},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4248":{"gid":4248,"name":"d","rank":2,"incarnation":13,"state":"up:creating","state_seq":1,"addr":"172.21.15.115:6837/2009761279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":2009761279},{"type":"v1","addr":"172.21.15.115:6837","nonce":2009761279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4294":{"gid":4294,"name":"b","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.115:6835/3894678097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3894678097},{"type":"v1","addr":"172.21.15.115:6835","nonce":3894678097}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4300":{"gid":4300,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.115:6839/1525097577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6838","nonce":1525097577},{"type":"v1","addr":"172.21.15.115:6839","nonce":1525097577}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4300,"qdb_cluster":[4300,4294]},"id":1}]} 2024-05-21T13:36:31.951 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 13 2024-05-21T13:36:31.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.973+0000 7f592c0cb640 1 -- 172.21.15.22:0/3698139855 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f591006f400 msgr2=0x7f59100718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:31.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.973+0000 7f592c0cb640 1 --2- 172.21.15.22:0/3698139855 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f591006f400 0x7f59100718c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f591c0b1000 tx=0x7f591c0aa000 comp rx=0 tx=0).stop 2024-05-21T13:36:31.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.973+0000 7f592c0cb640 1 -- 172.21.15.22:0/3698139855 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f59240ca670 msgr2=0x7f5924152d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:31.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.973+0000 7f592c0cb640 1 --2- 172.21.15.22:0/3698139855 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f59240ca670 0x7f5924152d70 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f591800d800 tx=0x7f591800dcc0 comp rx=0 tx=0).stop 2024-05-21T13:36:31.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.973+0000 7f592c0cb640 1 -- 172.21.15.22:0/3698139855 shutdown_connections 2024-05-21T13:36:31.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.973+0000 7f592c0cb640 1 --2- 172.21.15.22:0/3698139855 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f591006f400 0x7f59100718c0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:31.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.973+0000 7f592c0cb640 1 --2- 172.21.15.22:0/3698139855 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5924153d10 0x7f59241f2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:31.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.973+0000 7f592c0cb640 1 --2- 172.21.15.22:0/3698139855 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f59240ca670 0x7f5924152d70 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:31.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.973+0000 7f592c0cb640 1 --2- 172.21.15.22:0/3698139855 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f59240c4520 0x7f5924156d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:31.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.973+0000 7f592c0cb640 1 -- 172.21.15.22:0/3698139855 >> 172.21.15.22:0/3698139855 conn(0x7f592406c8f0 msgr2=0x7f5924068260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:31.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.973+0000 7f592c0cb640 1 -- 172.21.15.22:0/3698139855 shutdown_connections 2024-05-21T13:36:31.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:31.973+0000 7f592c0cb640 1 -- 172.21.15.22:0/3698139855 wait complete. 2024-05-21T13:36:31.969 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-21T13:36:32.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.117+0000 7f9a91857640 1 Processor -- start 2024-05-21T13:36:32.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.117+0000 7f9a91857640 1 -- start start 2024-05-21T13:36:32.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.117+0000 7f9a91857640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a8c0c70b0 0x7f9a8c071220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:32.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.117+0000 7f9a91857640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a8c070d80 con 0x7f9a8c0c9f50 2024-05-21T13:36:32.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.117+0000 7f9a91857640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a8c0c84b0 con 0x7f9a8c0cb7a0 2024-05-21T13:36:32.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.117+0000 7f9a91857640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f9a8c15a340 con 0x7f9a8c0c70b0 2024-05-21T13:36:32.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.117+0000 7f9a8a7fc640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f9a8c0c9f50 0x7f9a8c15ce10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:44644/0 (socket says 172.21.15.22:44644) 2024-05-21T13:36:32.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.117+0000 7f9a8a7fc640 1 -- 172.21.15.22:0/104517859 learned_addr learned my addr 172.21.15.22:0/104517859 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-21T13:36:32.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.117+0000 7f9a8affd640 1 --2- 172.21.15.22:0/104517859 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a8c0c70b0 0x7f9a8c071220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:32.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.117+0000 7f9a89ffb640 1 -- 172.21.15.22:0/104517859 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 878903677 0 0) 0x7f9a8c070d80 con 0x7f9a8c0c9f50 2024-05-21T13:36:32.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.117+0000 7f9a89ffb640 1 -- 172.21.15.22:0/104517859 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a78003530 con 0x7f9a8c0c9f50 2024-05-21T13:36:32.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.117+0000 7f9a89ffb640 1 -- 172.21.15.22:0/104517859 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2917301652 0 0) 0x7f9a78003530 con 0x7f9a8c0c9f50 2024-05-21T13:36:32.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.117+0000 7f9a89ffb640 1 -- 172.21.15.22:0/104517859 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a8c0c70b0 msgr2=0x7f9a8c071220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:32.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.117+0000 7f9a89ffb640 1 --2- 172.21.15.22:0/104517859 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a8c0c70b0 0x7f9a8c071220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:32.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.117+0000 7f9a89ffb640 1 -- 172.21.15.22:0/104517859 >> v1:172.21.15.115:6789/0 conn(0x7f9a8c0cb7a0 legacy=0x7f9a8c1641a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:32.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.117+0000 7f9a89ffb640 1 -- 172.21.15.22:0/104517859 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a8c15a620 con 0x7f9a8c0c9f50 2024-05-21T13:36:32.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.117+0000 7f9a89ffb640 1 -- 172.21.15.22:0/104517859 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2684847062 0 0) 0x7f9a74001700 con 0x7f9a8c0c9f50 2024-05-21T13:36:32.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.117+0000 7f9a89ffb640 1 -- 172.21.15.22:0/104517859 >> v1:172.21.15.22:6789/0 conn(0x7f9a8c0c9f50 legacy=0x7f9a8c15ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:32.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.117+0000 7f9a89ffb640 1 --2- 172.21.15.22:0/104517859 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a8c0c70b0 0x7f9a78003a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:32.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.117+0000 7f9a89ffb640 1 --2- 172.21.15.22:0/104517859 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a78004010 0x7f9a78004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:32.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.117+0000 7f9a89ffb640 1 --2- 172.21.15.22:0/104517859 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a78004d50 0x7f9a780051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:32.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.117+0000 7f9a89ffb640 1 -- 172.21.15.22:0/104517859 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9a8c15a340 con 0x7f9a78004d50 2024-05-21T13:36:32.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.117+0000 7f9a89ffb640 1 -- 172.21.15.22:0/104517859 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f9a7800bbf0 con 0x7f9a78004010 2024-05-21T13:36:32.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.117+0000 7f9a89ffb640 1 -- 172.21.15.22:0/104517859 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f9a7800bdf0 con 0x7f9a8c0c70b0 2024-05-21T13:36:32.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.117+0000 7f9a8b7fe640 1 --2- 172.21.15.22:0/104517859 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a78004d50 0x7f9a780051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:32.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.117+0000 7f9a8affd640 1 --2- 172.21.15.22:0/104517859 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a8c0c70b0 0x7f9a78003a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:32.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.117+0000 7f9a8a7fc640 1 --2- 172.21.15.22:0/104517859 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a78004010 0x7f9a78004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:32.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.117+0000 7f9a8b7fe640 1 -- 172.21.15.22:0/104517859 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a8c0c70b0 msgr2=0x7f9a78003a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:32.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.117+0000 7f9a8b7fe640 1 --2- 172.21.15.22:0/104517859 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a8c0c70b0 0x7f9a78003a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:32.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.117+0000 7f9a8b7fe640 1 -- 172.21.15.22:0/104517859 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a78004010 msgr2=0x7f9a78004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:32.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.117+0000 7f9a8b7fe640 1 --2- 172.21.15.22:0/104517859 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a78004010 0x7f9a78004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:32.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.117+0000 7f9a8b7fe640 1 -- 172.21.15.22:0/104517859 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a78003530 con 0x7f9a78004d50 2024-05-21T13:36:32.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.121+0000 7f9a8b7fe640 1 --2- 172.21.15.22:0/104517859 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a78004d50 0x7f9a780051d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9a84001790 tx=0x7f9a8401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a0d653662aa81a1 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:32.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.121+0000 7f9a89ffb640 1 -- 172.21.15.22:0/104517859 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a840013e0 con 0x7f9a78004d50 2024-05-21T13:36:32.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.121+0000 7f9a89ffb640 1 -- 172.21.15.22:0/104517859 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a840052d0 con 0x7f9a78004d50 2024-05-21T13:36:32.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.121+0000 7f9a89ffb640 1 -- 172.21.15.22:0/104517859 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a84003840 con 0x7f9a78004d50 2024-05-21T13:36:32.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.121+0000 7f9a91857640 1 -- 172.21.15.22:0/104517859 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a78004d50 msgr2=0x7f9a780051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:32.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.121+0000 7f9a91857640 1 --2- 172.21.15.22:0/104517859 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a78004d50 0x7f9a780051d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f9a84001790 tx=0x7f9a8401c3f0 comp rx=0 tx=0).stop 2024-05-21T13:36:32.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.121+0000 7f9a8b7fe640 1 -- 172.21.15.22:0/104517859 reap_dead start 2024-05-21T13:36:32.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.121+0000 7f9a91857640 1 -- 172.21.15.22:0/104517859 shutdown_connections 2024-05-21T13:36:32.101 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.121+0000 7f9a91857640 1 -- 172.21.15.22:0/104517859 >> 172.21.15.22:0/104517859 conn(0x7f9a8c0cd9a0 msgr2=0x7f9a8c0cddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:32.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.121+0000 7f9a91857640 1 -- 172.21.15.22:0/104517859 shutdown_connections 2024-05-21T13:36:32.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.121+0000 7f9a91857640 1 -- 172.21.15.22:0/104517859 wait complete. 2024-05-21T13:36:32.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.121+0000 7f9a91857640 1 Processor -- start 2024-05-21T13:36:32.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.121+0000 7f9a91857640 1 -- start start 2024-05-21T13:36:32.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.121+0000 7f9a91857640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a8c0ccc70 0x7f9a8c1f1470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:32.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.121+0000 7f9a91857640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a8c0cd050 0x7f9a8c1f4a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:32.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.121+0000 7f9a91857640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a8c0c6000 0x7f9a8c1594e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:32.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.121+0000 7f9a91857640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f9a8c153ba0 con 0x7f9a8c0c6000 2024-05-21T13:36:32.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.121+0000 7f9a91857640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f9a8c15d520 con 0x7f9a8c0ccc70 2024-05-21T13:36:32.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.121+0000 7f9a91857640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f9a8c153d20 con 0x7f9a8c0cd050 2024-05-21T13:36:32.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.121+0000 7f9a8b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a8c0c6000 0x7f9a8c1594e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:32.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.121+0000 7f9a8b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a8c0c6000 0x7f9a8c1594e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48624/0 (socket says 172.21.15.22:48624) 2024-05-21T13:36:32.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.121+0000 7f9a8b7fe640 1 -- 172.21.15.22:0/1603748190 learned_addr learned my addr 172.21.15.22:0/1603748190 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:32.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.121+0000 7f9a8affd640 1 --2- 172.21.15.22:0/1603748190 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a8c0ccc70 0x7f9a8c1f1470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:32.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.125+0000 7f9a8a7fc640 1 --2- 172.21.15.22:0/1603748190 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a8c0cd050 0x7f9a8c1f4a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:32.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.125+0000 7f9a8b7fe640 1 -- 172.21.15.22:0/1603748190 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a8c0cd050 msgr2=0x7f9a8c1f4a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:32.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.125+0000 7f9a8b7fe640 1 --2- 172.21.15.22:0/1603748190 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a8c0cd050 0x7f9a8c1f4a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:32.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.125+0000 7f9a8b7fe640 1 -- 172.21.15.22:0/1603748190 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a8c0ccc70 msgr2=0x7f9a8c1f1470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:32.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.125+0000 7f9a8b7fe640 1 --2- 172.21.15.22:0/1603748190 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a8c0ccc70 0x7f9a8c1f1470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:32.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.125+0000 7f9a8b7fe640 1 -- 172.21.15.22:0/1603748190 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a8c0733c0 con 0x7f9a8c0c6000 2024-05-21T13:36:32.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.125+0000 7f9a8b7fe640 1 --2- 172.21.15.22:0/1603748190 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a8c0c6000 0x7f9a8c1594e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9a84097e60 tx=0x7f9a78005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:32.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.125+0000 7f9a83fff640 1 -- 172.21.15.22:0/1603748190 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a84007a80 con 0x7f9a8c0c6000 2024-05-21T13:36:32.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.125+0000 7f9a83fff640 1 -- 172.21.15.22:0/1603748190 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9a840013c0 con 0x7f9a8c0c6000 2024-05-21T13:36:32.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.125+0000 7f9a91857640 1 -- 172.21.15.22:0/1603748190 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a8c1f50f0 con 0x7f9a8c0c6000 2024-05-21T13:36:32.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.125+0000 7f9a83fff640 1 -- 172.21.15.22:0/1603748190 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a84005480 con 0x7f9a8c0c6000 2024-05-21T13:36:32.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.125+0000 7f9a91857640 1 -- 172.21.15.22:0/1603748190 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a8c1f56b0 con 0x7f9a8c0c6000 2024-05-21T13:36:32.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.125+0000 7f9a91857640 1 -- 172.21.15.22:0/1603748190 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a8c1f58f0 con 0x7f9a8c0c6000 2024-05-21T13:36:32.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.125+0000 7f9a83fff640 1 -- 172.21.15.22:0/1603748190 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f9a840067e0 con 0x7f9a8c0c6000 2024-05-21T13:36:32.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.125+0000 7f9a83fff640 1 --2- 172.21.15.22:0/1603748190 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f9a6c06f430 0x7f9a6c0718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:32.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.125+0000 7f9a83fff640 1 -- 172.21.15.22:0/1603748190 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f9a84128aa0 con 0x7f9a8c0c6000 2024-05-21T13:36:32.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.125+0000 7f9a8affd640 1 --2- 172.21.15.22:0/1603748190 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f9a6c06f430 0x7f9a6c0718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:32.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.125+0000 7f9a8affd640 1 --2- 172.21.15.22:0/1603748190 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f9a6c06f430 0x7f9a6c0718f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c007520 tx=0x7f9a7c00b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:32.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.129+0000 7f9a83fff640 1 -- 172.21.15.22:0/1603748190 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f9a8c1f58f0 con 0x7f9a8c0c6000 2024-05-21T13:36:32.306 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.329+0000 7f9a91857640 1 -- 172.21.15.22:0/1603748190 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9a8c077bb0 con 0x7f9a8c0c6000 2024-05-21T13:36:32.307 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.329+0000 7f9a83fff640 1 -- 172.21.15.22:0/1603748190 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+6871 (secure 0 0 0) 0x7f9a840a7070 con 0x7f9a8c0c6000 2024-05-21T13:36:32.307 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-21T13:36:32.307 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4224,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/355756580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":355756580},{"type":"v1","addr":"172.21.15.22:6833","nonce":355756580}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4230,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3277017116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":3277017116},{"type":"v1","addr":"172.21.15.22:6835","nonce":3277017116}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4233,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3840772609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3840772609},{"type":"v1","addr":"172.21.15.22:6837","nonce":3840772609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-21T13:35:57.106892+0000","modified":"2024-05-21T13:36:26.994036+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4300,"mds_1":4294,"mds_2":4248},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4248":{"gid":4248,"name":"d","rank":2,"incarnation":13,"state":"up:creating","state_seq":1,"addr":"172.21.15.115:6837/2009761279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":2009761279},{"type":"v1","addr":"172.21.15.115:6837","nonce":2009761279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4294":{"gid":4294,"name":"b","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.115:6835/3894678097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3894678097},{"type":"v1","addr":"172.21.15.115:6835","nonce":3894678097}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4300":{"gid":4300,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.115:6839/1525097577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6838","nonce":1525097577},{"type":"v1","addr":"172.21.15.115:6839","nonce":1525097577}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4300,"qdb_cluster":[4300,4294]},"id":1}]} 2024-05-21T13:36:32.307 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 13 2024-05-21T13:36:32.309 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.329+0000 7f9a91857640 1 -- 172.21.15.22:0/1603748190 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f9a6c06f430 msgr2=0x7f9a6c0718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:32.309 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.329+0000 7f9a91857640 1 --2- 172.21.15.22:0/1603748190 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f9a6c06f430 0x7f9a6c0718f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c007520 tx=0x7f9a7c00b040 comp rx=0 tx=0).stop 2024-05-21T13:36:32.309 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.329+0000 7f9a91857640 1 -- 172.21.15.22:0/1603748190 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a8c0c6000 msgr2=0x7f9a8c1594e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:32.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.329+0000 7f9a91857640 1 --2- 172.21.15.22:0/1603748190 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a8c0c6000 0x7f9a8c1594e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f9a84097e60 tx=0x7f9a78005840 comp rx=0 tx=0).stop 2024-05-21T13:36:32.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.329+0000 7f9a91857640 1 -- 172.21.15.22:0/1603748190 shutdown_connections 2024-05-21T13:36:32.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.329+0000 7f9a91857640 1 --2- 172.21.15.22:0/1603748190 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f9a6c06f430 0x7f9a6c0718f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:32.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.329+0000 7f9a91857640 1 --2- 172.21.15.22:0/1603748190 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f9a8c0c6000 0x7f9a8c1594e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:32.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.329+0000 7f9a91857640 1 --2- 172.21.15.22:0/1603748190 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f9a8c0cd050 0x7f9a8c1f4a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:32.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.329+0000 7f9a91857640 1 --2- 172.21.15.22:0/1603748190 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f9a8c0ccc70 0x7f9a8c1f1470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:32.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.329+0000 7f9a91857640 1 -- 172.21.15.22:0/1603748190 >> 172.21.15.22:0/1603748190 conn(0x7f9a8c0cd9a0 msgr2=0x7f9a8c14ffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:32.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.329+0000 7f9a91857640 1 -- 172.21.15.22:0/1603748190 shutdown_connections 2024-05-21T13:36:32.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.329+0000 7f9a91857640 1 -- 172.21.15.22:0/1603748190 wait complete. 2024-05-21T13:36:32.325 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-21T13:36:32.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.461+0000 7fd61baf6640 1 Processor -- start 2024-05-21T13:36:32.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.461+0000 7fd61baf6640 1 -- start start 2024-05-21T13:36:32.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.461+0000 7fd61baf6640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd614152b20 0x7fd6140c5790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:32.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.461+0000 7fd61baf6640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd61406e680 0x7fd614070eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:32.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.461+0000 7fd61baf6640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd61406e280 con 0x7fd6140713f0 2024-05-21T13:36:32.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.461+0000 7fd61baf6640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7fd6140c8700 con 0x7fd61406e680 2024-05-21T13:36:32.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.461+0000 7fd61baf6640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7fd61406dcc0 con 0x7fd614152b20 2024-05-21T13:36:32.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.461+0000 7fd619892640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd614152b20 0x7fd6140c5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:32.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.461+0000 7fd619091640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fd61406e680 0x7fd614070eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:32.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.461+0000 7fd619892640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd614152b20 0x7fd6140c5790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.22:42432/0 (socket says 172.21.15.22:42432) 2024-05-21T13:36:32.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.461+0000 7fd619892640 1 -- 172.21.15.22:0/2668784661 learned_addr learned my addr 172.21.15.22:0/2668784661 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:32.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.461+0000 7fd619892640 1 -- 172.21.15.22:0/2668784661 >> v2:172.21.15.115:3300/0 conn(0x7fd61406e680 msgr2=0x7fd614070eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:32.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.461+0000 7fd619892640 1 --2- 172.21.15.22:0/2668784661 >> v2:172.21.15.115:3300/0 conn(0x7fd61406e680 0x7fd614070eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:32.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.461+0000 7fd619892640 1 -- 172.21.15.22:0/2668784661 >> v1:172.21.15.115:6789/0 conn(0x7fd6140713f0 legacy=0x7fd61415bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:32.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.461+0000 7fd619892640 1 -- 172.21.15.22:0/2668784661 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd61406dfa0 con 0x7fd614152b20 2024-05-21T13:36:32.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.461+0000 7fd619091640 1 --2- 172.21.15.22:0/2668784661 >> v2:172.21.15.115:3300/0 conn(0x7fd61406e680 0x7fd614070eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-21T13:36:32.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.465+0000 7fd619892640 1 --2- 172.21.15.22:0/2668784661 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd614152b20 0x7fd6140c5790 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd61000bb10 tx=0x7fd61001ec30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cddbd5257fa130fd server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:32.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.465+0000 7fd618890640 1 -- 172.21.15.22:0/2668784661 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6100b4070 con 0x7fd614152b20 2024-05-21T13:36:32.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.465+0000 7fd618890640 1 -- 172.21.15.22:0/2668784661 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6100a7a00 con 0x7fd614152b20 2024-05-21T13:36:32.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.465+0000 7fd618890640 1 -- 172.21.15.22:0/2668784661 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6100a7dd0 con 0x7fd614152b20 2024-05-21T13:36:32.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.465+0000 7fd61baf6640 1 -- 172.21.15.22:0/2668784661 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd614152b20 msgr2=0x7fd6140c5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:32.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.465+0000 7fd61baf6640 1 --2- 172.21.15.22:0/2668784661 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd614152b20 0x7fd6140c5790 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd61000bb10 tx=0x7fd61001ec30 comp rx=0 tx=0).stop 2024-05-21T13:36:32.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.465+0000 7fd61baf6640 1 -- 172.21.15.22:0/2668784661 shutdown_connections 2024-05-21T13:36:32.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.465+0000 7fd61baf6640 1 --2- 172.21.15.22:0/2668784661 >> v2:172.21.15.115:3300/0 conn(0x7fd61406e680 0x7fd614070eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:32.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.465+0000 7fd61baf6640 1 --2- 172.21.15.22:0/2668784661 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd614152b20 0x7fd6140c5790 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:32.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.465+0000 7fd61baf6640 1 -- 172.21.15.22:0/2668784661 >> 172.21.15.22:0/2668784661 conn(0x7fd6140ce290 msgr2=0x7fd6140ce6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:32.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.465+0000 7fd61baf6640 1 -- 172.21.15.22:0/2668784661 shutdown_connections 2024-05-21T13:36:32.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.465+0000 7fd61baf6640 1 -- 172.21.15.22:0/2668784661 wait complete. 2024-05-21T13:36:32.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.465+0000 7fd61baf6640 1 Processor -- start 2024-05-21T13:36:32.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.465+0000 7fd61baf6640 1 -- start start 2024-05-21T13:36:32.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.465+0000 7fd61baf6640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd61406e680 0x7fd61414edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:32.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.465+0000 7fd61baf6640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6140713f0 0x7fd614145380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:32.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.465+0000 7fd61baf6640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd614152b20 0x7fd61415aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:32.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.465+0000 7fd61baf6640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fd614152f00 con 0x7fd6140713f0 2024-05-21T13:36:32.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.465+0000 7fd61baf6640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fd6140c5cd0 con 0x7fd614152b20 2024-05-21T13:36:32.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.465+0000 7fd61baf6640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7fd614153080 con 0x7fd61406e680 2024-05-21T13:36:32.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.465+0000 7fd619091640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6140713f0 0x7fd614145380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:32.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.465+0000 7fd619091640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6140713f0 0x7fd614145380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48640/0 (socket says 172.21.15.22:48640) 2024-05-21T13:36:32.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.465+0000 7fd619091640 1 -- 172.21.15.22:0/3434309430 learned_addr learned my addr 172.21.15.22:0/3434309430 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:32.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.469+0000 7fd619892640 1 --2- 172.21.15.22:0/3434309430 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd61406e680 0x7fd61414edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:32.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.469+0000 7fd61a093640 1 --2- 172.21.15.22:0/3434309430 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd614152b20 0x7fd61415aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:32.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.469+0000 7fd619091640 1 -- 172.21.15.22:0/3434309430 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd61406e680 msgr2=0x7fd61414edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:32.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.469+0000 7fd619091640 1 --2- 172.21.15.22:0/3434309430 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd61406e680 0x7fd61414edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:32.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.469+0000 7fd619091640 1 -- 172.21.15.22:0/3434309430 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd614152b20 msgr2=0x7fd61415aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:32.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.469+0000 7fd619091640 1 --2- 172.21.15.22:0/3434309430 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd614152b20 0x7fd61415aab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:32.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.469+0000 7fd619091640 1 -- 172.21.15.22:0/3434309430 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd61414f300 con 0x7fd6140713f0 2024-05-21T13:36:32.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.469+0000 7fd619091640 1 --2- 172.21.15.22:0/3434309430 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6140713f0 0x7fd614145380 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd60400e9e0 tx=0x7fd60400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:32.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.469+0000 7fd60a7fc640 1 -- 172.21.15.22:0/3434309430 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd604017070 con 0x7fd6140713f0 2024-05-21T13:36:32.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.469+0000 7fd60a7fc640 1 -- 172.21.15.22:0/3434309430 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd60400c9d0 con 0x7fd6140713f0 2024-05-21T13:36:32.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.469+0000 7fd61baf6640 1 -- 172.21.15.22:0/3434309430 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6141f4170 con 0x7fd6140713f0 2024-05-21T13:36:32.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.469+0000 7fd60a7fc640 1 -- 172.21.15.22:0/3434309430 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd60400cdc0 con 0x7fd6140713f0 2024-05-21T13:36:32.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.469+0000 7fd61baf6640 1 -- 172.21.15.22:0/3434309430 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6141f4730 con 0x7fd6140713f0 2024-05-21T13:36:32.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.469+0000 7fd61baf6640 1 -- 172.21.15.22:0/3434309430 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd614162e00 con 0x7fd6140713f0 2024-05-21T13:36:32.449 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.469+0000 7fd60a7fc640 1 -- 172.21.15.22:0/3434309430 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fd60401a070 con 0x7fd6140713f0 2024-05-21T13:36:32.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.469+0000 7fd60a7fc640 1 --2- 172.21.15.22:0/3434309430 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fd5f806f400 0x7fd5f80718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:32.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.469+0000 7fd60a7fc640 1 -- 172.21.15.22:0/3434309430 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fd60408f060 con 0x7fd6140713f0 2024-05-21T13:36:32.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.469+0000 7fd619892640 1 --2- 172.21.15.22:0/3434309430 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fd5f806f400 0x7fd5f80718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:32.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.469+0000 7fd619892640 1 --2- 172.21.15.22:0/3434309430 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fd5f806f400 0x7fd5f80718c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd6100b1000 tx=0x7fd6100a9070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:32.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.473+0000 7fd60a7fc640 1 -- 172.21.15.22:0/3434309430 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fd60405bc90 con 0x7fd6140713f0 2024-05-21T13:36:32.612 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.633+0000 7fd61baf6640 1 -- 172.21.15.22:0/3434309430 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd61406e460 con 0x7fd6140713f0 2024-05-21T13:36:32.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.637+0000 7fd60a7fc640 1 -- 172.21.15.22:0/3434309430 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18458 (secure 0 0 0) 0x7fd60405b590 con 0x7fd6140713f0 2024-05-21T13:36:32.615 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-21T13:36:32.615 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":25,"fsid":"f2c96204-e240-4e7f-8a76-927b4f80f534","created":"2024-05-21T13:35:33.827005+0000","modified":"2024-05-21T13:36:02.190808+0000","last_up_change":"2024-05-21T13:35:44.542324+0000","last_in_change":"2024-05-21T13:35:36.061492+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-21T13:35:44.536105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-21T13:35:54.972996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-21T13:35:56.065755+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-21T13:35:59.791448+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"09157d4a-9443-4e10-bbb3-cf8ed7c42cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":222752954},{"type":"v1","addr":"172.21.15.22:6801","nonce":222752954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":222752954},{"type":"v1","addr":"172.21.15.22:6803","nonce":222752954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":222752954},{"type":"v1","addr":"172.21.15.22:6807","nonce":222752954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":222752954},{"type":"v1","addr":"172.21.15.22:6805","nonce":222752954}]},"public_addr":"172.21.15.22:6801/222752954","cluster_addr":"172.21.15.22:6803/222752954","heartbeat_back_addr":"172.21.15.22:6807/222752954","heartbeat_front_addr":"172.21.15.22:6805/222752954","state":["exists","up"]},{"osd":1,"uuid":"2a6a87c0-01ad-4a98-a538-c0a8e865b05d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":685426272},{"type":"v1","addr":"172.21.15.22:6809","nonce":685426272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":685426272},{"type":"v1","addr":"172.21.15.22:6811","nonce":685426272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":685426272},{"type":"v1","addr":"172.21.15.22:6815","nonce":685426272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":685426272},{"type":"v1","addr":"172.21.15.22:6813","nonce":685426272}]},"public_addr":"172.21.15.22:6809/685426272","cluster_addr":"172.21.15.22:6811/685426272","heartbeat_back_addr":"172.21.15.22:6815/685426272","heartbeat_front_addr":"172.21.15.22:6813/685426272","state":["exists","up"]},{"osd":2,"uuid":"4c18f931-40a4-46ac-a752-0d1be35b01a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":2092224336},{"type":"v1","addr":"172.21.15.22:6817","nonce":2092224336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":2092224336},{"type":"v1","addr":"172.21.15.22:6819","nonce":2092224336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":2092224336},{"type":"v1","addr":"172.21.15.22:6823","nonce":2092224336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":2092224336},{"type":"v1","addr":"172.21.15.22:6821","nonce":2092224336}]},"public_addr":"172.21.15.22:6817/2092224336","cluster_addr":"172.21.15.22:6819/2092224336","heartbeat_back_addr":"172.21.15.22:6823/2092224336","heartbeat_front_addr":"172.21.15.22:6821/2092224336","state":["exists","up"]},{"osd":3,"uuid":"d57ee7fd-b73e-41ec-8e3b-e62fb8898128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":1232311110},{"type":"v1","addr":"172.21.15.22:6825","nonce":1232311110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":1232311110},{"type":"v1","addr":"172.21.15.22:6827","nonce":1232311110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":1232311110},{"type":"v1","addr":"172.21.15.22:6831","nonce":1232311110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":1232311110},{"type":"v1","addr":"172.21.15.22:6829","nonce":1232311110}]},"public_addr":"172.21.15.22:6825/1232311110","cluster_addr":"172.21.15.22:6827/1232311110","heartbeat_back_addr":"172.21.15.22:6831/1232311110","heartbeat_front_addr":"172.21.15.22:6829/1232311110","state":["exists","up"]},{"osd":4,"uuid":"43c6494f-352b-42a7-b6a9-fe7e3573fab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":832695158},{"type":"v1","addr":"172.21.15.115:6801","nonce":832695158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":832695158},{"type":"v1","addr":"172.21.15.115:6803","nonce":832695158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":832695158},{"type":"v1","addr":"172.21.15.115:6807","nonce":832695158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":832695158},{"type":"v1","addr":"172.21.15.115:6805","nonce":832695158}]},"public_addr":"172.21.15.115:6801/832695158","cluster_addr":"172.21.15.115:6803/832695158","heartbeat_back_addr":"172.21.15.115:6807/832695158","heartbeat_front_addr":"172.21.15.115:6805/832695158","state":["exists","up"]},{"osd":5,"uuid":"25fc861c-593d-4d49-942a-c75c19f25994","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":1504764223},{"type":"v1","addr":"172.21.15.115:6815","nonce":1504764223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":1504764223},{"type":"v1","addr":"172.21.15.115:6823","nonce":1504764223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":1504764223},{"type":"v1","addr":"172.21.15.115:6830","nonce":1504764223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6825","nonce":1504764223},{"type":"v1","addr":"172.21.15.115:6827","nonce":1504764223}]},"public_addr":"172.21.15.115:6815/1504764223","cluster_addr":"172.21.15.115:6823/1504764223","heartbeat_back_addr":"172.21.15.115:6830/1504764223","heartbeat_front_addr":"172.21.15.115:6827/1504764223","state":["exists","up"]},{"osd":6,"uuid":"2e7fb0b8-1162-497f-bffc-e2c02b9b9ef4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":959292720},{"type":"v1","addr":"172.21.15.115:6809","nonce":959292720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":959292720},{"type":"v1","addr":"172.21.15.115:6813","nonce":959292720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":959292720},{"type":"v1","addr":"172.21.15.115:6822","nonce":959292720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":959292720},{"type":"v1","addr":"172.21.15.115:6818","nonce":959292720}]},"public_addr":"172.21.15.115:6809/959292720","cluster_addr":"172.21.15.115:6813/959292720","heartbeat_back_addr":"172.21.15.115:6822/959292720","heartbeat_front_addr":"172.21.15.115:6818/959292720","state":["exists","up"]},{"osd":7,"uuid":"a97df0dc-e370-45ce-8742-25ae31e2212e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6811","nonce":20268513},{"type":"v1","addr":"172.21.15.115:6814","nonce":20268513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":20268513},{"type":"v1","addr":"172.21.15.115:6821","nonce":20268513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6829","nonce":20268513},{"type":"v1","addr":"172.21.15.115:6831","nonce":20268513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":20268513},{"type":"v1","addr":"172.21.15.115:6826","nonce":20268513}]},"public_addr":"172.21.15.115:6814/20268513","cluster_addr":"172.21.15.115:6821/20268513","heartbeat_back_addr":"172.21.15.115:6831/20268513","heartbeat_front_addr":"172.21.15.115:6826/20268513","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.692890+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.545577+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.712724+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.681944+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.492954+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.553222+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.597022+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.601698+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-21T13:36:32.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.637+0000 7fd61baf6640 1 -- 172.21.15.22:0/3434309430 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fd5f806f400 msgr2=0x7fd5f80718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:32.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.637+0000 7fd61baf6640 1 --2- 172.21.15.22:0/3434309430 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fd5f806f400 0x7fd5f80718c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd6100b1000 tx=0x7fd6100a9070 comp rx=0 tx=0).stop 2024-05-21T13:36:32.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.637+0000 7fd61baf6640 1 -- 172.21.15.22:0/3434309430 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6140713f0 msgr2=0x7fd614145380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:32.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.637+0000 7fd61baf6640 1 --2- 172.21.15.22:0/3434309430 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6140713f0 0x7fd614145380 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fd60400e9e0 tx=0x7fd60400eea0 comp rx=0 tx=0).stop 2024-05-21T13:36:32.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.637+0000 7fd61baf6640 1 -- 172.21.15.22:0/3434309430 shutdown_connections 2024-05-21T13:36:32.618 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.637+0000 7fd61baf6640 1 --2- 172.21.15.22:0/3434309430 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fd5f806f400 0x7fd5f80718c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:32.618 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.637+0000 7fd61baf6640 1 --2- 172.21.15.22:0/3434309430 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fd614152b20 0x7fd61415aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:32.618 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.637+0000 7fd61baf6640 1 --2- 172.21.15.22:0/3434309430 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fd6140713f0 0x7fd614145380 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:32.618 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.637+0000 7fd61baf6640 1 --2- 172.21.15.22:0/3434309430 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fd61406e680 0x7fd61414edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:32.618 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.637+0000 7fd61baf6640 1 -- 172.21.15.22:0/3434309430 >> 172.21.15.22:0/3434309430 conn(0x7fd6140ce290 msgr2=0x7fd6140c52e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:32.618 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.637+0000 7fd61baf6640 1 -- 172.21.15.22:0/3434309430 shutdown_connections 2024-05-21T13:36:32.618 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.637+0000 7fd61baf6640 1 -- 172.21.15.22:0/3434309430 wait complete. 2024-05-21T13:36:32.633 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-21T13:36:32.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.769+0000 7f65df943640 1 Processor -- start 2024-05-21T13:36:32.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.769+0000 7f65df943640 1 -- start start 2024-05-21T13:36:32.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.773+0000 7f65df943640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f65d80c9e30 0x7f65d80ca280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:32.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.773+0000 7f65df943640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65d81530a0 con 0x7f65d80c4bf0 2024-05-21T13:36:32.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.773+0000 7f65df943640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65d80c5060 con 0x7f65d8152cc0 2024-05-21T13:36:32.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.773+0000 7f65df943640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f65d81592b0 con 0x7f65d80c9e30 2024-05-21T13:36:32.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.773+0000 7f65dcede640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f65d80c4bf0 0x7f65d80c7df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:44646/0 (socket says 172.21.15.22:44646) 2024-05-21T13:36:32.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.773+0000 7f65dcede640 1 -- 172.21.15.22:0/1921911894 learned_addr learned my addr 172.21.15.22:0/1921911894 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-21T13:36:32.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.773+0000 7f65ddee0640 1 --2- 172.21.15.22:0/1921911894 >> v2:172.21.15.115:3300/0 conn(0x7f65d80c9e30 0x7f65d80ca280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:32.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.773+0000 7f65cffff640 1 -- 172.21.15.22:0/1921911894 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2622656052 0 0) 0x7f65d81530a0 con 0x7f65d80c4bf0 2024-05-21T13:36:32.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.773+0000 7f65cffff640 1 -- 172.21.15.22:0/1921911894 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f65c4003530 con 0x7f65d80c4bf0 2024-05-21T13:36:32.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.773+0000 7f65cffff640 1 -- 172.21.15.22:0/1921911894 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4000063125 0 0) 0x7f65c4003530 con 0x7f65d80c4bf0 2024-05-21T13:36:32.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.773+0000 7f65cffff640 1 -- 172.21.15.22:0/1921911894 >> v2:172.21.15.115:3300/0 conn(0x7f65d80c9e30 msgr2=0x7f65d80ca280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:32.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.773+0000 7f65cffff640 1 --2- 172.21.15.22:0/1921911894 >> v2:172.21.15.115:3300/0 conn(0x7f65d80c9e30 0x7f65d80ca280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:32.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.773+0000 7f65cffff640 1 -- 172.21.15.22:0/1921911894 >> v1:172.21.15.115:6789/0 conn(0x7f65d8152cc0 legacy=0x7f65d80c66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:32.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.773+0000 7f65cffff640 1 -- 172.21.15.22:0/1921911894 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65d81589a0 con 0x7f65d80c4bf0 2024-05-21T13:36:32.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.773+0000 7f65cffff640 1 -- 172.21.15.22:0/1921911894 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2684847062 0 0) 0x7f65c8001700 con 0x7f65d80c4bf0 2024-05-21T13:36:32.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.773+0000 7f65cffff640 1 -- 172.21.15.22:0/1921911894 >> v1:172.21.15.22:6789/0 conn(0x7f65d80c4bf0 legacy=0x7f65d80c7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:32.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.773+0000 7f65cffff640 1 --2- 172.21.15.22:0/1921911894 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f65c4003ab0 0x7f65c4003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:32.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.773+0000 7f65cffff640 1 --2- 172.21.15.22:0/1921911894 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f65c4004810 0x7f65c4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:32.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.773+0000 7f65cffff640 1 --2- 172.21.15.22:0/1921911894 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f65c4005240 0x7f65c400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:32.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.773+0000 7f65cffff640 1 -- 172.21.15.22:0/1921911894 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f65d81592b0 con 0x7f65c4003ab0 2024-05-21T13:36:32.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.773+0000 7f65cffff640 1 -- 172.21.15.22:0/1921911894 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f65c400c1a0 con 0x7f65c4005240 2024-05-21T13:36:32.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.773+0000 7f65cffff640 1 -- 172.21.15.22:0/1921911894 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f65c400c3a0 con 0x7f65c4004810 2024-05-21T13:36:32.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.773+0000 7f65dd6df640 1 --2- 172.21.15.22:0/1921911894 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f65c4003ab0 0x7f65c4003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:32.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.773+0000 7f65dcede640 1 --2- 172.21.15.22:0/1921911894 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f65c4004810 0x7f65c4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:32.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.773+0000 7f65ddee0640 1 --2- 172.21.15.22:0/1921911894 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f65c4005240 0x7f65c400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:32.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.773+0000 7f65dd6df640 1 -- 172.21.15.22:0/1921911894 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f65c4004810 msgr2=0x7f65c4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:32.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.773+0000 7f65dd6df640 1 --2- 172.21.15.22:0/1921911894 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f65c4004810 0x7f65c4004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:32.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.773+0000 7f65dd6df640 1 -- 172.21.15.22:0/1921911894 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f65c4005240 msgr2=0x7f65c400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:32.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.773+0000 7f65dd6df640 1 --2- 172.21.15.22:0/1921911894 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f65c4005240 0x7f65c400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:32.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.773+0000 7f65dd6df640 1 -- 172.21.15.22:0/1921911894 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65c4003530 con 0x7f65c4003ab0 2024-05-21T13:36:32.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.773+0000 7f65ddee0640 1 -- 172.21.15.22:0/1921911894 reap_dead start 2024-05-21T13:36:32.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.773+0000 7f65dd6df640 1 --2- 172.21.15.22:0/1921911894 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f65c4003ab0 0x7f65c4003ef0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f65d4001790 tx=0x7f65d401c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69a6fe9e7e9269ef server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:32.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.773+0000 7f65cffff640 1 -- 172.21.15.22:0/1921911894 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65d40013e0 con 0x7f65c4003ab0 2024-05-21T13:36:32.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.773+0000 7f65cffff640 1 -- 172.21.15.22:0/1921911894 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65d40052d0 con 0x7f65c4003ab0 2024-05-21T13:36:32.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.773+0000 7f65cffff640 1 -- 172.21.15.22:0/1921911894 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65d4003840 con 0x7f65c4003ab0 2024-05-21T13:36:32.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.777+0000 7f65df943640 1 -- 172.21.15.22:0/1921911894 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f65c4003ab0 msgr2=0x7f65c4003ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:32.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.777+0000 7f65df943640 1 --2- 172.21.15.22:0/1921911894 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f65c4003ab0 0x7f65c4003ef0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f65d4001790 tx=0x7f65d401c2d0 comp rx=0 tx=0).stop 2024-05-21T13:36:32.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.777+0000 7f65df943640 1 -- 172.21.15.22:0/1921911894 shutdown_connections 2024-05-21T13:36:32.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.777+0000 7f65df943640 1 --2- 172.21.15.22:0/1921911894 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f65c4003ab0 0x7f65c4003ef0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:32.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.777+0000 7f65df943640 1 -- 172.21.15.22:0/1921911894 >> 172.21.15.22:0/1921911894 conn(0x7f65d806ea10 msgr2=0x7f65d806ff50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:32.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.777+0000 7f65df943640 1 -- 172.21.15.22:0/1921911894 shutdown_connections 2024-05-21T13:36:32.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.777+0000 7f65df943640 1 -- 172.21.15.22:0/1921911894 wait complete. 2024-05-21T13:36:32.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.777+0000 7f65df943640 1 Processor -- start 2024-05-21T13:36:32.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.777+0000 7f65df943640 1 -- start start 2024-05-21T13:36:32.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.777+0000 7f65df943640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f65c4003ab0 0x7f65d8157fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:32.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.777+0000 7f65df943640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f65d8159b60 0x7f65d815b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:32.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.777+0000 7f65df943640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f65d814c870 0x7f65d815bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:32.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.777+0000 7f65df943640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f65d8158f40 con 0x7f65d8159b60 2024-05-21T13:36:32.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.777+0000 7f65df943640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f65d80ca650 con 0x7f65d814c870 2024-05-21T13:36:32.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.777+0000 7f65df943640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f65d8159720 con 0x7f65c4003ab0 2024-05-21T13:36:32.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.777+0000 7f65dcede640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f65d8159b60 0x7f65d815b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:32.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.777+0000 7f65dcede640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f65d8159b60 0x7f65d815b7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48650/0 (socket says 172.21.15.22:48650) 2024-05-21T13:36:32.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.777+0000 7f65dcede640 1 -- 172.21.15.22:0/3499368807 learned_addr learned my addr 172.21.15.22:0/3499368807 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:32.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.777+0000 7f65ddee0640 1 --2- 172.21.15.22:0/3499368807 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f65d814c870 0x7f65d815bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:32.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.777+0000 7f65dd6df640 1 --2- 172.21.15.22:0/3499368807 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f65c4003ab0 0x7f65d8157fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:32.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.777+0000 7f65dcede640 1 -- 172.21.15.22:0/3499368807 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f65c4003ab0 msgr2=0x7f65d8157fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:32.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.777+0000 7f65dcede640 1 --2- 172.21.15.22:0/3499368807 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f65c4003ab0 0x7f65d8157fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:32.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.777+0000 7f65dcede640 1 -- 172.21.15.22:0/3499368807 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f65d814c870 msgr2=0x7f65d815bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:32.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.777+0000 7f65dcede640 1 --2- 172.21.15.22:0/3499368807 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f65d814c870 0x7f65d815bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:32.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.777+0000 7f65dcede640 1 -- 172.21.15.22:0/3499368807 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65d815a710 con 0x7f65d8159b60 2024-05-21T13:36:32.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.777+0000 7f65ddee0640 1 --2- 172.21.15.22:0/3499368807 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f65d814c870 0x7f65d815bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T13:36:32.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.777+0000 7f65dd6df640 1 --2- 172.21.15.22:0/3499368807 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f65c4003ab0 0x7f65d8157fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:36:32.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.777+0000 7f65dcede640 1 --2- 172.21.15.22:0/3499368807 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f65d8159b60 0x7f65d815b7b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f65c800e6d0 tx=0x7f65c800eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:32.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.777+0000 7f65cdffb640 1 -- 172.21.15.22:0/3499368807 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c800c6c0 con 0x7f65d8159b60 2024-05-21T13:36:32.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.777+0000 7f65cdffb640 1 -- 172.21.15.22:0/3499368807 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65c8018070 con 0x7f65d8159b60 2024-05-21T13:36:32.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.777+0000 7f65cdffb640 1 -- 172.21.15.22:0/3499368807 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65c800caa0 con 0x7f65d8159b60 2024-05-21T13:36:32.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.777+0000 7f65df943640 1 -- 172.21.15.22:0/3499368807 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65d815a9f0 con 0x7f65d8159b60 2024-05-21T13:36:32.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.777+0000 7f65df943640 1 -- 172.21.15.22:0/3499368807 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65d815afb0 con 0x7f65d8159b60 2024-05-21T13:36:32.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.777+0000 7f65df943640 1 -- 172.21.15.22:0/3499368807 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65d8077bb0 con 0x7f65d8159b60 2024-05-21T13:36:32.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.781+0000 7f65cdffb640 1 -- 172.21.15.22:0/3499368807 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f65c800cc40 con 0x7f65d8159b60 2024-05-21T13:36:32.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.781+0000 7f65cdffb640 1 --2- 172.21.15.22:0/3499368807 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f65bc06f430 0x7f65bc0718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:32.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.781+0000 7f65cdffb640 1 -- 172.21.15.22:0/3499368807 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f65c808f410 con 0x7f65d8159b60 2024-05-21T13:36:32.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.781+0000 7f65dd6df640 1 --2- 172.21.15.22:0/3499368807 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f65bc06f430 0x7f65bc0718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:32.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.781+0000 7f65dd6df640 1 --2- 172.21.15.22:0/3499368807 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f65bc06f430 0x7f65bc0718f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f65d40ac000 tx=0x7f65d4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:32.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.785+0000 7f65cdffb640 1 -- 172.21.15.22:0/3499368807 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f65c805bf20 con 0x7f65d8159b60 2024-05-21T13:36:32.960 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.981+0000 7f65df943640 1 -- 172.21.15.22:0/3499368807 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f65d8151e70 con 0x7f65d8159b60 2024-05-21T13:36:32.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.981+0000 7f65cdffb640 1 -- 172.21.15.22:0/3499368807 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6875 (secure 0 0 0) 0x7f65c805b820 con 0x7f65d8159b60 2024-05-21T13:36:32.962 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-21T13:36:32.962 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4224,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/355756580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":355756580},{"type":"v1","addr":"172.21.15.22:6833","nonce":355756580}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4230,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3277017116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":3277017116},{"type":"v1","addr":"172.21.15.22:6835","nonce":3277017116}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4233,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3840772609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3840772609},{"type":"v1","addr":"172.21.15.22:6837","nonce":3840772609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-21T13:35:57.106892+0000","modified":"2024-05-21T13:36:32.396351+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4300,"mds_1":4294,"mds_2":4248},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4248":{"gid":4248,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":12,"addr":"172.21.15.115:6837/2009761279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":2009761279},{"type":"v1","addr":"172.21.15.115:6837","nonce":2009761279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4294":{"gid":4294,"name":"b","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.115:6835/3894678097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3894678097},{"type":"v1","addr":"172.21.15.115:6835","nonce":3894678097}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4300":{"gid":4300,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.115:6839/1525097577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6838","nonce":1525097577},{"type":"v1","addr":"172.21.15.115:6839","nonce":1525097577}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4300,"qdb_cluster":[4248,4300,4294]},"id":1}]} 2024-05-21T13:36:32.963 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 14 2024-05-21T13:36:32.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.985+0000 7f65df943640 1 -- 172.21.15.22:0/3499368807 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f65bc06f430 msgr2=0x7f65bc0718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:32.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.985+0000 7f65df943640 1 --2- 172.21.15.22:0/3499368807 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f65bc06f430 0x7f65bc0718f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f65d40ac000 tx=0x7f65d4009040 comp rx=0 tx=0).stop 2024-05-21T13:36:32.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.985+0000 7f65df943640 1 -- 172.21.15.22:0/3499368807 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f65d8159b60 msgr2=0x7f65d815b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:32.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.985+0000 7f65df943640 1 --2- 172.21.15.22:0/3499368807 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f65d8159b60 0x7f65d815b7b0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f65c800e6d0 tx=0x7f65c800eb90 comp rx=0 tx=0).stop 2024-05-21T13:36:32.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.985+0000 7f65df943640 1 -- 172.21.15.22:0/3499368807 shutdown_connections 2024-05-21T13:36:32.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.985+0000 7f65df943640 1 --2- 172.21.15.22:0/3499368807 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f65bc06f430 0x7f65bc0718f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:32.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.985+0000 7f65df943640 1 --2- 172.21.15.22:0/3499368807 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f65d814c870 0x7f65d815bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:32.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.985+0000 7f65df943640 1 --2- 172.21.15.22:0/3499368807 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f65d8159b60 0x7f65d815b7b0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:32.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.985+0000 7f65df943640 1 --2- 172.21.15.22:0/3499368807 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f65c4003ab0 0x7f65d8157fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:32.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.985+0000 7f65df943640 1 -- 172.21.15.22:0/3499368807 >> 172.21.15.22:0/3499368807 conn(0x7f65d806ea10 msgr2=0x7f65d814f480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:32.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.985+0000 7f65df943640 1 -- 172.21.15.22:0/3499368807 shutdown_connections 2024-05-21T13:36:32.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:32.985+0000 7f65df943640 1 -- 172.21.15.22:0/3499368807 wait complete. 2024-05-21T13:36:33.584 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 14, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-21T13:35:57.106892+0000', 'modified': '2024-05-21T13:36:32.396351+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 4300, 'mds_1': 4294, 'mds_2': 4248}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4248': {'gid': 4248, 'name': 'd', 'rank': 2, 'incarnation': 13, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.115:6837/2009761279', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6836', 'nonce': 2009761279}, {'type': 'v1', 'addr': '172.21.15.115:6837', 'nonce': 2009761279}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4294': {'gid': 4294, 'name': 'b', 'rank': 1, 'incarnation': 9, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.115:6835/3894678097', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6834', 'nonce': 3894678097}, {'type': 'v1', 'addr': '172.21.15.115:6835', 'nonce': 3894678097}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4300': {'gid': 4300, 'name': 'f', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.115:6839/1525097577', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6838', 'nonce': 1525097577}, {'type': 'v1', 'addr': '172.21.15.115:6839', 'nonce': 1525097577}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4300, 'qdb_cluster': [4248, 4300, 4294]} 2024-05-21T13:36:33.584 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-05-21T13:36:33.585 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-05-21T13:36:33.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.741+0000 7f48f4856640 1 Processor -- start 2024-05-21T13:36:33.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.741+0000 7f48f4856640 1 -- start start 2024-05-21T13:36:33.723 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.745+0000 7f48f4856640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f48f00cceb0 0x7f48f01652a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:33.723 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.745+0000 7f48f4856640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48f015da90 con 0x7f48f0153ae0 2024-05-21T13:36:33.723 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.745+0000 7f48f4856640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f48f015dd70 con 0x7f48f00caee0 2024-05-21T13:36:33.723 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.745+0000 7f48f4856640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f48f00cbab0 con 0x7f48f00cceb0 2024-05-21T13:36:33.723 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.745+0000 7f48ee59c640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f48f0153ae0 0x7f48f00cb3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:44662/0 (socket says 172.21.15.22:44662) 2024-05-21T13:36:33.724 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.745+0000 7f48ee59c640 1 -- 172.21.15.22:0/906550801 learned_addr learned my addr 172.21.15.22:0/906550801 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-21T13:36:33.724 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.745+0000 7f48edd9b640 1 -- 172.21.15.22:0/906550801 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2957195835 0 0) 0x7f48f015da90 con 0x7f48f0153ae0 2024-05-21T13:36:33.724 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.745+0000 7f48edd9b640 1 -- 172.21.15.22:0/906550801 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f48dc003530 con 0x7f48f0153ae0 2024-05-21T13:36:33.724 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.745+0000 7f48eed9d640 1 --2- 172.21.15.22:0/906550801 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f48f00cceb0 0x7f48f01652a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:33.724 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.745+0000 7f48edd9b640 1 -- 172.21.15.22:0/906550801 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3003582717 0 0) 0x7f48dc003530 con 0x7f48f0153ae0 2024-05-21T13:36:33.724 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.745+0000 7f48edd9b640 1 -- 172.21.15.22:0/906550801 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f48f00cceb0 msgr2=0x7f48f01652a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:33.724 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.745+0000 7f48edd9b640 1 --2- 172.21.15.22:0/906550801 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f48f00cceb0 0x7f48f01652a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:33.724 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.745+0000 7f48edd9b640 1 -- 172.21.15.22:0/906550801 >> v1:172.21.15.115:6789/0 conn(0x7f48f00caee0 legacy=0x7f48f00c5170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:33.724 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.745+0000 7f48edd9b640 1 -- 172.21.15.22:0/906550801 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48f0159c60 con 0x7f48f0153ae0 2024-05-21T13:36:33.724 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.745+0000 7f48edd9b640 1 -- 172.21.15.22:0/906550801 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2684847062 0 0) 0x7f48e0001700 con 0x7f48f0153ae0 2024-05-21T13:36:33.724 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.745+0000 7f48edd9b640 1 -- 172.21.15.22:0/906550801 >> v1:172.21.15.22:6789/0 conn(0x7f48f0153ae0 legacy=0x7f48f00cb3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:33.724 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.745+0000 7f48edd9b640 1 --2- 172.21.15.22:0/906550801 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f48dc003a40 0x7f48dc003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:33.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.745+0000 7f48edd9b640 1 --2- 172.21.15.22:0/906550801 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f48f00cceb0 0x7f48dc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:33.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.745+0000 7f48edd9b640 1 --2- 172.21.15.22:0/906550801 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f48dc004d50 0x7f48dc0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:33.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.745+0000 7f48edd9b640 1 -- 172.21.15.22:0/906550801 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f48f00cbab0 con 0x7f48dc003a40 2024-05-21T13:36:33.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.745+0000 7f48edd9b640 1 -- 172.21.15.22:0/906550801 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f48dc00bb90 con 0x7f48dc004d50 2024-05-21T13:36:33.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.745+0000 7f48edd9b640 1 -- 172.21.15.22:0/906550801 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f48dc00bd90 con 0x7f48f00cceb0 2024-05-21T13:36:33.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.745+0000 7f48ee59c640 1 --2- 172.21.15.22:0/906550801 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f48dc003a40 0x7f48dc003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:33.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.745+0000 7f48eed9d640 1 --2- 172.21.15.22:0/906550801 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f48dc004d50 0x7f48dc0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:33.725 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.745+0000 7f48e7fff640 1 --2- 172.21.15.22:0/906550801 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f48f00cceb0 0x7f48dc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:33.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.745+0000 7f48ee59c640 1 -- 172.21.15.22:0/906550801 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f48f00cceb0 msgr2=0x7f48dc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:33.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.745+0000 7f48ee59c640 1 --2- 172.21.15.22:0/906550801 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f48f00cceb0 0x7f48dc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:33.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.745+0000 7f48ee59c640 1 -- 172.21.15.22:0/906550801 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f48dc004d50 msgr2=0x7f48dc0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:33.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.745+0000 7f48ee59c640 1 --2- 172.21.15.22:0/906550801 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f48dc004d50 0x7f48dc0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:33.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.745+0000 7f48ee59c640 1 -- 172.21.15.22:0/906550801 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48dc003530 con 0x7f48dc003a40 2024-05-21T13:36:33.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.745+0000 7f48eed9d640 1 --2- 172.21.15.22:0/906550801 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f48dc004d50 0x7f48dc0051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T13:36:33.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.749+0000 7f48ee59c640 1 --2- 172.21.15.22:0/906550801 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f48dc003a40 0x7f48dc003e60 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f48e000c240 tx=0x7f48e001f270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c193b8058be15924 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:33.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.749+0000 7f48edd9b640 1 -- 172.21.15.22:0/906550801 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e0007cf0 con 0x7f48dc003a40 2024-05-21T13:36:33.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.749+0000 7f48edd9b640 1 -- 172.21.15.22:0/906550801 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48e0005ae0 con 0x7f48dc003a40 2024-05-21T13:36:33.729 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.749+0000 7f48edd9b640 1 -- 172.21.15.22:0/906550801 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e0007070 con 0x7f48dc003a40 2024-05-21T13:36:33.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.749+0000 7f48f4856640 1 -- 172.21.15.22:0/906550801 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f48dc003a40 msgr2=0x7f48dc003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:33.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.749+0000 7f48f4856640 1 --2- 172.21.15.22:0/906550801 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f48dc003a40 0x7f48dc003e60 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f48e000c240 tx=0x7f48e001f270 comp rx=0 tx=0).stop 2024-05-21T13:36:33.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.749+0000 7f48eed9d640 1 -- 172.21.15.22:0/906550801 reap_dead start 2024-05-21T13:36:33.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.749+0000 7f48f4856640 1 -- 172.21.15.22:0/906550801 shutdown_connections 2024-05-21T13:36:33.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.749+0000 7f48f4856640 1 -- 172.21.15.22:0/906550801 >> 172.21.15.22:0/906550801 conn(0x7f48f00722b0 msgr2=0x7f48f00726c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:33.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.753+0000 7f48f4856640 1 -- 172.21.15.22:0/906550801 shutdown_connections 2024-05-21T13:36:33.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.753+0000 7f48f4856640 1 -- 172.21.15.22:0/906550801 wait complete. 2024-05-21T13:36:33.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.753+0000 7f48f4856640 1 Processor -- start 2024-05-21T13:36:33.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.753+0000 7f48f4856640 1 -- start start 2024-05-21T13:36:33.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.753+0000 7f48f4856640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f48f015c820 0x7f48f014a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:33.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.753+0000 7f48f4856640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f48f015cc00 0x7f48f014a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:33.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.753+0000 7f48f4856640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f48f015d0b0 0x7f48f00af910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:33.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.753+0000 7f48f4856640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f48f0159910 con 0x7f48f015d0b0 2024-05-21T13:36:33.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.753+0000 7f48f4856640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f48f015a2b0 con 0x7f48f015cc00 2024-05-21T13:36:33.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.753+0000 7f48f4856640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f48f015a740 con 0x7f48f015c820 2024-05-21T13:36:33.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.753+0000 7f48eed9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f48f015d0b0 0x7f48f00af910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:33.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.753+0000 7f48eed9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f48f015d0b0 0x7f48f00af910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48674/0 (socket says 172.21.15.22:48674) 2024-05-21T13:36:33.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.753+0000 7f48eed9d640 1 -- 172.21.15.22:0/3215418553 learned_addr learned my addr 172.21.15.22:0/3215418553 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:33.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.753+0000 7f48ee59c640 1 --2- 172.21.15.22:0/3215418553 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f48f015c820 0x7f48f014a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:33.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.753+0000 7f48eed9d640 1 -- 172.21.15.22:0/3215418553 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f48f015c820 msgr2=0x7f48f014a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:33.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.753+0000 7f48eed9d640 1 --2- 172.21.15.22:0/3215418553 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f48f015c820 0x7f48f014a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:33.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.753+0000 7f48eed9d640 1 -- 172.21.15.22:0/3215418553 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f48f015cc00 msgr2=0x7f48f014a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:33.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.753+0000 7f48e7fff640 1 --2- 172.21.15.22:0/3215418553 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f48f015cc00 0x7f48f014a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:33.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.753+0000 7f48eed9d640 1 --2- 172.21.15.22:0/3215418553 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f48f015cc00 0x7f48f014a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:33.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.753+0000 7f48eed9d640 1 -- 172.21.15.22:0/3215418553 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48f00b1ee0 con 0x7f48f015d0b0 2024-05-21T13:36:33.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.753+0000 7f48ee59c640 1 --2- 172.21.15.22:0/3215418553 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f48f015c820 0x7f48f014a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:36:33.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.753+0000 7f48e7fff640 1 --2- 172.21.15.22:0/3215418553 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f48f015cc00 0x7f48f014a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:36:33.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.753+0000 7f48eed9d640 1 --2- 172.21.15.22:0/3215418553 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f48f015d0b0 0x7f48f00af910 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f48e8009fd0 tx=0x7f48e8010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:33.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.753+0000 7f48e6ffd640 1 -- 172.21.15.22:0/3215418553 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e8010e30 con 0x7f48f015d0b0 2024-05-21T13:36:33.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.753+0000 7f48e6ffd640 1 -- 172.21.15.22:0/3215418553 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48e80039a0 con 0x7f48f015d0b0 2024-05-21T13:36:33.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.753+0000 7f48e6ffd640 1 -- 172.21.15.22:0/3215418553 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e8003d90 con 0x7f48f015d0b0 2024-05-21T13:36:33.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.753+0000 7f48f4856640 1 -- 172.21.15.22:0/3215418553 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48f00b2430 con 0x7f48f015d0b0 2024-05-21T13:36:33.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.753+0000 7f48f4856640 1 -- 172.21.15.22:0/3215418553 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48f00b2150 con 0x7f48f015d0b0 2024-05-21T13:36:33.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.757+0000 7f48e6ffd640 1 -- 172.21.15.22:0/3215418553 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f48e801e020 con 0x7f48f015d0b0 2024-05-21T13:36:33.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.757+0000 7f48e6ffd640 1 --2- 172.21.15.22:0/3215418553 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f48d006f430 0x7f48d00718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:33.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.757+0000 7f48e6ffd640 1 -- 172.21.15.22:0/3215418553 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f48e808fbf0 con 0x7f48f015d0b0 2024-05-21T13:36:33.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.757+0000 7f48ee59c640 1 --2- 172.21.15.22:0/3215418553 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f48d006f430 0x7f48d00718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:33.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.757+0000 7f48f79e1000 1 Processor -- start 2024-05-21T13:36:33.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.757+0000 7f48f79e1000 1 -- start start 2024-05-21T13:36:33.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.757+0000 7f48ee59c640 1 --2- 172.21.15.22:0/3215418553 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f48d006f430 0x7f48d00718f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f48e00ae000 tx=0x7f48e0007040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:33.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.757+0000 7f48f79e1000 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56161b0df4a0 0x56161b0a8200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:33.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.757+0000 7f48f79e1000 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x56161b0a8740 0x56161b0c79b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:33.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.757+0000 7f48f79e1000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56161b0c7ef0 0x56161b0c82d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:33.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.757+0000 7f48f79e1000 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56161aefc6d0 con 0x56161b0df4a0 2024-05-21T13:36:33.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.757+0000 7f48f79e1000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x56161aeec270 con 0x56161b0c7ef0 2024-05-21T13:36:33.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.757+0000 7f48f79e1000 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x56161aef02b0 con 0x56161b0a8740 2024-05-21T13:36:33.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.757+0000 7f48ee59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56161b0df4a0 0x56161b0a8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:33.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.757+0000 7f48ee59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56161b0df4a0 0x56161b0a8200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48690/0 (socket says 172.21.15.22:48690) 2024-05-21T13:36:33.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.757+0000 7f48ee59c640 1 -- 172.21.15.22:0/1747067155 learned_addr learned my addr 172.21.15.22:0/1747067155 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:33.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.757+0000 7f48e7fff640 1 --2- 172.21.15.22:0/1747067155 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x56161b0a8740 0x56161b0c79b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:33.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.757+0000 7f48eed9d640 1 --2- 172.21.15.22:0/1747067155 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56161b0c7ef0 0x56161b0c82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:33.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.757+0000 7f48ee59c640 1 -- 172.21.15.22:0/1747067155 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x56161b0a8740 msgr2=0x56161b0c79b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:33.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.757+0000 7f48ee59c640 1 --2- 172.21.15.22:0/1747067155 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x56161b0a8740 0x56161b0c79b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:33.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.757+0000 7f48ee59c640 1 -- 172.21.15.22:0/1747067155 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56161b0c7ef0 msgr2=0x56161b0c82d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:33.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.757+0000 7f48ee59c640 1 --2- 172.21.15.22:0/1747067155 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56161b0c7ef0 0x56161b0c82d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:33.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.757+0000 7f48ee59c640 1 -- 172.21.15.22:0/1747067155 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56161aecabf0 con 0x56161b0df4a0 2024-05-21T13:36:33.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.757+0000 7f48e7fff640 1 --2- 172.21.15.22:0/1747067155 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x56161b0a8740 0x56161b0c79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:36:33.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.757+0000 7f48ee59c640 1 --2- 172.21.15.22:0/1747067155 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56161b0df4a0 0x56161b0a8200 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f48e009ba60 tx=0x7f48f015a220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66c2673e2f084392 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:33.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.757+0000 7f48cffff640 1 -- 172.21.15.22:0/1747067155 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e00016e0 con 0x56161b0df4a0 2024-05-21T13:36:33.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.757+0000 7f48cffff640 1 -- 172.21.15.22:0/1747067155 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48e00070b0 con 0x56161b0df4a0 2024-05-21T13:36:33.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.757+0000 7f48cffff640 1 -- 172.21.15.22:0/1747067155 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e0007460 con 0x56161b0df4a0 2024-05-21T13:36:33.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.761+0000 7f48f79e1000 1 -- 172.21.15.22:0/1747067155 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56161b0df4a0 msgr2=0x56161b0a8200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:33.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.761+0000 7f48f79e1000 1 --2- 172.21.15.22:0/1747067155 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56161b0df4a0 0x56161b0a8200 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f48e009ba60 tx=0x7f48f015a220 comp rx=0 tx=0).stop 2024-05-21T13:36:33.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.761+0000 7f48f79e1000 1 -- 172.21.15.22:0/1747067155 shutdown_connections 2024-05-21T13:36:33.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.761+0000 7f48f79e1000 1 --2- 172.21.15.22:0/1747067155 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56161b0c7ef0 0x56161b0c82d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:33.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.761+0000 7f48f79e1000 1 --2- 172.21.15.22:0/1747067155 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x56161b0a8740 0x56161b0c79b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:33.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.761+0000 7f48f79e1000 1 --2- 172.21.15.22:0/1747067155 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56161b0df4a0 0x56161b0a8200 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:33.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.761+0000 7f48f79e1000 1 -- 172.21.15.22:0/1747067155 >> 172.21.15.22:0/1747067155 conn(0x56161af87ef0 msgr2=0x56161b0deb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:33.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.761+0000 7f48f79e1000 1 -- 172.21.15.22:0/1747067155 shutdown_connections 2024-05-21T13:36:33.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.761+0000 7f48f79e1000 1 -- 172.21.15.22:0/1747067155 wait complete. 2024-05-21T13:36:33.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.761+0000 7f48f79e1000 1 -- start start 2024-05-21T13:36:33.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.761+0000 7f48f79e1000 1 Processor -- start 2024-05-21T13:36:33.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.761+0000 7f48f79e1000 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x56161b0a8740 0x56161b0ec050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:33.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.761+0000 7f48f79e1000 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56161b0c7ef0 0x56161b0ec590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:33.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.761+0000 7f48f79e1000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56161b0df4a0 0x56161b0a3c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:33.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.761+0000 7f48f79e1000 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56161aeaf630 con 0x56161b0c7ef0 2024-05-21T13:36:33.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.761+0000 7f48f79e1000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x56161af70570 con 0x56161b0df4a0 2024-05-21T13:36:33.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.761+0000 7f48f79e1000 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x56161aefb4a0 con 0x56161b0a8740 2024-05-21T13:36:33.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.761+0000 7f48f79e1000 10 client.0 _ll_register_callbacks cb 0x56161b08b540 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-21T13:36:33.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.761+0000 7f48e7fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56161b0c7ef0 0x56161b0ec590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:33.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.761+0000 7f48e7fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56161b0c7ef0 0x56161b0ec590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:48702/0 (socket says 172.21.15.22:48702) 2024-05-21T13:36:33.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.761+0000 7f48e7fff640 1 -- 172.21.15.22:0/2231073185 learned_addr learned my addr 172.21.15.22:0/2231073185 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:33.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.761+0000 7f48ee59c640 1 --2- 172.21.15.22:0/2231073185 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x56161b0a8740 0x56161b0ec050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:33.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.761+0000 7f48eed9d640 1 --2- 172.21.15.22:0/2231073185 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56161b0df4a0 0x56161b0a3c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:33.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.761+0000 7f48e7fff640 1 -- 172.21.15.22:0/2231073185 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x56161b0a8740 msgr2=0x56161b0ec050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:33.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.761+0000 7f48e7fff640 1 --2- 172.21.15.22:0/2231073185 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x56161b0a8740 0x56161b0ec050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:33.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.761+0000 7f48e7fff640 1 -- 172.21.15.22:0/2231073185 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56161b0df4a0 msgr2=0x56161b0a3c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:33.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.761+0000 7f48e7fff640 1 --2- 172.21.15.22:0/2231073185 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56161b0df4a0 0x56161b0a3c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:33.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.761+0000 7f48e7fff640 1 -- 172.21.15.22:0/2231073185 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56161af349b0 con 0x56161b0c7ef0 2024-05-21T13:36:33.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.761+0000 7f48eed9d640 1 --2- 172.21.15.22:0/2231073185 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56161b0df4a0 0x56161b0a3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:36:33.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.761+0000 7f48e7fff640 1 --2- 172.21.15.22:0/2231073185 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56161b0c7ef0 0x56161b0ec590 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f48d8005630 tx=0x7f48d8001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3009cff2e84029d1 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:33.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.761+0000 7f48cd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-05-21T13:36:33.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.761+0000 7f48cd7fa640 1 -- 172.21.15.22:0/2231073185 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48d8010040 con 0x56161b0c7ef0 2024-05-21T13:36:33.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.761+0000 7f48cd7fa640 1 -- 172.21.15.22:0/2231073185 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f48d8015610 con 0x56161b0c7ef0 2024-05-21T13:36:33.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.761+0000 7f48f79e1000 1 -- 172.21.15.22:0/2231073185 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f48e00070b0 con 0x56161b0c7ef0 2024-05-21T13:36:33.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.761+0000 7f48cd7fa640 1 -- 172.21.15.22:0/2231073185 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f48d8021050 con 0x56161b0c7ef0 2024-05-21T13:36:33.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.761+0000 7f48f79e1000 10 client.4695 fetch_fsmap learned FSMap version 14 2024-05-21T13:36:33.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.761+0000 7f48f79e1000 1 -- 172.21.15.22:0/2231073185 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x56161aec7510 con 0x56161b0c7ef0 2024-05-21T13:36:33.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.761+0000 7f48cd7fa640 1 -- 172.21.15.22:0/2231073185 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48e00070b0 con 0x56161b0c7ef0 2024-05-21T13:36:33.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.761+0000 7f48cd7fa640 1 -- 172.21.15.22:0/2231073185 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7f48d8024020 con 0x56161b0c7ef0 2024-05-21T13:36:33.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.761+0000 7f48f79e1000 10 client.4695 fetch_fsmap finished waiting for FSMap version 14 2024-05-21T13:36:33.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.761+0000 7f48f79e1000 10 client.4695 resolve_mds: resolved name 'd' to daemon mds.d 2024-05-21T13:36:33.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.761+0000 7f48f79e1000 20 client.4695 populate_metadata read hostname 'smithi022' 2024-05-21T13:36:33.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.761+0000 7f48f79e1000 1 --2- 172.21.15.22:0/2231073185 >> [v2:172.21.15.115:6836/2009761279,v1:172.21.15.115:6837/2009761279] conn(0x56161b0a49c0 0x56161b0a4da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:33.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.761+0000 7f48f79e1000 4 client.4695 mds_command: new command op to 4248 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-21T13:36:33.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.761+0000 7f48f79e1000 1 -- 172.21.15.22:0/2231073185 --> [v2:172.21.15.115:6836/2009761279,v1:172.21.15.115:6837/2009761279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56161ae87bc0 con 0x56161b0a49c0 2024-05-21T13:36:33.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.761+0000 7f48ee59c640 1 --2- 172.21.15.22:0/2231073185 >> [v2:172.21.15.115:6836/2009761279,v1:172.21.15.115:6837/2009761279] conn(0x56161b0a49c0 0x56161b0a4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:33.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.761+0000 7f48cd7fa640 10 client.4695 ms_handle_connect on v2:172.21.15.115:6836/2009761279 2024-05-21T13:36:33.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:33.761+0000 7f48ee59c640 1 --2- 172.21.15.22:0/2231073185 >> [v2:172.21.15.115:6836/2009761279,v1:172.21.15.115:6837/2009761279] conn(0x56161b0a49c0 0x56161b0a4da0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c4e99dc9f74954dd server_cookie=77b6bcaf9d621c45 in_seq=0 out_seq=0 2024-05-21T13:36:37.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.409+0000 7f48cd7fa640 1 -- 172.21.15.22:0/2231073185 <== mds.2 v2:172.21.15.115:6836/2009761279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x56161ae87bc0 con 0x56161b0a49c0 2024-05-21T13:36:37.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.409+0000 7f48cd7fa640 10 client.4695 handle_command_reply: tid=0 2024-05-21T13:36:37.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.409+0000 7f48f79e1000 1 client.4695 shutdown 2024-05-21T13:36:37.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.409+0000 7f48f79e1000 1 -- 172.21.15.22:0/2231073185 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56161b0c7ef0 msgr2=0x56161b0ec590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:37.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.409+0000 7f48f79e1000 1 --2- 172.21.15.22:0/2231073185 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56161b0c7ef0 0x56161b0ec590 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f48d8005630 tx=0x7f48d8001670 comp rx=0 tx=0).stop 2024-05-21T13:36:37.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.409+0000 7f48f79e1000 1 -- 172.21.15.22:0/2231073185 shutdown_connections 2024-05-21T13:36:37.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.409+0000 7f48f79e1000 1 --2- 172.21.15.22:0/2231073185 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56161b0df4a0 0x56161b0a3c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:37.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.409+0000 7f48f79e1000 1 --2- 172.21.15.22:0/2231073185 >> [v2:172.21.15.115:6836/2009761279,v1:172.21.15.115:6837/2009761279] conn(0x56161b0a49c0 0x56161b0a4da0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:37.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.409+0000 7f48f79e1000 1 --2- 172.21.15.22:0/2231073185 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56161b0c7ef0 0x56161b0ec590 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:37.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.409+0000 7f48f79e1000 1 --2- 172.21.15.22:0/2231073185 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x56161b0a8740 0x56161b0ec050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:37.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.409+0000 7f48cd7fa640 0 client.4695 ms_handle_reset on v2:172.21.15.115:6836/2009761279 2024-05-21T13:36:37.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.409+0000 7f48f79e1000 1 -- 172.21.15.22:0/2231073185 >> 172.21.15.22:0/2231073185 conn(0x56161af87ef0 msgr2=0x56161b09e8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:37.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.409+0000 7f48f79e1000 1 -- 172.21.15.22:0/2231073185 shutdown_connections 2024-05-21T13:36:37.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.409+0000 7f48f79e1000 1 -- 172.21.15.22:0/2231073185 wait complete. 2024-05-21T13:36:37.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.409+0000 7f48f79e1000 20 client.4695 trim_cache size 0 max 16384 2024-05-21T13:36:37.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.449+0000 7f48f79e1000 1 Processor -- start 2024-05-21T13:36:37.427 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.449+0000 7f48f79e1000 1 -- start start 2024-05-21T13:36:37.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.449+0000 7f48f79e1000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56161b0a8740 0x56161b0fc820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:37.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.449+0000 7f48f79e1000 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56161b0c7ef0 0x56161b0da360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:37.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.449+0000 7f48f79e1000 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x56161b0df4a0 0x56161b0da8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:37.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.449+0000 7f48f79e1000 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f48f01f5d40 con 0x56161b0c7ef0 2024-05-21T13:36:37.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.449+0000 7f48f79e1000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f48f01feaf0 con 0x56161b0a8740 2024-05-21T13:36:37.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.449+0000 7f48f79e1000 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x56161ae89200 con 0x56161b0df4a0 2024-05-21T13:36:37.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.449+0000 7f48e7fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56161b0c7ef0 0x56161b0da360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:37.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.449+0000 7f48e7fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56161b0c7ef0 0x56161b0da360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43068/0 (socket says 172.21.15.22:43068) 2024-05-21T13:36:37.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.449+0000 7f48e7fff640 1 -- 172.21.15.22:0/2751814183 learned_addr learned my addr 172.21.15.22:0/2751814183 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:37.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.449+0000 7f48ee59c640 1 --2- 172.21.15.22:0/2751814183 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56161b0a8740 0x56161b0fc820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:37.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.449+0000 7f48eed9d640 1 --2- 172.21.15.22:0/2751814183 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x56161b0df4a0 0x56161b0da8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:37.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.449+0000 7f48e7fff640 1 -- 172.21.15.22:0/2751814183 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x56161b0df4a0 msgr2=0x56161b0da8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:37.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.449+0000 7f48e7fff640 1 --2- 172.21.15.22:0/2751814183 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x56161b0df4a0 0x56161b0da8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:37.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.449+0000 7f48e7fff640 1 -- 172.21.15.22:0/2751814183 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56161b0a8740 msgr2=0x56161b0fc820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:37.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.449+0000 7f48e7fff640 1 --2- 172.21.15.22:0/2751814183 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56161b0a8740 0x56161b0fc820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:37.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.449+0000 7f48e7fff640 1 -- 172.21.15.22:0/2751814183 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56161ae8d860 con 0x56161b0c7ef0 2024-05-21T13:36:37.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.449+0000 7f48eed9d640 1 --2- 172.21.15.22:0/2751814183 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x56161b0df4a0 0x56161b0da8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T13:36:37.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.449+0000 7f48ee59c640 1 --2- 172.21.15.22:0/2751814183 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56161b0a8740 0x56161b0fc820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T13:36:37.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.449+0000 7f48e7fff640 1 --2- 172.21.15.22:0/2751814183 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56161b0c7ef0 0x56161b0da360 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f48d8003680 tx=0x7f48d800c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcfcf6a9135ad88b server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:37.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.449+0000 7f48cf7fe640 1 -- 172.21.15.22:0/2751814183 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48d8029020 con 0x56161b0c7ef0 2024-05-21T13:36:37.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.449+0000 7f48cf7fe640 1 -- 172.21.15.22:0/2751814183 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48d80153e0 con 0x56161b0c7ef0 2024-05-21T13:36:37.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.449+0000 7f48cf7fe640 1 -- 172.21.15.22:0/2751814183 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48d801c2f0 con 0x56161b0c7ef0 2024-05-21T13:36:37.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.453+0000 7f48f79e1000 1 -- 172.21.15.22:0/2751814183 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56161b0c7ef0 msgr2=0x56161b0da360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:37.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.453+0000 7f48f79e1000 1 --2- 172.21.15.22:0/2751814183 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56161b0c7ef0 0x56161b0da360 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f48d8003680 tx=0x7f48d800c000 comp rx=0 tx=0).stop 2024-05-21T13:36:37.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.453+0000 7f48f79e1000 1 -- 172.21.15.22:0/2751814183 shutdown_connections 2024-05-21T13:36:37.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.453+0000 7f48f79e1000 1 --2- 172.21.15.22:0/2751814183 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x56161b0df4a0 0x56161b0da8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:37.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.453+0000 7f48f79e1000 1 --2- 172.21.15.22:0/2751814183 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56161b0c7ef0 0x56161b0da360 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:37.432 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.453+0000 7f48f79e1000 1 --2- 172.21.15.22:0/2751814183 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56161b0a8740 0x56161b0fc820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:37.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.453+0000 7f48f79e1000 1 -- 172.21.15.22:0/2751814183 >> 172.21.15.22:0/2751814183 conn(0x56161af87ef0 msgr2=0x56161b0a7fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:37.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.453+0000 7f48f79e1000 1 -- 172.21.15.22:0/2751814183 shutdown_connections 2024-05-21T13:36:37.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.453+0000 7f48f79e1000 1 -- 172.21.15.22:0/2751814183 wait complete. 2024-05-21T13:36:37.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.453+0000 7f48f79e1000 1 -- start start 2024-05-21T13:36:37.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.453+0000 7f48f79e1000 1 Processor -- start 2024-05-21T13:36:37.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.457+0000 7f48f79e1000 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56161b0a8740 0x56161b0a3470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:37.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.457+0000 7f48f79e1000 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x56161b0c7ef0 0x56161b154850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:37.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.457+0000 7f48f79e1000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56161b0df4a0 0x56161b154d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:37.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.457+0000 7f48f79e1000 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x56161aeef5c0 con 0x56161b0a8740 2024-05-21T13:36:37.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.457+0000 7f48f79e1000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x56161ae847b0 con 0x56161b0df4a0 2024-05-21T13:36:37.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.457+0000 7f48f79e1000 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x56161aef48e0 con 0x56161b0c7ef0 2024-05-21T13:36:37.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.457+0000 7f48f79e1000 10 client.0 _ll_register_callbacks cb 0x7f48d8005050 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-21T13:36:37.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.457+0000 7f48ee59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56161b0a8740 0x56161b0a3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:37.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.457+0000 7f48ee59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56161b0a8740 0x56161b0a3470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43084/0 (socket says 172.21.15.22:43084) 2024-05-21T13:36:37.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.457+0000 7f48ee59c640 1 -- 172.21.15.22:0/1692437482 learned_addr learned my addr 172.21.15.22:0/1692437482 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:37.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.457+0000 7f48e7fff640 1 --2- 172.21.15.22:0/1692437482 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x56161b0c7ef0 0x56161b154850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:37.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.457+0000 7f48eed9d640 1 --2- 172.21.15.22:0/1692437482 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56161b0df4a0 0x56161b154d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:37.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.457+0000 7f48ee59c640 1 -- 172.21.15.22:0/1692437482 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x56161b0c7ef0 msgr2=0x56161b154850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:37.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.457+0000 7f48ee59c640 1 --2- 172.21.15.22:0/1692437482 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x56161b0c7ef0 0x56161b154850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:37.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.457+0000 7f48ee59c640 1 -- 172.21.15.22:0/1692437482 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56161b0df4a0 msgr2=0x56161b154d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:37.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.457+0000 7f48ee59c640 1 --2- 172.21.15.22:0/1692437482 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56161b0df4a0 0x56161b154d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:37.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.457+0000 7f48ee59c640 1 -- 172.21.15.22:0/1692437482 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56161aea3e80 con 0x56161b0a8740 2024-05-21T13:36:37.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.457+0000 7f48ee59c640 1 --2- 172.21.15.22:0/1692437482 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56161b0a8740 0x56161b0a3470 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f48e0007010 tx=0x7f48e001db00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48dd35c042741ad6 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:37.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.457+0000 7f48cd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-05-21T13:36:37.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.457+0000 7f48cd7fa640 1 -- 172.21.15.22:0/1692437482 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48e0001760 con 0x56161b0a8740 2024-05-21T13:36:37.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.457+0000 7f48f79e1000 1 -- 172.21.15.22:0/1692437482 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f48d80153e0 con 0x56161b0a8740 2024-05-21T13:36:37.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.457+0000 7f48cd7fa640 1 -- 172.21.15.22:0/1692437482 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f48e0007360 con 0x56161b0a8740 2024-05-21T13:36:37.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.457+0000 7f48cd7fa640 1 -- 172.21.15.22:0/1692437482 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f48e0007560 con 0x56161b0a8740 2024-05-21T13:36:37.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.457+0000 7f48f79e1000 10 client.4701 fetch_fsmap learned FSMap version 14 2024-05-21T13:36:37.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.457+0000 7f48f79e1000 1 -- 172.21.15.22:0/1692437482 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x56161af70a00 con 0x56161b0a8740 2024-05-21T13:36:37.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.457+0000 7f48cd7fa640 1 -- 172.21.15.22:0/1692437482 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48d80153e0 con 0x56161b0a8740 2024-05-21T13:36:37.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.457+0000 7f48cd7fa640 1 -- 172.21.15.22:0/1692437482 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7f48e00b2720 con 0x56161b0a8740 2024-05-21T13:36:37.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.457+0000 7f48f79e1000 10 client.4701 fetch_fsmap finished waiting for FSMap version 14 2024-05-21T13:36:37.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.457+0000 7f48f79e1000 10 client.4701 resolve_mds: resolved name 'd' to daemon mds.d 2024-05-21T13:36:37.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.457+0000 7f48f79e1000 20 client.4701 populate_metadata read hostname 'smithi022' 2024-05-21T13:36:37.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.457+0000 7f48f79e1000 1 --2- 172.21.15.22:0/1692437482 >> [v2:172.21.15.115:6836/2009761279,v1:172.21.15.115:6837/2009761279] conn(0x56161b153420 0x56161b153800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:37.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.457+0000 7f48f79e1000 4 client.4701 mds_command: new command op to 4248 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-21T13:36:37.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.457+0000 7f48f79e1000 1 -- 172.21.15.22:0/1692437482 --> [v2:172.21.15.115:6836/2009761279,v1:172.21.15.115:6837/2009761279] -- command(tid 0: {"prefix": "status"}) -- 0x56161ae8bdc0 con 0x56161b153420 2024-05-21T13:36:37.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.457+0000 7f48e7fff640 1 --2- 172.21.15.22:0/1692437482 >> [v2:172.21.15.115:6836/2009761279,v1:172.21.15.115:6837/2009761279] conn(0x56161b153420 0x56161b153800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:37.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.461+0000 7f48e7fff640 1 --2- 172.21.15.22:0/1692437482 >> [v2:172.21.15.115:6836/2009761279,v1:172.21.15.115:6837/2009761279] conn(0x56161b153420 0x56161b153800 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=da287aadc67df090 server_cookie=61d561837895e576 in_seq=0 out_seq=0 2024-05-21T13:36:37.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.461+0000 7f48cd7fa640 10 client.4701 ms_handle_connect on v2:172.21.15.115:6836/2009761279 2024-05-21T13:36:37.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.461+0000 7f48cd7fa640 1 -- 172.21.15.22:0/1692437482 <== mds.2 v2:172.21.15.115:6836/2009761279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x56161ae8bdc0 con 0x56161b153420 2024-05-21T13:36:37.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.461+0000 7f48cd7fa640 10 client.4701 handle_command_reply: tid=0 2024-05-21T13:36:37.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.461+0000 7f48f79e1000 1 client.4701 shutdown 2024-05-21T13:36:37.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.461+0000 7f48f79e1000 1 -- 172.21.15.22:0/1692437482 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56161b0a8740 msgr2=0x56161b0a3470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:37.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.461+0000 7f48f79e1000 1 --2- 172.21.15.22:0/1692437482 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56161b0a8740 0x56161b0a3470 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f48e0007010 tx=0x7f48e001db00 comp rx=0 tx=0).stop 2024-05-21T13:36:37.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.461+0000 7f48f79e1000 1 -- 172.21.15.22:0/1692437482 shutdown_connections 2024-05-21T13:36:37.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.461+0000 7f48f79e1000 1 --2- 172.21.15.22:0/1692437482 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x56161b0df4a0 0x56161b154d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:37.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.461+0000 7f48f79e1000 1 --2- 172.21.15.22:0/1692437482 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x56161b0c7ef0 0x56161b154850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:37.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.461+0000 7f48f79e1000 1 --2- 172.21.15.22:0/1692437482 >> [v2:172.21.15.115:6836/2009761279,v1:172.21.15.115:6837/2009761279] conn(0x56161b153420 0x56161b153800 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:37.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.461+0000 7f48f79e1000 1 --2- 172.21.15.22:0/1692437482 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x56161b0a8740 0x56161b0a3470 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:37.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.461+0000 7f48cd7fa640 0 client.4701 ms_handle_reset on v2:172.21.15.115:6836/2009761279 2024-05-21T13:36:37.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.461+0000 7f48f79e1000 1 -- 172.21.15.22:0/1692437482 >> 172.21.15.22:0/1692437482 conn(0x56161af87ef0 msgr2=0x56161b0a2970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:37.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.461+0000 7f48f79e1000 1 -- 172.21.15.22:0/1692437482 shutdown_connections 2024-05-21T13:36:37.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.461+0000 7f48f79e1000 1 -- 172.21.15.22:0/1692437482 wait complete. 2024-05-21T13:36:37.441 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.461+0000 7f48f79e1000 20 client.4701 trim_cache size 0 max 16384 2024-05-21T13:36:37.442 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-05-21T13:36:37.442 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_fsid": "f2c96204-e240-4e7f-8a76-927b4f80f534", 2024-05-21T13:36:37.442 INFO:teuthology.orchestra.run.smithi022.stdout: "whoami": 2, 2024-05-21T13:36:37.442 INFO:teuthology.orchestra.run.smithi022.stdout: "id": 4248, 2024-05-21T13:36:37.442 INFO:teuthology.orchestra.run.smithi022.stdout: "want_state": "up:active", 2024-05-21T13:36:37.442 INFO:teuthology.orchestra.run.smithi022.stdout: "state": "up:active", 2024-05-21T13:36:37.442 INFO:teuthology.orchestra.run.smithi022.stdout: "fs_name": "cephfs", 2024-05-21T13:36:37.442 INFO:teuthology.orchestra.run.smithi022.stdout: "rank_uptime": 10.45590799, 2024-05-21T13:36:37.442 INFO:teuthology.orchestra.run.smithi022.stdout: "mdsmap_epoch": 14, 2024-05-21T13:36:37.442 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch": 25, 2024-05-21T13:36:37.443 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch_barrier": 25, 2024-05-21T13:36:37.443 INFO:teuthology.orchestra.run.smithi022.stdout: "uptime": 45.756890314000003 2024-05-21T13:36:37.443 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-05-21T13:36:37.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.461+0000 7f48f4856640 1 -- 172.21.15.22:0/3215418553 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f48d006f430 msgr2=0x7f48d00718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:37.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.461+0000 7f48f4856640 1 --2- 172.21.15.22:0/3215418553 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f48d006f430 0x7f48d00718f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f48e00ae000 tx=0x7f48e0007040 comp rx=0 tx=0).stop 2024-05-21T13:36:37.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.461+0000 7f48f4856640 1 -- 172.21.15.22:0/3215418553 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f48f015d0b0 msgr2=0x7f48f00af910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:37.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.461+0000 7f48f4856640 1 --2- 172.21.15.22:0/3215418553 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f48f015d0b0 0x7f48f00af910 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f48e8009fd0 tx=0x7f48e8010590 comp rx=0 tx=0).stop 2024-05-21T13:36:37.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.461+0000 7f48f4856640 1 -- 172.21.15.22:0/3215418553 shutdown_connections 2024-05-21T13:36:37.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.461+0000 7f48f4856640 1 --2- 172.21.15.22:0/3215418553 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f48d006f430 0x7f48d00718f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:37.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.461+0000 7f48f4856640 1 --2- 172.21.15.22:0/3215418553 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f48f015d0b0 0x7f48f00af910 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:37.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.461+0000 7f48f4856640 1 --2- 172.21.15.22:0/3215418553 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f48f015cc00 0x7f48f014a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:37.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.461+0000 7f48f4856640 1 --2- 172.21.15.22:0/3215418553 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f48f015c820 0x7f48f014a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:37.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.461+0000 7f48f4856640 1 -- 172.21.15.22:0/3215418553 >> 172.21.15.22:0/3215418553 conn(0x7f48f00722b0 msgr2=0x7f48f014d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:37.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.461+0000 7f48f4856640 1 -- 172.21.15.22:0/3215418553 shutdown_connections 2024-05-21T13:36:37.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.461+0000 7f48f4856640 1 -- 172.21.15.22:0/3215418553 wait complete. 2024-05-21T13:36:37.471 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-05-21T13:36:37.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.625+0000 7f22c2eb8640 1 Processor -- start 2024-05-21T13:36:37.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.625+0000 7f22c2eb8640 1 -- start start 2024-05-21T13:36:37.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.629+0000 7f22c2eb8640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f22bc152420 0x7f22bc0c7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:37.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.629+0000 7f22c2eb8640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f22bc072ed0 0x7f22bc06fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:37.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.629+0000 7f22c2eb8640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22bc158be0 0x7f22bc070320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:37.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.629+0000 7f22c2eb8640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f22bc06eec0 con 0x7f22bc072ed0 2024-05-21T13:36:37.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.629+0000 7f22c2eb8640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f22bc074360 con 0x7f22bc152420 2024-05-21T13:36:37.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.629+0000 7f22c2eb8640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f22bc073750 con 0x7f22bc158be0 2024-05-21T13:36:37.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.629+0000 7f22bbfff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f22bc072ed0 0x7f22bc06fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:37.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.629+0000 7f22bbfff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f22bc072ed0 0x7f22bc06fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43096/0 (socket says 172.21.15.22:43096) 2024-05-21T13:36:37.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.629+0000 7f22bbfff640 1 -- 172.21.15.22:0/2677734477 learned_addr learned my addr 172.21.15.22:0/2677734477 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:37.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.629+0000 7f22c0c54640 1 --2- 172.21.15.22:0/2677734477 >> v2:172.21.15.115:3300/0 conn(0x7f22bc152420 0x7f22bc0c7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:37.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.629+0000 7f22c1455640 1 --2- 172.21.15.22:0/2677734477 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22bc158be0 0x7f22bc070320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:37.608 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.629+0000 7f22bbfff640 1 -- 172.21.15.22:0/2677734477 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22bc158be0 msgr2=0x7f22bc070320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:37.608 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.629+0000 7f22bbfff640 1 --2- 172.21.15.22:0/2677734477 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22bc158be0 0x7f22bc070320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:37.608 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.629+0000 7f22bbfff640 1 -- 172.21.15.22:0/2677734477 >> v2:172.21.15.115:3300/0 conn(0x7f22bc152420 msgr2=0x7f22bc0c7bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:37.608 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.629+0000 7f22bbfff640 1 --2- 172.21.15.22:0/2677734477 >> v2:172.21.15.115:3300/0 conn(0x7f22bc152420 0x7f22bc0c7bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:37.608 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.629+0000 7f22bbfff640 1 -- 172.21.15.22:0/2677734477 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22bc073a30 con 0x7f22bc072ed0 2024-05-21T13:36:37.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.629+0000 7f22bbfff640 1 --2- 172.21.15.22:0/2677734477 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f22bc072ed0 0x7f22bc06fde0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f22bc0cdfb0 tx=0x7f22b001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71f222a157b8644f server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:37.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.629+0000 7f22bb7fe640 1 -- 172.21.15.22:0/2677734477 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22b00ab680 con 0x7f22bc072ed0 2024-05-21T13:36:37.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.629+0000 7f22bb7fe640 1 -- 172.21.15.22:0/2677734477 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22b00b0070 con 0x7f22bc072ed0 2024-05-21T13:36:37.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.629+0000 7f22bb7fe640 1 -- 172.21.15.22:0/2677734477 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22b00aba40 con 0x7f22bc072ed0 2024-05-21T13:36:37.610 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.633+0000 7f22c2eb8640 1 -- 172.21.15.22:0/2677734477 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f22bc072ed0 msgr2=0x7f22bc06fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:37.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.633+0000 7f22c2eb8640 1 --2- 172.21.15.22:0/2677734477 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f22bc072ed0 0x7f22bc06fde0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f22bc0cdfb0 tx=0x7f22b001c520 comp rx=0 tx=0).stop 2024-05-21T13:36:37.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.633+0000 7f22c2eb8640 1 -- 172.21.15.22:0/2677734477 shutdown_connections 2024-05-21T13:36:37.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.633+0000 7f22c2eb8640 1 --2- 172.21.15.22:0/2677734477 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22bc158be0 0x7f22bc070320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:37.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.633+0000 7f22c2eb8640 1 --2- 172.21.15.22:0/2677734477 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f22bc072ed0 0x7f22bc06fde0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:37.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.633+0000 7f22c2eb8640 1 --2- 172.21.15.22:0/2677734477 >> v2:172.21.15.115:3300/0 conn(0x7f22bc152420 0x7f22bc0c7bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:37.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.633+0000 7f22c2eb8640 1 -- 172.21.15.22:0/2677734477 >> 172.21.15.22:0/2677734477 conn(0x7f22bc06ce70 msgr2=0x7f22bc0cd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:37.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.633+0000 7f22c2eb8640 1 -- 172.21.15.22:0/2677734477 shutdown_connections 2024-05-21T13:36:37.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.633+0000 7f22c2eb8640 1 -- 172.21.15.22:0/2677734477 wait complete. 2024-05-21T13:36:37.612 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.633+0000 7f22c2eb8640 1 Processor -- start 2024-05-21T13:36:37.612 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.633+0000 7f22c2eb8640 1 -- start start 2024-05-21T13:36:37.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.633+0000 7f22c2eb8640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22bc072ed0 0x7f22bc144610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:37.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.633+0000 7f22c2eb8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f22bc152420 0x7f22bc154b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:37.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.633+0000 7f22c2eb8640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22bc158be0 0x7f22bc13eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:37.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.633+0000 7f22c2eb8640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f22bc074950 con 0x7f22bc152420 2024-05-21T13:36:37.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.633+0000 7f22c2eb8640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f22bc0747d0 con 0x7f22bc072ed0 2024-05-21T13:36:37.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.633+0000 7f22c2eb8640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f22bc0c8130 con 0x7f22bc158be0 2024-05-21T13:36:37.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.633+0000 7f22bbfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f22bc152420 0x7f22bc154b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:37.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.633+0000 7f22c1455640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22bc158be0 0x7f22bc13eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:37.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.633+0000 7f22bbfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f22bc152420 0x7f22bc154b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43104/0 (socket says 172.21.15.22:43104) 2024-05-21T13:36:37.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.633+0000 7f22bbfff640 1 -- 172.21.15.22:0/807171371 learned_addr learned my addr 172.21.15.22:0/807171371 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:37.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.633+0000 7f22c0c54640 1 --2- 172.21.15.22:0/807171371 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22bc072ed0 0x7f22bc144610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:37.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.633+0000 7f22bbfff640 1 -- 172.21.15.22:0/807171371 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22bc158be0 msgr2=0x7f22bc13eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:37.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.633+0000 7f22bbfff640 1 --2- 172.21.15.22:0/807171371 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22bc158be0 0x7f22bc13eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:37.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.633+0000 7f22bbfff640 1 -- 172.21.15.22:0/807171371 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22bc072ed0 msgr2=0x7f22bc144610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:37.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.633+0000 7f22bbfff640 1 --2- 172.21.15.22:0/807171371 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22bc072ed0 0x7f22bc144610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:37.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.633+0000 7f22bbfff640 1 -- 172.21.15.22:0/807171371 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22bc06e7e0 con 0x7f22bc152420 2024-05-21T13:36:37.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.633+0000 7f22bbfff640 1 --2- 172.21.15.22:0/807171371 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f22bc152420 0x7f22bc154b60 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f22b001abd0 tx=0x7f22b001ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:37.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.633+0000 7f22b97fa640 1 -- 172.21.15.22:0/807171371 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22b00be5f0 con 0x7f22bc152420 2024-05-21T13:36:37.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.633+0000 7f22b97fa640 1 -- 172.21.15.22:0/807171371 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22b00a7070 con 0x7f22bc152420 2024-05-21T13:36:37.615 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.633+0000 7f22c2eb8640 1 -- 172.21.15.22:0/807171371 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22bc0ccc70 con 0x7f22bc152420 2024-05-21T13:36:37.616 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.633+0000 7f22b97fa640 1 -- 172.21.15.22:0/807171371 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22b00be9b0 con 0x7f22bc152420 2024-05-21T13:36:37.616 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.633+0000 7f22c2eb8640 1 -- 172.21.15.22:0/807171371 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22bc14aa70 con 0x7f22bc152420 2024-05-21T13:36:37.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.637+0000 7f22b97fa640 1 -- 172.21.15.22:0/807171371 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f22b00b43f0 con 0x7f22bc152420 2024-05-21T13:36:37.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.637+0000 7f22b97fa640 1 --2- 172.21.15.22:0/807171371 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f22a806f400 0x7f22a80718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:37.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.637+0000 7f22b97fa640 1 -- 172.21.15.22:0/807171371 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f22b0129bd0 con 0x7f22bc152420 2024-05-21T13:36:37.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.637+0000 7f22c0c54640 1 --2- 172.21.15.22:0/807171371 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f22a806f400 0x7f22a80718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:37.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.637+0000 7f22c6043000 1 Processor -- start 2024-05-21T13:36:37.617 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.637+0000 7f22c6043000 1 -- start start 2024-05-21T13:36:37.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.637+0000 7f22c0c54640 1 --2- 172.21.15.22:0/807171371 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f22a806f400 0x7f22a80718c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f22ac0045f0 tx=0x7f22ac008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:37.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.637+0000 7f22c6043000 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x559aad3014a0 0x559aad2ca200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:37.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.637+0000 7f22c6043000 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559aad2ca740 0x559aad2e99b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:37.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.637+0000 7f22c6043000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559aad2e9ef0 0x559aad2ea2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:37.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.637+0000 7f22c6043000 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x559aad11e6d0 con 0x559aad2ca740 2024-05-21T13:36:37.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.637+0000 7f22c6043000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x559aad10e270 con 0x559aad2e9ef0 2024-05-21T13:36:37.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.637+0000 7f22c6043000 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x559aad1122b0 con 0x559aad3014a0 2024-05-21T13:36:37.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.637+0000 7f22bbfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559aad2ca740 0x559aad2e99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:37.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.637+0000 7f22bbfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559aad2ca740 0x559aad2e99b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43114/0 (socket says 172.21.15.22:43114) 2024-05-21T13:36:37.620 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.637+0000 7f22bbfff640 1 -- 172.21.15.22:0/2731832123 learned_addr learned my addr 172.21.15.22:0/2731832123 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:37.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.637+0000 7f22c0c54640 1 --2- 172.21.15.22:0/2731832123 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x559aad3014a0 0x559aad2ca200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:37.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.637+0000 7f22c1455640 1 --2- 172.21.15.22:0/2731832123 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559aad2e9ef0 0x559aad2ea2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:37.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.637+0000 7f22bbfff640 1 -- 172.21.15.22:0/2731832123 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x559aad3014a0 msgr2=0x559aad2ca200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:37.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.637+0000 7f22bbfff640 1 --2- 172.21.15.22:0/2731832123 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x559aad3014a0 0x559aad2ca200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:37.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.637+0000 7f22bbfff640 1 -- 172.21.15.22:0/2731832123 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559aad2e9ef0 msgr2=0x559aad2ea2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:37.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.637+0000 7f22bbfff640 1 --2- 172.21.15.22:0/2731832123 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559aad2e9ef0 0x559aad2ea2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:37.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.637+0000 7f22bbfff640 1 -- 172.21.15.22:0/2731832123 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559aad0ecbf0 con 0x559aad2ca740 2024-05-21T13:36:37.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.637+0000 7f22c1455640 1 --2- 172.21.15.22:0/2731832123 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559aad2e9ef0 0x559aad2ea2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:36:37.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.641+0000 7f22bbfff640 1 --2- 172.21.15.22:0/2731832123 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559aad2ca740 0x559aad2e99b0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f22b00f22d0 tx=0x7f22b00192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b620c01267c3c4db server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:37.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.641+0000 7f22a27fc640 1 -- 172.21.15.22:0/2731832123 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22b00f6250 con 0x559aad2ca740 2024-05-21T13:36:37.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.641+0000 7f22a27fc640 1 -- 172.21.15.22:0/2731832123 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22b00b0070 con 0x559aad2ca740 2024-05-21T13:36:37.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.641+0000 7f22a27fc640 1 -- 172.21.15.22:0/2731832123 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22b00fa550 con 0x559aad2ca740 2024-05-21T13:36:37.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.641+0000 7f22c6043000 1 -- 172.21.15.22:0/2731832123 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559aad2ca740 msgr2=0x559aad2e99b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:37.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.641+0000 7f22c6043000 1 --2- 172.21.15.22:0/2731832123 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559aad2ca740 0x559aad2e99b0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f22b00f22d0 tx=0x7f22b00192c0 comp rx=0 tx=0).stop 2024-05-21T13:36:37.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.641+0000 7f22c6043000 1 -- 172.21.15.22:0/2731832123 shutdown_connections 2024-05-21T13:36:37.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.641+0000 7f22c6043000 1 --2- 172.21.15.22:0/2731832123 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559aad2e9ef0 0x559aad2ea2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:37.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.641+0000 7f22c6043000 1 --2- 172.21.15.22:0/2731832123 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559aad2ca740 0x559aad2e99b0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:37.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.641+0000 7f22c6043000 1 --2- 172.21.15.22:0/2731832123 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x559aad3014a0 0x559aad2ca200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:37.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.641+0000 7f22c6043000 1 -- 172.21.15.22:0/2731832123 >> 172.21.15.22:0/2731832123 conn(0x559aad1a9ef0 msgr2=0x559aad300b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:37.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.641+0000 7f22c6043000 1 -- 172.21.15.22:0/2731832123 shutdown_connections 2024-05-21T13:36:37.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.641+0000 7f22c6043000 1 -- 172.21.15.22:0/2731832123 wait complete. 2024-05-21T13:36:37.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.641+0000 7f22c6043000 1 -- start start 2024-05-21T13:36:37.622 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.641+0000 7f22c6043000 1 Processor -- start 2024-05-21T13:36:37.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.641+0000 7f22c6043000 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x559aad2ca740 0x559aad30e050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:37.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.641+0000 7f22c6043000 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559aad2e9ef0 0x559aad30e590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:37.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.641+0000 7f22c6043000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559aad3014a0 0x559aad2c5c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:37.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.641+0000 7f22c6043000 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x559aad0d1630 con 0x559aad2e9ef0 2024-05-21T13:36:37.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.641+0000 7f22c6043000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x559aad192570 con 0x559aad3014a0 2024-05-21T13:36:37.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.641+0000 7f22c6043000 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x559aad11d4a0 con 0x559aad2ca740 2024-05-21T13:36:37.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.641+0000 7f22c6043000 10 client.0 _ll_register_callbacks cb 0x559aad2ad540 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-21T13:36:37.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.641+0000 7f22bbfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559aad2e9ef0 0x559aad30e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:37.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.641+0000 7f22bbfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559aad2e9ef0 0x559aad30e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43128/0 (socket says 172.21.15.22:43128) 2024-05-21T13:36:37.626 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.641+0000 7f22bbfff640 1 -- 172.21.15.22:0/2465476178 learned_addr learned my addr 172.21.15.22:0/2465476178 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:37.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.641+0000 7f22c0c54640 1 --2- 172.21.15.22:0/2465476178 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x559aad2ca740 0x559aad30e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:37.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.641+0000 7f22c1455640 1 --2- 172.21.15.22:0/2465476178 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559aad3014a0 0x559aad2c5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:37.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.641+0000 7f22bbfff640 1 -- 172.21.15.22:0/2465476178 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x559aad2ca740 msgr2=0x559aad30e050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:37.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.641+0000 7f22bbfff640 1 --2- 172.21.15.22:0/2465476178 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x559aad2ca740 0x559aad30e050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:37.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.641+0000 7f22bbfff640 1 -- 172.21.15.22:0/2465476178 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559aad3014a0 msgr2=0x559aad2c5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:37.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.641+0000 7f22bbfff640 1 --2- 172.21.15.22:0/2465476178 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559aad3014a0 0x559aad2c5c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:37.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.641+0000 7f22bbfff640 1 -- 172.21.15.22:0/2465476178 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559aad1569b0 con 0x559aad2e9ef0 2024-05-21T13:36:37.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.641+0000 7f22c1455640 1 --2- 172.21.15.22:0/2465476178 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559aad3014a0 0x559aad2c5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:36:37.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.641+0000 7f22bbfff640 1 --2- 172.21.15.22:0/2465476178 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559aad2e9ef0 0x559aad30e590 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f22b0127e10 tx=0x7f22b0000bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b91256e1e1c6950 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:37.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.641+0000 7f229b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-05-21T13:36:37.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.641+0000 7f229b7fe640 1 -- 172.21.15.22:0/2465476178 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22b00fa550 con 0x559aad2e9ef0 2024-05-21T13:36:37.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.641+0000 7f229b7fe640 1 -- 172.21.15.22:0/2465476178 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f22b00fa020 con 0x559aad2e9ef0 2024-05-21T13:36:37.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.641+0000 7f22c6043000 1 -- 172.21.15.22:0/2465476178 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f22b00b0070 con 0x559aad2e9ef0 2024-05-21T13:36:37.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.641+0000 7f229b7fe640 1 -- 172.21.15.22:0/2465476178 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f22b00f6250 con 0x559aad2e9ef0 2024-05-21T13:36:37.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.641+0000 7f22c6043000 10 client.4713 fetch_fsmap learned FSMap version 14 2024-05-21T13:36:37.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.641+0000 7f22c6043000 1 -- 172.21.15.22:0/2465476178 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x559aad0e9510 con 0x559aad2e9ef0 2024-05-21T13:36:37.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.641+0000 7f229b7fe640 1 -- 172.21.15.22:0/2465476178 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22b00b0070 con 0x559aad2e9ef0 2024-05-21T13:36:37.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.641+0000 7f229b7fe640 1 -- 172.21.15.22:0/2465476178 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7f22b00f54b0 con 0x559aad2e9ef0 2024-05-21T13:36:37.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.641+0000 7f22c6043000 10 client.4713 fetch_fsmap finished waiting for FSMap version 14 2024-05-21T13:36:37.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.641+0000 7f22c6043000 10 client.4713 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-21T13:36:37.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.641+0000 7f22c6043000 20 client.4713 populate_metadata read hostname 'smithi022' 2024-05-21T13:36:37.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.641+0000 7f22c6043000 1 --2- 172.21.15.22:0/2465476178 >> [v2:172.21.15.115:6834/3894678097,v1:172.21.15.115:6835/3894678097] conn(0x559aad2c6900 0x559aad2c6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:37.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.641+0000 7f22c6043000 4 client.4713 mds_command: new command op to 4294 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-21T13:36:37.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.641+0000 7f22c6043000 1 -- 172.21.15.22:0/2465476178 --> [v2:172.21.15.115:6834/3894678097,v1:172.21.15.115:6835/3894678097] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559aad0a9bc0 con 0x559aad2c6900 2024-05-21T13:36:37.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.645+0000 7f22c0c54640 1 --2- 172.21.15.22:0/2465476178 >> [v2:172.21.15.115:6834/3894678097,v1:172.21.15.115:6835/3894678097] conn(0x559aad2c6900 0x559aad2c6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:37.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.645+0000 7f229b7fe640 10 client.4713 ms_handle_connect on v2:172.21.15.115:6834/3894678097 2024-05-21T13:36:37.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.645+0000 7f22c0c54640 1 --2- 172.21.15.22:0/2465476178 >> [v2:172.21.15.115:6834/3894678097,v1:172.21.15.115:6835/3894678097] conn(0x559aad2c6900 0x559aad2c6ce0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2892326d0a11076c server_cookie=bca72ef0155b71b9 in_seq=0 out_seq=0 2024-05-21T13:36:37.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.645+0000 7f229b7fe640 1 -- 172.21.15.22:0/2465476178 <== mds.1 v2:172.21.15.115:6834/3894678097 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x559aad0a9bc0 con 0x559aad2c6900 2024-05-21T13:36:37.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.645+0000 7f229b7fe640 10 client.4713 handle_command_reply: tid=0 2024-05-21T13:36:37.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.645+0000 7f22c6043000 1 client.4713 shutdown 2024-05-21T13:36:37.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.645+0000 7f22c6043000 1 -- 172.21.15.22:0/2465476178 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559aad2e9ef0 msgr2=0x559aad30e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:37.629 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.645+0000 7f22c6043000 1 --2- 172.21.15.22:0/2465476178 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559aad2e9ef0 0x559aad30e590 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f22b0127e10 tx=0x7f22b0000bd0 comp rx=0 tx=0).stop 2024-05-21T13:36:37.630 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.645+0000 7f22c6043000 1 -- 172.21.15.22:0/2465476178 shutdown_connections 2024-05-21T13:36:37.630 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.645+0000 7f22c6043000 1 --2- 172.21.15.22:0/2465476178 >> [v2:172.21.15.115:6834/3894678097,v1:172.21.15.115:6835/3894678097] conn(0x559aad2c6900 0x559aad2c6ce0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:37.630 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.645+0000 7f22c6043000 1 --2- 172.21.15.22:0/2465476178 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559aad3014a0 0x559aad2c5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:37.630 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.645+0000 7f22c6043000 1 --2- 172.21.15.22:0/2465476178 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559aad2e9ef0 0x559aad30e590 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:37.630 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.645+0000 7f22c6043000 1 --2- 172.21.15.22:0/2465476178 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x559aad2ca740 0x559aad30e050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:37.630 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.645+0000 7f229b7fe640 0 client.4713 ms_handle_reset on v2:172.21.15.115:6834/3894678097 2024-05-21T13:36:37.630 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.645+0000 7f22c6043000 1 -- 172.21.15.22:0/2465476178 >> 172.21.15.22:0/2465476178 conn(0x559aad1a9ef0 msgr2=0x559aad2c08e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:37.630 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.645+0000 7f22c6043000 1 -- 172.21.15.22:0/2465476178 shutdown_connections 2024-05-21T13:36:37.630 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.645+0000 7f22c6043000 1 -- 172.21.15.22:0/2465476178 wait complete. 2024-05-21T13:36:37.630 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.645+0000 7f22c6043000 20 client.4713 trim_cache size 0 max 16384 2024-05-21T13:36:37.643 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.665+0000 7f22c6043000 1 Processor -- start 2024-05-21T13:36:37.643 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.665+0000 7f22c6043000 1 -- start start 2024-05-21T13:36:37.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.665+0000 7f22c6043000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559aad1a9ef0 0x559aad31e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:37.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.665+0000 7f22c6043000 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x559aad2ca740 0x559aad31d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:37.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.665+0000 7f22c6043000 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559aad2e9ef0 0x559aad31d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:37.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.665+0000 7f22c6043000 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x559aad0ab200 con 0x559aad2e9ef0 2024-05-21T13:36:37.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.665+0000 7f22c6043000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x559aad0a67b0 con 0x559aad1a9ef0 2024-05-21T13:36:37.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.665+0000 7f22c6043000 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x559aad1115c0 con 0x559aad2ca740 2024-05-21T13:36:37.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.665+0000 7f22c1455640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559aad2e9ef0 0x559aad31d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:37.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.665+0000 7f22c1455640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559aad2e9ef0 0x559aad31d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43144/0 (socket says 172.21.15.22:43144) 2024-05-21T13:36:37.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.665+0000 7f22c1455640 1 -- 172.21.15.22:0/3334251488 learned_addr learned my addr 172.21.15.22:0/3334251488 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:37.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.665+0000 7f22c0c54640 1 --2- 172.21.15.22:0/3334251488 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559aad1a9ef0 0x559aad31e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:37.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.665+0000 7f22c1455640 1 -- 172.21.15.22:0/3334251488 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x559aad2ca740 msgr2=0x559aad31d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:37.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.665+0000 7f22bbfff640 1 --2- 172.21.15.22:0/3334251488 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x559aad2ca740 0x559aad31d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:37.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.665+0000 7f22c1455640 1 --2- 172.21.15.22:0/3334251488 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x559aad2ca740 0x559aad31d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:37.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.665+0000 7f22c1455640 1 -- 172.21.15.22:0/3334251488 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559aad1a9ef0 msgr2=0x559aad31e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:37.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.665+0000 7f22c1455640 1 --2- 172.21.15.22:0/3334251488 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559aad1a9ef0 0x559aad31e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:37.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.665+0000 7f22c1455640 1 -- 172.21.15.22:0/3334251488 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559aad0af860 con 0x559aad2e9ef0 2024-05-21T13:36:37.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.665+0000 7f22c1455640 1 --2- 172.21.15.22:0/3334251488 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559aad2e9ef0 0x559aad31d720 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f22b4003cc0 tx=0x7f22b4004410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6afea300bb0615a3 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:37.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.665+0000 7f22a1ffb640 1 -- 172.21.15.22:0/3334251488 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22b4019020 con 0x559aad2e9ef0 2024-05-21T13:36:37.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.665+0000 7f22a1ffb640 1 -- 172.21.15.22:0/3334251488 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22b4003e70 con 0x559aad2e9ef0 2024-05-21T13:36:37.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.665+0000 7f22a1ffb640 1 -- 172.21.15.22:0/3334251488 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22b4015820 con 0x559aad2e9ef0 2024-05-21T13:36:37.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.665+0000 7f22c6043000 1 -- 172.21.15.22:0/3334251488 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559aad2e9ef0 msgr2=0x559aad31d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:37.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.665+0000 7f22c6043000 1 --2- 172.21.15.22:0/3334251488 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559aad2e9ef0 0x559aad31d720 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f22b4003cc0 tx=0x7f22b4004410 comp rx=0 tx=0).stop 2024-05-21T13:36:37.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.665+0000 7f22c6043000 1 -- 172.21.15.22:0/3334251488 shutdown_connections 2024-05-21T13:36:37.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.665+0000 7f22c6043000 1 --2- 172.21.15.22:0/3334251488 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559aad2e9ef0 0x559aad31d720 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:37.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.665+0000 7f22c6043000 1 --2- 172.21.15.22:0/3334251488 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x559aad2ca740 0x559aad31d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:37.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.665+0000 7f22c6043000 1 --2- 172.21.15.22:0/3334251488 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559aad1a9ef0 0x559aad31e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:37.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.665+0000 7f22c6043000 1 -- 172.21.15.22:0/3334251488 >> 172.21.15.22:0/3334251488 conn(0x559aad2e9b10 msgr2=0x559aad2fc360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:37.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.669+0000 7f22c6043000 1 -- 172.21.15.22:0/3334251488 shutdown_connections 2024-05-21T13:36:37.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.669+0000 7f22c6043000 1 -- 172.21.15.22:0/3334251488 wait complete. 2024-05-21T13:36:37.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.669+0000 7f22c6043000 1 -- start start 2024-05-21T13:36:37.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.669+0000 7f22c6043000 1 Processor -- start 2024-05-21T13:36:37.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.669+0000 7f22c6043000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559aad1a9ef0 0x559aad313090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:37.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.669+0000 7f22c6043000 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559aad2ca740 0x559aad3135d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:37.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.669+0000 7f22c6043000 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x559aad2e9ef0 0x559aad37aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:37.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.669+0000 7f22c6043000 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x559aad11d4a0 con 0x559aad2ca740 2024-05-21T13:36:37.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.669+0000 7f22c6043000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x559aad1168e0 con 0x559aad1a9ef0 2024-05-21T13:36:37.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.669+0000 7f22c6043000 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x559aad0d1630 con 0x559aad2e9ef0 2024-05-21T13:36:37.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.669+0000 7f22c6043000 10 client.0 _ll_register_callbacks cb 0x7f22b00f21a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-21T13:36:37.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.669+0000 7f22bbfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559aad2ca740 0x559aad3135d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:37.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.669+0000 7f22bbfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559aad2ca740 0x559aad3135d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43150/0 (socket says 172.21.15.22:43150) 2024-05-21T13:36:37.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.669+0000 7f22bbfff640 1 -- 172.21.15.22:0/2820624741 learned_addr learned my addr 172.21.15.22:0/2820624741 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:37.652 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.669+0000 7f22c0c54640 1 --2- 172.21.15.22:0/2820624741 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559aad1a9ef0 0x559aad313090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:37.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.669+0000 7f22c1455640 1 --2- 172.21.15.22:0/2820624741 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x559aad2e9ef0 0x559aad37aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:37.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.669+0000 7f22bbfff640 1 -- 172.21.15.22:0/2820624741 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x559aad2e9ef0 msgr2=0x559aad37aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:37.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.669+0000 7f22bbfff640 1 --2- 172.21.15.22:0/2820624741 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x559aad2e9ef0 0x559aad37aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:37.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.669+0000 7f22bbfff640 1 -- 172.21.15.22:0/2820624741 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559aad1a9ef0 msgr2=0x559aad313090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:37.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.669+0000 7f22bbfff640 1 --2- 172.21.15.22:0/2820624741 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559aad1a9ef0 0x559aad313090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:37.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.669+0000 7f22bbfff640 1 -- 172.21.15.22:0/2820624741 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559aad0c5e80 con 0x559aad2ca740 2024-05-21T13:36:37.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.669+0000 7f22c0c54640 1 --2- 172.21.15.22:0/2820624741 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559aad1a9ef0 0x559aad313090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:36:37.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.669+0000 7f22bbfff640 1 --2- 172.21.15.22:0/2820624741 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559aad2ca740 0x559aad3135d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f22b0019300 tx=0x7f22b0009240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a257bf5fd44de3d1 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:37.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.669+0000 7f229b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-05-21T13:36:37.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.669+0000 7f229b7fe640 1 -- 172.21.15.22:0/2820624741 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22b00f59c0 con 0x559aad2ca740 2024-05-21T13:36:37.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.669+0000 7f229b7fe640 1 -- 172.21.15.22:0/2820624741 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f22b00fa070 con 0x559aad2ca740 2024-05-21T13:36:37.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.669+0000 7f22c6043000 1 -- 172.21.15.22:0/2820624741 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f22b4003e70 con 0x559aad2ca740 2024-05-21T13:36:37.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.669+0000 7f229b7fe640 1 -- 172.21.15.22:0/2820624741 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f22b00fa550 con 0x559aad2ca740 2024-05-21T13:36:37.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.669+0000 7f22c6043000 10 client.4719 fetch_fsmap learned FSMap version 14 2024-05-21T13:36:37.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.669+0000 7f22c6043000 1 -- 172.21.15.22:0/2820624741 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x559aad192a00 con 0x559aad2ca740 2024-05-21T13:36:37.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.669+0000 7f229b7fe640 1 -- 172.21.15.22:0/2820624741 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22b4003e70 con 0x559aad2ca740 2024-05-21T13:36:37.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.669+0000 7f229b7fe640 1 -- 172.21.15.22:0/2820624741 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7f22b010b0d0 con 0x559aad2ca740 2024-05-21T13:36:37.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.669+0000 7f22c6043000 10 client.4719 fetch_fsmap finished waiting for FSMap version 14 2024-05-21T13:36:37.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.669+0000 7f22c6043000 10 client.4719 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-21T13:36:37.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.669+0000 7f22c6043000 20 client.4719 populate_metadata read hostname 'smithi022' 2024-05-21T13:36:37.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.669+0000 7f22c6043000 1 --2- 172.21.15.22:0/2820624741 >> [v2:172.21.15.115:6834/3894678097,v1:172.21.15.115:6835/3894678097] conn(0x559aad3014a0 0x559aad37b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:37.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.669+0000 7f22c6043000 4 client.4719 mds_command: new command op to 4294 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-21T13:36:37.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.669+0000 7f22c6043000 1 -- 172.21.15.22:0/2820624741 --> [v2:172.21.15.115:6834/3894678097,v1:172.21.15.115:6835/3894678097] -- command(tid 0: {"prefix": "status"}) -- 0x559aad0addc0 con 0x559aad3014a0 2024-05-21T13:36:37.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.669+0000 7f22c0c54640 1 --2- 172.21.15.22:0/2820624741 >> [v2:172.21.15.115:6834/3894678097,v1:172.21.15.115:6835/3894678097] conn(0x559aad3014a0 0x559aad37b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:37.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.669+0000 7f229b7fe640 10 client.4719 ms_handle_connect on v2:172.21.15.115:6834/3894678097 2024-05-21T13:36:37.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.669+0000 7f22c0c54640 1 --2- 172.21.15.22:0/2820624741 >> [v2:172.21.15.115:6834/3894678097,v1:172.21.15.115:6835/3894678097] conn(0x559aad3014a0 0x559aad37b3b0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=891884d9ad140b8a server_cookie=8c96ac3a3db1d284 in_seq=0 out_seq=0 2024-05-21T13:36:37.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.673+0000 7f229b7fe640 1 -- 172.21.15.22:0/2820624741 <== mds.1 v2:172.21.15.115:6834/3894678097 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x559aad0addc0 con 0x559aad3014a0 2024-05-21T13:36:37.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.673+0000 7f229b7fe640 10 client.4719 handle_command_reply: tid=0 2024-05-21T13:36:37.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.673+0000 7f22c6043000 1 client.4719 shutdown 2024-05-21T13:36:37.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.673+0000 7f22c6043000 1 -- 172.21.15.22:0/2820624741 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559aad2ca740 msgr2=0x559aad3135d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:37.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.673+0000 7f22c6043000 1 --2- 172.21.15.22:0/2820624741 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559aad2ca740 0x559aad3135d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f22b0019300 tx=0x7f22b0009240 comp rx=0 tx=0).stop 2024-05-21T13:36:37.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.673+0000 7f22c6043000 1 -- 172.21.15.22:0/2820624741 shutdown_connections 2024-05-21T13:36:37.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.673+0000 7f22c6043000 1 --2- 172.21.15.22:0/2820624741 >> [v2:172.21.15.115:6834/3894678097,v1:172.21.15.115:6835/3894678097] conn(0x559aad3014a0 0x559aad37b3b0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:37.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.673+0000 7f22c6043000 1 --2- 172.21.15.22:0/2820624741 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x559aad2e9ef0 0x559aad37aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:37.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.673+0000 7f22c6043000 1 --2- 172.21.15.22:0/2820624741 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x559aad2ca740 0x559aad3135d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:37.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.673+0000 7f22c6043000 1 --2- 172.21.15.22:0/2820624741 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x559aad1a9ef0 0x559aad313090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:37.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.673+0000 7f229b7fe640 0 client.4719 ms_handle_reset on v2:172.21.15.115:6834/3894678097 2024-05-21T13:36:37.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.673+0000 7f22c6043000 1 -- 172.21.15.22:0/2820624741 >> 172.21.15.22:0/2820624741 conn(0x559aad2e9b10 msgr2=0x559aad2c28f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:37.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.673+0000 7f22c6043000 1 -- 172.21.15.22:0/2820624741 shutdown_connections 2024-05-21T13:36:37.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.673+0000 7f22c6043000 1 -- 172.21.15.22:0/2820624741 wait complete. 2024-05-21T13:36:37.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.673+0000 7f22c6043000 20 client.4719 trim_cache size 0 max 16384 2024-05-21T13:36:37.656 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-05-21T13:36:37.656 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_fsid": "f2c96204-e240-4e7f-8a76-927b4f80f534", 2024-05-21T13:36:37.656 INFO:teuthology.orchestra.run.smithi022.stdout: "whoami": 1, 2024-05-21T13:36:37.656 INFO:teuthology.orchestra.run.smithi022.stdout: "id": 4294, 2024-05-21T13:36:37.657 INFO:teuthology.orchestra.run.smithi022.stdout: "want_state": "up:active", 2024-05-21T13:36:37.657 INFO:teuthology.orchestra.run.smithi022.stdout: "state": "up:active", 2024-05-21T13:36:37.657 INFO:teuthology.orchestra.run.smithi022.stdout: "fs_name": "cephfs", 2024-05-21T13:36:37.657 INFO:teuthology.orchestra.run.smithi022.stdout: "rank_uptime": 15.789538581, 2024-05-21T13:36:37.657 INFO:teuthology.orchestra.run.smithi022.stdout: "mdsmap_epoch": 14, 2024-05-21T13:36:37.657 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch": 25, 2024-05-21T13:36:37.657 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch_barrier": 25, 2024-05-21T13:36:37.657 INFO:teuthology.orchestra.run.smithi022.stdout: "uptime": 45.969053969000001 2024-05-21T13:36:37.657 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-05-21T13:36:37.658 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.673+0000 7f22c2eb8640 1 -- 172.21.15.22:0/807171371 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f22a806f400 msgr2=0x7f22a80718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:37.658 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.673+0000 7f22c2eb8640 1 --2- 172.21.15.22:0/807171371 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f22a806f400 0x7f22a80718c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f22ac0045f0 tx=0x7f22ac008040 comp rx=0 tx=0).stop 2024-05-21T13:36:37.658 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.673+0000 7f22c2eb8640 1 -- 172.21.15.22:0/807171371 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f22bc152420 msgr2=0x7f22bc154b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:37.658 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.673+0000 7f22c2eb8640 1 --2- 172.21.15.22:0/807171371 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f22bc152420 0x7f22bc154b60 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f22b001abd0 tx=0x7f22b001ad60 comp rx=0 tx=0).stop 2024-05-21T13:36:37.658 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.673+0000 7f22c2eb8640 1 -- 172.21.15.22:0/807171371 shutdown_connections 2024-05-21T13:36:37.658 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.673+0000 7f22c2eb8640 1 --2- 172.21.15.22:0/807171371 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f22a806f400 0x7f22a80718c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:37.658 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.673+0000 7f22c2eb8640 1 --2- 172.21.15.22:0/807171371 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22bc158be0 0x7f22bc13eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:37.658 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.673+0000 7f22c2eb8640 1 --2- 172.21.15.22:0/807171371 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f22bc152420 0x7f22bc154b60 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:37.658 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.673+0000 7f22c2eb8640 1 --2- 172.21.15.22:0/807171371 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22bc072ed0 0x7f22bc144610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:37.658 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.673+0000 7f22c2eb8640 1 -- 172.21.15.22:0/807171371 >> 172.21.15.22:0/807171371 conn(0x7f22bc06ce70 msgr2=0x7f22bc1583e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:37.658 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.673+0000 7f22c2eb8640 1 -- 172.21.15.22:0/807171371 shutdown_connections 2024-05-21T13:36:37.659 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.673+0000 7f22c2eb8640 1 -- 172.21.15.22:0/807171371 wait complete. 2024-05-21T13:36:37.668 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2024-05-21T13:36:37.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.801+0000 7fb9950f9640 1 Processor -- start 2024-05-21T13:36:37.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.801+0000 7fb9950f9640 1 -- start start 2024-05-21T13:36:37.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.801+0000 7fb9950f9640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb990070790 0x7fb9900c8290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:37.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.801+0000 7fb9950f9640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb99015fdf0 0x7fb990155cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:37.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.801+0000 7fb9950f9640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb990068390 con 0x7fb990070b70 2024-05-21T13:36:37.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.801+0000 7fb9950f9640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7fb990068950 con 0x7fb990070790 2024-05-21T13:36:37.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.801+0000 7fb9950f9640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7fb9900c9010 con 0x7fb99015fdf0 2024-05-21T13:36:37.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.801+0000 7fb98f59e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb99015fdf0 0x7fb990155cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:37.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.801+0000 7fb98ed9d640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb990070790 0x7fb9900c8290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:37.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.801+0000 7fb98f59e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb99015fdf0 0x7fb990155cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.22:56022/0 (socket says 172.21.15.22:56022) 2024-05-21T13:36:37.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.801+0000 7fb98f59e640 1 -- 172.21.15.22:0/1050218647 learned_addr learned my addr 172.21.15.22:0/1050218647 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:37.783 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.805+0000 7fb98f59e640 1 -- 172.21.15.22:0/1050218647 >> v2:172.21.15.115:3300/0 conn(0x7fb990070790 msgr2=0x7fb9900c8290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:37.783 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.805+0000 7fb98f59e640 1 --2- 172.21.15.22:0/1050218647 >> v2:172.21.15.115:3300/0 conn(0x7fb990070790 0x7fb9900c8290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:37.783 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.805+0000 7fb98f59e640 1 -- 172.21.15.22:0/1050218647 >> v1:172.21.15.115:6789/0 conn(0x7fb990070b70 legacy=0x7fb9900c94a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:37.783 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.805+0000 7fb98f59e640 1 -- 172.21.15.22:0/1050218647 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb990068670 con 0x7fb99015fdf0 2024-05-21T13:36:37.783 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.805+0000 7fb98ed9d640 1 --2- 172.21.15.22:0/1050218647 >> v2:172.21.15.115:3300/0 conn(0x7fb990070790 0x7fb9900c8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-21T13:36:37.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.805+0000 7fb98f59e640 1 --2- 172.21.15.22:0/1050218647 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb99015fdf0 0x7fb990155cb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb988009e50 tx=0x7fb98801ca30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b302d3fc314dffa7 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:37.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.805+0000 7fb98dd9b640 1 -- 172.21.15.22:0/1050218647 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9880a5700 con 0x7fb99015fdf0 2024-05-21T13:36:37.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.805+0000 7fb98dd9b640 1 -- 172.21.15.22:0/1050218647 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9880a58a0 con 0x7fb99015fdf0 2024-05-21T13:36:37.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.805+0000 7fb98dd9b640 1 -- 172.21.15.22:0/1050218647 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9880a5c70 con 0x7fb99015fdf0 2024-05-21T13:36:37.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.805+0000 7fb9950f9640 1 -- 172.21.15.22:0/1050218647 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb99015fdf0 msgr2=0x7fb990155cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:37.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.805+0000 7fb9950f9640 1 --2- 172.21.15.22:0/1050218647 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb99015fdf0 0x7fb990155cb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb988009e50 tx=0x7fb98801ca30 comp rx=0 tx=0).stop 2024-05-21T13:36:37.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.805+0000 7fb9950f9640 1 -- 172.21.15.22:0/1050218647 shutdown_connections 2024-05-21T13:36:37.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.805+0000 7fb9950f9640 1 --2- 172.21.15.22:0/1050218647 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb99015fdf0 0x7fb990155cb0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:37.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.805+0000 7fb9950f9640 1 --2- 172.21.15.22:0/1050218647 >> v2:172.21.15.115:3300/0 conn(0x7fb990070790 0x7fb9900c8290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:37.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.805+0000 7fb9950f9640 1 -- 172.21.15.22:0/1050218647 >> 172.21.15.22:0/1050218647 conn(0x7fb9900cd890 msgr2=0x7fb9900cdca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:37.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.805+0000 7fb9950f9640 1 -- 172.21.15.22:0/1050218647 shutdown_connections 2024-05-21T13:36:37.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.805+0000 7fb9950f9640 1 -- 172.21.15.22:0/1050218647 wait complete. 2024-05-21T13:36:37.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.809+0000 7fb9950f9640 1 Processor -- start 2024-05-21T13:36:37.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.809+0000 7fb9950f9640 1 -- start start 2024-05-21T13:36:37.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.809+0000 7fb9950f9640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb990070790 0x7fb99014faa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:37.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.809+0000 7fb9950f9640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb990070b70 0x7fb9900cca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:37.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.809+0000 7fb9950f9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb99015fdf0 0x7fb99015ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:37.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.809+0000 7fb9950f9640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb990159da0 con 0x7fb99015fdf0 2024-05-21T13:36:37.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.809+0000 7fb9950f9640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fb990156600 con 0x7fb990070b70 2024-05-21T13:36:37.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.809+0000 7fb9950f9640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7fb990071320 con 0x7fb990070790 2024-05-21T13:36:37.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.809+0000 7fb98f59e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb99015fdf0 0x7fb99015ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:37.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.809+0000 7fb98f59e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb99015fdf0 0x7fb99015ae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43152/0 (socket says 172.21.15.22:43152) 2024-05-21T13:36:37.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.809+0000 7fb98f59e640 1 -- 172.21.15.22:0/2928395158 learned_addr learned my addr 172.21.15.22:0/2928395158 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:37.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.809+0000 7fb98ed9d640 1 --2- 172.21.15.22:0/2928395158 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb990070790 0x7fb99014faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:37.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.809+0000 7fb98e59c640 1 --2- 172.21.15.22:0/2928395158 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb990070b70 0x7fb9900cca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:37.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.809+0000 7fb98f59e640 1 -- 172.21.15.22:0/2928395158 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb990070790 msgr2=0x7fb99014faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:37.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.809+0000 7fb98f59e640 1 --2- 172.21.15.22:0/2928395158 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb990070790 0x7fb99014faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:37.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.809+0000 7fb98f59e640 1 -- 172.21.15.22:0/2928395158 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb990070b70 msgr2=0x7fb9900cca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:37.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.809+0000 7fb98f59e640 1 --2- 172.21.15.22:0/2928395158 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb990070b70 0x7fb9900cca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:37.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.809+0000 7fb98f59e640 1 -- 172.21.15.22:0/2928395158 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb99015b370 con 0x7fb99015fdf0 2024-05-21T13:36:37.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.809+0000 7fb98f59e640 1 --2- 172.21.15.22:0/2928395158 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb99015fdf0 0x7fb99015ae30 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb98801a660 tx=0x7fb9880197d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:37.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.809+0000 7fb9777fe640 1 -- 172.21.15.22:0/2928395158 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb988009510 con 0x7fb99015fdf0 2024-05-21T13:36:37.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.809+0000 7fb9777fe640 1 -- 172.21.15.22:0/2928395158 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9880be070 con 0x7fb99015fdf0 2024-05-21T13:36:37.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.809+0000 7fb9950f9640 1 -- 172.21.15.22:0/2928395158 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9900cd0f0 con 0x7fb99015fdf0 2024-05-21T13:36:37.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.809+0000 7fb9777fe640 1 -- 172.21.15.22:0/2928395158 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9880b88b0 con 0x7fb99015fdf0 2024-05-21T13:36:37.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.809+0000 7fb9950f9640 1 -- 172.21.15.22:0/2928395158 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9901f43a0 con 0x7fb99015fdf0 2024-05-21T13:36:37.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.809+0000 7fb9777fe640 1 -- 172.21.15.22:0/2928395158 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fb9880b8a50 con 0x7fb99015fdf0 2024-05-21T13:36:37.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.813+0000 7fb9777fe640 1 --2- 172.21.15.22:0/2928395158 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fb97c06f400 0x7fb97c0718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:37.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.813+0000 7fb9777fe640 1 -- 172.21.15.22:0/2928395158 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb98812a5d0 con 0x7fb99015fdf0 2024-05-21T13:36:37.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.813+0000 7fb98ed9d640 1 --2- 172.21.15.22:0/2928395158 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fb97c06f400 0x7fb97c0718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:37.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.813+0000 7fb998284000 1 Processor -- start 2024-05-21T13:36:37.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.813+0000 7fb998284000 1 -- start start 2024-05-21T13:36:37.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.813+0000 7fb98ed9d640 1 --2- 172.21.15.22:0/2928395158 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fb97c06f400 0x7fb97c0718c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb980009580 tx=0x7fb980009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:37.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.813+0000 7fb998284000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55950dd594a0 0x55950dd22200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:37.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.813+0000 7fb998284000 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55950dd22740 0x55950dd419b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:37.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.813+0000 7fb998284000 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55950dd41ef0 0x55950dd422d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:37.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.813+0000 7fb998284000 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55950db766d0 con 0x55950dd41ef0 2024-05-21T13:36:37.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.813+0000 7fb998284000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55950db66270 con 0x55950dd594a0 2024-05-21T13:36:37.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.813+0000 7fb998284000 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x55950db6a2b0 con 0x55950dd22740 2024-05-21T13:36:37.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.813+0000 7fb98f59e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55950dd41ef0 0x55950dd422d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:37.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.813+0000 7fb98f59e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55950dd41ef0 0x55950dd422d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43168/0 (socket says 172.21.15.22:43168) 2024-05-21T13:36:37.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.813+0000 7fb98f59e640 1 -- 172.21.15.22:0/3380576764 learned_addr learned my addr 172.21.15.22:0/3380576764 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:37.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.813+0000 7fb98e59c640 1 --2- 172.21.15.22:0/3380576764 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55950dd22740 0x55950dd419b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:37.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.813+0000 7fb98f59e640 1 -- 172.21.15.22:0/3380576764 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55950dd22740 msgr2=0x55950dd419b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:37.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.813+0000 7fb98f59e640 1 --2- 172.21.15.22:0/3380576764 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55950dd22740 0x55950dd419b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:37.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.813+0000 7fb98f59e640 1 -- 172.21.15.22:0/3380576764 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55950dd594a0 msgr2=0x55950dd22200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:37.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.813+0000 7fb98f59e640 1 --2- 172.21.15.22:0/3380576764 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55950dd594a0 0x55950dd22200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:37.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.813+0000 7fb98f59e640 1 -- 172.21.15.22:0/3380576764 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55950db44bf0 con 0x55950dd41ef0 2024-05-21T13:36:37.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.813+0000 7fb98e59c640 1 --2- 172.21.15.22:0/3380576764 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55950dd22740 0x55950dd419b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:36:37.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.813+0000 7fb98f59e640 1 --2- 172.21.15.22:0/3380576764 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55950dd41ef0 0x55950dd422d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb9880f6ad0 tx=0x7fb9880f6550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f13471880f4532dd server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:37.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.813+0000 7fb974ff9640 1 -- 172.21.15.22:0/3380576764 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9880f6650 con 0x55950dd41ef0 2024-05-21T13:36:37.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.813+0000 7fb974ff9640 1 -- 172.21.15.22:0/3380576764 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9880a5880 con 0x55950dd41ef0 2024-05-21T13:36:37.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.813+0000 7fb974ff9640 1 -- 172.21.15.22:0/3380576764 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb988128e40 con 0x55950dd41ef0 2024-05-21T13:36:37.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.813+0000 7fb998284000 1 -- 172.21.15.22:0/3380576764 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55950dd41ef0 msgr2=0x55950dd422d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:37.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.813+0000 7fb998284000 1 --2- 172.21.15.22:0/3380576764 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55950dd41ef0 0x55950dd422d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb9880f6ad0 tx=0x7fb9880f6550 comp rx=0 tx=0).stop 2024-05-21T13:36:37.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.813+0000 7fb998284000 1 -- 172.21.15.22:0/3380576764 shutdown_connections 2024-05-21T13:36:37.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.813+0000 7fb998284000 1 --2- 172.21.15.22:0/3380576764 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55950dd41ef0 0x55950dd422d0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:37.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.813+0000 7fb998284000 1 --2- 172.21.15.22:0/3380576764 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55950dd22740 0x55950dd419b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:37.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.813+0000 7fb998284000 1 --2- 172.21.15.22:0/3380576764 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55950dd594a0 0x55950dd22200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:37.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.813+0000 7fb998284000 1 -- 172.21.15.22:0/3380576764 >> 172.21.15.22:0/3380576764 conn(0x55950dc01ef0 msgr2=0x55950dd58b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:37.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.813+0000 7fb998284000 1 -- 172.21.15.22:0/3380576764 shutdown_connections 2024-05-21T13:36:37.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.813+0000 7fb998284000 1 -- 172.21.15.22:0/3380576764 wait complete. 2024-05-21T13:36:37.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.817+0000 7fb998284000 1 -- start start 2024-05-21T13:36:37.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.817+0000 7fb998284000 1 Processor -- start 2024-05-21T13:36:37.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.817+0000 7fb998284000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55950dd22740 0x55950dd66050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:37.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.817+0000 7fb998284000 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55950dd41ef0 0x55950dd66590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:37.799 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.817+0000 7fb998284000 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55950dd594a0 0x55950dd1dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:37.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.817+0000 7fb998284000 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55950db29630 con 0x55950dd41ef0 2024-05-21T13:36:37.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.817+0000 7fb998284000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55950dbea570 con 0x55950dd22740 2024-05-21T13:36:37.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.817+0000 7fb998284000 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x55950db754a0 con 0x55950dd594a0 2024-05-21T13:36:37.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.817+0000 7fb998284000 10 client.0 _ll_register_callbacks cb 0x55950dd05540 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-21T13:36:37.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.817+0000 7fb98e59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55950dd41ef0 0x55950dd66590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:37.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.817+0000 7fb98e59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55950dd41ef0 0x55950dd66590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43182/0 (socket says 172.21.15.22:43182) 2024-05-21T13:36:37.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.817+0000 7fb98e59c640 1 -- 172.21.15.22:0/3507233733 learned_addr learned my addr 172.21.15.22:0/3507233733 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:37.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.817+0000 7fb98f59e640 1 --2- 172.21.15.22:0/3507233733 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55950dd594a0 0x55950dd1dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:37.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.817+0000 7fb98ed9d640 1 --2- 172.21.15.22:0/3507233733 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55950dd22740 0x55950dd66050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:37.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.817+0000 7fb98e59c640 1 -- 172.21.15.22:0/3507233733 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55950dd594a0 msgr2=0x55950dd1dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:37.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.817+0000 7fb98e59c640 1 --2- 172.21.15.22:0/3507233733 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55950dd594a0 0x55950dd1dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:37.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.817+0000 7fb98e59c640 1 -- 172.21.15.22:0/3507233733 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55950dd22740 msgr2=0x55950dd66050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:37.800 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.817+0000 7fb98e59c640 1 --2- 172.21.15.22:0/3507233733 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55950dd22740 0x55950dd66050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:37.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.817+0000 7fb98e59c640 1 -- 172.21.15.22:0/3507233733 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55950dbae9b0 con 0x55950dd41ef0 2024-05-21T13:36:37.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.817+0000 7fb98ed9d640 1 --2- 172.21.15.22:0/3507233733 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55950dd22740 0x55950dd66050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:36:37.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.817+0000 7fb98e59c640 1 --2- 172.21.15.22:0/3507233733 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55950dd41ef0 0x55950dd66590 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb984001e90 tx=0x7fb98400f660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ba3dab21648562b server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:37.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.817+0000 7fb96dffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-05-21T13:36:37.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.817+0000 7fb96dffb640 1 -- 172.21.15.22:0/3507233733 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb98400fe60 con 0x55950dd41ef0 2024-05-21T13:36:37.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.817+0000 7fb96dffb640 1 -- 172.21.15.22:0/3507233733 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb9840052e0 con 0x55950dd41ef0 2024-05-21T13:36:37.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.817+0000 7fb998284000 1 -- 172.21.15.22:0/3507233733 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb9880a5880 con 0x55950dd41ef0 2024-05-21T13:36:37.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.817+0000 7fb96dffb640 1 -- 172.21.15.22:0/3507233733 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7fb984020050 con 0x55950dd41ef0 2024-05-21T13:36:37.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.817+0000 7fb998284000 10 client.4728 fetch_fsmap learned FSMap version 14 2024-05-21T13:36:37.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.817+0000 7fb998284000 1 -- 172.21.15.22:0/3507233733 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x55950db41510 con 0x55950dd41ef0 2024-05-21T13:36:37.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.817+0000 7fb96dffb640 1 -- 172.21.15.22:0/3507233733 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9880a5880 con 0x55950dd41ef0 2024-05-21T13:36:37.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.817+0000 7fb96dffb640 1 -- 172.21.15.22:0/3507233733 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7fb984023020 con 0x55950dd41ef0 2024-05-21T13:36:37.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.817+0000 7fb998284000 10 client.4728 fetch_fsmap finished waiting for FSMap version 14 2024-05-21T13:36:37.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.817+0000 7fb998284000 10 client.4728 resolve_mds: resolved name 'f' to daemon mds.f 2024-05-21T13:36:37.801 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.817+0000 7fb998284000 20 client.4728 populate_metadata read hostname 'smithi022' 2024-05-21T13:36:37.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.817+0000 7fb998284000 1 --2- 172.21.15.22:0/3507233733 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x55950dd1ea00 0x55950dd1ede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:37.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.817+0000 7fb998284000 4 client.4728 mds_command: new command op to 4300 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-21T13:36:37.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.817+0000 7fb998284000 1 -- 172.21.15.22:0/3507233733 --> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55950db01bc0 con 0x55950dd1ea00 2024-05-21T13:36:37.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.817+0000 7fb98ed9d640 1 --2- 172.21.15.22:0/3507233733 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x55950dd1ea00 0x55950dd1ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:37.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.817+0000 7fb98ed9d640 1 --2- 172.21.15.22:0/3507233733 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x55950dd1ea00 0x55950dd1ede0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e7f2426204031662 server_cookie=36044b1ccfae4817 in_seq=0 out_seq=0 2024-05-21T13:36:37.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.817+0000 7fb96dffb640 10 client.4728 ms_handle_connect on v2:172.21.15.115:6838/1525097577 2024-05-21T13:36:37.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.821+0000 7fb96dffb640 1 -- 172.21.15.22:0/3507233733 <== mds.0 v2:172.21.15.115:6838/1525097577 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x55950db01bc0 con 0x55950dd1ea00 2024-05-21T13:36:37.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.821+0000 7fb96dffb640 10 client.4728 handle_command_reply: tid=0 2024-05-21T13:36:37.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.821+0000 7fb998284000 1 client.4728 shutdown 2024-05-21T13:36:37.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.821+0000 7fb998284000 1 -- 172.21.15.22:0/3507233733 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55950dd41ef0 msgr2=0x55950dd66590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:37.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.821+0000 7fb998284000 1 --2- 172.21.15.22:0/3507233733 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55950dd41ef0 0x55950dd66590 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb984001e90 tx=0x7fb98400f660 comp rx=0 tx=0).stop 2024-05-21T13:36:37.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.821+0000 7fb998284000 1 -- 172.21.15.22:0/3507233733 shutdown_connections 2024-05-21T13:36:37.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.821+0000 7fb998284000 1 --2- 172.21.15.22:0/3507233733 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55950dd594a0 0x55950dd1dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:37.802 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.821+0000 7fb998284000 1 --2- 172.21.15.22:0/3507233733 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55950dd41ef0 0x55950dd66590 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:37.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.821+0000 7fb998284000 1 --2- 172.21.15.22:0/3507233733 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x55950dd1ea00 0x55950dd1ede0 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:37.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.821+0000 7fb998284000 1 --2- 172.21.15.22:0/3507233733 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55950dd22740 0x55950dd66050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:37.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.821+0000 7fb96dffb640 0 client.4728 ms_handle_reset on v2:172.21.15.115:6838/1525097577 2024-05-21T13:36:37.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.821+0000 7fb998284000 1 -- 172.21.15.22:0/3507233733 >> 172.21.15.22:0/3507233733 conn(0x55950dc01ef0 msgr2=0x55950dd188e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:37.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.821+0000 7fb998284000 1 -- 172.21.15.22:0/3507233733 shutdown_connections 2024-05-21T13:36:37.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.821+0000 7fb998284000 1 -- 172.21.15.22:0/3507233733 wait complete. 2024-05-21T13:36:37.803 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.821+0000 7fb998284000 20 client.4728 trim_cache size 0 max 16384 2024-05-21T13:36:37.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.841+0000 7fb998284000 1 Processor -- start 2024-05-21T13:36:37.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.841+0000 7fb998284000 1 -- start start 2024-05-21T13:36:37.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.841+0000 7fb998284000 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55950dd22740 0x55950dd54360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:37.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.841+0000 7fb998284000 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55950dd41ef0 0x55950dd548a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:37.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.841+0000 7fb998284000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55950dd594a0 0x55950dd761f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:37.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.841+0000 7fb998284000 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb9902008a0 con 0x55950dd22740 2024-05-21T13:36:37.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.841+0000 7fb998284000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fb990200ef0 con 0x55950dd594a0 2024-05-21T13:36:37.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.841+0000 7fb998284000 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x55950db03200 con 0x55950dd41ef0 2024-05-21T13:36:37.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.841+0000 7fb98ed9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55950dd22740 0x55950dd54360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:37.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.841+0000 7fb98ed9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55950dd22740 0x55950dd54360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43184/0 (socket says 172.21.15.22:43184) 2024-05-21T13:36:37.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.841+0000 7fb98ed9d640 1 -- 172.21.15.22:0/602800637 learned_addr learned my addr 172.21.15.22:0/602800637 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:37.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.841+0000 7fb98ed9d640 1 -- 172.21.15.22:0/602800637 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55950dd41ef0 msgr2=0x55950dd548a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:37.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.841+0000 7fb98ed9d640 1 --2- 172.21.15.22:0/602800637 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55950dd41ef0 0x55950dd548a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:37.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.841+0000 7fb98ed9d640 1 -- 172.21.15.22:0/602800637 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55950dd594a0 msgr2=0x55950dd761f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:37.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.841+0000 7fb98ed9d640 1 --2- 172.21.15.22:0/602800637 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55950dd594a0 0x55950dd761f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:37.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.841+0000 7fb98ed9d640 1 -- 172.21.15.22:0/602800637 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55950db07860 con 0x55950dd22740 2024-05-21T13:36:37.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.841+0000 7fb98ed9d640 1 --2- 172.21.15.22:0/602800637 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55950dd22740 0x55950dd54360 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb980011b40 tx=0x7fb980004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95066e2c5e3f02c5 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:37.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.841+0000 7fb96ffff640 1 -- 172.21.15.22:0/602800637 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb980004040 con 0x55950dd22740 2024-05-21T13:36:37.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.841+0000 7fb96ffff640 1 -- 172.21.15.22:0/602800637 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb980026030 con 0x55950dd22740 2024-05-21T13:36:37.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.841+0000 7fb96ffff640 1 -- 172.21.15.22:0/602800637 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb980004220 con 0x55950dd22740 2024-05-21T13:36:37.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.841+0000 7fb998284000 1 -- 172.21.15.22:0/602800637 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55950dd22740 msgr2=0x55950dd54360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:37.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.841+0000 7fb998284000 1 --2- 172.21.15.22:0/602800637 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55950dd22740 0x55950dd54360 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb980011b40 tx=0x7fb980004740 comp rx=0 tx=0).stop 2024-05-21T13:36:37.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.841+0000 7fb998284000 1 -- 172.21.15.22:0/602800637 shutdown_connections 2024-05-21T13:36:37.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.841+0000 7fb998284000 1 --2- 172.21.15.22:0/602800637 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55950dd594a0 0x55950dd761f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:37.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.841+0000 7fb998284000 1 --2- 172.21.15.22:0/602800637 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55950dd41ef0 0x55950dd548a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:37.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.841+0000 7fb998284000 1 --2- 172.21.15.22:0/602800637 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55950dd22740 0x55950dd54360 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:37.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.841+0000 7fb998284000 1 -- 172.21.15.22:0/602800637 >> 172.21.15.22:0/602800637 conn(0x55950dc01ef0 msgr2=0x55950dd1b180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:37.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.841+0000 7fb998284000 1 -- 172.21.15.22:0/602800637 shutdown_connections 2024-05-21T13:36:37.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.841+0000 7fb998284000 1 -- 172.21.15.22:0/602800637 wait complete. 2024-05-21T13:36:37.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.841+0000 7fb998284000 1 -- start start 2024-05-21T13:36:37.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.841+0000 7fb998284000 1 Processor -- start 2024-05-21T13:36:37.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.841+0000 7fb998284000 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55950dd22740 0x55950dd6bc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:37.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.841+0000 7fb998284000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55950dd41ef0 0x55950dd6c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:37.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.841+0000 7fb998284000 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55950dd594a0 0x55950ddd1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:37.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.841+0000 7fb998284000 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55950db695c0 con 0x55950dd22740 2024-05-21T13:36:37.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.841+0000 7fb998284000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55950dafe7b0 con 0x55950dd41ef0 2024-05-21T13:36:37.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.841+0000 7fb998284000 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x55950db6e8e0 con 0x55950dd594a0 2024-05-21T13:36:37.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.841+0000 7fb998284000 10 client.0 _ll_register_callbacks cb 0x7fb984007dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-21T13:36:37.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.841+0000 7fb98ed9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55950dd22740 0x55950dd6bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:37.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.841+0000 7fb98ed9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55950dd22740 0x55950dd6bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43198/0 (socket says 172.21.15.22:43198) 2024-05-21T13:36:37.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.841+0000 7fb98ed9d640 1 -- 172.21.15.22:0/627495702 learned_addr learned my addr 172.21.15.22:0/627495702 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:37.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.841+0000 7fb98e59c640 1 --2- 172.21.15.22:0/627495702 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55950dd41ef0 0x55950dd6c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:37.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.841+0000 7fb98ed9d640 1 -- 172.21.15.22:0/627495702 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55950dd594a0 msgr2=0x55950ddd1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:37.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.841+0000 7fb98f59e640 1 --2- 172.21.15.22:0/627495702 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55950dd594a0 0x55950ddd1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:37.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.841+0000 7fb98ed9d640 1 --2- 172.21.15.22:0/627495702 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55950dd594a0 0x55950ddd1460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:37.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.841+0000 7fb98ed9d640 1 -- 172.21.15.22:0/627495702 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55950dd41ef0 msgr2=0x55950dd6c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:37.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.841+0000 7fb98ed9d640 1 --2- 172.21.15.22:0/627495702 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55950dd41ef0 0x55950dd6c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:37.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.841+0000 7fb98ed9d640 1 -- 172.21.15.22:0/627495702 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55950db1de80 con 0x55950dd22740 2024-05-21T13:36:37.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.841+0000 7fb98e59c640 1 --2- 172.21.15.22:0/627495702 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55950dd41ef0 0x55950dd6c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:36:37.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.845+0000 7fb98ed9d640 1 --2- 172.21.15.22:0/627495702 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55950dd22740 0x55950dd6bc80 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb9800096c0 tx=0x7fb9840017d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc9c5898c68b5a02 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:37.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.845+0000 7fb96dffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-05-21T13:36:37.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.845+0000 7fb96dffb640 1 -- 172.21.15.22:0/627495702 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb98003b060 con 0x55950dd22740 2024-05-21T13:36:37.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.845+0000 7fb96dffb640 1 -- 172.21.15.22:0/627495702 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7fb980029070 con 0x55950dd22740 2024-05-21T13:36:37.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.845+0000 7fb998284000 1 -- 172.21.15.22:0/627495702 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb980026030 con 0x55950dd22740 2024-05-21T13:36:37.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.845+0000 7fb96dffb640 1 -- 172.21.15.22:0/627495702 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7fb980041050 con 0x55950dd22740 2024-05-21T13:36:37.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.845+0000 7fb998284000 10 client.4734 fetch_fsmap learned FSMap version 14 2024-05-21T13:36:37.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.845+0000 7fb998284000 1 -- 172.21.15.22:0/627495702 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x55950dbeaa00 con 0x55950dd22740 2024-05-21T13:36:37.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.845+0000 7fb96dffb640 1 -- 172.21.15.22:0/627495702 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb980026030 con 0x55950dd22740 2024-05-21T13:36:37.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.845+0000 7fb96dffb640 1 -- 172.21.15.22:0/627495702 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7fb980044020 con 0x55950dd22740 2024-05-21T13:36:37.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.845+0000 7fb998284000 10 client.4734 fetch_fsmap finished waiting for FSMap version 14 2024-05-21T13:36:37.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.845+0000 7fb998284000 10 client.4734 resolve_mds: resolved name 'f' to daemon mds.f 2024-05-21T13:36:37.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.845+0000 7fb998284000 20 client.4734 populate_metadata read hostname 'smithi022' 2024-05-21T13:36:37.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.845+0000 7fb998284000 1 --2- 172.21.15.22:0/627495702 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x55950ddd19a0 0x55950ddd1d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:37.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.845+0000 7fb998284000 4 client.4734 mds_command: new command op to 4300 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-21T13:36:37.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.845+0000 7fb998284000 1 -- 172.21.15.22:0/627495702 --> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] -- command(tid 0: {"prefix": "status"}) -- 0x55950db05dc0 con 0x55950ddd19a0 2024-05-21T13:36:37.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.845+0000 7fb98e59c640 1 --2- 172.21.15.22:0/627495702 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x55950ddd19a0 0x55950ddd1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:37.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.845+0000 7fb96dffb640 10 client.4734 ms_handle_connect on v2:172.21.15.115:6838/1525097577 2024-05-21T13:36:37.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.845+0000 7fb98e59c640 1 --2- 172.21.15.22:0/627495702 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x55950ddd19a0 0x55950ddd1d80 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d1085135ae0d832 server_cookie=75e8fd904f1e8f0 in_seq=0 out_seq=0 2024-05-21T13:36:37.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.845+0000 7fb96dffb640 1 -- 172.21.15.22:0/627495702 <== mds.0 v2:172.21.15.115:6838/1525097577 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55950db05dc0 con 0x55950ddd19a0 2024-05-21T13:36:37.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.845+0000 7fb96dffb640 10 client.4734 handle_command_reply: tid=0 2024-05-21T13:36:37.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.845+0000 7fb998284000 1 client.4734 shutdown 2024-05-21T13:36:37.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.845+0000 7fb998284000 1 -- 172.21.15.22:0/627495702 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55950dd22740 msgr2=0x55950dd6bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:37.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.845+0000 7fb998284000 1 --2- 172.21.15.22:0/627495702 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55950dd22740 0x55950dd6bc80 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fb9800096c0 tx=0x7fb9840017d0 comp rx=0 tx=0).stop 2024-05-21T13:36:37.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.845+0000 7fb998284000 1 -- 172.21.15.22:0/627495702 shutdown_connections 2024-05-21T13:36:37.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.845+0000 7fb998284000 1 --2- 172.21.15.22:0/627495702 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55950dd594a0 0x55950ddd1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:37.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.845+0000 7fb998284000 1 --2- 172.21.15.22:0/627495702 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x55950ddd19a0 0x55950ddd1d80 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:37.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.845+0000 7fb998284000 1 --2- 172.21.15.22:0/627495702 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55950dd41ef0 0x55950dd6c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:37.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.845+0000 7fb998284000 1 --2- 172.21.15.22:0/627495702 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55950dd22740 0x55950dd6bc80 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:37.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.845+0000 7fb96dffb640 0 client.4734 ms_handle_reset on v2:172.21.15.115:6838/1525097577 2024-05-21T13:36:37.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.845+0000 7fb998284000 1 -- 172.21.15.22:0/627495702 >> 172.21.15.22:0/627495702 conn(0x55950dc01ef0 msgr2=0x55950dd1b180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:37.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.845+0000 7fb998284000 1 -- 172.21.15.22:0/627495702 shutdown_connections 2024-05-21T13:36:37.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.845+0000 7fb998284000 1 -- 172.21.15.22:0/627495702 wait complete. 2024-05-21T13:36:37.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.845+0000 7fb998284000 20 client.4734 trim_cache size 0 max 16384 2024-05-21T13:36:37.830 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-05-21T13:36:37.830 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_fsid": "f2c96204-e240-4e7f-8a76-927b4f80f534", 2024-05-21T13:36:37.830 INFO:teuthology.orchestra.run.smithi022.stdout: "whoami": 0, 2024-05-21T13:36:37.830 INFO:teuthology.orchestra.run.smithi022.stdout: "id": 4300, 2024-05-21T13:36:37.830 INFO:teuthology.orchestra.run.smithi022.stdout: "want_state": "up:active", 2024-05-21T13:36:37.830 INFO:teuthology.orchestra.run.smithi022.stdout: "state": "up:active", 2024-05-21T13:36:37.830 INFO:teuthology.orchestra.run.smithi022.stdout: "fs_name": "cephfs", 2024-05-21T13:36:37.830 INFO:teuthology.orchestra.run.smithi022.stdout: "rank_uptime": 40.072540985000003, 2024-05-21T13:36:37.830 INFO:teuthology.orchestra.run.smithi022.stdout: "mdsmap_epoch": 14, 2024-05-21T13:36:37.831 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch": 25, 2024-05-21T13:36:37.831 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch_barrier": 25, 2024-05-21T13:36:37.831 INFO:teuthology.orchestra.run.smithi022.stdout: "uptime": 46.140851998000002 2024-05-21T13:36:37.831 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-05-21T13:36:37.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.845+0000 7fb9950f9640 1 -- 172.21.15.22:0/2928395158 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fb97c06f400 msgr2=0x7fb97c0718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:37.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.845+0000 7fb9950f9640 1 --2- 172.21.15.22:0/2928395158 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fb97c06f400 0x7fb97c0718c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fb980009580 tx=0x7fb980009190 comp rx=0 tx=0).stop 2024-05-21T13:36:37.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.845+0000 7fb9950f9640 1 -- 172.21.15.22:0/2928395158 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb99015fdf0 msgr2=0x7fb99015ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:37.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.845+0000 7fb9950f9640 1 --2- 172.21.15.22:0/2928395158 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb99015fdf0 0x7fb99015ae30 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fb98801a660 tx=0x7fb9880197d0 comp rx=0 tx=0).stop 2024-05-21T13:36:37.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.845+0000 7fb9950f9640 1 -- 172.21.15.22:0/2928395158 shutdown_connections 2024-05-21T13:36:37.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.845+0000 7fb9950f9640 1 --2- 172.21.15.22:0/2928395158 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fb97c06f400 0x7fb97c0718c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:37.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.845+0000 7fb9950f9640 1 --2- 172.21.15.22:0/2928395158 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb99015fdf0 0x7fb99015ae30 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:37.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.845+0000 7fb9950f9640 1 --2- 172.21.15.22:0/2928395158 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb990070b70 0x7fb9900cca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:37.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.845+0000 7fb9950f9640 1 --2- 172.21.15.22:0/2928395158 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb990070790 0x7fb99014faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:37.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.845+0000 7fb9950f9640 1 -- 172.21.15.22:0/2928395158 >> 172.21.15.22:0/2928395158 conn(0x7fb9900cd890 msgr2=0x7fb990152370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:37.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.845+0000 7fb9950f9640 1 -- 172.21.15.22:0/2928395158 shutdown_connections 2024-05-21T13:36:37.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:37.845+0000 7fb9950f9640 1 -- 172.21.15.22:0/2928395158 wait complete. 2024-05-21T13:36:37.842 INFO:teuthology.run_tasks:Running task sequential... 2024-05-21T13:36:37.852 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-05-21T13:36:37.852 INFO:teuthology.task.sequential:In sequential, running task print... 2024-05-21T13:36:37.852 INFO:teuthology.task.print:Enabling mgr modules 2024-05-21T13:36:37.852 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-05-21T13:36:37.864 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-05-21T13:36:37.864 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-05-21T13:36:37.864 INFO:tasks.ceph_fuse:client.0 config is {} 2024-05-21T13:36:37.864 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-05-21T13:36:37.864 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-21T13:36:37.864 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-21T13:36:37.864 DEBUG:teuthology.orchestra.run.smithi022:> ip netns list 2024-05-21T13:36:37.870 INFO:teuthology.orchestra.run.smithi022.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-05-21T13:36:37.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-21T13:36:37.870 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-05-21T13:36:37.926 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-21T13:36:37.927 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link delete ceph-brx 2024-05-21T13:36:38.133 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-05-21T13:36:38.133 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-05-21T13:36:38.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:38.289+0000 7f87ca047640 1 Processor -- start 2024-05-21T13:36:38.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:38.289+0000 7f87ca047640 1 -- start start 2024-05-21T13:36:38.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:38.293+0000 7f87ca047640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f87c4153cb0 0x7f87c40c9440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:38.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:38.293+0000 7f87ca047640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f87c40c48f0 0x7f87c40c7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:38.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:38.293+0000 7f87ca047640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f87c40c4d00 0x7f87c40c83e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:38.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:38.293+0000 7f87ca047640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f87c40c9c60 con 0x7f87c4153cb0 2024-05-21T13:36:38.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:38.293+0000 7f87ca047640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f87c4159cf0 con 0x7f87c40c48f0 2024-05-21T13:36:38.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:38.293+0000 7f87ca047640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f87c4159fd0 con 0x7f87c40c4d00 2024-05-21T13:36:38.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:38.293+0000 7f87c37fe640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f87c4153cb0 0x7f87c40c9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:38.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:38.293+0000 7f87c37fe640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f87c4153cb0 0x7f87c40c9440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43208/0 (socket says 172.21.15.22:43208) 2024-05-21T13:36:38.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:38.293+0000 7f87c37fe640 1 -- 172.21.15.22:0/3488838906 learned_addr learned my addr 172.21.15.22:0/3488838906 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:38.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:38.293+0000 7f87c2ffd640 1 --2- 172.21.15.22:0/3488838906 >> v2:172.21.15.115:3300/0 conn(0x7f87c40c48f0 0x7f87c40c7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:38.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:38.293+0000 7f87c3fff640 1 --2- 172.21.15.22:0/3488838906 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f87c40c4d00 0x7f87c40c83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:38.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:38.293+0000 7f87c37fe640 1 -- 172.21.15.22:0/3488838906 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f87c40c4d00 msgr2=0x7f87c40c83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:38.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:38.293+0000 7f87c37fe640 1 --2- 172.21.15.22:0/3488838906 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f87c40c4d00 0x7f87c40c83e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:38.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:38.293+0000 7f87c37fe640 1 -- 172.21.15.22:0/3488838906 >> v2:172.21.15.115:3300/0 conn(0x7f87c40c48f0 msgr2=0x7f87c40c7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:38.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:38.293+0000 7f87c37fe640 1 --2- 172.21.15.22:0/3488838906 >> v2:172.21.15.115:3300/0 conn(0x7f87c40c48f0 0x7f87c40c7ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:38.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:38.293+0000 7f87c37fe640 1 -- 172.21.15.22:0/3488838906 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87c415a2b0 con 0x7f87c4153cb0 2024-05-21T13:36:38.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:38.293+0000 7f87c37fe640 1 --2- 172.21.15.22:0/3488838906 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87c4153cb0 0x7f87c40c9440 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f87c406e1b0 tx=0x7f87b401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e2e13484d3113a9 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:38.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:38.293+0000 7f87c27fc640 1 -- 172.21.15.22:0/3488838906 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87b40b1070 con 0x7f87c4153cb0 2024-05-21T13:36:38.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:38.293+0000 7f87c27fc640 1 -- 172.21.15.22:0/3488838906 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87b40ac630 con 0x7f87c4153cb0 2024-05-21T13:36:38.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:38.293+0000 7f87c27fc640 1 -- 172.21.15.22:0/3488838906 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87b40a8050 con 0x7f87c4153cb0 2024-05-21T13:36:38.274 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:38.297+0000 7f87ca047640 1 -- 172.21.15.22:0/3488838906 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87c4153cb0 msgr2=0x7f87c40c9440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:38.274 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:38.297+0000 7f87ca047640 1 --2- 172.21.15.22:0/3488838906 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87c4153cb0 0x7f87c40c9440 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f87c406e1b0 tx=0x7f87b401c520 comp rx=0 tx=0).stop 2024-05-21T13:36:38.274 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:38.297+0000 7f87ca047640 1 -- 172.21.15.22:0/3488838906 shutdown_connections 2024-05-21T13:36:38.274 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:38.297+0000 7f87ca047640 1 --2- 172.21.15.22:0/3488838906 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f87c40c4d00 0x7f87c40c83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:38.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:38.297+0000 7f87ca047640 1 --2- 172.21.15.22:0/3488838906 >> v2:172.21.15.115:3300/0 conn(0x7f87c40c48f0 0x7f87c40c7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:38.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:38.297+0000 7f87ca047640 1 --2- 172.21.15.22:0/3488838906 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87c4153cb0 0x7f87c40c9440 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:38.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:38.297+0000 7f87ca047640 1 -- 172.21.15.22:0/3488838906 >> 172.21.15.22:0/3488838906 conn(0x7f87c406ea10 msgr2=0x7f87c406ff50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:38.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:38.297+0000 7f87ca047640 1 -- 172.21.15.22:0/3488838906 shutdown_connections 2024-05-21T13:36:38.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:38.297+0000 7f87ca047640 1 -- 172.21.15.22:0/3488838906 wait complete. 2024-05-21T13:36:38.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:38.297+0000 7f87ca047640 1 Processor -- start 2024-05-21T13:36:38.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:38.297+0000 7f87ca047640 1 -- start start 2024-05-21T13:36:38.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:38.297+0000 7f87ca047640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87c40c48f0 0x7f87c4150880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:38.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:38.297+0000 7f87ca047640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f87c40c4d00 0x7f87c4143ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:38.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:38.297+0000 7f87ca047640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f87c4153cb0 0x7f87c40ccec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:38.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:38.297+0000 7f87ca047640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f87c4154210 con 0x7f87c40c48f0 2024-05-21T13:36:38.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:38.297+0000 7f87ca047640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f87c4154090 con 0x7f87c40c4d00 2024-05-21T13:36:38.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:38.297+0000 7f87ca047640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f87c406c4f0 con 0x7f87c4153cb0 2024-05-21T13:36:38.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:38.297+0000 7f87c37fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87c40c48f0 0x7f87c4150880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:38.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:38.297+0000 7f87c37fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87c40c48f0 0x7f87c4150880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43218/0 (socket says 172.21.15.22:43218) 2024-05-21T13:36:38.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:38.297+0000 7f87c37fe640 1 -- 172.21.15.22:0/3466519169 learned_addr learned my addr 172.21.15.22:0/3466519169 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:38.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:38.297+0000 7f87c2ffd640 1 --2- 172.21.15.22:0/3466519169 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f87c40c4d00 0x7f87c4143ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:38.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:38.297+0000 7f87c3fff640 1 --2- 172.21.15.22:0/3466519169 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f87c4153cb0 0x7f87c40ccec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:38.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:38.297+0000 7f87c37fe640 1 -- 172.21.15.22:0/3466519169 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f87c4153cb0 msgr2=0x7f87c40ccec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:38.278 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:38.297+0000 7f87c37fe640 1 --2- 172.21.15.22:0/3466519169 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f87c4153cb0 0x7f87c40ccec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:38.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:38.297+0000 7f87c37fe640 1 -- 172.21.15.22:0/3466519169 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f87c40c4d00 msgr2=0x7f87c4143ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:38.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:38.297+0000 7f87c37fe640 1 --2- 172.21.15.22:0/3466519169 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f87c40c4d00 0x7f87c4143ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:38.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:38.297+0000 7f87c37fe640 1 -- 172.21.15.22:0/3466519169 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87c4152b00 con 0x7f87c40c48f0 2024-05-21T13:36:38.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:38.297+0000 7f87c37fe640 1 --2- 172.21.15.22:0/3466519169 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87c40c48f0 0x7f87c4150880 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f87b40af040 tx=0x7f87b40192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:38.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:38.297+0000 7f87abfff640 1 -- 172.21.15.22:0/3466519169 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87b40b1070 con 0x7f87c40c48f0 2024-05-21T13:36:38.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:38.297+0000 7f87abfff640 1 -- 172.21.15.22:0/3466519169 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87b40ab5e0 con 0x7f87c40c48f0 2024-05-21T13:36:38.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:38.297+0000 7f87ca047640 1 -- 172.21.15.22:0/3466519169 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87c40c4250 con 0x7f87c40c48f0 2024-05-21T13:36:38.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:38.297+0000 7f87abfff640 1 -- 172.21.15.22:0/3466519169 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87b40a8040 con 0x7f87c40c48f0 2024-05-21T13:36:38.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:38.297+0000 7f87ca047640 1 -- 172.21.15.22:0/3466519169 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87c40cc6c0 con 0x7f87c40c48f0 2024-05-21T13:36:38.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:38.301+0000 7f87ca047640 1 -- 172.21.15.22:0/3466519169 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87c4077bb0 con 0x7f87c40c48f0 2024-05-21T13:36:38.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:38.301+0000 7f87abfff640 1 -- 172.21.15.22:0/3466519169 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f87b40be060 con 0x7f87c40c48f0 2024-05-21T13:36:38.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:38.301+0000 7f87abfff640 1 --2- 172.21.15.22:0/3466519169 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f87b006f430 0x7f87b00718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:38.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:38.301+0000 7f87abfff640 1 -- 172.21.15.22:0/3466519169 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6532+0+0 (secure 0 0 0) 0x7f87b4128b80 con 0x7f87c40c48f0 2024-05-21T13:36:38.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:38.301+0000 7f87c2ffd640 1 --2- 172.21.15.22:0/3466519169 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f87b006f430 0x7f87b00718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:38.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:38.301+0000 7f87c2ffd640 1 --2- 172.21.15.22:0/3466519169 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f87b006f430 0x7f87b00718f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f87c4157640 tx=0x7f87b8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:38.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:38.305+0000 7f87abfff640 1 -- 172.21.15.22:0/3466519169 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f87b4016110 con 0x7f87c40c48f0 2024-05-21T13:36:38.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:38.509+0000 7f87ca047640 1 -- 172.21.15.22:0/3466519169 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f87c4144b10 con 0x7f87c40c48f0 2024-05-21T13:36:38.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:38.509+0000 7f87abfff640 1 -- 172.21.15.22:0/3466519169 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) ==== 53+0+88 (secure 0 0 0) 0x7f87b40f5690 con 0x7f87c40c48f0 2024-05-21T13:36:38.488 INFO:teuthology.orchestra.run.smithi022.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-05-21T13:36:38.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:38.509+0000 7f87ca047640 1 -- 172.21.15.22:0/3466519169 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f87b006f430 msgr2=0x7f87b00718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:38.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:38.509+0000 7f87ca047640 1 --2- 172.21.15.22:0/3466519169 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f87b006f430 0x7f87b00718f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f87c4157640 tx=0x7f87b8008040 comp rx=0 tx=0).stop 2024-05-21T13:36:38.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:38.513+0000 7f87ca047640 1 -- 172.21.15.22:0/3466519169 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87c40c48f0 msgr2=0x7f87c4150880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:38.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:38.513+0000 7f87ca047640 1 --2- 172.21.15.22:0/3466519169 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87c40c48f0 0x7f87c4150880 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f87b40af040 tx=0x7f87b40192c0 comp rx=0 tx=0).stop 2024-05-21T13:36:38.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:38.513+0000 7f87ca047640 1 -- 172.21.15.22:0/3466519169 shutdown_connections 2024-05-21T13:36:38.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:38.513+0000 7f87ca047640 1 --2- 172.21.15.22:0/3466519169 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f87b006f430 0x7f87b00718f0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:38.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:38.513+0000 7f87ca047640 1 --2- 172.21.15.22:0/3466519169 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f87c4153cb0 0x7f87c40ccec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:38.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:38.513+0000 7f87ca047640 1 --2- 172.21.15.22:0/3466519169 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f87c40c4d00 0x7f87c4143ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:38.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:38.513+0000 7f87ca047640 1 --2- 172.21.15.22:0/3466519169 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f87c40c48f0 0x7f87c4150880 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:38.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:38.513+0000 7f87ca047640 1 -- 172.21.15.22:0/3466519169 >> 172.21.15.22:0/3466519169 conn(0x7f87c406ea10 msgr2=0x7f87c4157770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:38.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:38.513+0000 7f87ca047640 1 -- 172.21.15.22:0/3466519169 shutdown_connections 2024-05-21T13:36:38.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:38.513+0000 7f87ca047640 1 -- 172.21.15.22:0/3466519169 wait complete. 2024-05-21T13:36:38.508 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-05-21T13:36:38.508 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-05-21T13:36:38.508 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi022.front.sepia.ceph.com 2024-05-21T13:36:38.508 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-05-21T13:36:38.508 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-05-21T13:36:38.508 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-05-21T13:36:38.508 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-05-21T13:36:38.508 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-05-21T13:36:38.508 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-05-21T13:36:38.509 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-21T13:36:38.509 DEBUG:teuthology.orchestra.run.smithi022:> ip addr 2024-05-21T13:36:38.515 INFO:teuthology.orchestra.run.smithi022.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-05-21T13:36:38.515 INFO:teuthology.orchestra.run.smithi022.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-05-21T13:36:38.515 INFO:teuthology.orchestra.run.smithi022.stdout: inet 127.0.0.1/8 scope host lo 2024-05-21T13:36:38.516 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2024-05-21T13:36:38.516 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 ::1/128 scope host 2024-05-21T13:36:38.516 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2024-05-21T13:36:38.516 INFO:teuthology.orchestra.run.smithi022.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-21T13:36:38.516 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:6b:fd:9a brd ff:ff:ff:ff:ff:ff 2024-05-21T13:36:38.516 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp7s0f0 2024-05-21T13:36:38.516 INFO:teuthology.orchestra.run.smithi022.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-21T13:36:38.516 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:6b:fd:9b brd ff:ff:ff:ff:ff:ff 2024-05-21T13:36:38.516 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp7s0f1 2024-05-21T13:36:38.516 INFO:teuthology.orchestra.run.smithi022.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-05-21T13:36:38.516 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:59:5d:e4 brd ff:ff:ff:ff:ff:ff 2024-05-21T13:36:38.516 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp1s0f0 2024-05-21T13:36:38.517 INFO:teuthology.orchestra.run.smithi022.stdout: inet 172.21.15.22/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-05-21T13:36:38.517 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft 42492sec preferred_lft 42492sec 2024-05-21T13:36:38.517 INFO:teuthology.orchestra.run.smithi022.stdout: inet6 fe80::ec4:7aff:fe59:5de4/64 scope link 2024-05-21T13:36:38.517 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2024-05-21T13:36:38.517 INFO:teuthology.orchestra.run.smithi022.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-05-21T13:36:38.517 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 0c:c4:7a:59:5d:e5 brd ff:ff:ff:ff:ff:ff 2024-05-21T13:36:38.517 INFO:teuthology.orchestra.run.smithi022.stdout: altname enp1s0f1 2024-05-21T13:36:38.517 INFO:teuthology.orchestra.run.smithi022.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-05-21T13:36:38.517 INFO:teuthology.orchestra.run.smithi022.stdout: link/ether 02:42:c2:aa:29:b9 brd ff:ff:ff:ff:ff:ff 2024-05-21T13:36:38.517 INFO:teuthology.orchestra.run.smithi022.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-05-21T13:36:38.517 INFO:teuthology.orchestra.run.smithi022.stdout: valid_lft forever preferred_lft forever 2024-05-21T13:36:38.517 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-05-21T13:36:38.518 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-21T13:36:38.518 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2024-05-21T13:36:38.518 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link add name ceph-brx type bridge 2024-05-21T13:36:38.518 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip addr flush dev ceph-brx 2024-05-21T13:36:38.518 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link set ceph-brx up 2024-05-21T13:36:38.518 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-05-21T13:36:38.518 DEBUG:teuthology.orchestra.run.smithi022:> ') 2024-05-21T13:36:38.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-21T13:36:38.631 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-21T13:36:38.638 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-21T13:36:38.638 DEBUG:teuthology.orchestra.run.smithi022:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-05-21T13:36:38.696 INFO:teuthology.orchestra.run.smithi022.stdout:1 2024-05-21T13:36:38.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-21T13:36:38.697 DEBUG:teuthology.orchestra.run.smithi022:> route 2024-05-21T13:36:38.744 INFO:teuthology.orchestra.run.smithi022.stdout:Kernel IP routing table 2024-05-21T13:36:38.744 INFO:teuthology.orchestra.run.smithi022.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-05-21T13:36:38.744 INFO:teuthology.orchestra.run.smithi022.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-05-21T13:36:38.745 INFO:teuthology.orchestra.run.smithi022.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-05-21T13:36:38.745 INFO:teuthology.orchestra.run.smithi022.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-05-21T13:36:38.745 INFO:teuthology.orchestra.run.smithi022.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-05-21T13:36:38.745 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-21T13:36:38.745 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2024-05-21T13:36:38.745 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-05-21T13:36:38.745 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-05-21T13:36:38.745 DEBUG:teuthology.orchestra.run.smithi022:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-05-21T13:36:38.745 DEBUG:teuthology.orchestra.run.smithi022:> ') 2024-05-21T13:36:38.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:38 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-21T13:36:38.862 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-21T13:36:38.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-21T13:36:38.869 DEBUG:teuthology.orchestra.run.smithi022:> ip netns list 2024-05-21T13:36:38.876 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-21T13:36:38.876 DEBUG:teuthology.orchestra.run.smithi022:> ip netns list-id 2024-05-21T13:36:38.923 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-21T13:36:38.923 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2024-05-21T13:36:38.923 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-21T13:36:38.923 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-05-21T13:36:38.924 DEBUG:teuthology.orchestra.run.smithi022:> ') 2024-05-21T13:36:39.015 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-21T13:36:39.037 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-21T13:36:39.045 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-05-21T13:36:39.045 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-21T13:36:39.045 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2024-05-21T13:36:39.045 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-05-21T13:36:39.045 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-05-21T13:36:39.046 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-05-21T13:36:39.046 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-05-21T13:36:39.046 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-05-21T13:36:39.046 DEBUG:teuthology.orchestra.run.smithi022:> ') 2024-05-21T13:36:39.093 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-21T13:36:39.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-21T13:36:39.145 DEBUG:teuthology.orchestra.run.smithi022:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-05-21T13:36:39.146 DEBUG:teuthology.orchestra.run.smithi022:> set -e 2024-05-21T13:36:39.146 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link set brx.0 up 2024-05-21T13:36:39.146 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link set dev brx.0 master ceph-brx 2024-05-21T13:36:39.146 DEBUG:teuthology.orchestra.run.smithi022:> ') 2024-05-21T13:36:39.228 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-05-21T13:36:39.248 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-21T13:36:39.255 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-05-21T13:36:39.255 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-21T13:36:39.255 DEBUG:teuthology.orchestra.run.smithi022:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-05-21T13:36:39.302 INFO:teuthology.orchestra.run.smithi022.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-05-21T13:36:39.302 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-05-21T13:36:39.302 DEBUG:teuthology.orchestra.run.smithi022:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-05-21T13:36:39.350 DEBUG:teuthology.orchestra.run.smithi022:> sudo modprobe fuse 2024-05-21T13:36:39.408 DEBUG:teuthology.orchestra.run.smithi022:> cat /proc/self/mounts | awk '{print $2}' 2024-05-21T13:36:39.461 INFO:teuthology.orchestra.run.smithi022.stdout:/sys 2024-05-21T13:36:39.461 INFO:teuthology.orchestra.run.smithi022.stdout:/proc 2024-05-21T13:36:39.461 INFO:teuthology.orchestra.run.smithi022.stdout:/dev 2024-05-21T13:36:39.461 INFO:teuthology.orchestra.run.smithi022.stdout:/dev/pts 2024-05-21T13:36:39.462 INFO:teuthology.orchestra.run.smithi022.stdout:/run 2024-05-21T13:36:39.462 INFO:teuthology.orchestra.run.smithi022.stdout:/ 2024-05-21T13:36:39.462 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/kernel/security 2024-05-21T13:36:39.462 INFO:teuthology.orchestra.run.smithi022.stdout:/dev/shm 2024-05-21T13:36:39.462 INFO:teuthology.orchestra.run.smithi022.stdout:/run/lock 2024-05-21T13:36:39.462 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/fs/cgroup 2024-05-21T13:36:39.462 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/fs/pstore 2024-05-21T13:36:39.462 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/fs/bpf 2024-05-21T13:36:39.462 INFO:teuthology.orchestra.run.smithi022.stdout:/proc/sys/fs/binfmt_misc 2024-05-21T13:36:39.462 INFO:teuthology.orchestra.run.smithi022.stdout:/dev/hugepages 2024-05-21T13:36:39.462 INFO:teuthology.orchestra.run.smithi022.stdout:/dev/mqueue 2024-05-21T13:36:39.462 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/kernel/debug 2024-05-21T13:36:39.463 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/kernel/tracing 2024-05-21T13:36:39.463 INFO:teuthology.orchestra.run.smithi022.stdout:/proc/fs/nfsd 2024-05-21T13:36:39.463 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/fs/fuse/connections 2024-05-21T13:36:39.463 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/kernel/config 2024-05-21T13:36:39.463 INFO:teuthology.orchestra.run.smithi022.stdout:/run/credentials/systemd-sysusers.service 2024-05-21T13:36:39.463 INFO:teuthology.orchestra.run.smithi022.stdout:/run/rpc_pipefs 2024-05-21T13:36:39.463 INFO:teuthology.orchestra.run.smithi022.stdout:/run/user/1000 2024-05-21T13:36:39.463 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/ceph 2024-05-21T13:36:39.463 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/ceph/osd/ceph-0 2024-05-21T13:36:39.463 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/ceph/osd/ceph-1 2024-05-21T13:36:39.463 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/ceph/osd/ceph-2 2024-05-21T13:36:39.463 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/ceph/osd/ceph-3 2024-05-21T13:36:39.463 INFO:teuthology.orchestra.run.smithi022.stdout:/run/netns 2024-05-21T13:36:39.464 INFO:teuthology.orchestra.run.smithi022.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-21T13:36:39.464 INFO:teuthology.orchestra.run.smithi022.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-21T13:36:39.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-21T13:36:39.465 DEBUG:teuthology.orchestra.run.smithi022:> ls /sys/fs/fuse/connections 2024-05-21T13:36:39.511 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-05-21T13:36:39.511 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-05-21T13:36:39.555 DEBUG:teuthology.orchestra.run.smithi022:> sudo modprobe fuse 2024-05-21T13:36:39.573 DEBUG:teuthology.orchestra.run.smithi022:> cat /proc/self/mounts | awk '{print $2}' 2024-05-21T13:36:39.619 INFO:teuthology.orchestra.run.smithi022.stdout:/sys 2024-05-21T13:36:39.619 INFO:teuthology.orchestra.run.smithi022.stdout:/proc 2024-05-21T13:36:39.619 INFO:teuthology.orchestra.run.smithi022.stdout:/dev 2024-05-21T13:36:39.619 INFO:teuthology.orchestra.run.smithi022.stdout:/dev/pts 2024-05-21T13:36:39.619 INFO:teuthology.orchestra.run.smithi022.stdout:/run 2024-05-21T13:36:39.619 INFO:teuthology.orchestra.run.smithi022.stdout:/ 2024-05-21T13:36:39.619 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/kernel/security 2024-05-21T13:36:39.619 INFO:teuthology.orchestra.run.smithi022.stdout:/dev/shm 2024-05-21T13:36:39.619 INFO:teuthology.orchestra.run.smithi022.stdout:/run/lock 2024-05-21T13:36:39.619 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/fs/cgroup 2024-05-21T13:36:39.619 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/fs/pstore 2024-05-21T13:36:39.620 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/fs/bpf 2024-05-21T13:36:39.620 INFO:teuthology.orchestra.run.smithi022.stdout:/proc/sys/fs/binfmt_misc 2024-05-21T13:36:39.620 INFO:teuthology.orchestra.run.smithi022.stdout:/dev/hugepages 2024-05-21T13:36:39.620 INFO:teuthology.orchestra.run.smithi022.stdout:/dev/mqueue 2024-05-21T13:36:39.620 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/kernel/debug 2024-05-21T13:36:39.620 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/kernel/tracing 2024-05-21T13:36:39.620 INFO:teuthology.orchestra.run.smithi022.stdout:/proc/fs/nfsd 2024-05-21T13:36:39.620 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/fs/fuse/connections 2024-05-21T13:36:39.620 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/kernel/config 2024-05-21T13:36:39.620 INFO:teuthology.orchestra.run.smithi022.stdout:/run/credentials/systemd-sysusers.service 2024-05-21T13:36:39.620 INFO:teuthology.orchestra.run.smithi022.stdout:/run/rpc_pipefs 2024-05-21T13:36:39.620 INFO:teuthology.orchestra.run.smithi022.stdout:/run/user/1000 2024-05-21T13:36:39.620 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/ceph 2024-05-21T13:36:39.621 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/ceph/osd/ceph-0 2024-05-21T13:36:39.621 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/ceph/osd/ceph-1 2024-05-21T13:36:39.621 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/ceph/osd/ceph-2 2024-05-21T13:36:39.621 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/ceph/osd/ceph-3 2024-05-21T13:36:39.621 INFO:teuthology.orchestra.run.smithi022.stdout:/run/netns 2024-05-21T13:36:39.621 INFO:teuthology.orchestra.run.smithi022.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-21T13:36:39.621 INFO:teuthology.orchestra.run.smithi022.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-21T13:36:39.622 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-21T13:36:39.622 DEBUG:teuthology.orchestra.run.smithi022:> ls /sys/fs/fuse/connections 2024-05-21T13:36:39.642 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi022.stderr:2024-05-21T13:36:39.665+0000 7fd386c61580 -1 init, newargv = 0x5629ed0266c0 newargc=15 2024-05-21T13:36:39.642 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi022.stderr:ceph-fuse[33615]: starting ceph client 2024-05-21T13:36:39.655 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi022.stderr:ceph-fuse[33615]: starting fuse 2024-05-21T13:36:40.748 DEBUG:teuthology.orchestra.run.smithi022:> sudo modprobe fuse 2024-05-21T13:36:40.765 DEBUG:teuthology.orchestra.run.smithi022:> cat /proc/self/mounts | awk '{print $2}' 2024-05-21T13:36:40.817 INFO:teuthology.orchestra.run.smithi022.stdout:/sys 2024-05-21T13:36:40.817 INFO:teuthology.orchestra.run.smithi022.stdout:/proc 2024-05-21T13:36:40.817 INFO:teuthology.orchestra.run.smithi022.stdout:/dev 2024-05-21T13:36:40.817 INFO:teuthology.orchestra.run.smithi022.stdout:/dev/pts 2024-05-21T13:36:40.817 INFO:teuthology.orchestra.run.smithi022.stdout:/run 2024-05-21T13:36:40.817 INFO:teuthology.orchestra.run.smithi022.stdout:/ 2024-05-21T13:36:40.818 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/kernel/security 2024-05-21T13:36:40.818 INFO:teuthology.orchestra.run.smithi022.stdout:/dev/shm 2024-05-21T13:36:40.818 INFO:teuthology.orchestra.run.smithi022.stdout:/run/lock 2024-05-21T13:36:40.818 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/fs/cgroup 2024-05-21T13:36:40.818 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/fs/pstore 2024-05-21T13:36:40.818 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/fs/bpf 2024-05-21T13:36:40.818 INFO:teuthology.orchestra.run.smithi022.stdout:/proc/sys/fs/binfmt_misc 2024-05-21T13:36:40.818 INFO:teuthology.orchestra.run.smithi022.stdout:/dev/hugepages 2024-05-21T13:36:40.819 INFO:teuthology.orchestra.run.smithi022.stdout:/dev/mqueue 2024-05-21T13:36:40.819 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/kernel/debug 2024-05-21T13:36:40.819 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/kernel/tracing 2024-05-21T13:36:40.819 INFO:teuthology.orchestra.run.smithi022.stdout:/proc/fs/nfsd 2024-05-21T13:36:40.819 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/fs/fuse/connections 2024-05-21T13:36:40.819 INFO:teuthology.orchestra.run.smithi022.stdout:/sys/kernel/config 2024-05-21T13:36:40.819 INFO:teuthology.orchestra.run.smithi022.stdout:/run/credentials/systemd-sysusers.service 2024-05-21T13:36:40.819 INFO:teuthology.orchestra.run.smithi022.stdout:/run/rpc_pipefs 2024-05-21T13:36:40.819 INFO:teuthology.orchestra.run.smithi022.stdout:/run/user/1000 2024-05-21T13:36:40.819 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/ceph 2024-05-21T13:36:40.820 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/ceph/osd/ceph-0 2024-05-21T13:36:40.820 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/ceph/osd/ceph-1 2024-05-21T13:36:40.820 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/ceph/osd/ceph-2 2024-05-21T13:36:40.820 INFO:teuthology.orchestra.run.smithi022.stdout:/var/lib/ceph/osd/ceph-3 2024-05-21T13:36:40.820 INFO:teuthology.orchestra.run.smithi022.stdout:/run/netns 2024-05-21T13:36:40.820 INFO:teuthology.orchestra.run.smithi022.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-21T13:36:40.820 INFO:teuthology.orchestra.run.smithi022.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-21T13:36:40.820 INFO:teuthology.orchestra.run.smithi022.stdout:/home/ubuntu/cephtest/mnt.0 2024-05-21T13:36:40.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-21T13:36:40.821 DEBUG:teuthology.orchestra.run.smithi022:> ls /sys/fs/fuse/connections 2024-05-21T13:36:40.871 INFO:teuthology.orchestra.run.smithi022.stdout:45 2024-05-21T13:36:40.871 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-05-21T13:36:40.872 DEBUG:teuthology.orchestra.run.smithi022:> sudo stdin-killer -- python3 -c ' 2024-05-21T13:36:40.872 DEBUG:teuthology.orchestra.run.smithi022:> import glob 2024-05-21T13:36:40.872 DEBUG:teuthology.orchestra.run.smithi022:> import re 2024-05-21T13:36:40.872 DEBUG:teuthology.orchestra.run.smithi022:> import os 2024-05-21T13:36:40.872 DEBUG:teuthology.orchestra.run.smithi022:> import subprocess 2024-05-21T13:36:40.872 DEBUG:teuthology.orchestra.run.smithi022:> 2024-05-21T13:36:40.872 DEBUG:teuthology.orchestra.run.smithi022:> def _find_admin_socket(client_name): 2024-05-21T13:36:40.872 DEBUG:teuthology.orchestra.run.smithi022:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-05-21T13:36:40.872 DEBUG:teuthology.orchestra.run.smithi022:> files = glob.glob(asok_path) 2024-05-21T13:36:40.872 DEBUG:teuthology.orchestra.run.smithi022:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-05-21T13:36:40.872 DEBUG:teuthology.orchestra.run.smithi022:> 2024-05-21T13:36:40.872 DEBUG:teuthology.orchestra.run.smithi022:> # Given a non-glob path, it better be there 2024-05-21T13:36:40.873 DEBUG:teuthology.orchestra.run.smithi022:> if "*" not in asok_path: 2024-05-21T13:36:40.873 DEBUG:teuthology.orchestra.run.smithi022:> assert(len(files) == 1) 2024-05-21T13:36:40.873 DEBUG:teuthology.orchestra.run.smithi022:> return files[0] 2024-05-21T13:36:40.873 DEBUG:teuthology.orchestra.run.smithi022:> 2024-05-21T13:36:40.873 DEBUG:teuthology.orchestra.run.smithi022:> for f in files: 2024-05-21T13:36:40.873 DEBUG:teuthology.orchestra.run.smithi022:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-05-21T13:36:40.873 DEBUG:teuthology.orchestra.run.smithi022:> if os.path.exists("/proc/{0}".format(pid)): 2024-05-21T13:36:40.873 DEBUG:teuthology.orchestra.run.smithi022:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-05-21T13:36:40.873 DEBUG:teuthology.orchestra.run.smithi022:> contents = proc_f.read() 2024-05-21T13:36:40.873 DEBUG:teuthology.orchestra.run.smithi022:> if mountpoint in contents: 2024-05-21T13:36:40.873 DEBUG:teuthology.orchestra.run.smithi022:> return f 2024-05-21T13:36:40.873 DEBUG:teuthology.orchestra.run.smithi022:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-05-21T13:36:40.873 DEBUG:teuthology.orchestra.run.smithi022:> 2024-05-21T13:36:40.873 DEBUG:teuthology.orchestra.run.smithi022:> print(_find_admin_socket("client.0")) 2024-05-21T13:36:40.873 DEBUG:teuthology.orchestra.run.smithi022:> ' 2024-05-21T13:36:41.000 INFO:teuthology.orchestra.run.smithi022.stdout:/var/run/ceph/ceph-client.0.33615.asok 2024-05-21T13:36:41.003 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-05-21T13:36:41.011 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.33615.asok 2024-05-21T13:36:41.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-21T13:36:41.011 DEBUG:teuthology.orchestra.run.smithi022:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.33615.asok status 2024-05-21T13:36:41.172 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-05-21T13:36:41.172 INFO:teuthology.orchestra.run.smithi022.stdout: "metadata": { 2024-05-21T13:36:41.172 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_sha1": "7956b5e965f6ee5669688b5643c11d881b72442c", 2024-05-21T13:36:41.172 INFO:teuthology.orchestra.run.smithi022.stdout: "ceph_version": "ceph version 19.0.0-3857-g7956b5e9 (7956b5e965f6ee5669688b5643c11d881b72442c) squid (dev)", 2024-05-21T13:36:41.173 INFO:teuthology.orchestra.run.smithi022.stdout: "entity_id": "0", 2024-05-21T13:36:41.173 INFO:teuthology.orchestra.run.smithi022.stdout: "hostname": "smithi022", 2024-05-21T13:36:41.173 INFO:teuthology.orchestra.run.smithi022.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-05-21T13:36:41.173 INFO:teuthology.orchestra.run.smithi022.stdout: "pid": "33615", 2024-05-21T13:36:41.173 INFO:teuthology.orchestra.run.smithi022.stdout: "root": "/" 2024-05-21T13:36:41.173 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-05-21T13:36:41.173 INFO:teuthology.orchestra.run.smithi022.stdout: "dentry_count": 0, 2024-05-21T13:36:41.173 INFO:teuthology.orchestra.run.smithi022.stdout: "dentry_pinned_count": 0, 2024-05-21T13:36:41.173 INFO:teuthology.orchestra.run.smithi022.stdout: "id": 4749, 2024-05-21T13:36:41.173 INFO:teuthology.orchestra.run.smithi022.stdout: "inst": { 2024-05-21T13:36:41.173 INFO:teuthology.orchestra.run.smithi022.stdout: "name": { 2024-05-21T13:36:41.173 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "client", 2024-05-21T13:36:41.174 INFO:teuthology.orchestra.run.smithi022.stdout: "num": 4749 2024-05-21T13:36:41.174 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-05-21T13:36:41.174 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": { 2024-05-21T13:36:41.174 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-05-21T13:36:41.174 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "192.168.0.1:0", 2024-05-21T13:36:41.174 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 767109674 2024-05-21T13:36:41.174 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-05-21T13:36:41.174 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-05-21T13:36:41.174 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": { 2024-05-21T13:36:41.174 INFO:teuthology.orchestra.run.smithi022.stdout: "type": "v1", 2024-05-21T13:36:41.174 INFO:teuthology.orchestra.run.smithi022.stdout: "addr": "192.168.0.1:0", 2024-05-21T13:36:41.174 INFO:teuthology.orchestra.run.smithi022.stdout: "nonce": 767109674 2024-05-21T13:36:41.174 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-05-21T13:36:41.175 INFO:teuthology.orchestra.run.smithi022.stdout: "inst_str": "client.4749 192.168.0.1:0/767109674", 2024-05-21T13:36:41.175 INFO:teuthology.orchestra.run.smithi022.stdout: "addr_str": "192.168.0.1:0/767109674", 2024-05-21T13:36:41.175 INFO:teuthology.orchestra.run.smithi022.stdout: "inode_count": 1, 2024-05-21T13:36:41.175 INFO:teuthology.orchestra.run.smithi022.stdout: "mds_epoch": 14, 2024-05-21T13:36:41.175 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_epoch": 27, 2024-05-21T13:36:41.175 INFO:teuthology.orchestra.run.smithi022.stdout: "osd_epoch_barrier": 0, 2024-05-21T13:36:41.175 INFO:teuthology.orchestra.run.smithi022.stdout: "blocklisted": false, 2024-05-21T13:36:41.175 INFO:teuthology.orchestra.run.smithi022.stdout: "fs_name": "cephfs" 2024-05-21T13:36:41.175 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-05-21T13:36:41.186 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-21T13:36:41.186 DEBUG:teuthology.orchestra.run.smithi022:> stat --file-system '--printf=%T 2024-05-21T13:36:41.186 DEBUG:teuthology.orchestra.run.smithi022:> ' -- /home/ubuntu/cephtest/mnt.0 2024-05-21T13:36:41.192 INFO:teuthology.orchestra.run.smithi022.stdout:fuseblk 2024-05-21T13:36:41.193 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-05-21T13:36:41.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-21T13:36:41.193 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-05-21T13:36:41.246 INFO:teuthology.run_tasks:Running task quiescer... 2024-05-21T13:36:41.259 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-21T13:36:41.259 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-21T13:36:41.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.441+0000 7f1d4a163640 1 Processor -- start 2024-05-21T13:36:41.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.441+0000 7f1d4a163640 1 -- start start 2024-05-21T13:36:41.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.441+0000 7f1d4a163640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1d4415a260 0x7f1d440c8510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:41.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.441+0000 7f1d4a163640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1d440ca480 0x7f1d440c5570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:41.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.441+0000 7f1d4a163640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d44160c50 con 0x7f1d4406c4f0 2024-05-21T13:36:41.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.441+0000 7f1d4a163640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f1d440c9ff0 con 0x7f1d440ca480 2024-05-21T13:36:41.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.441+0000 7f1d4a163640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f1d440c8c30 con 0x7f1d4415a260 2024-05-21T13:36:41.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.441+0000 7f1d43fff640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f1d4406c4f0 0x7f1d4406c960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:56742/0 (socket says 172.21.15.22:56742) 2024-05-21T13:36:41.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.441+0000 7f1d43fff640 1 -- 172.21.15.22:0/3906768684 learned_addr learned my addr 172.21.15.22:0/3906768684 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-21T13:36:41.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.441+0000 7f1d42ffd640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1d440ca480 0x7f1d440c5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:41.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.441+0000 7f1d437fe640 1 --2- 172.21.15.22:0/3906768684 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1d4415a260 0x7f1d440c8510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:41.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.441+0000 7f1d427fc640 1 -- 172.21.15.22:0/3906768684 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 309658000 0 0) 0x7f1d44160c50 con 0x7f1d4406c4f0 2024-05-21T13:36:41.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.441+0000 7f1d427fc640 1 -- 172.21.15.22:0/3906768684 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1d2c003530 con 0x7f1d4406c4f0 2024-05-21T13:36:41.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.441+0000 7f1d42ffd640 1 -- 172.21.15.22:0/3906768684 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1d4415a260 msgr2=0x7f1d440c8510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:41.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.441+0000 7f1d42ffd640 1 --2- 172.21.15.22:0/3906768684 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1d4415a260 0x7f1d440c8510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:41.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.441+0000 7f1d42ffd640 1 -- 172.21.15.22:0/3906768684 >> v1:172.21.15.22:6789/0 conn(0x7f1d4406c4f0 legacy=0x7f1d4406c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:41.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.441+0000 7f1d42ffd640 1 -- 172.21.15.22:0/3906768684 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d44160ef0 con 0x7f1d440ca480 2024-05-21T13:36:41.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.441+0000 7f1d437fe640 1 --2- 172.21.15.22:0/3906768684 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1d4415a260 0x7f1d440c8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T13:36:41.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.445+0000 7f1d42ffd640 1 --2- 172.21.15.22:0/3906768684 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1d440ca480 0x7f1d440c5570 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1d38009d90 tx=0x7f1d3801f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb455b297fb659f6 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:41.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.445+0000 7f1d427fc640 1 -- 172.21.15.22:0/3906768684 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d380b4070 con 0x7f1d440ca480 2024-05-21T13:36:41.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.445+0000 7f1d427fc640 1 -- 172.21.15.22:0/3906768684 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d380af600 con 0x7f1d440ca480 2024-05-21T13:36:41.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.445+0000 7f1d427fc640 1 -- 172.21.15.22:0/3906768684 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d380af9d0 con 0x7f1d440ca480 2024-05-21T13:36:41.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.445+0000 7f1d4a163640 1 -- 172.21.15.22:0/3906768684 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1d440ca480 msgr2=0x7f1d440c5570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:41.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.445+0000 7f1d4a163640 1 --2- 172.21.15.22:0/3906768684 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1d440ca480 0x7f1d440c5570 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1d38009d90 tx=0x7f1d3801f150 comp rx=0 tx=0).stop 2024-05-21T13:36:41.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.445+0000 7f1d4a163640 1 -- 172.21.15.22:0/3906768684 shutdown_connections 2024-05-21T13:36:41.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.445+0000 7f1d4a163640 1 --2- 172.21.15.22:0/3906768684 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1d440ca480 0x7f1d440c5570 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:41.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.445+0000 7f1d4a163640 1 --2- 172.21.15.22:0/3906768684 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1d4415a260 0x7f1d440c8510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:41.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.445+0000 7f1d4a163640 1 -- 172.21.15.22:0/3906768684 >> 172.21.15.22:0/3906768684 conn(0x7f1d4406ea10 msgr2=0x7f1d4406ff50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:41.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.445+0000 7f1d4a163640 1 -- 172.21.15.22:0/3906768684 shutdown_connections 2024-05-21T13:36:41.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.445+0000 7f1d4a163640 1 -- 172.21.15.22:0/3906768684 wait complete. 2024-05-21T13:36:41.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.445+0000 7f1d4a163640 1 Processor -- start 2024-05-21T13:36:41.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.449+0000 7f1d4a163640 1 -- start start 2024-05-21T13:36:41.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.449+0000 7f1d4a163640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1d4406c4f0 0x7f1d441f5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:41.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.449+0000 7f1d4a163640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1d440ca480 0x7f1d4415c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:41.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.449+0000 7f1d4a163640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d4415a260 0x7f1d441f8f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:41.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.449+0000 7f1d4a163640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f1d440c99a0 con 0x7f1d4406c4f0 2024-05-21T13:36:41.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.449+0000 7f1d4a163640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f1d440c96c0 con 0x7f1d4415a260 2024-05-21T13:36:41.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.449+0000 7f1d4a163640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f1d440c9c80 con 0x7f1d440ca480 2024-05-21T13:36:41.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.449+0000 7f1d437fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1d4406c4f0 0x7f1d441f5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:41.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.449+0000 7f1d437fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1d4406c4f0 0x7f1d441f5090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43228/0 (socket says 172.21.15.22:43228) 2024-05-21T13:36:41.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.449+0000 7f1d437fe640 1 -- 172.21.15.22:0/2465358658 learned_addr learned my addr 172.21.15.22:0/2465358658 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:41.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.449+0000 7f1d43fff640 1 --2- 172.21.15.22:0/2465358658 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d4415a260 0x7f1d441f8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:41.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.449+0000 7f1d437fe640 1 -- 172.21.15.22:0/2465358658 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1d440ca480 msgr2=0x7f1d4415c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:41.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.449+0000 7f1d437fe640 1 --2- 172.21.15.22:0/2465358658 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1d440ca480 0x7f1d4415c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:41.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.449+0000 7f1d437fe640 1 -- 172.21.15.22:0/2465358658 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d4415a260 msgr2=0x7f1d441f8f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:41.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.449+0000 7f1d437fe640 1 --2- 172.21.15.22:0/2465358658 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d4415a260 0x7f1d441f8f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:41.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.449+0000 7f1d437fe640 1 -- 172.21.15.22:0/2465358658 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d4415a940 con 0x7f1d4406c4f0 2024-05-21T13:36:41.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.449+0000 7f1d437fe640 1 --2- 172.21.15.22:0/2465358658 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1d4406c4f0 0x7f1d441f5090 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c00e810 tx=0x7f1d3c00ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:41.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.449+0000 7f1d2bfff640 1 -- 172.21.15.22:0/2465358658 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d3c017070 con 0x7f1d4406c4f0 2024-05-21T13:36:41.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.449+0000 7f1d2bfff640 1 -- 172.21.15.22:0/2465358658 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d3c00c870 con 0x7f1d4406c4f0 2024-05-21T13:36:41.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.449+0000 7f1d4a163640 1 -- 172.21.15.22:0/2465358658 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d44163df0 con 0x7f1d4406c4f0 2024-05-21T13:36:41.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.449+0000 7f1d2bfff640 1 -- 172.21.15.22:0/2465358658 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d3c00f040 con 0x7f1d4406c4f0 2024-05-21T13:36:41.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.449+0000 7f1d4a163640 1 -- 172.21.15.22:0/2465358658 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d441f45b0 con 0x7f1d4406c4f0 2024-05-21T13:36:41.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.449+0000 7f1d4a163640 1 -- 172.21.15.22:0/2465358658 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d441f43c0 con 0x7f1d4406c4f0 2024-05-21T13:36:41.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.449+0000 7f1d2bfff640 1 -- 172.21.15.22:0/2465358658 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f1d3c01a070 con 0x7f1d4406c4f0 2024-05-21T13:36:41.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.449+0000 7f1d2bfff640 1 --2- 172.21.15.22:0/2465358658 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f1d3006f430 0x7f1d300718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:41.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.453+0000 7f1d2bfff640 1 -- 172.21.15.22:0/2465358658 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f1d3c08f110 con 0x7f1d4406c4f0 2024-05-21T13:36:41.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.453+0000 7f1d42ffd640 1 --2- 172.21.15.22:0/2465358658 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f1d3006f430 0x7f1d300718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:41.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.453+0000 7f1d42ffd640 1 --2- 172.21.15.22:0/2465358658 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f1d3006f430 0x7f1d300718f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1d380b1000 tx=0x7f1d38004ac0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:41.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.457+0000 7f1d2bfff640 1 -- 172.21.15.22:0/2465358658 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f1d3c05bdb0 con 0x7f1d4406c4f0 2024-05-21T13:36:41.593 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.613+0000 7f1d4a163640 1 -- 172.21.15.22:0/2465358658 --> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1d44077bb0 con 0x7f1d3006f430 2024-05-21T13:36:41.616 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.637+0000 7f1d2bfff640 1 -- 172.21.15.22:0/2465358658 <== mgr.4103 v2:172.21.15.115:6832/184591771 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332711 (secure 0 0 0) 0x7f1d44077bb0 con 0x7f1d3006f430 2024-05-21T13:36:41.620 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-21T13:36:41.622 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-05-21T13:36:41.623 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.641+0000 7f1d4a163640 1 -- 172.21.15.22:0/2465358658 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f1d3006f430 msgr2=0x7f1d300718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:41.624 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.641+0000 7f1d4a163640 1 --2- 172.21.15.22:0/2465358658 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f1d3006f430 0x7f1d300718f0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f1d380b1000 tx=0x7f1d38004ac0 comp rx=0 tx=0).stop 2024-05-21T13:36:41.624 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.641+0000 7f1d4a163640 1 -- 172.21.15.22:0/2465358658 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1d4406c4f0 msgr2=0x7f1d441f5090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:41.624 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.641+0000 7f1d4a163640 1 --2- 172.21.15.22:0/2465358658 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1d4406c4f0 0x7f1d441f5090 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c00e810 tx=0x7f1d3c00ecd0 comp rx=0 tx=0).stop 2024-05-21T13:36:41.624 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.641+0000 7f1d4a163640 1 -- 172.21.15.22:0/2465358658 shutdown_connections 2024-05-21T13:36:41.624 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.641+0000 7f1d4a163640 1 --2- 172.21.15.22:0/2465358658 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f1d3006f430 0x7f1d300718f0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:41.624 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.641+0000 7f1d4a163640 1 --2- 172.21.15.22:0/2465358658 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1d4415a260 0x7f1d441f8f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:41.624 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.641+0000 7f1d4a163640 1 --2- 172.21.15.22:0/2465358658 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1d440ca480 0x7f1d4415c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:41.624 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.641+0000 7f1d4a163640 1 --2- 172.21.15.22:0/2465358658 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1d4406c4f0 0x7f1d441f5090 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:41.624 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.641+0000 7f1d4a163640 1 -- 172.21.15.22:0/2465358658 >> 172.21.15.22:0/2465358658 conn(0x7f1d4406ea10 msgr2=0x7f1d44158ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:41.624 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.645+0000 7f1d4a163640 1 -- 172.21.15.22:0/2465358658 shutdown_connections 2024-05-21T13:36:41.624 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.645+0000 7f1d4a163640 1 -- 172.21.15.22:0/2465358658 wait complete. 2024-05-21T13:36:41.640 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":49,"stamp":"2024-05-21T13:36:40.514958+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597820,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":228,"num_write_kb":1670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235088,"kb_used_data":2316,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739632,"statfs":{"total":773094113280,"available":772853383168,"internally_reserved":0,"allocated":2371584,"data_stored":2014512,"data_compressed":66916,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1406,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.003452"},"pg_stats":[{"pgid":"2.1f","version":"25'9","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:32.022623+0000","last_change":"2024-05-21T13:35:56.739488+0000","last_active":"2024-05-21T13:36:32.022623+0000","last_peered":"2024-05-21T13:36:32.022623+0000","last_clean":"2024-05-21T13:36:32.022623+0000","last_became_active":"2024-05-21T13:35:56.738481+0000","last_became_peered":"2024-05-21T13:35:56.738481+0000","last_unstale":"2024-05-21T13:36:32.022623+0000","last_undegraded":"2024-05-21T13:36:32.022623+0000","last_fullsized":"2024-05-21T13:36:32.022623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:20:48.149770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-21T13:36:38.728860+0000","last_change":"2024-05-21T13:35:57.779462+0000","last_active":"2024-05-21T13:36:38.728860+0000","last_peered":"2024-05-21T13:36:38.728860+0000","last_clean":"2024-05-21T13:36:38.728860+0000","last_became_active":"2024-05-21T13:35:57.778721+0000","last_became_peered":"2024-05-21T13:35:57.778721+0000","last_unstale":"2024-05-21T13:36:38.728860+0000","last_undegraded":"2024-05-21T13:36:38.728860+0000","last_fullsized":"2024-05-21T13:36:38.728860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:13:05.005747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.963696+0000","last_change":"2024-05-21T13:36:01.868203+0000","last_active":"2024-05-21T13:36:02.963696+0000","last_peered":"2024-05-21T13:36:02.963696+0000","last_clean":"2024-05-21T13:36:02.963696+0000","last_became_active":"2024-05-21T13:36:01.864148+0000","last_became_peered":"2024-05-21T13:36:01.864148+0000","last_unstale":"2024-05-21T13:36:02.963696+0000","last_undegraded":"2024-05-21T13:36:02.963696+0000","last_fullsized":"2024-05-21T13:36:02.963696+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T13:57:33.088920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"25'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-21T13:36:38.729148+0000","last_change":"2024-05-21T13:35:56.775054+0000","last_active":"2024-05-21T13:36:38.729148+0000","last_peered":"2024-05-21T13:36:38.729148+0000","last_clean":"2024-05-21T13:36:38.729148+0000","last_became_active":"2024-05-21T13:35:56.770566+0000","last_became_peered":"2024-05-21T13:35:56.770566+0000","last_unstale":"2024-05-21T13:36:38.729148+0000","last_undegraded":"2024-05-21T13:36:38.729148+0000","last_fullsized":"2024-05-21T13:36:38.729148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:05:11.539201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-21T13:36:38.729089+0000","last_change":"2024-05-21T13:35:57.782094+0000","last_active":"2024-05-21T13:36:38.729089+0000","last_peered":"2024-05-21T13:36:38.729089+0000","last_clean":"2024-05-21T13:36:38.729089+0000","last_became_active":"2024-05-21T13:35:57.780590+0000","last_became_peered":"2024-05-21T13:35:57.780590+0000","last_unstale":"2024-05-21T13:36:38.729089+0000","last_undegraded":"2024-05-21T13:36:38.729089+0000","last_fullsized":"2024-05-21T13:36:38.729089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:30:50.929103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.960911+0000","last_change":"2024-05-21T13:36:01.852092+0000","last_active":"2024-05-21T13:36:02.960911+0000","last_peered":"2024-05-21T13:36:02.960911+0000","last_clean":"2024-05-21T13:36:02.960911+0000","last_became_active":"2024-05-21T13:36:01.851745+0000","last_became_peered":"2024-05-21T13:36:01.851745+0000","last_unstale":"2024-05-21T13:36:02.960911+0000","last_undegraded":"2024-05-21T13:36:02.960911+0000","last_fullsized":"2024-05-21T13:36:02.960911+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:57:21.599860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"25'4","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:32.023565+0000","last_change":"2024-05-21T13:35:56.731106+0000","last_active":"2024-05-21T13:36:32.023565+0000","last_peered":"2024-05-21T13:36:32.023565+0000","last_clean":"2024-05-21T13:36:32.023565+0000","last_became_active":"2024-05-21T13:35:56.730746+0000","last_became_peered":"2024-05-21T13:35:56.730746+0000","last_unstale":"2024-05-21T13:36:32.023565+0000","last_undegraded":"2024-05-21T13:36:32.023565+0000","last_fullsized":"2024-05-21T13:36:32.023565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:23:17.798397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.963099+0000","last_change":"2024-05-21T13:35:57.771371+0000","last_active":"2024-05-21T13:36:02.963099+0000","last_peered":"2024-05-21T13:36:02.963099+0000","last_clean":"2024-05-21T13:36:02.963099+0000","last_became_active":"2024-05-21T13:35:57.770595+0000","last_became_peered":"2024-05-21T13:35:57.770595+0000","last_unstale":"2024-05-21T13:36:02.963099+0000","last_undegraded":"2024-05-21T13:36:02.963099+0000","last_fullsized":"2024-05-21T13:36:02.963099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:53:17.771310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.961202+0000","last_change":"2024-05-21T13:36:01.849638+0000","last_active":"2024-05-21T13:36:02.961202+0000","last_peered":"2024-05-21T13:36:02.961202+0000","last_clean":"2024-05-21T13:36:02.961202+0000","last_became_active":"2024-05-21T13:36:01.848996+0000","last_became_peered":"2024-05-21T13:36:01.848996+0000","last_unstale":"2024-05-21T13:36:02.961202+0000","last_undegraded":"2024-05-21T13:36:02.961202+0000","last_fullsized":"2024-05-21T13:36:02.961202+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:24:31.613874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.960165+0000","last_change":"2024-05-21T13:35:56.737279+0000","last_active":"2024-05-21T13:36:02.960165+0000","last_peered":"2024-05-21T13:36:02.960165+0000","last_clean":"2024-05-21T13:36:02.960165+0000","last_became_active":"2024-05-21T13:35:56.731150+0000","last_became_peered":"2024-05-21T13:35:56.731150+0000","last_unstale":"2024-05-21T13:36:02.960165+0000","last_undegraded":"2024-05-21T13:36:02.960165+0000","last_fullsized":"2024-05-21T13:36:02.960165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:17:07.571294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.806009+0000","last_change":"2024-05-21T13:35:57.799803+0000","last_active":"2024-05-21T13:36:02.806009+0000","last_peered":"2024-05-21T13:36:02.806009+0000","last_clean":"2024-05-21T13:36:02.806009+0000","last_became_active":"2024-05-21T13:35:57.799043+0000","last_became_peered":"2024-05-21T13:35:57.799043+0000","last_unstale":"2024-05-21T13:36:02.806009+0000","last_undegraded":"2024-05-21T13:36:02.806009+0000","last_fullsized":"2024-05-21T13:36:02.806009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:22:48.607953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.961831+0000","last_change":"2024-05-21T13:36:01.852469+0000","last_active":"2024-05-21T13:36:02.961831+0000","last_peered":"2024-05-21T13:36:02.961831+0000","last_clean":"2024-05-21T13:36:02.961831+0000","last_became_active":"2024-05-21T13:36:01.851913+0000","last_became_peered":"2024-05-21T13:36:01.851913+0000","last_unstale":"2024-05-21T13:36:02.961831+0000","last_undegraded":"2024-05-21T13:36:02.961831+0000","last_fullsized":"2024-05-21T13:36:02.961831+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:42:58.062540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.805533+0000","last_change":"2024-05-21T13:35:57.796516+0000","last_active":"2024-05-21T13:36:02.805533+0000","last_peered":"2024-05-21T13:36:02.805533+0000","last_clean":"2024-05-21T13:36:02.805533+0000","last_became_active":"2024-05-21T13:35:57.795638+0000","last_became_peered":"2024-05-21T13:35:57.795638+0000","last_unstale":"2024-05-21T13:36:02.805533+0000","last_undegraded":"2024-05-21T13:36:02.805533+0000","last_fullsized":"2024-05-21T13:36:02.805533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:46:40.541835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"25'4","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:26.905177+0000","last_change":"2024-05-21T13:35:56.748046+0000","last_active":"2024-05-21T13:36:26.905177+0000","last_peered":"2024-05-21T13:36:26.905177+0000","last_clean":"2024-05-21T13:36:26.905177+0000","last_became_active":"2024-05-21T13:35:56.747635+0000","last_became_peered":"2024-05-21T13:35:56.747635+0000","last_unstale":"2024-05-21T13:36:26.905177+0000","last_undegraded":"2024-05-21T13:36:26.905177+0000","last_fullsized":"2024-05-21T13:36:26.905177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:52:28.665244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.805864+0000","last_change":"2024-05-21T13:36:01.862153+0000","last_active":"2024-05-21T13:36:02.805864+0000","last_peered":"2024-05-21T13:36:02.805864+0000","last_clean":"2024-05-21T13:36:02.805864+0000","last_became_active":"2024-05-21T13:36:01.861520+0000","last_became_peered":"2024-05-21T13:36:01.861520+0000","last_unstale":"2024-05-21T13:36:02.805864+0000","last_undegraded":"2024-05-21T13:36:02.805864+0000","last_fullsized":"2024-05-21T13:36:02.805864+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:04:37.306132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.964897+0000","last_change":"2024-05-21T13:35:57.786463+0000","last_active":"2024-05-21T13:36:02.964897+0000","last_peered":"2024-05-21T13:36:02.964897+0000","last_clean":"2024-05-21T13:36:02.964897+0000","last_became_active":"2024-05-21T13:35:57.786126+0000","last_became_peered":"2024-05-21T13:35:57.786126+0000","last_unstale":"2024-05-21T13:36:02.964897+0000","last_undegraded":"2024-05-21T13:36:02.964897+0000","last_fullsized":"2024-05-21T13:36:02.964897+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:39:32.076464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"25'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.966972+0000","last_change":"2024-05-21T13:35:56.765178+0000","last_active":"2024-05-21T13:36:02.966972+0000","last_peered":"2024-05-21T13:36:02.966972+0000","last_clean":"2024-05-21T13:36:02.966972+0000","last_became_active":"2024-05-21T13:35:56.764551+0000","last_became_peered":"2024-05-21T13:35:56.764551+0000","last_unstale":"2024-05-21T13:36:02.966972+0000","last_undegraded":"2024-05-21T13:36:02.966972+0000","last_fullsized":"2024-05-21T13:36:02.966972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:34:28.955222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.959609+0000","last_change":"2024-05-21T13:36:01.854410+0000","last_active":"2024-05-21T13:36:02.959609+0000","last_peered":"2024-05-21T13:36:02.959609+0000","last_clean":"2024-05-21T13:36:02.959609+0000","last_became_active":"2024-05-21T13:36:01.853975+0000","last_became_peered":"2024-05-21T13:36:01.853975+0000","last_unstale":"2024-05-21T13:36:02.959609+0000","last_undegraded":"2024-05-21T13:36:02.959609+0000","last_fullsized":"2024-05-21T13:36:02.959609+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:15:34.710504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.807180+0000","last_change":"2024-05-21T13:35:57.762509+0000","last_active":"2024-05-21T13:36:02.807180+0000","last_peered":"2024-05-21T13:36:02.807180+0000","last_clean":"2024-05-21T13:36:02.807180+0000","last_became_active":"2024-05-21T13:35:57.761739+0000","last_became_peered":"2024-05-21T13:35:57.761739+0000","last_unstale":"2024-05-21T13:36:02.807180+0000","last_undegraded":"2024-05-21T13:36:02.807180+0000","last_fullsized":"2024-05-21T13:36:02.807180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:41:17.911126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"25'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:26.908898+0000","last_change":"2024-05-21T13:35:56.734017+0000","last_active":"2024-05-21T13:36:26.908898+0000","last_peered":"2024-05-21T13:36:26.908898+0000","last_clean":"2024-05-21T13:36:26.908898+0000","last_became_active":"2024-05-21T13:35:56.733249+0000","last_became_peered":"2024-05-21T13:35:56.733249+0000","last_unstale":"2024-05-21T13:36:26.908898+0000","last_undegraded":"2024-05-21T13:36:26.908898+0000","last_fullsized":"2024-05-21T13:36:26.908898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:13:27.279557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.967145+0000","last_change":"2024-05-21T13:36:01.868669+0000","last_active":"2024-05-21T13:36:02.967145+0000","last_peered":"2024-05-21T13:36:02.967145+0000","last_clean":"2024-05-21T13:36:02.967145+0000","last_became_active":"2024-05-21T13:36:01.867701+0000","last_became_peered":"2024-05-21T13:36:01.867701+0000","last_unstale":"2024-05-21T13:36:02.967145+0000","last_undegraded":"2024-05-21T13:36:02.967145+0000","last_fullsized":"2024-05-21T13:36:02.967145+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:09:21.615570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.804889+0000","last_change":"2024-05-21T13:35:57.789966+0000","last_active":"2024-05-21T13:36:02.804889+0000","last_peered":"2024-05-21T13:36:02.804889+0000","last_clean":"2024-05-21T13:36:02.804889+0000","last_became_active":"2024-05-21T13:35:57.789213+0000","last_became_peered":"2024-05-21T13:35:57.789213+0000","last_unstale":"2024-05-21T13:36:02.804889+0000","last_undegraded":"2024-05-21T13:36:02.804889+0000","last_fullsized":"2024-05-21T13:36:02.804889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:33:24.183958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"25'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:26.906102+0000","last_change":"2024-05-21T13:35:56.746878+0000","last_active":"2024-05-21T13:36:26.906102+0000","last_peered":"2024-05-21T13:36:26.906102+0000","last_clean":"2024-05-21T13:36:26.906102+0000","last_became_active":"2024-05-21T13:35:56.746534+0000","last_became_peered":"2024-05-21T13:35:56.746534+0000","last_unstale":"2024-05-21T13:36:26.906102+0000","last_undegraded":"2024-05-21T13:36:26.906102+0000","last_fullsized":"2024-05-21T13:36:26.906102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:45:56.935415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.961481+0000","last_change":"2024-05-21T13:36:01.841632+0000","last_active":"2024-05-21T13:36:02.961481+0000","last_peered":"2024-05-21T13:36:02.961481+0000","last_clean":"2024-05-21T13:36:02.961481+0000","last_became_active":"2024-05-21T13:36:01.841216+0000","last_became_peered":"2024-05-21T13:36:01.841216+0000","last_unstale":"2024-05-21T13:36:02.961481+0000","last_undegraded":"2024-05-21T13:36:02.961481+0000","last_fullsized":"2024-05-21T13:36:02.961481+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:49:05.576221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.807962+0000","last_change":"2024-05-21T13:35:57.764793+0000","last_active":"2024-05-21T13:36:02.807962+0000","last_peered":"2024-05-21T13:36:02.807962+0000","last_clean":"2024-05-21T13:36:02.807962+0000","last_became_active":"2024-05-21T13:35:57.764017+0000","last_became_peered":"2024-05-21T13:35:57.764017+0000","last_unstale":"2024-05-21T13:36:02.807962+0000","last_undegraded":"2024-05-21T13:36:02.807962+0000","last_fullsized":"2024-05-21T13:36:02.807962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:25:45.006614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"25'4","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:26.906102+0000","last_change":"2024-05-21T13:35:56.752278+0000","last_active":"2024-05-21T13:36:26.906102+0000","last_peered":"2024-05-21T13:36:26.906102+0000","last_clean":"2024-05-21T13:36:26.906102+0000","last_became_active":"2024-05-21T13:35:56.751883+0000","last_became_peered":"2024-05-21T13:35:56.751883+0000","last_unstale":"2024-05-21T13:36:26.906102+0000","last_undegraded":"2024-05-21T13:36:26.906102+0000","last_fullsized":"2024-05-21T13:36:26.906102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:08:05.279701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.961503+0000","last_change":"2024-05-21T13:36:01.832621+0000","last_active":"2024-05-21T13:36:02.961503+0000","last_peered":"2024-05-21T13:36:02.961503+0000","last_clean":"2024-05-21T13:36:02.961503+0000","last_became_active":"2024-05-21T13:36:01.831609+0000","last_became_peered":"2024-05-21T13:36:01.831609+0000","last_unstale":"2024-05-21T13:36:02.961503+0000","last_undegraded":"2024-05-21T13:36:02.961503+0000","last_fullsized":"2024-05-21T13:36:02.961503+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:26:43.075259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.808212+0000","last_change":"2024-05-21T13:35:57.783487+0000","last_active":"2024-05-21T13:36:02.808212+0000","last_peered":"2024-05-21T13:36:02.808212+0000","last_clean":"2024-05-21T13:36:02.808212+0000","last_became_active":"2024-05-21T13:35:57.783150+0000","last_became_peered":"2024-05-21T13:35:57.783150+0000","last_unstale":"2024-05-21T13:36:02.808212+0000","last_undegraded":"2024-05-21T13:36:02.808212+0000","last_fullsized":"2024-05-21T13:36:02.808212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:14:56.991945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"25'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:32.021084+0000","last_change":"2024-05-21T13:35:56.745122+0000","last_active":"2024-05-21T13:36:32.021084+0000","last_peered":"2024-05-21T13:36:32.021084+0000","last_clean":"2024-05-21T13:36:32.021084+0000","last_became_active":"2024-05-21T13:35:56.744218+0000","last_became_peered":"2024-05-21T13:35:56.744218+0000","last_unstale":"2024-05-21T13:36:32.021084+0000","last_undegraded":"2024-05-21T13:36:32.021084+0000","last_fullsized":"2024-05-21T13:36:32.021084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:45:03.790591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.807106+0000","last_change":"2024-05-21T13:36:01.838971+0000","last_active":"2024-05-21T13:36:02.807106+0000","last_peered":"2024-05-21T13:36:02.807106+0000","last_clean":"2024-05-21T13:36:02.807106+0000","last_became_active":"2024-05-21T13:36:01.837401+0000","last_became_peered":"2024-05-21T13:36:01.837401+0000","last_unstale":"2024-05-21T13:36:02.807106+0000","last_undegraded":"2024-05-21T13:36:02.807106+0000","last_fullsized":"2024-05-21T13:36:02.807106+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:16:25.666568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.967981+0000","last_change":"2024-05-21T13:35:57.784993+0000","last_active":"2024-05-21T13:36:02.967981+0000","last_peered":"2024-05-21T13:36:02.967981+0000","last_clean":"2024-05-21T13:36:02.967981+0000","last_became_active":"2024-05-21T13:35:57.784664+0000","last_became_peered":"2024-05-21T13:35:57.784664+0000","last_unstale":"2024-05-21T13:36:02.967981+0000","last_undegraded":"2024-05-21T13:36:02.967981+0000","last_fullsized":"2024-05-21T13:36:02.967981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:58:20.045901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"25'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.806918+0000","last_change":"2024-05-21T13:35:56.741285+0000","last_active":"2024-05-21T13:36:02.806918+0000","last_peered":"2024-05-21T13:36:02.806918+0000","last_clean":"2024-05-21T13:36:02.806918+0000","last_became_active":"2024-05-21T13:35:56.740846+0000","last_became_peered":"2024-05-21T13:35:56.740846+0000","last_unstale":"2024-05-21T13:36:02.806918+0000","last_undegraded":"2024-05-21T13:36:02.806918+0000","last_fullsized":"2024-05-21T13:36:02.806918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:34:17.960870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.963587+0000","last_change":"2024-05-21T13:36:01.873172+0000","last_active":"2024-05-21T13:36:02.963587+0000","last_peered":"2024-05-21T13:36:02.963587+0000","last_clean":"2024-05-21T13:36:02.963587+0000","last_became_active":"2024-05-21T13:36:01.872085+0000","last_became_peered":"2024-05-21T13:36:01.872085+0000","last_unstale":"2024-05-21T13:36:02.963587+0000","last_undegraded":"2024-05-21T13:36:02.963587+0000","last_fullsized":"2024-05-21T13:36:02.963587+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:24:57.031323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.961092+0000","last_change":"2024-05-21T13:35:57.783176+0000","last_active":"2024-05-21T13:36:02.961092+0000","last_peered":"2024-05-21T13:36:02.961092+0000","last_clean":"2024-05-21T13:36:02.961092+0000","last_became_active":"2024-05-21T13:35:57.782517+0000","last_became_peered":"2024-05-21T13:35:57.782517+0000","last_unstale":"2024-05-21T13:36:02.961092+0000","last_undegraded":"2024-05-21T13:36:02.961092+0000","last_fullsized":"2024-05-21T13:36:02.961092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:06:58.203996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-21T13:36:38.728215+0000","last_change":"2024-05-21T13:35:56.767544+0000","last_active":"2024-05-21T13:36:38.728215+0000","last_peered":"2024-05-21T13:36:38.728215+0000","last_clean":"2024-05-21T13:36:38.728215+0000","last_became_active":"2024-05-21T13:35:56.764987+0000","last_became_peered":"2024-05-21T13:35:56.764987+0000","last_unstale":"2024-05-21T13:36:38.728215+0000","last_undegraded":"2024-05-21T13:36:38.728215+0000","last_fullsized":"2024-05-21T13:36:38.728215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:12:46.828769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.966223+0000","last_change":"2024-05-21T13:36:01.872215+0000","last_active":"2024-05-21T13:36:02.966223+0000","last_peered":"2024-05-21T13:36:02.966223+0000","last_clean":"2024-05-21T13:36:02.966223+0000","last_became_active":"2024-05-21T13:36:01.870831+0000","last_became_peered":"2024-05-21T13:36:01.870831+0000","last_unstale":"2024-05-21T13:36:02.966223+0000","last_undegraded":"2024-05-21T13:36:02.966223+0000","last_fullsized":"2024-05-21T13:36:02.966223+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:04:09.689206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.959882+0000","last_change":"2024-05-21T13:35:57.783616+0000","last_active":"2024-05-21T13:36:02.959882+0000","last_peered":"2024-05-21T13:36:02.959882+0000","last_clean":"2024-05-21T13:36:02.959882+0000","last_became_active":"2024-05-21T13:35:57.780521+0000","last_became_peered":"2024-05-21T13:35:57.780521+0000","last_unstale":"2024-05-21T13:36:02.959882+0000","last_undegraded":"2024-05-21T13:36:02.959882+0000","last_fullsized":"2024-05-21T13:36:02.959882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:59:44.121631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"25'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.806903+0000","last_change":"2024-05-21T13:35:56.750341+0000","last_active":"2024-05-21T13:36:02.806903+0000","last_peered":"2024-05-21T13:36:02.806903+0000","last_clean":"2024-05-21T13:36:02.806903+0000","last_became_active":"2024-05-21T13:35:56.750006+0000","last_became_peered":"2024-05-21T13:35:56.750006+0000","last_unstale":"2024-05-21T13:36:02.806903+0000","last_undegraded":"2024-05-21T13:36:02.806903+0000","last_fullsized":"2024-05-21T13:36:02.806903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:15:21.416234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.967726+0000","last_change":"2024-05-21T13:36:01.873693+0000","last_active":"2024-05-21T13:36:02.967726+0000","last_peered":"2024-05-21T13:36:02.967726+0000","last_clean":"2024-05-21T13:36:02.967726+0000","last_became_active":"2024-05-21T13:36:01.872363+0000","last_became_peered":"2024-05-21T13:36:01.872363+0000","last_unstale":"2024-05-21T13:36:02.967726+0000","last_undegraded":"2024-05-21T13:36:02.967726+0000","last_fullsized":"2024-05-21T13:36:02.967726+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:27:25.974289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-21T13:36:38.727538+0000","last_change":"2024-05-21T13:35:57.780809+0000","last_active":"2024-05-21T13:36:38.727538+0000","last_peered":"2024-05-21T13:36:38.727538+0000","last_clean":"2024-05-21T13:36:38.727538+0000","last_became_active":"2024-05-21T13:35:57.780313+0000","last_became_peered":"2024-05-21T13:35:57.780313+0000","last_unstale":"2024-05-21T13:36:38.727538+0000","last_undegraded":"2024-05-21T13:36:38.727538+0000","last_fullsized":"2024-05-21T13:36:38.727538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:43:11.778238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"25'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:32.025109+0000","last_change":"2024-05-21T13:35:56.771138+0000","last_active":"2024-05-21T13:36:32.025109+0000","last_peered":"2024-05-21T13:36:32.025109+0000","last_clean":"2024-05-21T13:36:32.025109+0000","last_became_active":"2024-05-21T13:35:56.770465+0000","last_became_peered":"2024-05-21T13:35:56.770465+0000","last_unstale":"2024-05-21T13:36:32.025109+0000","last_undegraded":"2024-05-21T13:36:32.025109+0000","last_fullsized":"2024-05-21T13:36:32.025109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:21:16.702309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.968200+0000","last_change":"2024-05-21T13:36:01.871328+0000","last_active":"2024-05-21T13:36:02.968200+0000","last_peered":"2024-05-21T13:36:02.968200+0000","last_clean":"2024-05-21T13:36:02.968200+0000","last_became_active":"2024-05-21T13:36:01.870678+0000","last_became_peered":"2024-05-21T13:36:01.870678+0000","last_unstale":"2024-05-21T13:36:02.968200+0000","last_undegraded":"2024-05-21T13:36:02.968200+0000","last_fullsized":"2024-05-21T13:36:02.968200+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:22:47.393065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.962506+0000","last_change":"2024-05-21T13:35:57.782665+0000","last_active":"2024-05-21T13:36:02.962506+0000","last_peered":"2024-05-21T13:36:02.962506+0000","last_clean":"2024-05-21T13:36:02.962506+0000","last_became_active":"2024-05-21T13:35:57.781299+0000","last_became_peered":"2024-05-21T13:35:57.781299+0000","last_unstale":"2024-05-21T13:36:02.962506+0000","last_undegraded":"2024-05-21T13:36:02.962506+0000","last_fullsized":"2024-05-21T13:36:02.962506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:21:22.721124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"25'3","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:32.019985+0000","last_change":"2024-05-21T13:35:56.768193+0000","last_active":"2024-05-21T13:36:32.019985+0000","last_peered":"2024-05-21T13:36:32.019985+0000","last_clean":"2024-05-21T13:36:32.019985+0000","last_became_active":"2024-05-21T13:35:56.767788+0000","last_became_peered":"2024-05-21T13:35:56.767788+0000","last_unstale":"2024-05-21T13:36:32.019985+0000","last_undegraded":"2024-05-21T13:36:32.019985+0000","last_fullsized":"2024-05-21T13:36:32.019985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:12:52.911816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-21T13:36:38.728339+0000","last_change":"2024-05-21T13:36:01.860305+0000","last_active":"2024-05-21T13:36:38.728339+0000","last_peered":"2024-05-21T13:36:38.728339+0000","last_clean":"2024-05-21T13:36:38.728339+0000","last_became_active":"2024-05-21T13:36:01.859141+0000","last_became_peered":"2024-05-21T13:36:01.859141+0000","last_unstale":"2024-05-21T13:36:38.728339+0000","last_undegraded":"2024-05-21T13:36:38.728339+0000","last_fullsized":"2024-05-21T13:36:38.728339+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:05:45.203241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.807817+0000","last_change":"2024-05-21T13:35:57.775523+0000","last_active":"2024-05-21T13:36:02.807817+0000","last_peered":"2024-05-21T13:36:02.807817+0000","last_clean":"2024-05-21T13:36:02.807817+0000","last_became_active":"2024-05-21T13:35:57.774322+0000","last_became_peered":"2024-05-21T13:35:57.774322+0000","last_unstale":"2024-05-21T13:36:02.807817+0000","last_undegraded":"2024-05-21T13:36:02.807817+0000","last_fullsized":"2024-05-21T13:36:02.807817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:06:35.118540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"25'3","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:26.905395+0000","last_change":"2024-05-21T13:35:56.748185+0000","last_active":"2024-05-21T13:36:26.905395+0000","last_peered":"2024-05-21T13:36:26.905395+0000","last_clean":"2024-05-21T13:36:26.905395+0000","last_became_active":"2024-05-21T13:35:56.747823+0000","last_became_peered":"2024-05-21T13:35:56.747823+0000","last_unstale":"2024-05-21T13:36:26.905395+0000","last_undegraded":"2024-05-21T13:36:26.905395+0000","last_fullsized":"2024-05-21T13:36:26.905395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:38:00.235330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":117,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.963125+0000","last_change":"2024-05-21T13:35:45.682484+0000","last_active":"2024-05-21T13:36:02.963125+0000","last_peered":"2024-05-21T13:36:02.963125+0000","last_clean":"2024-05-21T13:36:02.963125+0000","last_became_active":"2024-05-21T13:35:45.680732+0000","last_became_peered":"2024-05-21T13:35:45.680732+0000","last_unstale":"2024-05-21T13:36:02.963125+0000","last_undegraded":"2024-05-21T13:36:02.963125+0000","last_fullsized":"2024-05-21T13:36:02.963125+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:44.542324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:44.542324+0000","last_clean_scrub_stamp":"2024-05-21T13:35:44.542324+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:16:05.034161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.806631+0000","last_change":"2024-05-21T13:36:01.830034+0000","last_active":"2024-05-21T13:36:02.806631+0000","last_peered":"2024-05-21T13:36:02.806631+0000","last_clean":"2024-05-21T13:36:02.806631+0000","last_became_active":"2024-05-21T13:36:01.828957+0000","last_became_peered":"2024-05-21T13:36:01.828957+0000","last_unstale":"2024-05-21T13:36:02.806631+0000","last_undegraded":"2024-05-21T13:36:02.806631+0000","last_fullsized":"2024-05-21T13:36:02.806631+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:21:59.514268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.806258+0000","last_change":"2024-05-21T13:35:57.796419+0000","last_active":"2024-05-21T13:36:02.806258+0000","last_peered":"2024-05-21T13:36:02.806258+0000","last_clean":"2024-05-21T13:36:02.806258+0000","last_became_active":"2024-05-21T13:35:57.796050+0000","last_became_peered":"2024-05-21T13:35:57.796050+0000","last_unstale":"2024-05-21T13:36:02.806258+0000","last_undegraded":"2024-05-21T13:36:02.806258+0000","last_fullsized":"2024-05-21T13:36:02.806258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:56:07.121391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"25'3","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:32.024966+0000","last_change":"2024-05-21T13:35:56.751619+0000","last_active":"2024-05-21T13:36:32.024966+0000","last_peered":"2024-05-21T13:36:32.024966+0000","last_clean":"2024-05-21T13:36:32.024966+0000","last_became_active":"2024-05-21T13:35:56.748604+0000","last_became_peered":"2024-05-21T13:35:56.748604+0000","last_unstale":"2024-05-21T13:36:32.024966+0000","last_undegraded":"2024-05-21T13:36:32.024966+0000","last_fullsized":"2024-05-21T13:36:32.024966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:19:03.052434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.961835+0000","last_change":"2024-05-21T13:36:01.825464+0000","last_active":"2024-05-21T13:36:02.961835+0000","last_peered":"2024-05-21T13:36:02.961835+0000","last_clean":"2024-05-21T13:36:02.961835+0000","last_became_active":"2024-05-21T13:36:01.824653+0000","last_became_peered":"2024-05-21T13:36:01.824653+0000","last_unstale":"2024-05-21T13:36:02.961835+0000","last_undegraded":"2024-05-21T13:36:02.961835+0000","last_fullsized":"2024-05-21T13:36:02.961835+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:29:32.830052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.960114+0000","last_change":"2024-05-21T13:35:57.784031+0000","last_active":"2024-05-21T13:36:02.960114+0000","last_peered":"2024-05-21T13:36:02.960114+0000","last_clean":"2024-05-21T13:36:02.960114+0000","last_became_active":"2024-05-21T13:35:57.771695+0000","last_became_peered":"2024-05-21T13:35:57.771695+0000","last_unstale":"2024-05-21T13:36:02.960114+0000","last_undegraded":"2024-05-21T13:36:02.960114+0000","last_fullsized":"2024-05-21T13:36:02.960114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:46:33.308257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-21T13:36:38.728564+0000","last_change":"2024-05-21T13:35:56.768166+0000","last_active":"2024-05-21T13:36:38.728564+0000","last_peered":"2024-05-21T13:36:38.728564+0000","last_clean":"2024-05-21T13:36:38.728564+0000","last_became_active":"2024-05-21T13:35:56.767053+0000","last_became_peered":"2024-05-21T13:35:56.767053+0000","last_unstale":"2024-05-21T13:36:38.728564+0000","last_undegraded":"2024-05-21T13:36:38.728564+0000","last_fullsized":"2024-05-21T13:36:38.728564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:10:16.639491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-21T13:36:38.728163+0000","last_change":"2024-05-21T13:36:01.834253+0000","last_active":"2024-05-21T13:36:38.728163+0000","last_peered":"2024-05-21T13:36:38.728163+0000","last_clean":"2024-05-21T13:36:38.728163+0000","last_became_active":"2024-05-21T13:36:01.832972+0000","last_became_peered":"2024-05-21T13:36:01.832972+0000","last_unstale":"2024-05-21T13:36:38.728163+0000","last_undegraded":"2024-05-21T13:36:38.728163+0000","last_fullsized":"2024-05-21T13:36:38.728163+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:52:05.576063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.960150+0000","last_change":"2024-05-21T13:35:57.766504+0000","last_active":"2024-05-21T13:36:02.960150+0000","last_peered":"2024-05-21T13:36:02.960150+0000","last_clean":"2024-05-21T13:36:02.960150+0000","last_became_active":"2024-05-21T13:35:57.765756+0000","last_became_peered":"2024-05-21T13:35:57.765756+0000","last_unstale":"2024-05-21T13:36:02.960150+0000","last_undegraded":"2024-05-21T13:36:02.960150+0000","last_fullsized":"2024-05-21T13:36:02.960150+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:52:13.025110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.808071+0000","last_change":"2024-05-21T13:35:56.770347+0000","last_active":"2024-05-21T13:36:02.808071+0000","last_peered":"2024-05-21T13:36:02.808071+0000","last_clean":"2024-05-21T13:36:02.808071+0000","last_became_active":"2024-05-21T13:35:56.769767+0000","last_became_peered":"2024-05-21T13:35:56.769767+0000","last_unstale":"2024-05-21T13:36:02.808071+0000","last_undegraded":"2024-05-21T13:36:02.808071+0000","last_fullsized":"2024-05-21T13:36:02.808071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:40:01.698967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.804632+0000","last_change":"2024-05-21T13:36:01.827091+0000","last_active":"2024-05-21T13:36:02.804632+0000","last_peered":"2024-05-21T13:36:02.804632+0000","last_clean":"2024-05-21T13:36:02.804632+0000","last_became_active":"2024-05-21T13:36:01.826686+0000","last_became_peered":"2024-05-21T13:36:01.826686+0000","last_unstale":"2024-05-21T13:36:02.804632+0000","last_undegraded":"2024-05-21T13:36:02.804632+0000","last_fullsized":"2024-05-21T13:36:02.804632+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:42:47.638921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.962149+0000","last_change":"2024-05-21T13:35:57.781528+0000","last_active":"2024-05-21T13:36:02.962149+0000","last_peered":"2024-05-21T13:36:02.962149+0000","last_clean":"2024-05-21T13:36:02.962149+0000","last_became_active":"2024-05-21T13:35:57.781111+0000","last_became_peered":"2024-05-21T13:35:57.781111+0000","last_unstale":"2024-05-21T13:36:02.962149+0000","last_undegraded":"2024-05-21T13:36:02.962149+0000","last_fullsized":"2024-05-21T13:36:02.962149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:15:43.847640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"24'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.960114+0000","last_change":"2024-05-21T13:35:56.755413+0000","last_active":"2024-05-21T13:36:02.960114+0000","last_peered":"2024-05-21T13:36:02.960114+0000","last_clean":"2024-05-21T13:36:02.960114+0000","last_became_active":"2024-05-21T13:35:56.755158+0000","last_became_peered":"2024-05-21T13:35:56.755158+0000","last_unstale":"2024-05-21T13:36:02.960114+0000","last_undegraded":"2024-05-21T13:36:02.960114+0000","last_fullsized":"2024-05-21T13:36:02.960114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:23:05.102098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.962809+0000","last_change":"2024-05-21T13:36:01.827237+0000","last_active":"2024-05-21T13:36:02.962809+0000","last_peered":"2024-05-21T13:36:02.962809+0000","last_clean":"2024-05-21T13:36:02.962809+0000","last_became_active":"2024-05-21T13:36:01.826374+0000","last_became_peered":"2024-05-21T13:36:01.826374+0000","last_unstale":"2024-05-21T13:36:02.962809+0000","last_undegraded":"2024-05-21T13:36:02.962809+0000","last_fullsized":"2024-05-21T13:36:02.962809+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:12:33.528068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.804889+0000","last_change":"2024-05-21T13:35:57.787940+0000","last_active":"2024-05-21T13:36:02.804889+0000","last_peered":"2024-05-21T13:36:02.804889+0000","last_clean":"2024-05-21T13:36:02.804889+0000","last_became_active":"2024-05-21T13:35:57.787544+0000","last_became_peered":"2024-05-21T13:35:57.787544+0000","last_unstale":"2024-05-21T13:36:02.804889+0000","last_undegraded":"2024-05-21T13:36:02.804889+0000","last_fullsized":"2024-05-21T13:36:02.804889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:46:20.335316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"25'15","reported_seq":37,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:32.027063+0000","last_change":"2024-05-21T13:35:56.756262+0000","last_active":"2024-05-21T13:36:32.027063+0000","last_peered":"2024-05-21T13:36:32.027063+0000","last_clean":"2024-05-21T13:36:32.027063+0000","last_became_active":"2024-05-21T13:35:56.752342+0000","last_became_peered":"2024-05-21T13:35:56.752342+0000","last_unstale":"2024-05-21T13:36:32.027063+0000","last_undegraded":"2024-05-21T13:36:32.027063+0000","last_fullsized":"2024-05-21T13:36:32.027063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:59:09.541382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-21T13:36:38.728680+0000","last_change":"2024-05-21T13:36:01.859498+0000","last_active":"2024-05-21T13:36:38.728680+0000","last_peered":"2024-05-21T13:36:38.728680+0000","last_clean":"2024-05-21T13:36:38.728680+0000","last_became_active":"2024-05-21T13:36:01.857707+0000","last_became_peered":"2024-05-21T13:36:01.857707+0000","last_unstale":"2024-05-21T13:36:38.728680+0000","last_undegraded":"2024-05-21T13:36:38.728680+0000","last_fullsized":"2024-05-21T13:36:38.728680+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:38:06.966814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.962835+0000","last_change":"2024-05-21T13:35:57.783007+0000","last_active":"2024-05-21T13:36:02.962835+0000","last_peered":"2024-05-21T13:36:02.962835+0000","last_clean":"2024-05-21T13:36:02.962835+0000","last_became_active":"2024-05-21T13:35:57.782330+0000","last_became_peered":"2024-05-21T13:35:57.782330+0000","last_unstale":"2024-05-21T13:36:02.962835+0000","last_undegraded":"2024-05-21T13:36:02.962835+0000","last_fullsized":"2024-05-21T13:36:02.962835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:26:14.697766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"25'3","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:32.023577+0000","last_change":"2024-05-21T13:35:56.745787+0000","last_active":"2024-05-21T13:36:32.023577+0000","last_peered":"2024-05-21T13:36:32.023577+0000","last_clean":"2024-05-21T13:36:32.023577+0000","last_became_active":"2024-05-21T13:35:56.745202+0000","last_became_peered":"2024-05-21T13:35:56.745202+0000","last_unstale":"2024-05-21T13:36:32.023577+0000","last_undegraded":"2024-05-21T13:36:32.023577+0000","last_fullsized":"2024-05-21T13:36:32.023577+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:31:13.498003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-21T13:36:38.728909+0000","last_change":"2024-05-21T13:36:01.858550+0000","last_active":"2024-05-21T13:36:38.728909+0000","last_peered":"2024-05-21T13:36:38.728909+0000","last_clean":"2024-05-21T13:36:38.728909+0000","last_became_active":"2024-05-21T13:36:01.857716+0000","last_became_peered":"2024-05-21T13:36:01.857716+0000","last_unstale":"2024-05-21T13:36:38.728909+0000","last_undegraded":"2024-05-21T13:36:38.728909+0000","last_fullsized":"2024-05-21T13:36:38.728909+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:48:32.490678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.805527+0000","last_change":"2024-05-21T13:35:57.799702+0000","last_active":"2024-05-21T13:36:02.805527+0000","last_peered":"2024-05-21T13:36:02.805527+0000","last_clean":"2024-05-21T13:36:02.805527+0000","last_became_active":"2024-05-21T13:35:57.799225+0000","last_became_peered":"2024-05-21T13:35:57.799225+0000","last_unstale":"2024-05-21T13:36:02.805527+0000","last_undegraded":"2024-05-21T13:36:02.805527+0000","last_fullsized":"2024-05-21T13:36:02.805527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:29:54.094448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"25'3","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:26.904458+0000","last_change":"2024-05-21T13:35:56.742650+0000","last_active":"2024-05-21T13:36:26.904458+0000","last_peered":"2024-05-21T13:36:26.904458+0000","last_clean":"2024-05-21T13:36:26.904458+0000","last_became_active":"2024-05-21T13:35:56.742296+0000","last_became_peered":"2024-05-21T13:35:56.742296+0000","last_unstale":"2024-05-21T13:36:26.904458+0000","last_undegraded":"2024-05-21T13:36:26.904458+0000","last_fullsized":"2024-05-21T13:36:26.904458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:18:55.514845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.967634+0000","last_change":"2024-05-21T13:36:01.873708+0000","last_active":"2024-05-21T13:36:02.967634+0000","last_peered":"2024-05-21T13:36:02.967634+0000","last_clean":"2024-05-21T13:36:02.967634+0000","last_became_active":"2024-05-21T13:36:01.872320+0000","last_became_peered":"2024-05-21T13:36:01.872320+0000","last_unstale":"2024-05-21T13:36:02.967634+0000","last_undegraded":"2024-05-21T13:36:02.967634+0000","last_fullsized":"2024-05-21T13:36:02.967634+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:01:15.545756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.966606+0000","last_change":"2024-05-21T13:35:57.802763+0000","last_active":"2024-05-21T13:36:02.966606+0000","last_peered":"2024-05-21T13:36:02.966606+0000","last_clean":"2024-05-21T13:36:02.966606+0000","last_became_active":"2024-05-21T13:35:57.802433+0000","last_became_peered":"2024-05-21T13:35:57.802433+0000","last_unstale":"2024-05-21T13:36:02.966606+0000","last_undegraded":"2024-05-21T13:36:02.966606+0000","last_fullsized":"2024-05-21T13:36:02.966606+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:09:48.463186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"25'6","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:32.021995+0000","last_change":"2024-05-21T13:35:56.754087+0000","last_active":"2024-05-21T13:36:32.021995+0000","last_peered":"2024-05-21T13:36:32.021995+0000","last_clean":"2024-05-21T13:36:32.021995+0000","last_became_active":"2024-05-21T13:35:56.753319+0000","last_became_peered":"2024-05-21T13:35:56.753319+0000","last_unstale":"2024-05-21T13:36:32.021995+0000","last_undegraded":"2024-05-21T13:36:32.021995+0000","last_fullsized":"2024-05-21T13:36:32.021995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:19:21.276993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.806089+0000","last_change":"2024-05-21T13:36:01.836017+0000","last_active":"2024-05-21T13:36:02.806089+0000","last_peered":"2024-05-21T13:36:02.806089+0000","last_clean":"2024-05-21T13:36:02.806089+0000","last_became_active":"2024-05-21T13:36:01.835450+0000","last_became_peered":"2024-05-21T13:36:01.835450+0000","last_unstale":"2024-05-21T13:36:02.806089+0000","last_undegraded":"2024-05-21T13:36:02.806089+0000","last_fullsized":"2024-05-21T13:36:02.806089+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:05:56.077605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.962152+0000","last_change":"2024-05-21T13:35:57.787177+0000","last_active":"2024-05-21T13:36:02.962152+0000","last_peered":"2024-05-21T13:36:02.962152+0000","last_clean":"2024-05-21T13:36:02.962152+0000","last_became_active":"2024-05-21T13:35:57.786401+0000","last_became_peered":"2024-05-21T13:35:57.786401+0000","last_unstale":"2024-05-21T13:36:02.962152+0000","last_undegraded":"2024-05-21T13:36:02.962152+0000","last_fullsized":"2024-05-21T13:36:02.962152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:17:18.939002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"25'11","reported_seq":33,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:26.902139+0000","last_change":"2024-05-21T13:35:56.751229+0000","last_active":"2024-05-21T13:36:26.902139+0000","last_peered":"2024-05-21T13:36:26.902139+0000","last_clean":"2024-05-21T13:36:26.902139+0000","last_became_active":"2024-05-21T13:35:56.750831+0000","last_became_peered":"2024-05-21T13:35:56.750831+0000","last_unstale":"2024-05-21T13:36:26.902139+0000","last_undegraded":"2024-05-21T13:36:26.902139+0000","last_fullsized":"2024-05-21T13:36:26.902139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:03:40.186241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.807730+0000","last_change":"2024-05-21T13:36:01.832691+0000","last_active":"2024-05-21T13:36:02.807730+0000","last_peered":"2024-05-21T13:36:02.807730+0000","last_clean":"2024-05-21T13:36:02.807730+0000","last_became_active":"2024-05-21T13:36:01.831476+0000","last_became_peered":"2024-05-21T13:36:01.831476+0000","last_unstale":"2024-05-21T13:36:02.807730+0000","last_undegraded":"2024-05-21T13:36:02.807730+0000","last_fullsized":"2024-05-21T13:36:02.807730+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:08:38.092592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.805422+0000","last_change":"2024-05-21T13:35:57.788547+0000","last_active":"2024-05-21T13:36:02.805422+0000","last_peered":"2024-05-21T13:36:02.805422+0000","last_clean":"2024-05-21T13:36:02.805422+0000","last_became_active":"2024-05-21T13:35:57.787785+0000","last_became_peered":"2024-05-21T13:35:57.787785+0000","last_unstale":"2024-05-21T13:36:02.805422+0000","last_undegraded":"2024-05-21T13:36:02.805422+0000","last_fullsized":"2024-05-21T13:36:02.805422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:51:08.781399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"25'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.964746+0000","last_change":"2024-05-21T13:35:56.760557+0000","last_active":"2024-05-21T13:36:02.964746+0000","last_peered":"2024-05-21T13:36:02.964746+0000","last_clean":"2024-05-21T13:36:02.964746+0000","last_became_active":"2024-05-21T13:35:56.759728+0000","last_became_peered":"2024-05-21T13:35:56.759728+0000","last_unstale":"2024-05-21T13:36:02.964746+0000","last_undegraded":"2024-05-21T13:36:02.964746+0000","last_fullsized":"2024-05-21T13:36:02.964746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:56:19.754940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.962040+0000","last_change":"2024-05-21T13:36:01.861622+0000","last_active":"2024-05-21T13:36:02.962040+0000","last_peered":"2024-05-21T13:36:02.962040+0000","last_clean":"2024-05-21T13:36:02.962040+0000","last_became_active":"2024-05-21T13:36:01.861172+0000","last_became_peered":"2024-05-21T13:36:01.861172+0000","last_unstale":"2024-05-21T13:36:02.962040+0000","last_undegraded":"2024-05-21T13:36:02.962040+0000","last_fullsized":"2024-05-21T13:36:02.962040+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:39:53.211812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-21T13:36:38.729090+0000","last_change":"2024-05-21T13:35:57.804520+0000","last_active":"2024-05-21T13:36:38.729090+0000","last_peered":"2024-05-21T13:36:38.729090+0000","last_clean":"2024-05-21T13:36:38.729090+0000","last_became_active":"2024-05-21T13:35:57.804139+0000","last_became_peered":"2024-05-21T13:35:57.804139+0000","last_unstale":"2024-05-21T13:36:38.729090+0000","last_undegraded":"2024-05-21T13:36:38.729090+0000","last_fullsized":"2024-05-21T13:36:38.729090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:21:52.433019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"25'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:26.902540+0000","last_change":"2024-05-21T13:35:56.733821+0000","last_active":"2024-05-21T13:36:26.902540+0000","last_peered":"2024-05-21T13:36:26.902540+0000","last_clean":"2024-05-21T13:36:26.902540+0000","last_became_active":"2024-05-21T13:35:56.732488+0000","last_became_peered":"2024-05-21T13:35:56.732488+0000","last_unstale":"2024-05-21T13:36:26.902540+0000","last_undegraded":"2024-05-21T13:36:26.902540+0000","last_fullsized":"2024-05-21T13:36:26.902540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:10:01.786931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.961990+0000","last_change":"2024-05-21T13:36:01.868781+0000","last_active":"2024-05-21T13:36:02.961990+0000","last_peered":"2024-05-21T13:36:02.961990+0000","last_clean":"2024-05-21T13:36:02.961990+0000","last_became_active":"2024-05-21T13:36:01.864254+0000","last_became_peered":"2024-05-21T13:36:01.864254+0000","last_unstale":"2024-05-21T13:36:02.961990+0000","last_undegraded":"2024-05-21T13:36:02.961990+0000","last_fullsized":"2024-05-21T13:36:02.961990+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:34:12.632333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.962094+0000","last_change":"2024-05-21T13:35:57.788313+0000","last_active":"2024-05-21T13:36:02.962094+0000","last_peered":"2024-05-21T13:36:02.962094+0000","last_clean":"2024-05-21T13:36:02.962094+0000","last_became_active":"2024-05-21T13:35:57.787963+0000","last_became_peered":"2024-05-21T13:35:57.787963+0000","last_unstale":"2024-05-21T13:36:02.962094+0000","last_undegraded":"2024-05-21T13:36:02.962094+0000","last_fullsized":"2024-05-21T13:36:02.962094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:16:21.586571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"25'3","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:26.903956+0000","last_change":"2024-05-21T13:35:56.748334+0000","last_active":"2024-05-21T13:36:26.903956+0000","last_peered":"2024-05-21T13:36:26.903956+0000","last_clean":"2024-05-21T13:36:26.903956+0000","last_became_active":"2024-05-21T13:35:56.748049+0000","last_became_peered":"2024-05-21T13:35:56.748049+0000","last_unstale":"2024-05-21T13:36:26.903956+0000","last_undegraded":"2024-05-21T13:36:26.903956+0000","last_fullsized":"2024-05-21T13:36:26.903956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:59:02.802905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.807330+0000","last_change":"2024-05-21T13:36:01.856216+0000","last_active":"2024-05-21T13:36:02.807330+0000","last_peered":"2024-05-21T13:36:02.807330+0000","last_clean":"2024-05-21T13:36:02.807330+0000","last_became_active":"2024-05-21T13:36:01.855417+0000","last_became_peered":"2024-05-21T13:36:01.855417+0000","last_unstale":"2024-05-21T13:36:02.807330+0000","last_undegraded":"2024-05-21T13:36:02.807330+0000","last_fullsized":"2024-05-21T13:36:02.807330+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:36:01.423944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.807915+0000","last_change":"2024-05-21T13:36:01.838966+0000","last_active":"2024-05-21T13:36:02.807915+0000","last_peered":"2024-05-21T13:36:02.807915+0000","last_clean":"2024-05-21T13:36:02.807915+0000","last_became_active":"2024-05-21T13:36:01.837777+0000","last_became_peered":"2024-05-21T13:36:01.837777+0000","last_unstale":"2024-05-21T13:36:02.807915+0000","last_undegraded":"2024-05-21T13:36:02.807915+0000","last_fullsized":"2024-05-21T13:36:02.807915+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:40:55.688338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.807274+0000","last_change":"2024-05-21T13:35:57.762719+0000","last_active":"2024-05-21T13:36:02.807274+0000","last_peered":"2024-05-21T13:36:02.807274+0000","last_clean":"2024-05-21T13:36:02.807274+0000","last_became_active":"2024-05-21T13:35:57.762071+0000","last_became_peered":"2024-05-21T13:35:57.762071+0000","last_unstale":"2024-05-21T13:36:02.807274+0000","last_undegraded":"2024-05-21T13:36:02.807274+0000","last_fullsized":"2024-05-21T13:36:02.807274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:55:37.631695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"25'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.805245+0000","last_change":"2024-05-21T13:35:56.751481+0000","last_active":"2024-05-21T13:36:02.805245+0000","last_peered":"2024-05-21T13:36:02.805245+0000","last_clean":"2024-05-21T13:36:02.805245+0000","last_became_active":"2024-05-21T13:35:56.751201+0000","last_became_peered":"2024-05-21T13:35:56.751201+0000","last_unstale":"2024-05-21T13:36:02.805245+0000","last_undegraded":"2024-05-21T13:36:02.805245+0000","last_fullsized":"2024-05-21T13:36:02.805245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:33:28.720246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.806144+0000","last_change":"2024-05-21T13:36:01.837042+0000","last_active":"2024-05-21T13:36:02.806144+0000","last_peered":"2024-05-21T13:36:02.806144+0000","last_clean":"2024-05-21T13:36:02.806144+0000","last_became_active":"2024-05-21T13:36:01.836194+0000","last_became_peered":"2024-05-21T13:36:01.836194+0000","last_unstale":"2024-05-21T13:36:02.806144+0000","last_undegraded":"2024-05-21T13:36:02.806144+0000","last_fullsized":"2024-05-21T13:36:02.806144+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:15:50.751693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-21T13:36:38.727810+0000","last_change":"2024-05-21T13:35:57.788838+0000","last_active":"2024-05-21T13:36:38.727810+0000","last_peered":"2024-05-21T13:36:38.727810+0000","last_clean":"2024-05-21T13:36:38.727810+0000","last_became_active":"2024-05-21T13:35:57.786307+0000","last_became_peered":"2024-05-21T13:35:57.786307+0000","last_unstale":"2024-05-21T13:36:38.727810+0000","last_undegraded":"2024-05-21T13:36:38.727810+0000","last_fullsized":"2024-05-21T13:36:38.727810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:52:09.086807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"25'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:32.021842+0000","last_change":"2024-05-21T13:35:56.746564+0000","last_active":"2024-05-21T13:36:32.021842+0000","last_peered":"2024-05-21T13:36:32.021842+0000","last_clean":"2024-05-21T13:36:32.021842+0000","last_became_active":"2024-05-21T13:35:56.745884+0000","last_became_peered":"2024-05-21T13:35:56.745884+0000","last_unstale":"2024-05-21T13:36:32.021842+0000","last_undegraded":"2024-05-21T13:36:32.021842+0000","last_fullsized":"2024-05-21T13:36:32.021842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:01:44.738607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"25'3","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:32.015963+0000","last_change":"2024-05-21T13:35:56.753930+0000","last_active":"2024-05-21T13:36:32.015963+0000","last_peered":"2024-05-21T13:36:32.015963+0000","last_clean":"2024-05-21T13:36:32.015963+0000","last_became_active":"2024-05-21T13:35:56.753499+0000","last_became_peered":"2024-05-21T13:35:56.753499+0000","last_unstale":"2024-05-21T13:36:32.015963+0000","last_undegraded":"2024-05-21T13:36:32.015963+0000","last_fullsized":"2024-05-21T13:36:32.015963+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:40:51.516544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.808045+0000","last_change":"2024-05-21T13:35:57.780101+0000","last_active":"2024-05-21T13:36:02.808045+0000","last_peered":"2024-05-21T13:36:02.808045+0000","last_clean":"2024-05-21T13:36:02.808045+0000","last_became_active":"2024-05-21T13:35:57.779368+0000","last_became_peered":"2024-05-21T13:35:57.779368+0000","last_unstale":"2024-05-21T13:36:02.808045+0000","last_undegraded":"2024-05-21T13:36:02.808045+0000","last_fullsized":"2024-05-21T13:36:02.808045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:37:39.347067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.808272+0000","last_change":"2024-05-21T13:36:01.844240+0000","last_active":"2024-05-21T13:36:02.808272+0000","last_peered":"2024-05-21T13:36:02.808272+0000","last_clean":"2024-05-21T13:36:02.808272+0000","last_became_active":"2024-05-21T13:36:01.842792+0000","last_became_peered":"2024-05-21T13:36:01.842792+0000","last_unstale":"2024-05-21T13:36:02.808272+0000","last_undegraded":"2024-05-21T13:36:02.808272+0000","last_fullsized":"2024-05-21T13:36:02.808272+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:19:54.016465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"25'5","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-21T13:36:38.728442+0000","last_change":"2024-05-21T13:35:56.770864+0000","last_active":"2024-05-21T13:36:38.728442+0000","last_peered":"2024-05-21T13:36:38.728442+0000","last_clean":"2024-05-21T13:36:38.728442+0000","last_became_active":"2024-05-21T13:35:56.766873+0000","last_became_peered":"2024-05-21T13:35:56.766873+0000","last_unstale":"2024-05-21T13:36:38.728442+0000","last_undegraded":"2024-05-21T13:36:38.728442+0000","last_fullsized":"2024-05-21T13:36:38.728442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:13:02.633858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.963803+0000","last_change":"2024-05-21T13:35:57.787563+0000","last_active":"2024-05-21T13:36:02.963803+0000","last_peered":"2024-05-21T13:36:02.963803+0000","last_clean":"2024-05-21T13:36:02.963803+0000","last_became_active":"2024-05-21T13:35:57.787255+0000","last_became_peered":"2024-05-21T13:35:57.787255+0000","last_unstale":"2024-05-21T13:36:02.963803+0000","last_undegraded":"2024-05-21T13:36:02.963803+0000","last_fullsized":"2024-05-21T13:36:02.963803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:32:49.325049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.964068+0000","last_change":"2024-05-21T13:36:01.868514+0000","last_active":"2024-05-21T13:36:02.964068+0000","last_peered":"2024-05-21T13:36:02.964068+0000","last_clean":"2024-05-21T13:36:02.964068+0000","last_became_active":"2024-05-21T13:36:01.867522+0000","last_became_peered":"2024-05-21T13:36:01.867522+0000","last_unstale":"2024-05-21T13:36:02.964068+0000","last_undegraded":"2024-05-21T13:36:02.964068+0000","last_fullsized":"2024-05-21T13:36:02.964068+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:19:13.533784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.960872+0000","last_change":"2024-05-21T13:35:57.782641+0000","last_active":"2024-05-21T13:36:02.960872+0000","last_peered":"2024-05-21T13:36:02.960872+0000","last_clean":"2024-05-21T13:36:02.960872+0000","last_became_active":"2024-05-21T13:35:57.782233+0000","last_became_peered":"2024-05-21T13:35:57.782233+0000","last_unstale":"2024-05-21T13:36:02.960872+0000","last_undegraded":"2024-05-21T13:36:02.960872+0000","last_fullsized":"2024-05-21T13:36:02.960872+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:55:18.808229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.963845+0000","last_change":"2024-05-21T13:35:57.770591+0000","last_active":"2024-05-21T13:36:02.963845+0000","last_peered":"2024-05-21T13:36:02.963845+0000","last_clean":"2024-05-21T13:36:02.963845+0000","last_became_active":"2024-05-21T13:35:57.769785+0000","last_became_peered":"2024-05-21T13:35:57.769785+0000","last_unstale":"2024-05-21T13:36:02.963845+0000","last_undegraded":"2024-05-21T13:36:02.963845+0000","last_fullsized":"2024-05-21T13:36:02.963845+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:18:28.168393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.805267+0000","last_change":"2024-05-21T13:35:57.799153+0000","last_active":"2024-05-21T13:36:02.805267+0000","last_peered":"2024-05-21T13:36:02.805267+0000","last_clean":"2024-05-21T13:36:02.805267+0000","last_became_active":"2024-05-21T13:35:57.796495+0000","last_became_peered":"2024-05-21T13:35:57.796495+0000","last_unstale":"2024-05-21T13:36:02.805267+0000","last_undegraded":"2024-05-21T13:36:02.805267+0000","last_fullsized":"2024-05-21T13:36:02.805267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:53:04.109036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-21T13:36:38.728181+0000","last_change":"2024-05-21T13:35:57.784335+0000","last_active":"2024-05-21T13:36:38.728181+0000","last_peered":"2024-05-21T13:36:38.728181+0000","last_clean":"2024-05-21T13:36:38.728181+0000","last_became_active":"2024-05-21T13:35:57.783968+0000","last_became_peered":"2024-05-21T13:35:57.783968+0000","last_unstale":"2024-05-21T13:36:38.728181+0000","last_undegraded":"2024-05-21T13:36:38.728181+0000","last_fullsized":"2024-05-21T13:36:38.728181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:57:20.832617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.967890+0000","last_change":"2024-05-21T13:35:57.795153+0000","last_active":"2024-05-21T13:36:02.967890+0000","last_peered":"2024-05-21T13:36:02.967890+0000","last_clean":"2024-05-21T13:36:02.967890+0000","last_became_active":"2024-05-21T13:35:57.794885+0000","last_became_peered":"2024-05-21T13:35:57.794885+0000","last_unstale":"2024-05-21T13:36:02.967890+0000","last_undegraded":"2024-05-21T13:36:02.967890+0000","last_fullsized":"2024-05-21T13:36:02.967890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:17:00.454371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.967778+0000","last_change":"2024-05-21T13:35:57.778916+0000","last_active":"2024-05-21T13:36:02.967778+0000","last_peered":"2024-05-21T13:36:02.967778+0000","last_clean":"2024-05-21T13:36:02.967778+0000","last_became_active":"2024-05-21T13:35:57.778171+0000","last_became_peered":"2024-05-21T13:35:57.778171+0000","last_unstale":"2024-05-21T13:36:02.967778+0000","last_undegraded":"2024-05-21T13:36:02.967778+0000","last_fullsized":"2024-05-21T13:36:02.967778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:15:37.425836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.961364+0000","last_change":"2024-05-21T13:35:57.791367+0000","last_active":"2024-05-21T13:36:02.961364+0000","last_peered":"2024-05-21T13:36:02.961364+0000","last_clean":"2024-05-21T13:36:02.961364+0000","last_became_active":"2024-05-21T13:35:57.790971+0000","last_became_peered":"2024-05-21T13:35:57.790971+0000","last_unstale":"2024-05-21T13:36:02.961364+0000","last_undegraded":"2024-05-21T13:36:02.961364+0000","last_fullsized":"2024-05-21T13:36:02.961364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:14:47.428631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-21T13:36:38.728814+0000","last_change":"2024-05-21T13:35:57.785257+0000","last_active":"2024-05-21T13:36:38.728814+0000","last_peered":"2024-05-21T13:36:38.728814+0000","last_clean":"2024-05-21T13:36:38.728814+0000","last_became_active":"2024-05-21T13:35:57.781533+0000","last_became_peered":"2024-05-21T13:35:57.781533+0000","last_unstale":"2024-05-21T13:36:38.728814+0000","last_undegraded":"2024-05-21T13:36:38.728814+0000","last_fullsized":"2024-05-21T13:36:38.728814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:18:32.591803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.804917+0000","last_change":"2024-05-21T13:35:57.799128+0000","last_active":"2024-05-21T13:36:02.804917+0000","last_peered":"2024-05-21T13:36:02.804917+0000","last_clean":"2024-05-21T13:36:02.804917+0000","last_became_active":"2024-05-21T13:35:57.797044+0000","last_became_peered":"2024-05-21T13:35:57.797044+0000","last_unstale":"2024-05-21T13:36:02.804917+0000","last_undegraded":"2024-05-21T13:36:02.804917+0000","last_fullsized":"2024-05-21T13:36:02.804917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:57:13.472309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-21T13:36:38.727777+0000","last_change":"2024-05-21T13:35:57.789768+0000","last_active":"2024-05-21T13:36:38.727777+0000","last_peered":"2024-05-21T13:36:38.727777+0000","last_clean":"2024-05-21T13:36:38.727777+0000","last_became_active":"2024-05-21T13:35:57.789474+0000","last_became_peered":"2024-05-21T13:35:57.789474+0000","last_unstale":"2024-05-21T13:36:38.727777+0000","last_undegraded":"2024-05-21T13:36:38.727777+0000","last_fullsized":"2024-05-21T13:36:38.727777+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:42:53.993281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.963561+0000","last_change":"2024-05-21T13:35:57.756607+0000","last_active":"2024-05-21T13:36:02.963561+0000","last_peered":"2024-05-21T13:36:02.963561+0000","last_clean":"2024-05-21T13:36:02.963561+0000","last_became_active":"2024-05-21T13:35:57.755889+0000","last_became_peered":"2024-05-21T13:35:57.755889+0000","last_unstale":"2024-05-21T13:36:02.963561+0000","last_undegraded":"2024-05-21T13:36:02.963561+0000","last_fullsized":"2024-05-21T13:36:02.963561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:16:19.541597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.808181+0000","last_change":"2024-05-21T13:35:57.775322+0000","last_active":"2024-05-21T13:36:02.808181+0000","last_peered":"2024-05-21T13:36:02.808181+0000","last_clean":"2024-05-21T13:36:02.808181+0000","last_became_active":"2024-05-21T13:35:57.774386+0000","last_became_peered":"2024-05-21T13:35:57.774386+0000","last_unstale":"2024-05-21T13:36:02.808181+0000","last_undegraded":"2024-05-21T13:36:02.808181+0000","last_fullsized":"2024-05-21T13:36:02.808181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:01:02.106172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.959969+0000","last_change":"2024-05-21T13:35:57.769931+0000","last_active":"2024-05-21T13:36:02.959969+0000","last_peered":"2024-05-21T13:36:02.959969+0000","last_clean":"2024-05-21T13:36:02.959969+0000","last_became_active":"2024-05-21T13:35:57.769149+0000","last_became_peered":"2024-05-21T13:35:57.769149+0000","last_unstale":"2024-05-21T13:36:02.959969+0000","last_undegraded":"2024-05-21T13:36:02.959969+0000","last_fullsized":"2024-05-21T13:36:02.959969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:55:56.268307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.806502+0000","last_change":"2024-05-21T13:35:57.796153+0000","last_active":"2024-05-21T13:36:02.806502+0000","last_peered":"2024-05-21T13:36:02.806502+0000","last_clean":"2024-05-21T13:36:02.806502+0000","last_became_active":"2024-05-21T13:35:57.795799+0000","last_became_peered":"2024-05-21T13:35:57.795799+0000","last_unstale":"2024-05-21T13:36:02.806502+0000","last_undegraded":"2024-05-21T13:36:02.806502+0000","last_fullsized":"2024-05-21T13:36:02.806502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:52:04.794391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.966824+0000","last_change":"2024-05-21T13:35:57.776414+0000","last_active":"2024-05-21T13:36:02.966824+0000","last_peered":"2024-05-21T13:36:02.966824+0000","last_clean":"2024-05-21T13:36:02.966824+0000","last_became_active":"2024-05-21T13:35:57.775573+0000","last_became_peered":"2024-05-21T13:35:57.775573+0000","last_unstale":"2024-05-21T13:36:02.966824+0000","last_undegraded":"2024-05-21T13:36:02.966824+0000","last_fullsized":"2024-05-21T13:36:02.966824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:47:47.624662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.808011+0000","last_change":"2024-05-21T13:35:57.799673+0000","last_active":"2024-05-21T13:36:02.808011+0000","last_peered":"2024-05-21T13:36:02.808011+0000","last_clean":"2024-05-21T13:36:02.808011+0000","last_became_active":"2024-05-21T13:35:57.799313+0000","last_became_peered":"2024-05-21T13:35:57.799313+0000","last_unstale":"2024-05-21T13:36:02.808011+0000","last_undegraded":"2024-05-21T13:36:02.808011+0000","last_fullsized":"2024-05-21T13:36:02.808011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:40:52.516216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.804786+0000","last_change":"2024-05-21T13:35:57.790705+0000","last_active":"2024-05-21T13:36:02.804786+0000","last_peered":"2024-05-21T13:36:02.804786+0000","last_clean":"2024-05-21T13:36:02.804786+0000","last_became_active":"2024-05-21T13:35:57.787735+0000","last_became_peered":"2024-05-21T13:35:57.787735+0000","last_unstale":"2024-05-21T13:36:02.804786+0000","last_undegraded":"2024-05-21T13:36:02.804786+0000","last_fullsized":"2024-05-21T13:36:02.804786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:17:24.376182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-21T13:36:38.727480+0000","last_change":"2024-05-21T13:35:57.786838+0000","last_active":"2024-05-21T13:36:38.727480+0000","last_peered":"2024-05-21T13:36:38.727480+0000","last_clean":"2024-05-21T13:36:38.727480+0000","last_became_active":"2024-05-21T13:35:57.786403+0000","last_became_peered":"2024-05-21T13:35:57.786403+0000","last_unstale":"2024-05-21T13:36:38.727480+0000","last_undegraded":"2024-05-21T13:36:38.727480+0000","last_fullsized":"2024-05-21T13:36:38.727480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:29:28.760793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.966410+0000","last_change":"2024-05-21T13:35:57.783561+0000","last_active":"2024-05-21T13:36:02.966410+0000","last_peered":"2024-05-21T13:36:02.966410+0000","last_clean":"2024-05-21T13:36:02.966410+0000","last_became_active":"2024-05-21T13:35:57.783060+0000","last_became_peered":"2024-05-21T13:35:57.783060+0000","last_unstale":"2024-05-21T13:36:02.966410+0000","last_undegraded":"2024-05-21T13:36:02.966410+0000","last_fullsized":"2024-05-21T13:36:02.966410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:27:27.261449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.964046+0000","last_change":"2024-05-21T13:35:57.788210+0000","last_active":"2024-05-21T13:36:02.964046+0000","last_peered":"2024-05-21T13:36:02.964046+0000","last_clean":"2024-05-21T13:36:02.964046+0000","last_became_active":"2024-05-21T13:35:57.787508+0000","last_became_peered":"2024-05-21T13:35:57.787508+0000","last_unstale":"2024-05-21T13:36:02.964046+0000","last_undegraded":"2024-05-21T13:36:02.964046+0000","last_fullsized":"2024-05-21T13:36:02.964046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:12:56.914580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.959869+0000","last_change":"2024-05-21T13:35:57.787335+0000","last_active":"2024-05-21T13:36:02.959869+0000","last_peered":"2024-05-21T13:36:02.959869+0000","last_clean":"2024-05-21T13:36:02.959869+0000","last_became_active":"2024-05-21T13:35:57.786292+0000","last_became_peered":"2024-05-21T13:35:57.786292+0000","last_unstale":"2024-05-21T13:36:02.959869+0000","last_undegraded":"2024-05-21T13:36:02.959869+0000","last_fullsized":"2024-05-21T13:36:02.959869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:49:40.480948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.960610+0000","last_change":"2024-05-21T13:35:57.801121+0000","last_active":"2024-05-21T13:36:02.960610+0000","last_peered":"2024-05-21T13:36:02.960610+0000","last_clean":"2024-05-21T13:36:02.960610+0000","last_became_active":"2024-05-21T13:35:57.800858+0000","last_became_peered":"2024-05-21T13:35:57.800858+0000","last_unstale":"2024-05-21T13:36:02.960610+0000","last_undegraded":"2024-05-21T13:36:02.960610+0000","last_fullsized":"2024-05-21T13:36:02.960610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:41:08.765821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.959709+0000","last_change":"2024-05-21T13:35:57.778753+0000","last_active":"2024-05-21T13:36:02.959709+0000","last_peered":"2024-05-21T13:36:02.959709+0000","last_clean":"2024-05-21T13:36:02.959709+0000","last_became_active":"2024-05-21T13:35:57.777962+0000","last_became_peered":"2024-05-21T13:35:57.777962+0000","last_unstale":"2024-05-21T13:36:02.959709+0000","last_undegraded":"2024-05-21T13:36:02.959709+0000","last_fullsized":"2024-05-21T13:36:02.959709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:51:49.102945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.963934+0000","last_change":"2024-05-21T13:35:57.798312+0000","last_active":"2024-05-21T13:36:02.963934+0000","last_peered":"2024-05-21T13:36:02.963934+0000","last_clean":"2024-05-21T13:36:02.963934+0000","last_became_active":"2024-05-21T13:35:57.797793+0000","last_became_peered":"2024-05-21T13:35:57.797793+0000","last_unstale":"2024-05-21T13:36:02.963934+0000","last_undegraded":"2024-05-21T13:36:02.963934+0000","last_fullsized":"2024-05-21T13:36:02.963934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:28:47.276868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-21T13:36:38.727461+0000","last_change":"2024-05-21T13:35:57.782412+0000","last_active":"2024-05-21T13:36:38.727461+0000","last_peered":"2024-05-21T13:36:38.727461+0000","last_clean":"2024-05-21T13:36:38.727461+0000","last_became_active":"2024-05-21T13:35:57.782058+0000","last_became_peered":"2024-05-21T13:35:57.782058+0000","last_unstale":"2024-05-21T13:36:38.727461+0000","last_undegraded":"2024-05-21T13:36:38.727461+0000","last_fullsized":"2024-05-21T13:36:38.727461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:39:49.142554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.959879+0000","last_change":"2024-05-21T13:35:57.779771+0000","last_active":"2024-05-21T13:36:02.959879+0000","last_peered":"2024-05-21T13:36:02.959879+0000","last_clean":"2024-05-21T13:36:02.959879+0000","last_became_active":"2024-05-21T13:35:57.779168+0000","last_became_peered":"2024-05-21T13:35:57.779168+0000","last_unstale":"2024-05-21T13:36:02.959879+0000","last_undegraded":"2024-05-21T13:36:02.959879+0000","last_fullsized":"2024-05-21T13:36:02.959879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T13:59:58.966203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.961896+0000","last_change":"2024-05-21T13:35:57.773098+0000","last_active":"2024-05-21T13:36:02.961896+0000","last_peered":"2024-05-21T13:36:02.961896+0000","last_clean":"2024-05-21T13:36:02.961896+0000","last_became_active":"2024-05-21T13:35:57.772268+0000","last_became_peered":"2024-05-21T13:35:57.772268+0000","last_unstale":"2024-05-21T13:36:02.961896+0000","last_undegraded":"2024-05-21T13:36:02.961896+0000","last_fullsized":"2024-05-21T13:36:02.961896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:05:25.482434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.960610+0000","last_change":"2024-05-21T13:35:57.788980+0000","last_active":"2024-05-21T13:36:02.960610+0000","last_peered":"2024-05-21T13:36:02.960610+0000","last_clean":"2024-05-21T13:36:02.960610+0000","last_became_active":"2024-05-21T13:35:57.788689+0000","last_became_peered":"2024-05-21T13:35:57.788689+0000","last_unstale":"2024-05-21T13:36:02.960610+0000","last_undegraded":"2024-05-21T13:36:02.960610+0000","last_fullsized":"2024-05-21T13:36:02.960610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:15:07.615363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.961136+0000","last_change":"2024-05-21T13:35:57.772867+0000","last_active":"2024-05-21T13:36:02.961136+0000","last_peered":"2024-05-21T13:36:02.961136+0000","last_clean":"2024-05-21T13:36:02.961136+0000","last_became_active":"2024-05-21T13:35:57.772160+0000","last_became_peered":"2024-05-21T13:35:57.772160+0000","last_unstale":"2024-05-21T13:36:02.961136+0000","last_undegraded":"2024-05-21T13:36:02.961136+0000","last_fullsized":"2024-05-21T13:36:02.961136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:11:24.428796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-21T13:36:38.728287+0000","last_change":"2024-05-21T13:35:57.785297+0000","last_active":"2024-05-21T13:36:38.728287+0000","last_peered":"2024-05-21T13:36:38.728287+0000","last_clean":"2024-05-21T13:36:38.728287+0000","last_became_active":"2024-05-21T13:35:57.784741+0000","last_became_peered":"2024-05-21T13:35:57.784741+0000","last_unstale":"2024-05-21T13:36:38.728287+0000","last_undegraded":"2024-05-21T13:36:38.728287+0000","last_fullsized":"2024-05-21T13:36:38.728287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:45:08.507286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-21T13:36:38.728614+0000","last_change":"2024-05-21T13:35:57.788875+0000","last_active":"2024-05-21T13:36:38.728614+0000","last_peered":"2024-05-21T13:36:38.728614+0000","last_clean":"2024-05-21T13:36:38.728614+0000","last_became_active":"2024-05-21T13:35:57.786629+0000","last_became_peered":"2024-05-21T13:35:57.786629+0000","last_unstale":"2024-05-21T13:36:38.728614+0000","last_undegraded":"2024-05-21T13:36:38.728614+0000","last_fullsized":"2024-05-21T13:36:38.728614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:40:07.549210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.959984+0000","last_change":"2024-05-21T13:35:57.803316+0000","last_active":"2024-05-21T13:36:02.959984+0000","last_peered":"2024-05-21T13:36:02.959984+0000","last_clean":"2024-05-21T13:36:02.959984+0000","last_became_active":"2024-05-21T13:35:57.802925+0000","last_became_peered":"2024-05-21T13:35:57.802925+0000","last_unstale":"2024-05-21T13:36:02.959984+0000","last_undegraded":"2024-05-21T13:36:02.959984+0000","last_fullsized":"2024-05-21T13:36:02.959984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:17:16.304097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":7452,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":14904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66916,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509454,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":102411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509454,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":270336,"data_stored":102707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509453,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":274432,"data_stored":102729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509454,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":274432,"data_stored":105379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509454,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31500,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340340,"statfs":{"total":96636764160,"available":96604508160,"internally_reserved":0,"allocated":331776,"data_stored":692031,"data_compressed":33458,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509453,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":278528,"data_stored":102819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542157,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":356352,"data_stored":699523,"data_compressed":33458,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574861,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":106913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33458,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33458,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":5410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-21T13:36:41.646 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-21T13:36:41.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.837+0000 7fa6995f7640 1 Processor -- start 2024-05-21T13:36:41.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.837+0000 7fa6995f7640 1 -- start start 2024-05-21T13:36:41.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.837+0000 7fa6995f7640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa694155f70 0x7fa6940cd470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:41.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.837+0000 7fa6995f7640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa69406c4f0 0x7fa69406c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:41.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.837+0000 7fa6995f7640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6940c92a0 con 0x7fa6940ce380 2024-05-21T13:36:41.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.837+0000 7fa6995f7640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fa6940cebc0 con 0x7fa694155f70 2024-05-21T13:36:41.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.837+0000 7fa6995f7640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7fa6940cd9b0 con 0x7fa69406c4f0 2024-05-21T13:36:41.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.837+0000 7fa692ffd640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa694155f70 0x7fa6940cd470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:41.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.837+0000 7fa692ffd640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fa694155f70 0x7fa6940cd470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43242/0 (socket says 172.21.15.22:43242) 2024-05-21T13:36:41.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.837+0000 7fa692ffd640 1 -- 172.21.15.22:0/3154199160 learned_addr learned my addr 172.21.15.22:0/3154199160 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:41.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.837+0000 7fa6937fe640 1 --2- 172.21.15.22:0/3154199160 >> v2:172.21.15.115:3300/0 conn(0x7fa69406c4f0 0x7fa69406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:41.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.837+0000 7fa692ffd640 1 -- 172.21.15.22:0/3154199160 >> v2:172.21.15.115:3300/0 conn(0x7fa69406c4f0 msgr2=0x7fa69406c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:41.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.837+0000 7fa692ffd640 1 --2- 172.21.15.22:0/3154199160 >> v2:172.21.15.115:3300/0 conn(0x7fa69406c4f0 0x7fa69406c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:41.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.837+0000 7fa692ffd640 1 -- 172.21.15.22:0/3154199160 >> v1:172.21.15.22:6789/0 conn(0x7fa6940ce380 legacy=0x7fa6940c8b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:41.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.837+0000 7fa692ffd640 1 -- 172.21.15.22:0/3154199160 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6940cc8a0 con 0x7fa694155f70 2024-05-21T13:36:41.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.841+0000 7fa692ffd640 1 --2- 172.21.15.22:0/3154199160 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa694155f70 0x7fa6940cd470 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa69406d1b0 tx=0x7fa68401ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4a353c44b168ac8 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:41.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.841+0000 7fa691ffb640 1 -- 172.21.15.22:0/3154199160 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6840b5070 con 0x7fa694155f70 2024-05-21T13:36:41.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.841+0000 7fa691ffb640 1 -- 172.21.15.22:0/3154199160 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6840a8a10 con 0x7fa694155f70 2024-05-21T13:36:41.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.841+0000 7fa691ffb640 1 -- 172.21.15.22:0/3154199160 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6840a8de0 con 0x7fa694155f70 2024-05-21T13:36:41.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.841+0000 7fa6995f7640 1 -- 172.21.15.22:0/3154199160 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa694155f70 msgr2=0x7fa6940cd470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:41.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.841+0000 7fa6995f7640 1 --2- 172.21.15.22:0/3154199160 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa694155f70 0x7fa6940cd470 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa69406d1b0 tx=0x7fa68401ed10 comp rx=0 tx=0).stop 2024-05-21T13:36:41.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.841+0000 7fa6995f7640 1 -- 172.21.15.22:0/3154199160 shutdown_connections 2024-05-21T13:36:41.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.841+0000 7fa6995f7640 1 --2- 172.21.15.22:0/3154199160 >> v2:172.21.15.115:3300/0 conn(0x7fa69406c4f0 0x7fa69406c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:41.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.841+0000 7fa6995f7640 1 --2- 172.21.15.22:0/3154199160 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa694155f70 0x7fa6940cd470 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:41.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.841+0000 7fa6995f7640 1 -- 172.21.15.22:0/3154199160 >> 172.21.15.22:0/3154199160 conn(0x7fa694070de0 msgr2=0x7fa6940cdc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:41.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.841+0000 7fa6995f7640 1 -- 172.21.15.22:0/3154199160 shutdown_connections 2024-05-21T13:36:41.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.841+0000 7fa6995f7640 1 -- 172.21.15.22:0/3154199160 wait complete. 2024-05-21T13:36:41.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.841+0000 7fa6995f7640 1 Processor -- start 2024-05-21T13:36:41.822 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.845+0000 7fa6995f7640 1 -- start start 2024-05-21T13:36:41.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.845+0000 7fa6995f7640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa69406c4f0 0x7fa6941565b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:41.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.845+0000 7fa6995f7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa6940ce380 0x7fa6940b2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:41.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.845+0000 7fa6995f7640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa694155f70 0x7fa6941f4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:41.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.845+0000 7fa6995f7640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa6940cd140 con 0x7fa6940ce380 2024-05-21T13:36:41.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.845+0000 7fa6995f7640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fa6940cce60 con 0x7fa694155f70 2024-05-21T13:36:41.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.845+0000 7fa6995f7640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7fa6940c8670 con 0x7fa69406c4f0 2024-05-21T13:36:41.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.845+0000 7fa6927fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa6940ce380 0x7fa6940b2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:41.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.845+0000 7fa6927fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa6940ce380 0x7fa6940b2480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43252/0 (socket says 172.21.15.22:43252) 2024-05-21T13:36:41.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.845+0000 7fa6927fc640 1 -- 172.21.15.22:0/6549708 learned_addr learned my addr 172.21.15.22:0/6549708 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:41.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.845+0000 7fa692ffd640 1 --2- 172.21.15.22:0/6549708 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa69406c4f0 0x7fa6941565b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:41.824 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.845+0000 7fa6937fe640 1 --2- 172.21.15.22:0/6549708 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa694155f70 0x7fa6941f4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:41.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.845+0000 7fa6927fc640 1 -- 172.21.15.22:0/6549708 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa69406c4f0 msgr2=0x7fa6941565b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:41.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.845+0000 7fa6927fc640 1 --2- 172.21.15.22:0/6549708 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa69406c4f0 0x7fa6941565b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:41.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.845+0000 7fa6927fc640 1 -- 172.21.15.22:0/6549708 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa694155f70 msgr2=0x7fa6941f4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:41.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.845+0000 7fa6927fc640 1 --2- 172.21.15.22:0/6549708 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa694155f70 0x7fa6941f4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:41.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.845+0000 7fa6927fc640 1 -- 172.21.15.22:0/6549708 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6940af940 con 0x7fa6940ce380 2024-05-21T13:36:41.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.845+0000 7fa692ffd640 1 --2- 172.21.15.22:0/6549708 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa69406c4f0 0x7fa6941565b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T13:36:41.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.845+0000 7fa6927fc640 1 --2- 172.21.15.22:0/6549708 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa6940ce380 0x7fa6940b2480 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa67c00c8a0 tx=0x7fa67c00cd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:41.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.845+0000 7fa68b7fe640 1 -- 172.21.15.22:0/6549708 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa67c003b80 con 0x7fa6940ce380 2024-05-21T13:36:41.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.845+0000 7fa68b7fe640 1 -- 172.21.15.22:0/6549708 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa67c003d40 con 0x7fa6940ce380 2024-05-21T13:36:41.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.845+0000 7fa6995f7640 1 -- 172.21.15.22:0/6549708 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6940afbe0 con 0x7fa6940ce380 2024-05-21T13:36:41.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.845+0000 7fa68b7fe640 1 -- 172.21.15.22:0/6549708 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa67c00aa90 con 0x7fa6940ce380 2024-05-21T13:36:41.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.845+0000 7fa6995f7640 1 -- 172.21.15.22:0/6549708 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6940b01a0 con 0x7fa6940ce380 2024-05-21T13:36:41.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.845+0000 7fa6995f7640 1 -- 172.21.15.22:0/6549708 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6940697d0 con 0x7fa6940ce380 2024-05-21T13:36:41.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.845+0000 7fa68b7fe640 1 -- 172.21.15.22:0/6549708 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fa67c00ac30 con 0x7fa6940ce380 2024-05-21T13:36:41.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.845+0000 7fa68b7fe640 1 --2- 172.21.15.22:0/6549708 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fa67806f400 0x7fa6780718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:41.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.849+0000 7fa68b7fe640 1 -- 172.21.15.22:0/6549708 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7fa67c08f5d0 con 0x7fa6940ce380 2024-05-21T13:36:41.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.849+0000 7fa692ffd640 1 --2- 172.21.15.22:0/6549708 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fa67806f400 0x7fa6780718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:41.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.849+0000 7fa692ffd640 1 --2- 172.21.15.22:0/6549708 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fa67806f400 0x7fa6780718c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa6840b2000 tx=0x7fa684008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:41.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:41.853+0000 7fa68b7fe640 1 -- 172.21.15.22:0/6549708 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fa67c05c150 con 0x7fa6940ce380 2024-05-21T13:36:41.994 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.013+0000 7fa6995f7640 1 -- 172.21.15.22:0/6549708 --> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa6940c8110 con 0x7fa67806f400 2024-05-21T13:36:42.017 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.037+0000 7fa68b7fe640 1 -- 172.21.15.22:0/6549708 <== mgr.4103 v2:172.21.15.115:6832/184591771 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332711 (secure 0 0 0) 0x7fa6940c8110 con 0x7fa67806f400 2024-05-21T13:36:42.019 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-21T13:36:42.022 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-05-21T13:36:42.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.045+0000 7fa6995f7640 1 -- 172.21.15.22:0/6549708 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fa67806f400 msgr2=0x7fa6780718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:42.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.045+0000 7fa6995f7640 1 --2- 172.21.15.22:0/6549708 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fa67806f400 0x7fa6780718c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fa6840b2000 tx=0x7fa684008040 comp rx=0 tx=0).stop 2024-05-21T13:36:42.024 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.045+0000 7fa6995f7640 1 -- 172.21.15.22:0/6549708 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa6940ce380 msgr2=0x7fa6940b2480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:42.024 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.045+0000 7fa6995f7640 1 --2- 172.21.15.22:0/6549708 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa6940ce380 0x7fa6940b2480 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa67c00c8a0 tx=0x7fa67c00cd60 comp rx=0 tx=0).stop 2024-05-21T13:36:42.024 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.045+0000 7fa6995f7640 1 -- 172.21.15.22:0/6549708 shutdown_connections 2024-05-21T13:36:42.024 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.045+0000 7fa6995f7640 1 --2- 172.21.15.22:0/6549708 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fa67806f400 0x7fa6780718c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:42.024 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.045+0000 7fa6995f7640 1 --2- 172.21.15.22:0/6549708 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa694155f70 0x7fa6941f4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:42.024 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.045+0000 7fa6995f7640 1 --2- 172.21.15.22:0/6549708 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa6940ce380 0x7fa6940b2480 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:42.024 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.045+0000 7fa6995f7640 1 --2- 172.21.15.22:0/6549708 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa69406c4f0 0x7fa6941565b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:42.024 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.045+0000 7fa6995f7640 1 -- 172.21.15.22:0/6549708 >> 172.21.15.22:0/6549708 conn(0x7fa694070de0 msgr2=0x7fa6940cdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:42.025 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.045+0000 7fa6995f7640 1 -- 172.21.15.22:0/6549708 shutdown_connections 2024-05-21T13:36:42.025 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.045+0000 7fa6995f7640 1 -- 172.21.15.22:0/6549708 wait complete. 2024-05-21T13:36:42.040 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":49,"stamp":"2024-05-21T13:36:40.514958+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597820,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":228,"num_write_kb":1670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235088,"kb_used_data":2316,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739632,"statfs":{"total":773094113280,"available":772853383168,"internally_reserved":0,"allocated":2371584,"data_stored":2014512,"data_compressed":66916,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1406,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.003452"},"pg_stats":[{"pgid":"2.1f","version":"25'9","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:32.022623+0000","last_change":"2024-05-21T13:35:56.739488+0000","last_active":"2024-05-21T13:36:32.022623+0000","last_peered":"2024-05-21T13:36:32.022623+0000","last_clean":"2024-05-21T13:36:32.022623+0000","last_became_active":"2024-05-21T13:35:56.738481+0000","last_became_peered":"2024-05-21T13:35:56.738481+0000","last_unstale":"2024-05-21T13:36:32.022623+0000","last_undegraded":"2024-05-21T13:36:32.022623+0000","last_fullsized":"2024-05-21T13:36:32.022623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:20:48.149770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-21T13:36:38.728860+0000","last_change":"2024-05-21T13:35:57.779462+0000","last_active":"2024-05-21T13:36:38.728860+0000","last_peered":"2024-05-21T13:36:38.728860+0000","last_clean":"2024-05-21T13:36:38.728860+0000","last_became_active":"2024-05-21T13:35:57.778721+0000","last_became_peered":"2024-05-21T13:35:57.778721+0000","last_unstale":"2024-05-21T13:36:38.728860+0000","last_undegraded":"2024-05-21T13:36:38.728860+0000","last_fullsized":"2024-05-21T13:36:38.728860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:13:05.005747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.963696+0000","last_change":"2024-05-21T13:36:01.868203+0000","last_active":"2024-05-21T13:36:02.963696+0000","last_peered":"2024-05-21T13:36:02.963696+0000","last_clean":"2024-05-21T13:36:02.963696+0000","last_became_active":"2024-05-21T13:36:01.864148+0000","last_became_peered":"2024-05-21T13:36:01.864148+0000","last_unstale":"2024-05-21T13:36:02.963696+0000","last_undegraded":"2024-05-21T13:36:02.963696+0000","last_fullsized":"2024-05-21T13:36:02.963696+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T13:57:33.088920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"25'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-21T13:36:38.729148+0000","last_change":"2024-05-21T13:35:56.775054+0000","last_active":"2024-05-21T13:36:38.729148+0000","last_peered":"2024-05-21T13:36:38.729148+0000","last_clean":"2024-05-21T13:36:38.729148+0000","last_became_active":"2024-05-21T13:35:56.770566+0000","last_became_peered":"2024-05-21T13:35:56.770566+0000","last_unstale":"2024-05-21T13:36:38.729148+0000","last_undegraded":"2024-05-21T13:36:38.729148+0000","last_fullsized":"2024-05-21T13:36:38.729148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:05:11.539201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-21T13:36:38.729089+0000","last_change":"2024-05-21T13:35:57.782094+0000","last_active":"2024-05-21T13:36:38.729089+0000","last_peered":"2024-05-21T13:36:38.729089+0000","last_clean":"2024-05-21T13:36:38.729089+0000","last_became_active":"2024-05-21T13:35:57.780590+0000","last_became_peered":"2024-05-21T13:35:57.780590+0000","last_unstale":"2024-05-21T13:36:38.729089+0000","last_undegraded":"2024-05-21T13:36:38.729089+0000","last_fullsized":"2024-05-21T13:36:38.729089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:30:50.929103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.960911+0000","last_change":"2024-05-21T13:36:01.852092+0000","last_active":"2024-05-21T13:36:02.960911+0000","last_peered":"2024-05-21T13:36:02.960911+0000","last_clean":"2024-05-21T13:36:02.960911+0000","last_became_active":"2024-05-21T13:36:01.851745+0000","last_became_peered":"2024-05-21T13:36:01.851745+0000","last_unstale":"2024-05-21T13:36:02.960911+0000","last_undegraded":"2024-05-21T13:36:02.960911+0000","last_fullsized":"2024-05-21T13:36:02.960911+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:57:21.599860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"25'4","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:32.023565+0000","last_change":"2024-05-21T13:35:56.731106+0000","last_active":"2024-05-21T13:36:32.023565+0000","last_peered":"2024-05-21T13:36:32.023565+0000","last_clean":"2024-05-21T13:36:32.023565+0000","last_became_active":"2024-05-21T13:35:56.730746+0000","last_became_peered":"2024-05-21T13:35:56.730746+0000","last_unstale":"2024-05-21T13:36:32.023565+0000","last_undegraded":"2024-05-21T13:36:32.023565+0000","last_fullsized":"2024-05-21T13:36:32.023565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:23:17.798397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.963099+0000","last_change":"2024-05-21T13:35:57.771371+0000","last_active":"2024-05-21T13:36:02.963099+0000","last_peered":"2024-05-21T13:36:02.963099+0000","last_clean":"2024-05-21T13:36:02.963099+0000","last_became_active":"2024-05-21T13:35:57.770595+0000","last_became_peered":"2024-05-21T13:35:57.770595+0000","last_unstale":"2024-05-21T13:36:02.963099+0000","last_undegraded":"2024-05-21T13:36:02.963099+0000","last_fullsized":"2024-05-21T13:36:02.963099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:53:17.771310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.961202+0000","last_change":"2024-05-21T13:36:01.849638+0000","last_active":"2024-05-21T13:36:02.961202+0000","last_peered":"2024-05-21T13:36:02.961202+0000","last_clean":"2024-05-21T13:36:02.961202+0000","last_became_active":"2024-05-21T13:36:01.848996+0000","last_became_peered":"2024-05-21T13:36:01.848996+0000","last_unstale":"2024-05-21T13:36:02.961202+0000","last_undegraded":"2024-05-21T13:36:02.961202+0000","last_fullsized":"2024-05-21T13:36:02.961202+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:24:31.613874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.960165+0000","last_change":"2024-05-21T13:35:56.737279+0000","last_active":"2024-05-21T13:36:02.960165+0000","last_peered":"2024-05-21T13:36:02.960165+0000","last_clean":"2024-05-21T13:36:02.960165+0000","last_became_active":"2024-05-21T13:35:56.731150+0000","last_became_peered":"2024-05-21T13:35:56.731150+0000","last_unstale":"2024-05-21T13:36:02.960165+0000","last_undegraded":"2024-05-21T13:36:02.960165+0000","last_fullsized":"2024-05-21T13:36:02.960165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:17:07.571294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.806009+0000","last_change":"2024-05-21T13:35:57.799803+0000","last_active":"2024-05-21T13:36:02.806009+0000","last_peered":"2024-05-21T13:36:02.806009+0000","last_clean":"2024-05-21T13:36:02.806009+0000","last_became_active":"2024-05-21T13:35:57.799043+0000","last_became_peered":"2024-05-21T13:35:57.799043+0000","last_unstale":"2024-05-21T13:36:02.806009+0000","last_undegraded":"2024-05-21T13:36:02.806009+0000","last_fullsized":"2024-05-21T13:36:02.806009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:22:48.607953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.961831+0000","last_change":"2024-05-21T13:36:01.852469+0000","last_active":"2024-05-21T13:36:02.961831+0000","last_peered":"2024-05-21T13:36:02.961831+0000","last_clean":"2024-05-21T13:36:02.961831+0000","last_became_active":"2024-05-21T13:36:01.851913+0000","last_became_peered":"2024-05-21T13:36:01.851913+0000","last_unstale":"2024-05-21T13:36:02.961831+0000","last_undegraded":"2024-05-21T13:36:02.961831+0000","last_fullsized":"2024-05-21T13:36:02.961831+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:42:58.062540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.805533+0000","last_change":"2024-05-21T13:35:57.796516+0000","last_active":"2024-05-21T13:36:02.805533+0000","last_peered":"2024-05-21T13:36:02.805533+0000","last_clean":"2024-05-21T13:36:02.805533+0000","last_became_active":"2024-05-21T13:35:57.795638+0000","last_became_peered":"2024-05-21T13:35:57.795638+0000","last_unstale":"2024-05-21T13:36:02.805533+0000","last_undegraded":"2024-05-21T13:36:02.805533+0000","last_fullsized":"2024-05-21T13:36:02.805533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:46:40.541835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"25'4","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:26.905177+0000","last_change":"2024-05-21T13:35:56.748046+0000","last_active":"2024-05-21T13:36:26.905177+0000","last_peered":"2024-05-21T13:36:26.905177+0000","last_clean":"2024-05-21T13:36:26.905177+0000","last_became_active":"2024-05-21T13:35:56.747635+0000","last_became_peered":"2024-05-21T13:35:56.747635+0000","last_unstale":"2024-05-21T13:36:26.905177+0000","last_undegraded":"2024-05-21T13:36:26.905177+0000","last_fullsized":"2024-05-21T13:36:26.905177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:52:28.665244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.805864+0000","last_change":"2024-05-21T13:36:01.862153+0000","last_active":"2024-05-21T13:36:02.805864+0000","last_peered":"2024-05-21T13:36:02.805864+0000","last_clean":"2024-05-21T13:36:02.805864+0000","last_became_active":"2024-05-21T13:36:01.861520+0000","last_became_peered":"2024-05-21T13:36:01.861520+0000","last_unstale":"2024-05-21T13:36:02.805864+0000","last_undegraded":"2024-05-21T13:36:02.805864+0000","last_fullsized":"2024-05-21T13:36:02.805864+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:04:37.306132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.964897+0000","last_change":"2024-05-21T13:35:57.786463+0000","last_active":"2024-05-21T13:36:02.964897+0000","last_peered":"2024-05-21T13:36:02.964897+0000","last_clean":"2024-05-21T13:36:02.964897+0000","last_became_active":"2024-05-21T13:35:57.786126+0000","last_became_peered":"2024-05-21T13:35:57.786126+0000","last_unstale":"2024-05-21T13:36:02.964897+0000","last_undegraded":"2024-05-21T13:36:02.964897+0000","last_fullsized":"2024-05-21T13:36:02.964897+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:39:32.076464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"25'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.966972+0000","last_change":"2024-05-21T13:35:56.765178+0000","last_active":"2024-05-21T13:36:02.966972+0000","last_peered":"2024-05-21T13:36:02.966972+0000","last_clean":"2024-05-21T13:36:02.966972+0000","last_became_active":"2024-05-21T13:35:56.764551+0000","last_became_peered":"2024-05-21T13:35:56.764551+0000","last_unstale":"2024-05-21T13:36:02.966972+0000","last_undegraded":"2024-05-21T13:36:02.966972+0000","last_fullsized":"2024-05-21T13:36:02.966972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:34:28.955222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.959609+0000","last_change":"2024-05-21T13:36:01.854410+0000","last_active":"2024-05-21T13:36:02.959609+0000","last_peered":"2024-05-21T13:36:02.959609+0000","last_clean":"2024-05-21T13:36:02.959609+0000","last_became_active":"2024-05-21T13:36:01.853975+0000","last_became_peered":"2024-05-21T13:36:01.853975+0000","last_unstale":"2024-05-21T13:36:02.959609+0000","last_undegraded":"2024-05-21T13:36:02.959609+0000","last_fullsized":"2024-05-21T13:36:02.959609+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:15:34.710504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.807180+0000","last_change":"2024-05-21T13:35:57.762509+0000","last_active":"2024-05-21T13:36:02.807180+0000","last_peered":"2024-05-21T13:36:02.807180+0000","last_clean":"2024-05-21T13:36:02.807180+0000","last_became_active":"2024-05-21T13:35:57.761739+0000","last_became_peered":"2024-05-21T13:35:57.761739+0000","last_unstale":"2024-05-21T13:36:02.807180+0000","last_undegraded":"2024-05-21T13:36:02.807180+0000","last_fullsized":"2024-05-21T13:36:02.807180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:41:17.911126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"25'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:26.908898+0000","last_change":"2024-05-21T13:35:56.734017+0000","last_active":"2024-05-21T13:36:26.908898+0000","last_peered":"2024-05-21T13:36:26.908898+0000","last_clean":"2024-05-21T13:36:26.908898+0000","last_became_active":"2024-05-21T13:35:56.733249+0000","last_became_peered":"2024-05-21T13:35:56.733249+0000","last_unstale":"2024-05-21T13:36:26.908898+0000","last_undegraded":"2024-05-21T13:36:26.908898+0000","last_fullsized":"2024-05-21T13:36:26.908898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:13:27.279557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.967145+0000","last_change":"2024-05-21T13:36:01.868669+0000","last_active":"2024-05-21T13:36:02.967145+0000","last_peered":"2024-05-21T13:36:02.967145+0000","last_clean":"2024-05-21T13:36:02.967145+0000","last_became_active":"2024-05-21T13:36:01.867701+0000","last_became_peered":"2024-05-21T13:36:01.867701+0000","last_unstale":"2024-05-21T13:36:02.967145+0000","last_undegraded":"2024-05-21T13:36:02.967145+0000","last_fullsized":"2024-05-21T13:36:02.967145+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:09:21.615570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.804889+0000","last_change":"2024-05-21T13:35:57.789966+0000","last_active":"2024-05-21T13:36:02.804889+0000","last_peered":"2024-05-21T13:36:02.804889+0000","last_clean":"2024-05-21T13:36:02.804889+0000","last_became_active":"2024-05-21T13:35:57.789213+0000","last_became_peered":"2024-05-21T13:35:57.789213+0000","last_unstale":"2024-05-21T13:36:02.804889+0000","last_undegraded":"2024-05-21T13:36:02.804889+0000","last_fullsized":"2024-05-21T13:36:02.804889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:33:24.183958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"25'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:26.906102+0000","last_change":"2024-05-21T13:35:56.746878+0000","last_active":"2024-05-21T13:36:26.906102+0000","last_peered":"2024-05-21T13:36:26.906102+0000","last_clean":"2024-05-21T13:36:26.906102+0000","last_became_active":"2024-05-21T13:35:56.746534+0000","last_became_peered":"2024-05-21T13:35:56.746534+0000","last_unstale":"2024-05-21T13:36:26.906102+0000","last_undegraded":"2024-05-21T13:36:26.906102+0000","last_fullsized":"2024-05-21T13:36:26.906102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:45:56.935415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.961481+0000","last_change":"2024-05-21T13:36:01.841632+0000","last_active":"2024-05-21T13:36:02.961481+0000","last_peered":"2024-05-21T13:36:02.961481+0000","last_clean":"2024-05-21T13:36:02.961481+0000","last_became_active":"2024-05-21T13:36:01.841216+0000","last_became_peered":"2024-05-21T13:36:01.841216+0000","last_unstale":"2024-05-21T13:36:02.961481+0000","last_undegraded":"2024-05-21T13:36:02.961481+0000","last_fullsized":"2024-05-21T13:36:02.961481+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:49:05.576221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.807962+0000","last_change":"2024-05-21T13:35:57.764793+0000","last_active":"2024-05-21T13:36:02.807962+0000","last_peered":"2024-05-21T13:36:02.807962+0000","last_clean":"2024-05-21T13:36:02.807962+0000","last_became_active":"2024-05-21T13:35:57.764017+0000","last_became_peered":"2024-05-21T13:35:57.764017+0000","last_unstale":"2024-05-21T13:36:02.807962+0000","last_undegraded":"2024-05-21T13:36:02.807962+0000","last_fullsized":"2024-05-21T13:36:02.807962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:25:45.006614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"25'4","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:26.906102+0000","last_change":"2024-05-21T13:35:56.752278+0000","last_active":"2024-05-21T13:36:26.906102+0000","last_peered":"2024-05-21T13:36:26.906102+0000","last_clean":"2024-05-21T13:36:26.906102+0000","last_became_active":"2024-05-21T13:35:56.751883+0000","last_became_peered":"2024-05-21T13:35:56.751883+0000","last_unstale":"2024-05-21T13:36:26.906102+0000","last_undegraded":"2024-05-21T13:36:26.906102+0000","last_fullsized":"2024-05-21T13:36:26.906102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:08:05.279701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.961503+0000","last_change":"2024-05-21T13:36:01.832621+0000","last_active":"2024-05-21T13:36:02.961503+0000","last_peered":"2024-05-21T13:36:02.961503+0000","last_clean":"2024-05-21T13:36:02.961503+0000","last_became_active":"2024-05-21T13:36:01.831609+0000","last_became_peered":"2024-05-21T13:36:01.831609+0000","last_unstale":"2024-05-21T13:36:02.961503+0000","last_undegraded":"2024-05-21T13:36:02.961503+0000","last_fullsized":"2024-05-21T13:36:02.961503+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:26:43.075259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.808212+0000","last_change":"2024-05-21T13:35:57.783487+0000","last_active":"2024-05-21T13:36:02.808212+0000","last_peered":"2024-05-21T13:36:02.808212+0000","last_clean":"2024-05-21T13:36:02.808212+0000","last_became_active":"2024-05-21T13:35:57.783150+0000","last_became_peered":"2024-05-21T13:35:57.783150+0000","last_unstale":"2024-05-21T13:36:02.808212+0000","last_undegraded":"2024-05-21T13:36:02.808212+0000","last_fullsized":"2024-05-21T13:36:02.808212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:14:56.991945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"25'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:32.021084+0000","last_change":"2024-05-21T13:35:56.745122+0000","last_active":"2024-05-21T13:36:32.021084+0000","last_peered":"2024-05-21T13:36:32.021084+0000","last_clean":"2024-05-21T13:36:32.021084+0000","last_became_active":"2024-05-21T13:35:56.744218+0000","last_became_peered":"2024-05-21T13:35:56.744218+0000","last_unstale":"2024-05-21T13:36:32.021084+0000","last_undegraded":"2024-05-21T13:36:32.021084+0000","last_fullsized":"2024-05-21T13:36:32.021084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:45:03.790591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.807106+0000","last_change":"2024-05-21T13:36:01.838971+0000","last_active":"2024-05-21T13:36:02.807106+0000","last_peered":"2024-05-21T13:36:02.807106+0000","last_clean":"2024-05-21T13:36:02.807106+0000","last_became_active":"2024-05-21T13:36:01.837401+0000","last_became_peered":"2024-05-21T13:36:01.837401+0000","last_unstale":"2024-05-21T13:36:02.807106+0000","last_undegraded":"2024-05-21T13:36:02.807106+0000","last_fullsized":"2024-05-21T13:36:02.807106+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:16:25.666568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.967981+0000","last_change":"2024-05-21T13:35:57.784993+0000","last_active":"2024-05-21T13:36:02.967981+0000","last_peered":"2024-05-21T13:36:02.967981+0000","last_clean":"2024-05-21T13:36:02.967981+0000","last_became_active":"2024-05-21T13:35:57.784664+0000","last_became_peered":"2024-05-21T13:35:57.784664+0000","last_unstale":"2024-05-21T13:36:02.967981+0000","last_undegraded":"2024-05-21T13:36:02.967981+0000","last_fullsized":"2024-05-21T13:36:02.967981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:58:20.045901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"25'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.806918+0000","last_change":"2024-05-21T13:35:56.741285+0000","last_active":"2024-05-21T13:36:02.806918+0000","last_peered":"2024-05-21T13:36:02.806918+0000","last_clean":"2024-05-21T13:36:02.806918+0000","last_became_active":"2024-05-21T13:35:56.740846+0000","last_became_peered":"2024-05-21T13:35:56.740846+0000","last_unstale":"2024-05-21T13:36:02.806918+0000","last_undegraded":"2024-05-21T13:36:02.806918+0000","last_fullsized":"2024-05-21T13:36:02.806918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:34:17.960870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.963587+0000","last_change":"2024-05-21T13:36:01.873172+0000","last_active":"2024-05-21T13:36:02.963587+0000","last_peered":"2024-05-21T13:36:02.963587+0000","last_clean":"2024-05-21T13:36:02.963587+0000","last_became_active":"2024-05-21T13:36:01.872085+0000","last_became_peered":"2024-05-21T13:36:01.872085+0000","last_unstale":"2024-05-21T13:36:02.963587+0000","last_undegraded":"2024-05-21T13:36:02.963587+0000","last_fullsized":"2024-05-21T13:36:02.963587+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:24:57.031323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.961092+0000","last_change":"2024-05-21T13:35:57.783176+0000","last_active":"2024-05-21T13:36:02.961092+0000","last_peered":"2024-05-21T13:36:02.961092+0000","last_clean":"2024-05-21T13:36:02.961092+0000","last_became_active":"2024-05-21T13:35:57.782517+0000","last_became_peered":"2024-05-21T13:35:57.782517+0000","last_unstale":"2024-05-21T13:36:02.961092+0000","last_undegraded":"2024-05-21T13:36:02.961092+0000","last_fullsized":"2024-05-21T13:36:02.961092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:06:58.203996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-21T13:36:38.728215+0000","last_change":"2024-05-21T13:35:56.767544+0000","last_active":"2024-05-21T13:36:38.728215+0000","last_peered":"2024-05-21T13:36:38.728215+0000","last_clean":"2024-05-21T13:36:38.728215+0000","last_became_active":"2024-05-21T13:35:56.764987+0000","last_became_peered":"2024-05-21T13:35:56.764987+0000","last_unstale":"2024-05-21T13:36:38.728215+0000","last_undegraded":"2024-05-21T13:36:38.728215+0000","last_fullsized":"2024-05-21T13:36:38.728215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:12:46.828769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.966223+0000","last_change":"2024-05-21T13:36:01.872215+0000","last_active":"2024-05-21T13:36:02.966223+0000","last_peered":"2024-05-21T13:36:02.966223+0000","last_clean":"2024-05-21T13:36:02.966223+0000","last_became_active":"2024-05-21T13:36:01.870831+0000","last_became_peered":"2024-05-21T13:36:01.870831+0000","last_unstale":"2024-05-21T13:36:02.966223+0000","last_undegraded":"2024-05-21T13:36:02.966223+0000","last_fullsized":"2024-05-21T13:36:02.966223+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:04:09.689206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.959882+0000","last_change":"2024-05-21T13:35:57.783616+0000","last_active":"2024-05-21T13:36:02.959882+0000","last_peered":"2024-05-21T13:36:02.959882+0000","last_clean":"2024-05-21T13:36:02.959882+0000","last_became_active":"2024-05-21T13:35:57.780521+0000","last_became_peered":"2024-05-21T13:35:57.780521+0000","last_unstale":"2024-05-21T13:36:02.959882+0000","last_undegraded":"2024-05-21T13:36:02.959882+0000","last_fullsized":"2024-05-21T13:36:02.959882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:59:44.121631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"25'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.806903+0000","last_change":"2024-05-21T13:35:56.750341+0000","last_active":"2024-05-21T13:36:02.806903+0000","last_peered":"2024-05-21T13:36:02.806903+0000","last_clean":"2024-05-21T13:36:02.806903+0000","last_became_active":"2024-05-21T13:35:56.750006+0000","last_became_peered":"2024-05-21T13:35:56.750006+0000","last_unstale":"2024-05-21T13:36:02.806903+0000","last_undegraded":"2024-05-21T13:36:02.806903+0000","last_fullsized":"2024-05-21T13:36:02.806903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:15:21.416234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.967726+0000","last_change":"2024-05-21T13:36:01.873693+0000","last_active":"2024-05-21T13:36:02.967726+0000","last_peered":"2024-05-21T13:36:02.967726+0000","last_clean":"2024-05-21T13:36:02.967726+0000","last_became_active":"2024-05-21T13:36:01.872363+0000","last_became_peered":"2024-05-21T13:36:01.872363+0000","last_unstale":"2024-05-21T13:36:02.967726+0000","last_undegraded":"2024-05-21T13:36:02.967726+0000","last_fullsized":"2024-05-21T13:36:02.967726+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:27:25.974289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-21T13:36:38.727538+0000","last_change":"2024-05-21T13:35:57.780809+0000","last_active":"2024-05-21T13:36:38.727538+0000","last_peered":"2024-05-21T13:36:38.727538+0000","last_clean":"2024-05-21T13:36:38.727538+0000","last_became_active":"2024-05-21T13:35:57.780313+0000","last_became_peered":"2024-05-21T13:35:57.780313+0000","last_unstale":"2024-05-21T13:36:38.727538+0000","last_undegraded":"2024-05-21T13:36:38.727538+0000","last_fullsized":"2024-05-21T13:36:38.727538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:43:11.778238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"25'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:32.025109+0000","last_change":"2024-05-21T13:35:56.771138+0000","last_active":"2024-05-21T13:36:32.025109+0000","last_peered":"2024-05-21T13:36:32.025109+0000","last_clean":"2024-05-21T13:36:32.025109+0000","last_became_active":"2024-05-21T13:35:56.770465+0000","last_became_peered":"2024-05-21T13:35:56.770465+0000","last_unstale":"2024-05-21T13:36:32.025109+0000","last_undegraded":"2024-05-21T13:36:32.025109+0000","last_fullsized":"2024-05-21T13:36:32.025109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:21:16.702309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.968200+0000","last_change":"2024-05-21T13:36:01.871328+0000","last_active":"2024-05-21T13:36:02.968200+0000","last_peered":"2024-05-21T13:36:02.968200+0000","last_clean":"2024-05-21T13:36:02.968200+0000","last_became_active":"2024-05-21T13:36:01.870678+0000","last_became_peered":"2024-05-21T13:36:01.870678+0000","last_unstale":"2024-05-21T13:36:02.968200+0000","last_undegraded":"2024-05-21T13:36:02.968200+0000","last_fullsized":"2024-05-21T13:36:02.968200+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:22:47.393065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.962506+0000","last_change":"2024-05-21T13:35:57.782665+0000","last_active":"2024-05-21T13:36:02.962506+0000","last_peered":"2024-05-21T13:36:02.962506+0000","last_clean":"2024-05-21T13:36:02.962506+0000","last_became_active":"2024-05-21T13:35:57.781299+0000","last_became_peered":"2024-05-21T13:35:57.781299+0000","last_unstale":"2024-05-21T13:36:02.962506+0000","last_undegraded":"2024-05-21T13:36:02.962506+0000","last_fullsized":"2024-05-21T13:36:02.962506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:21:22.721124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"25'3","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:32.019985+0000","last_change":"2024-05-21T13:35:56.768193+0000","last_active":"2024-05-21T13:36:32.019985+0000","last_peered":"2024-05-21T13:36:32.019985+0000","last_clean":"2024-05-21T13:36:32.019985+0000","last_became_active":"2024-05-21T13:35:56.767788+0000","last_became_peered":"2024-05-21T13:35:56.767788+0000","last_unstale":"2024-05-21T13:36:32.019985+0000","last_undegraded":"2024-05-21T13:36:32.019985+0000","last_fullsized":"2024-05-21T13:36:32.019985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:12:52.911816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-21T13:36:38.728339+0000","last_change":"2024-05-21T13:36:01.860305+0000","last_active":"2024-05-21T13:36:38.728339+0000","last_peered":"2024-05-21T13:36:38.728339+0000","last_clean":"2024-05-21T13:36:38.728339+0000","last_became_active":"2024-05-21T13:36:01.859141+0000","last_became_peered":"2024-05-21T13:36:01.859141+0000","last_unstale":"2024-05-21T13:36:38.728339+0000","last_undegraded":"2024-05-21T13:36:38.728339+0000","last_fullsized":"2024-05-21T13:36:38.728339+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:05:45.203241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.807817+0000","last_change":"2024-05-21T13:35:57.775523+0000","last_active":"2024-05-21T13:36:02.807817+0000","last_peered":"2024-05-21T13:36:02.807817+0000","last_clean":"2024-05-21T13:36:02.807817+0000","last_became_active":"2024-05-21T13:35:57.774322+0000","last_became_peered":"2024-05-21T13:35:57.774322+0000","last_unstale":"2024-05-21T13:36:02.807817+0000","last_undegraded":"2024-05-21T13:36:02.807817+0000","last_fullsized":"2024-05-21T13:36:02.807817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:06:35.118540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"25'3","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:26.905395+0000","last_change":"2024-05-21T13:35:56.748185+0000","last_active":"2024-05-21T13:36:26.905395+0000","last_peered":"2024-05-21T13:36:26.905395+0000","last_clean":"2024-05-21T13:36:26.905395+0000","last_became_active":"2024-05-21T13:35:56.747823+0000","last_became_peered":"2024-05-21T13:35:56.747823+0000","last_unstale":"2024-05-21T13:36:26.905395+0000","last_undegraded":"2024-05-21T13:36:26.905395+0000","last_fullsized":"2024-05-21T13:36:26.905395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:38:00.235330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":117,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.963125+0000","last_change":"2024-05-21T13:35:45.682484+0000","last_active":"2024-05-21T13:36:02.963125+0000","last_peered":"2024-05-21T13:36:02.963125+0000","last_clean":"2024-05-21T13:36:02.963125+0000","last_became_active":"2024-05-21T13:35:45.680732+0000","last_became_peered":"2024-05-21T13:35:45.680732+0000","last_unstale":"2024-05-21T13:36:02.963125+0000","last_undegraded":"2024-05-21T13:36:02.963125+0000","last_fullsized":"2024-05-21T13:36:02.963125+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:44.542324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:44.542324+0000","last_clean_scrub_stamp":"2024-05-21T13:35:44.542324+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:16:05.034161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.806631+0000","last_change":"2024-05-21T13:36:01.830034+0000","last_active":"2024-05-21T13:36:02.806631+0000","last_peered":"2024-05-21T13:36:02.806631+0000","last_clean":"2024-05-21T13:36:02.806631+0000","last_became_active":"2024-05-21T13:36:01.828957+0000","last_became_peered":"2024-05-21T13:36:01.828957+0000","last_unstale":"2024-05-21T13:36:02.806631+0000","last_undegraded":"2024-05-21T13:36:02.806631+0000","last_fullsized":"2024-05-21T13:36:02.806631+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:21:59.514268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.806258+0000","last_change":"2024-05-21T13:35:57.796419+0000","last_active":"2024-05-21T13:36:02.806258+0000","last_peered":"2024-05-21T13:36:02.806258+0000","last_clean":"2024-05-21T13:36:02.806258+0000","last_became_active":"2024-05-21T13:35:57.796050+0000","last_became_peered":"2024-05-21T13:35:57.796050+0000","last_unstale":"2024-05-21T13:36:02.806258+0000","last_undegraded":"2024-05-21T13:36:02.806258+0000","last_fullsized":"2024-05-21T13:36:02.806258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:56:07.121391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"25'3","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:32.024966+0000","last_change":"2024-05-21T13:35:56.751619+0000","last_active":"2024-05-21T13:36:32.024966+0000","last_peered":"2024-05-21T13:36:32.024966+0000","last_clean":"2024-05-21T13:36:32.024966+0000","last_became_active":"2024-05-21T13:35:56.748604+0000","last_became_peered":"2024-05-21T13:35:56.748604+0000","last_unstale":"2024-05-21T13:36:32.024966+0000","last_undegraded":"2024-05-21T13:36:32.024966+0000","last_fullsized":"2024-05-21T13:36:32.024966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:19:03.052434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.961835+0000","last_change":"2024-05-21T13:36:01.825464+0000","last_active":"2024-05-21T13:36:02.961835+0000","last_peered":"2024-05-21T13:36:02.961835+0000","last_clean":"2024-05-21T13:36:02.961835+0000","last_became_active":"2024-05-21T13:36:01.824653+0000","last_became_peered":"2024-05-21T13:36:01.824653+0000","last_unstale":"2024-05-21T13:36:02.961835+0000","last_undegraded":"2024-05-21T13:36:02.961835+0000","last_fullsized":"2024-05-21T13:36:02.961835+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:29:32.830052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.960114+0000","last_change":"2024-05-21T13:35:57.784031+0000","last_active":"2024-05-21T13:36:02.960114+0000","last_peered":"2024-05-21T13:36:02.960114+0000","last_clean":"2024-05-21T13:36:02.960114+0000","last_became_active":"2024-05-21T13:35:57.771695+0000","last_became_peered":"2024-05-21T13:35:57.771695+0000","last_unstale":"2024-05-21T13:36:02.960114+0000","last_undegraded":"2024-05-21T13:36:02.960114+0000","last_fullsized":"2024-05-21T13:36:02.960114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:46:33.308257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-21T13:36:38.728564+0000","last_change":"2024-05-21T13:35:56.768166+0000","last_active":"2024-05-21T13:36:38.728564+0000","last_peered":"2024-05-21T13:36:38.728564+0000","last_clean":"2024-05-21T13:36:38.728564+0000","last_became_active":"2024-05-21T13:35:56.767053+0000","last_became_peered":"2024-05-21T13:35:56.767053+0000","last_unstale":"2024-05-21T13:36:38.728564+0000","last_undegraded":"2024-05-21T13:36:38.728564+0000","last_fullsized":"2024-05-21T13:36:38.728564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:10:16.639491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-21T13:36:38.728163+0000","last_change":"2024-05-21T13:36:01.834253+0000","last_active":"2024-05-21T13:36:38.728163+0000","last_peered":"2024-05-21T13:36:38.728163+0000","last_clean":"2024-05-21T13:36:38.728163+0000","last_became_active":"2024-05-21T13:36:01.832972+0000","last_became_peered":"2024-05-21T13:36:01.832972+0000","last_unstale":"2024-05-21T13:36:38.728163+0000","last_undegraded":"2024-05-21T13:36:38.728163+0000","last_fullsized":"2024-05-21T13:36:38.728163+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:52:05.576063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.960150+0000","last_change":"2024-05-21T13:35:57.766504+0000","last_active":"2024-05-21T13:36:02.960150+0000","last_peered":"2024-05-21T13:36:02.960150+0000","last_clean":"2024-05-21T13:36:02.960150+0000","last_became_active":"2024-05-21T13:35:57.765756+0000","last_became_peered":"2024-05-21T13:35:57.765756+0000","last_unstale":"2024-05-21T13:36:02.960150+0000","last_undegraded":"2024-05-21T13:36:02.960150+0000","last_fullsized":"2024-05-21T13:36:02.960150+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:52:13.025110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.808071+0000","last_change":"2024-05-21T13:35:56.770347+0000","last_active":"2024-05-21T13:36:02.808071+0000","last_peered":"2024-05-21T13:36:02.808071+0000","last_clean":"2024-05-21T13:36:02.808071+0000","last_became_active":"2024-05-21T13:35:56.769767+0000","last_became_peered":"2024-05-21T13:35:56.769767+0000","last_unstale":"2024-05-21T13:36:02.808071+0000","last_undegraded":"2024-05-21T13:36:02.808071+0000","last_fullsized":"2024-05-21T13:36:02.808071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:40:01.698967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.804632+0000","last_change":"2024-05-21T13:36:01.827091+0000","last_active":"2024-05-21T13:36:02.804632+0000","last_peered":"2024-05-21T13:36:02.804632+0000","last_clean":"2024-05-21T13:36:02.804632+0000","last_became_active":"2024-05-21T13:36:01.826686+0000","last_became_peered":"2024-05-21T13:36:01.826686+0000","last_unstale":"2024-05-21T13:36:02.804632+0000","last_undegraded":"2024-05-21T13:36:02.804632+0000","last_fullsized":"2024-05-21T13:36:02.804632+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:42:47.638921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.962149+0000","last_change":"2024-05-21T13:35:57.781528+0000","last_active":"2024-05-21T13:36:02.962149+0000","last_peered":"2024-05-21T13:36:02.962149+0000","last_clean":"2024-05-21T13:36:02.962149+0000","last_became_active":"2024-05-21T13:35:57.781111+0000","last_became_peered":"2024-05-21T13:35:57.781111+0000","last_unstale":"2024-05-21T13:36:02.962149+0000","last_undegraded":"2024-05-21T13:36:02.962149+0000","last_fullsized":"2024-05-21T13:36:02.962149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:15:43.847640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"24'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.960114+0000","last_change":"2024-05-21T13:35:56.755413+0000","last_active":"2024-05-21T13:36:02.960114+0000","last_peered":"2024-05-21T13:36:02.960114+0000","last_clean":"2024-05-21T13:36:02.960114+0000","last_became_active":"2024-05-21T13:35:56.755158+0000","last_became_peered":"2024-05-21T13:35:56.755158+0000","last_unstale":"2024-05-21T13:36:02.960114+0000","last_undegraded":"2024-05-21T13:36:02.960114+0000","last_fullsized":"2024-05-21T13:36:02.960114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:23:05.102098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.962809+0000","last_change":"2024-05-21T13:36:01.827237+0000","last_active":"2024-05-21T13:36:02.962809+0000","last_peered":"2024-05-21T13:36:02.962809+0000","last_clean":"2024-05-21T13:36:02.962809+0000","last_became_active":"2024-05-21T13:36:01.826374+0000","last_became_peered":"2024-05-21T13:36:01.826374+0000","last_unstale":"2024-05-21T13:36:02.962809+0000","last_undegraded":"2024-05-21T13:36:02.962809+0000","last_fullsized":"2024-05-21T13:36:02.962809+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:12:33.528068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.804889+0000","last_change":"2024-05-21T13:35:57.787940+0000","last_active":"2024-05-21T13:36:02.804889+0000","last_peered":"2024-05-21T13:36:02.804889+0000","last_clean":"2024-05-21T13:36:02.804889+0000","last_became_active":"2024-05-21T13:35:57.787544+0000","last_became_peered":"2024-05-21T13:35:57.787544+0000","last_unstale":"2024-05-21T13:36:02.804889+0000","last_undegraded":"2024-05-21T13:36:02.804889+0000","last_fullsized":"2024-05-21T13:36:02.804889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:46:20.335316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"25'15","reported_seq":37,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:32.027063+0000","last_change":"2024-05-21T13:35:56.756262+0000","last_active":"2024-05-21T13:36:32.027063+0000","last_peered":"2024-05-21T13:36:32.027063+0000","last_clean":"2024-05-21T13:36:32.027063+0000","last_became_active":"2024-05-21T13:35:56.752342+0000","last_became_peered":"2024-05-21T13:35:56.752342+0000","last_unstale":"2024-05-21T13:36:32.027063+0000","last_undegraded":"2024-05-21T13:36:32.027063+0000","last_fullsized":"2024-05-21T13:36:32.027063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:59:09.541382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-21T13:36:38.728680+0000","last_change":"2024-05-21T13:36:01.859498+0000","last_active":"2024-05-21T13:36:38.728680+0000","last_peered":"2024-05-21T13:36:38.728680+0000","last_clean":"2024-05-21T13:36:38.728680+0000","last_became_active":"2024-05-21T13:36:01.857707+0000","last_became_peered":"2024-05-21T13:36:01.857707+0000","last_unstale":"2024-05-21T13:36:38.728680+0000","last_undegraded":"2024-05-21T13:36:38.728680+0000","last_fullsized":"2024-05-21T13:36:38.728680+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:38:06.966814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.962835+0000","last_change":"2024-05-21T13:35:57.783007+0000","last_active":"2024-05-21T13:36:02.962835+0000","last_peered":"2024-05-21T13:36:02.962835+0000","last_clean":"2024-05-21T13:36:02.962835+0000","last_became_active":"2024-05-21T13:35:57.782330+0000","last_became_peered":"2024-05-21T13:35:57.782330+0000","last_unstale":"2024-05-21T13:36:02.962835+0000","last_undegraded":"2024-05-21T13:36:02.962835+0000","last_fullsized":"2024-05-21T13:36:02.962835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:26:14.697766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"25'3","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:32.023577+0000","last_change":"2024-05-21T13:35:56.745787+0000","last_active":"2024-05-21T13:36:32.023577+0000","last_peered":"2024-05-21T13:36:32.023577+0000","last_clean":"2024-05-21T13:36:32.023577+0000","last_became_active":"2024-05-21T13:35:56.745202+0000","last_became_peered":"2024-05-21T13:35:56.745202+0000","last_unstale":"2024-05-21T13:36:32.023577+0000","last_undegraded":"2024-05-21T13:36:32.023577+0000","last_fullsized":"2024-05-21T13:36:32.023577+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:31:13.498003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-21T13:36:38.728909+0000","last_change":"2024-05-21T13:36:01.858550+0000","last_active":"2024-05-21T13:36:38.728909+0000","last_peered":"2024-05-21T13:36:38.728909+0000","last_clean":"2024-05-21T13:36:38.728909+0000","last_became_active":"2024-05-21T13:36:01.857716+0000","last_became_peered":"2024-05-21T13:36:01.857716+0000","last_unstale":"2024-05-21T13:36:38.728909+0000","last_undegraded":"2024-05-21T13:36:38.728909+0000","last_fullsized":"2024-05-21T13:36:38.728909+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:48:32.490678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.805527+0000","last_change":"2024-05-21T13:35:57.799702+0000","last_active":"2024-05-21T13:36:02.805527+0000","last_peered":"2024-05-21T13:36:02.805527+0000","last_clean":"2024-05-21T13:36:02.805527+0000","last_became_active":"2024-05-21T13:35:57.799225+0000","last_became_peered":"2024-05-21T13:35:57.799225+0000","last_unstale":"2024-05-21T13:36:02.805527+0000","last_undegraded":"2024-05-21T13:36:02.805527+0000","last_fullsized":"2024-05-21T13:36:02.805527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:29:54.094448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"25'3","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:26.904458+0000","last_change":"2024-05-21T13:35:56.742650+0000","last_active":"2024-05-21T13:36:26.904458+0000","last_peered":"2024-05-21T13:36:26.904458+0000","last_clean":"2024-05-21T13:36:26.904458+0000","last_became_active":"2024-05-21T13:35:56.742296+0000","last_became_peered":"2024-05-21T13:35:56.742296+0000","last_unstale":"2024-05-21T13:36:26.904458+0000","last_undegraded":"2024-05-21T13:36:26.904458+0000","last_fullsized":"2024-05-21T13:36:26.904458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:18:55.514845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.967634+0000","last_change":"2024-05-21T13:36:01.873708+0000","last_active":"2024-05-21T13:36:02.967634+0000","last_peered":"2024-05-21T13:36:02.967634+0000","last_clean":"2024-05-21T13:36:02.967634+0000","last_became_active":"2024-05-21T13:36:01.872320+0000","last_became_peered":"2024-05-21T13:36:01.872320+0000","last_unstale":"2024-05-21T13:36:02.967634+0000","last_undegraded":"2024-05-21T13:36:02.967634+0000","last_fullsized":"2024-05-21T13:36:02.967634+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:01:15.545756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.966606+0000","last_change":"2024-05-21T13:35:57.802763+0000","last_active":"2024-05-21T13:36:02.966606+0000","last_peered":"2024-05-21T13:36:02.966606+0000","last_clean":"2024-05-21T13:36:02.966606+0000","last_became_active":"2024-05-21T13:35:57.802433+0000","last_became_peered":"2024-05-21T13:35:57.802433+0000","last_unstale":"2024-05-21T13:36:02.966606+0000","last_undegraded":"2024-05-21T13:36:02.966606+0000","last_fullsized":"2024-05-21T13:36:02.966606+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:09:48.463186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"25'6","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:32.021995+0000","last_change":"2024-05-21T13:35:56.754087+0000","last_active":"2024-05-21T13:36:32.021995+0000","last_peered":"2024-05-21T13:36:32.021995+0000","last_clean":"2024-05-21T13:36:32.021995+0000","last_became_active":"2024-05-21T13:35:56.753319+0000","last_became_peered":"2024-05-21T13:35:56.753319+0000","last_unstale":"2024-05-21T13:36:32.021995+0000","last_undegraded":"2024-05-21T13:36:32.021995+0000","last_fullsized":"2024-05-21T13:36:32.021995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:19:21.276993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.806089+0000","last_change":"2024-05-21T13:36:01.836017+0000","last_active":"2024-05-21T13:36:02.806089+0000","last_peered":"2024-05-21T13:36:02.806089+0000","last_clean":"2024-05-21T13:36:02.806089+0000","last_became_active":"2024-05-21T13:36:01.835450+0000","last_became_peered":"2024-05-21T13:36:01.835450+0000","last_unstale":"2024-05-21T13:36:02.806089+0000","last_undegraded":"2024-05-21T13:36:02.806089+0000","last_fullsized":"2024-05-21T13:36:02.806089+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:05:56.077605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.962152+0000","last_change":"2024-05-21T13:35:57.787177+0000","last_active":"2024-05-21T13:36:02.962152+0000","last_peered":"2024-05-21T13:36:02.962152+0000","last_clean":"2024-05-21T13:36:02.962152+0000","last_became_active":"2024-05-21T13:35:57.786401+0000","last_became_peered":"2024-05-21T13:35:57.786401+0000","last_unstale":"2024-05-21T13:36:02.962152+0000","last_undegraded":"2024-05-21T13:36:02.962152+0000","last_fullsized":"2024-05-21T13:36:02.962152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:17:18.939002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"25'11","reported_seq":33,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:26.902139+0000","last_change":"2024-05-21T13:35:56.751229+0000","last_active":"2024-05-21T13:36:26.902139+0000","last_peered":"2024-05-21T13:36:26.902139+0000","last_clean":"2024-05-21T13:36:26.902139+0000","last_became_active":"2024-05-21T13:35:56.750831+0000","last_became_peered":"2024-05-21T13:35:56.750831+0000","last_unstale":"2024-05-21T13:36:26.902139+0000","last_undegraded":"2024-05-21T13:36:26.902139+0000","last_fullsized":"2024-05-21T13:36:26.902139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:03:40.186241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.807730+0000","last_change":"2024-05-21T13:36:01.832691+0000","last_active":"2024-05-21T13:36:02.807730+0000","last_peered":"2024-05-21T13:36:02.807730+0000","last_clean":"2024-05-21T13:36:02.807730+0000","last_became_active":"2024-05-21T13:36:01.831476+0000","last_became_peered":"2024-05-21T13:36:01.831476+0000","last_unstale":"2024-05-21T13:36:02.807730+0000","last_undegraded":"2024-05-21T13:36:02.807730+0000","last_fullsized":"2024-05-21T13:36:02.807730+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:08:38.092592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.805422+0000","last_change":"2024-05-21T13:35:57.788547+0000","last_active":"2024-05-21T13:36:02.805422+0000","last_peered":"2024-05-21T13:36:02.805422+0000","last_clean":"2024-05-21T13:36:02.805422+0000","last_became_active":"2024-05-21T13:35:57.787785+0000","last_became_peered":"2024-05-21T13:35:57.787785+0000","last_unstale":"2024-05-21T13:36:02.805422+0000","last_undegraded":"2024-05-21T13:36:02.805422+0000","last_fullsized":"2024-05-21T13:36:02.805422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:51:08.781399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"25'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.964746+0000","last_change":"2024-05-21T13:35:56.760557+0000","last_active":"2024-05-21T13:36:02.964746+0000","last_peered":"2024-05-21T13:36:02.964746+0000","last_clean":"2024-05-21T13:36:02.964746+0000","last_became_active":"2024-05-21T13:35:56.759728+0000","last_became_peered":"2024-05-21T13:35:56.759728+0000","last_unstale":"2024-05-21T13:36:02.964746+0000","last_undegraded":"2024-05-21T13:36:02.964746+0000","last_fullsized":"2024-05-21T13:36:02.964746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:56:19.754940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.962040+0000","last_change":"2024-05-21T13:36:01.861622+0000","last_active":"2024-05-21T13:36:02.962040+0000","last_peered":"2024-05-21T13:36:02.962040+0000","last_clean":"2024-05-21T13:36:02.962040+0000","last_became_active":"2024-05-21T13:36:01.861172+0000","last_became_peered":"2024-05-21T13:36:01.861172+0000","last_unstale":"2024-05-21T13:36:02.962040+0000","last_undegraded":"2024-05-21T13:36:02.962040+0000","last_fullsized":"2024-05-21T13:36:02.962040+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:39:53.211812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-21T13:36:38.729090+0000","last_change":"2024-05-21T13:35:57.804520+0000","last_active":"2024-05-21T13:36:38.729090+0000","last_peered":"2024-05-21T13:36:38.729090+0000","last_clean":"2024-05-21T13:36:38.729090+0000","last_became_active":"2024-05-21T13:35:57.804139+0000","last_became_peered":"2024-05-21T13:35:57.804139+0000","last_unstale":"2024-05-21T13:36:38.729090+0000","last_undegraded":"2024-05-21T13:36:38.729090+0000","last_fullsized":"2024-05-21T13:36:38.729090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:21:52.433019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"25'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:26.902540+0000","last_change":"2024-05-21T13:35:56.733821+0000","last_active":"2024-05-21T13:36:26.902540+0000","last_peered":"2024-05-21T13:36:26.902540+0000","last_clean":"2024-05-21T13:36:26.902540+0000","last_became_active":"2024-05-21T13:35:56.732488+0000","last_became_peered":"2024-05-21T13:35:56.732488+0000","last_unstale":"2024-05-21T13:36:26.902540+0000","last_undegraded":"2024-05-21T13:36:26.902540+0000","last_fullsized":"2024-05-21T13:36:26.902540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:10:01.786931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.961990+0000","last_change":"2024-05-21T13:36:01.868781+0000","last_active":"2024-05-21T13:36:02.961990+0000","last_peered":"2024-05-21T13:36:02.961990+0000","last_clean":"2024-05-21T13:36:02.961990+0000","last_became_active":"2024-05-21T13:36:01.864254+0000","last_became_peered":"2024-05-21T13:36:01.864254+0000","last_unstale":"2024-05-21T13:36:02.961990+0000","last_undegraded":"2024-05-21T13:36:02.961990+0000","last_fullsized":"2024-05-21T13:36:02.961990+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:34:12.632333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.962094+0000","last_change":"2024-05-21T13:35:57.788313+0000","last_active":"2024-05-21T13:36:02.962094+0000","last_peered":"2024-05-21T13:36:02.962094+0000","last_clean":"2024-05-21T13:36:02.962094+0000","last_became_active":"2024-05-21T13:35:57.787963+0000","last_became_peered":"2024-05-21T13:35:57.787963+0000","last_unstale":"2024-05-21T13:36:02.962094+0000","last_undegraded":"2024-05-21T13:36:02.962094+0000","last_fullsized":"2024-05-21T13:36:02.962094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:16:21.586571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"25'3","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:26.903956+0000","last_change":"2024-05-21T13:35:56.748334+0000","last_active":"2024-05-21T13:36:26.903956+0000","last_peered":"2024-05-21T13:36:26.903956+0000","last_clean":"2024-05-21T13:36:26.903956+0000","last_became_active":"2024-05-21T13:35:56.748049+0000","last_became_peered":"2024-05-21T13:35:56.748049+0000","last_unstale":"2024-05-21T13:36:26.903956+0000","last_undegraded":"2024-05-21T13:36:26.903956+0000","last_fullsized":"2024-05-21T13:36:26.903956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:59:02.802905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.807330+0000","last_change":"2024-05-21T13:36:01.856216+0000","last_active":"2024-05-21T13:36:02.807330+0000","last_peered":"2024-05-21T13:36:02.807330+0000","last_clean":"2024-05-21T13:36:02.807330+0000","last_became_active":"2024-05-21T13:36:01.855417+0000","last_became_peered":"2024-05-21T13:36:01.855417+0000","last_unstale":"2024-05-21T13:36:02.807330+0000","last_undegraded":"2024-05-21T13:36:02.807330+0000","last_fullsized":"2024-05-21T13:36:02.807330+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:36:01.423944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.807915+0000","last_change":"2024-05-21T13:36:01.838966+0000","last_active":"2024-05-21T13:36:02.807915+0000","last_peered":"2024-05-21T13:36:02.807915+0000","last_clean":"2024-05-21T13:36:02.807915+0000","last_became_active":"2024-05-21T13:36:01.837777+0000","last_became_peered":"2024-05-21T13:36:01.837777+0000","last_unstale":"2024-05-21T13:36:02.807915+0000","last_undegraded":"2024-05-21T13:36:02.807915+0000","last_fullsized":"2024-05-21T13:36:02.807915+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:40:55.688338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.807274+0000","last_change":"2024-05-21T13:35:57.762719+0000","last_active":"2024-05-21T13:36:02.807274+0000","last_peered":"2024-05-21T13:36:02.807274+0000","last_clean":"2024-05-21T13:36:02.807274+0000","last_became_active":"2024-05-21T13:35:57.762071+0000","last_became_peered":"2024-05-21T13:35:57.762071+0000","last_unstale":"2024-05-21T13:36:02.807274+0000","last_undegraded":"2024-05-21T13:36:02.807274+0000","last_fullsized":"2024-05-21T13:36:02.807274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:55:37.631695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"25'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.805245+0000","last_change":"2024-05-21T13:35:56.751481+0000","last_active":"2024-05-21T13:36:02.805245+0000","last_peered":"2024-05-21T13:36:02.805245+0000","last_clean":"2024-05-21T13:36:02.805245+0000","last_became_active":"2024-05-21T13:35:56.751201+0000","last_became_peered":"2024-05-21T13:35:56.751201+0000","last_unstale":"2024-05-21T13:36:02.805245+0000","last_undegraded":"2024-05-21T13:36:02.805245+0000","last_fullsized":"2024-05-21T13:36:02.805245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:33:28.720246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.806144+0000","last_change":"2024-05-21T13:36:01.837042+0000","last_active":"2024-05-21T13:36:02.806144+0000","last_peered":"2024-05-21T13:36:02.806144+0000","last_clean":"2024-05-21T13:36:02.806144+0000","last_became_active":"2024-05-21T13:36:01.836194+0000","last_became_peered":"2024-05-21T13:36:01.836194+0000","last_unstale":"2024-05-21T13:36:02.806144+0000","last_undegraded":"2024-05-21T13:36:02.806144+0000","last_fullsized":"2024-05-21T13:36:02.806144+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:15:50.751693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-21T13:36:38.727810+0000","last_change":"2024-05-21T13:35:57.788838+0000","last_active":"2024-05-21T13:36:38.727810+0000","last_peered":"2024-05-21T13:36:38.727810+0000","last_clean":"2024-05-21T13:36:38.727810+0000","last_became_active":"2024-05-21T13:35:57.786307+0000","last_became_peered":"2024-05-21T13:35:57.786307+0000","last_unstale":"2024-05-21T13:36:38.727810+0000","last_undegraded":"2024-05-21T13:36:38.727810+0000","last_fullsized":"2024-05-21T13:36:38.727810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:52:09.086807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"25'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:32.021842+0000","last_change":"2024-05-21T13:35:56.746564+0000","last_active":"2024-05-21T13:36:32.021842+0000","last_peered":"2024-05-21T13:36:32.021842+0000","last_clean":"2024-05-21T13:36:32.021842+0000","last_became_active":"2024-05-21T13:35:56.745884+0000","last_became_peered":"2024-05-21T13:35:56.745884+0000","last_unstale":"2024-05-21T13:36:32.021842+0000","last_undegraded":"2024-05-21T13:36:32.021842+0000","last_fullsized":"2024-05-21T13:36:32.021842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:01:44.738607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"25'3","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:32.015963+0000","last_change":"2024-05-21T13:35:56.753930+0000","last_active":"2024-05-21T13:36:32.015963+0000","last_peered":"2024-05-21T13:36:32.015963+0000","last_clean":"2024-05-21T13:36:32.015963+0000","last_became_active":"2024-05-21T13:35:56.753499+0000","last_became_peered":"2024-05-21T13:35:56.753499+0000","last_unstale":"2024-05-21T13:36:32.015963+0000","last_undegraded":"2024-05-21T13:36:32.015963+0000","last_fullsized":"2024-05-21T13:36:32.015963+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:40:51.516544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.808045+0000","last_change":"2024-05-21T13:35:57.780101+0000","last_active":"2024-05-21T13:36:02.808045+0000","last_peered":"2024-05-21T13:36:02.808045+0000","last_clean":"2024-05-21T13:36:02.808045+0000","last_became_active":"2024-05-21T13:35:57.779368+0000","last_became_peered":"2024-05-21T13:35:57.779368+0000","last_unstale":"2024-05-21T13:36:02.808045+0000","last_undegraded":"2024-05-21T13:36:02.808045+0000","last_fullsized":"2024-05-21T13:36:02.808045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:37:39.347067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.808272+0000","last_change":"2024-05-21T13:36:01.844240+0000","last_active":"2024-05-21T13:36:02.808272+0000","last_peered":"2024-05-21T13:36:02.808272+0000","last_clean":"2024-05-21T13:36:02.808272+0000","last_became_active":"2024-05-21T13:36:01.842792+0000","last_became_peered":"2024-05-21T13:36:01.842792+0000","last_unstale":"2024-05-21T13:36:02.808272+0000","last_undegraded":"2024-05-21T13:36:02.808272+0000","last_fullsized":"2024-05-21T13:36:02.808272+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:19:54.016465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"25'5","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-21T13:36:38.728442+0000","last_change":"2024-05-21T13:35:56.770864+0000","last_active":"2024-05-21T13:36:38.728442+0000","last_peered":"2024-05-21T13:36:38.728442+0000","last_clean":"2024-05-21T13:36:38.728442+0000","last_became_active":"2024-05-21T13:35:56.766873+0000","last_became_peered":"2024-05-21T13:35:56.766873+0000","last_unstale":"2024-05-21T13:36:38.728442+0000","last_undegraded":"2024-05-21T13:36:38.728442+0000","last_fullsized":"2024-05-21T13:36:38.728442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:13:02.633858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.963803+0000","last_change":"2024-05-21T13:35:57.787563+0000","last_active":"2024-05-21T13:36:02.963803+0000","last_peered":"2024-05-21T13:36:02.963803+0000","last_clean":"2024-05-21T13:36:02.963803+0000","last_became_active":"2024-05-21T13:35:57.787255+0000","last_became_peered":"2024-05-21T13:35:57.787255+0000","last_unstale":"2024-05-21T13:36:02.963803+0000","last_undegraded":"2024-05-21T13:36:02.963803+0000","last_fullsized":"2024-05-21T13:36:02.963803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:32:49.325049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.964068+0000","last_change":"2024-05-21T13:36:01.868514+0000","last_active":"2024-05-21T13:36:02.964068+0000","last_peered":"2024-05-21T13:36:02.964068+0000","last_clean":"2024-05-21T13:36:02.964068+0000","last_became_active":"2024-05-21T13:36:01.867522+0000","last_became_peered":"2024-05-21T13:36:01.867522+0000","last_unstale":"2024-05-21T13:36:02.964068+0000","last_undegraded":"2024-05-21T13:36:02.964068+0000","last_fullsized":"2024-05-21T13:36:02.964068+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:19:13.533784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.960872+0000","last_change":"2024-05-21T13:35:57.782641+0000","last_active":"2024-05-21T13:36:02.960872+0000","last_peered":"2024-05-21T13:36:02.960872+0000","last_clean":"2024-05-21T13:36:02.960872+0000","last_became_active":"2024-05-21T13:35:57.782233+0000","last_became_peered":"2024-05-21T13:35:57.782233+0000","last_unstale":"2024-05-21T13:36:02.960872+0000","last_undegraded":"2024-05-21T13:36:02.960872+0000","last_fullsized":"2024-05-21T13:36:02.960872+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:55:18.808229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.963845+0000","last_change":"2024-05-21T13:35:57.770591+0000","last_active":"2024-05-21T13:36:02.963845+0000","last_peered":"2024-05-21T13:36:02.963845+0000","last_clean":"2024-05-21T13:36:02.963845+0000","last_became_active":"2024-05-21T13:35:57.769785+0000","last_became_peered":"2024-05-21T13:35:57.769785+0000","last_unstale":"2024-05-21T13:36:02.963845+0000","last_undegraded":"2024-05-21T13:36:02.963845+0000","last_fullsized":"2024-05-21T13:36:02.963845+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:18:28.168393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.805267+0000","last_change":"2024-05-21T13:35:57.799153+0000","last_active":"2024-05-21T13:36:02.805267+0000","last_peered":"2024-05-21T13:36:02.805267+0000","last_clean":"2024-05-21T13:36:02.805267+0000","last_became_active":"2024-05-21T13:35:57.796495+0000","last_became_peered":"2024-05-21T13:35:57.796495+0000","last_unstale":"2024-05-21T13:36:02.805267+0000","last_undegraded":"2024-05-21T13:36:02.805267+0000","last_fullsized":"2024-05-21T13:36:02.805267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:53:04.109036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-21T13:36:38.728181+0000","last_change":"2024-05-21T13:35:57.784335+0000","last_active":"2024-05-21T13:36:38.728181+0000","last_peered":"2024-05-21T13:36:38.728181+0000","last_clean":"2024-05-21T13:36:38.728181+0000","last_became_active":"2024-05-21T13:35:57.783968+0000","last_became_peered":"2024-05-21T13:35:57.783968+0000","last_unstale":"2024-05-21T13:36:38.728181+0000","last_undegraded":"2024-05-21T13:36:38.728181+0000","last_fullsized":"2024-05-21T13:36:38.728181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:57:20.832617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.967890+0000","last_change":"2024-05-21T13:35:57.795153+0000","last_active":"2024-05-21T13:36:02.967890+0000","last_peered":"2024-05-21T13:36:02.967890+0000","last_clean":"2024-05-21T13:36:02.967890+0000","last_became_active":"2024-05-21T13:35:57.794885+0000","last_became_peered":"2024-05-21T13:35:57.794885+0000","last_unstale":"2024-05-21T13:36:02.967890+0000","last_undegraded":"2024-05-21T13:36:02.967890+0000","last_fullsized":"2024-05-21T13:36:02.967890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:17:00.454371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.967778+0000","last_change":"2024-05-21T13:35:57.778916+0000","last_active":"2024-05-21T13:36:02.967778+0000","last_peered":"2024-05-21T13:36:02.967778+0000","last_clean":"2024-05-21T13:36:02.967778+0000","last_became_active":"2024-05-21T13:35:57.778171+0000","last_became_peered":"2024-05-21T13:35:57.778171+0000","last_unstale":"2024-05-21T13:36:02.967778+0000","last_undegraded":"2024-05-21T13:36:02.967778+0000","last_fullsized":"2024-05-21T13:36:02.967778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:15:37.425836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.961364+0000","last_change":"2024-05-21T13:35:57.791367+0000","last_active":"2024-05-21T13:36:02.961364+0000","last_peered":"2024-05-21T13:36:02.961364+0000","last_clean":"2024-05-21T13:36:02.961364+0000","last_became_active":"2024-05-21T13:35:57.790971+0000","last_became_peered":"2024-05-21T13:35:57.790971+0000","last_unstale":"2024-05-21T13:36:02.961364+0000","last_undegraded":"2024-05-21T13:36:02.961364+0000","last_fullsized":"2024-05-21T13:36:02.961364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:14:47.428631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-21T13:36:38.728814+0000","last_change":"2024-05-21T13:35:57.785257+0000","last_active":"2024-05-21T13:36:38.728814+0000","last_peered":"2024-05-21T13:36:38.728814+0000","last_clean":"2024-05-21T13:36:38.728814+0000","last_became_active":"2024-05-21T13:35:57.781533+0000","last_became_peered":"2024-05-21T13:35:57.781533+0000","last_unstale":"2024-05-21T13:36:38.728814+0000","last_undegraded":"2024-05-21T13:36:38.728814+0000","last_fullsized":"2024-05-21T13:36:38.728814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:18:32.591803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.804917+0000","last_change":"2024-05-21T13:35:57.799128+0000","last_active":"2024-05-21T13:36:02.804917+0000","last_peered":"2024-05-21T13:36:02.804917+0000","last_clean":"2024-05-21T13:36:02.804917+0000","last_became_active":"2024-05-21T13:35:57.797044+0000","last_became_peered":"2024-05-21T13:35:57.797044+0000","last_unstale":"2024-05-21T13:36:02.804917+0000","last_undegraded":"2024-05-21T13:36:02.804917+0000","last_fullsized":"2024-05-21T13:36:02.804917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:57:13.472309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-21T13:36:38.727777+0000","last_change":"2024-05-21T13:35:57.789768+0000","last_active":"2024-05-21T13:36:38.727777+0000","last_peered":"2024-05-21T13:36:38.727777+0000","last_clean":"2024-05-21T13:36:38.727777+0000","last_became_active":"2024-05-21T13:35:57.789474+0000","last_became_peered":"2024-05-21T13:35:57.789474+0000","last_unstale":"2024-05-21T13:36:38.727777+0000","last_undegraded":"2024-05-21T13:36:38.727777+0000","last_fullsized":"2024-05-21T13:36:38.727777+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:42:53.993281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.963561+0000","last_change":"2024-05-21T13:35:57.756607+0000","last_active":"2024-05-21T13:36:02.963561+0000","last_peered":"2024-05-21T13:36:02.963561+0000","last_clean":"2024-05-21T13:36:02.963561+0000","last_became_active":"2024-05-21T13:35:57.755889+0000","last_became_peered":"2024-05-21T13:35:57.755889+0000","last_unstale":"2024-05-21T13:36:02.963561+0000","last_undegraded":"2024-05-21T13:36:02.963561+0000","last_fullsized":"2024-05-21T13:36:02.963561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:16:19.541597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.808181+0000","last_change":"2024-05-21T13:35:57.775322+0000","last_active":"2024-05-21T13:36:02.808181+0000","last_peered":"2024-05-21T13:36:02.808181+0000","last_clean":"2024-05-21T13:36:02.808181+0000","last_became_active":"2024-05-21T13:35:57.774386+0000","last_became_peered":"2024-05-21T13:35:57.774386+0000","last_unstale":"2024-05-21T13:36:02.808181+0000","last_undegraded":"2024-05-21T13:36:02.808181+0000","last_fullsized":"2024-05-21T13:36:02.808181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:01:02.106172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.959969+0000","last_change":"2024-05-21T13:35:57.769931+0000","last_active":"2024-05-21T13:36:02.959969+0000","last_peered":"2024-05-21T13:36:02.959969+0000","last_clean":"2024-05-21T13:36:02.959969+0000","last_became_active":"2024-05-21T13:35:57.769149+0000","last_became_peered":"2024-05-21T13:35:57.769149+0000","last_unstale":"2024-05-21T13:36:02.959969+0000","last_undegraded":"2024-05-21T13:36:02.959969+0000","last_fullsized":"2024-05-21T13:36:02.959969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:55:56.268307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.806502+0000","last_change":"2024-05-21T13:35:57.796153+0000","last_active":"2024-05-21T13:36:02.806502+0000","last_peered":"2024-05-21T13:36:02.806502+0000","last_clean":"2024-05-21T13:36:02.806502+0000","last_became_active":"2024-05-21T13:35:57.795799+0000","last_became_peered":"2024-05-21T13:35:57.795799+0000","last_unstale":"2024-05-21T13:36:02.806502+0000","last_undegraded":"2024-05-21T13:36:02.806502+0000","last_fullsized":"2024-05-21T13:36:02.806502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:52:04.794391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.966824+0000","last_change":"2024-05-21T13:35:57.776414+0000","last_active":"2024-05-21T13:36:02.966824+0000","last_peered":"2024-05-21T13:36:02.966824+0000","last_clean":"2024-05-21T13:36:02.966824+0000","last_became_active":"2024-05-21T13:35:57.775573+0000","last_became_peered":"2024-05-21T13:35:57.775573+0000","last_unstale":"2024-05-21T13:36:02.966824+0000","last_undegraded":"2024-05-21T13:36:02.966824+0000","last_fullsized":"2024-05-21T13:36:02.966824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:47:47.624662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.808011+0000","last_change":"2024-05-21T13:35:57.799673+0000","last_active":"2024-05-21T13:36:02.808011+0000","last_peered":"2024-05-21T13:36:02.808011+0000","last_clean":"2024-05-21T13:36:02.808011+0000","last_became_active":"2024-05-21T13:35:57.799313+0000","last_became_peered":"2024-05-21T13:35:57.799313+0000","last_unstale":"2024-05-21T13:36:02.808011+0000","last_undegraded":"2024-05-21T13:36:02.808011+0000","last_fullsized":"2024-05-21T13:36:02.808011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:40:52.516216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.804786+0000","last_change":"2024-05-21T13:35:57.790705+0000","last_active":"2024-05-21T13:36:02.804786+0000","last_peered":"2024-05-21T13:36:02.804786+0000","last_clean":"2024-05-21T13:36:02.804786+0000","last_became_active":"2024-05-21T13:35:57.787735+0000","last_became_peered":"2024-05-21T13:35:57.787735+0000","last_unstale":"2024-05-21T13:36:02.804786+0000","last_undegraded":"2024-05-21T13:36:02.804786+0000","last_fullsized":"2024-05-21T13:36:02.804786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:17:24.376182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-21T13:36:38.727480+0000","last_change":"2024-05-21T13:35:57.786838+0000","last_active":"2024-05-21T13:36:38.727480+0000","last_peered":"2024-05-21T13:36:38.727480+0000","last_clean":"2024-05-21T13:36:38.727480+0000","last_became_active":"2024-05-21T13:35:57.786403+0000","last_became_peered":"2024-05-21T13:35:57.786403+0000","last_unstale":"2024-05-21T13:36:38.727480+0000","last_undegraded":"2024-05-21T13:36:38.727480+0000","last_fullsized":"2024-05-21T13:36:38.727480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:29:28.760793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.966410+0000","last_change":"2024-05-21T13:35:57.783561+0000","last_active":"2024-05-21T13:36:02.966410+0000","last_peered":"2024-05-21T13:36:02.966410+0000","last_clean":"2024-05-21T13:36:02.966410+0000","last_became_active":"2024-05-21T13:35:57.783060+0000","last_became_peered":"2024-05-21T13:35:57.783060+0000","last_unstale":"2024-05-21T13:36:02.966410+0000","last_undegraded":"2024-05-21T13:36:02.966410+0000","last_fullsized":"2024-05-21T13:36:02.966410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:27:27.261449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.964046+0000","last_change":"2024-05-21T13:35:57.788210+0000","last_active":"2024-05-21T13:36:02.964046+0000","last_peered":"2024-05-21T13:36:02.964046+0000","last_clean":"2024-05-21T13:36:02.964046+0000","last_became_active":"2024-05-21T13:35:57.787508+0000","last_became_peered":"2024-05-21T13:35:57.787508+0000","last_unstale":"2024-05-21T13:36:02.964046+0000","last_undegraded":"2024-05-21T13:36:02.964046+0000","last_fullsized":"2024-05-21T13:36:02.964046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:12:56.914580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.959869+0000","last_change":"2024-05-21T13:35:57.787335+0000","last_active":"2024-05-21T13:36:02.959869+0000","last_peered":"2024-05-21T13:36:02.959869+0000","last_clean":"2024-05-21T13:36:02.959869+0000","last_became_active":"2024-05-21T13:35:57.786292+0000","last_became_peered":"2024-05-21T13:35:57.786292+0000","last_unstale":"2024-05-21T13:36:02.959869+0000","last_undegraded":"2024-05-21T13:36:02.959869+0000","last_fullsized":"2024-05-21T13:36:02.959869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:49:40.480948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.960610+0000","last_change":"2024-05-21T13:35:57.801121+0000","last_active":"2024-05-21T13:36:02.960610+0000","last_peered":"2024-05-21T13:36:02.960610+0000","last_clean":"2024-05-21T13:36:02.960610+0000","last_became_active":"2024-05-21T13:35:57.800858+0000","last_became_peered":"2024-05-21T13:35:57.800858+0000","last_unstale":"2024-05-21T13:36:02.960610+0000","last_undegraded":"2024-05-21T13:36:02.960610+0000","last_fullsized":"2024-05-21T13:36:02.960610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:41:08.765821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.959709+0000","last_change":"2024-05-21T13:35:57.778753+0000","last_active":"2024-05-21T13:36:02.959709+0000","last_peered":"2024-05-21T13:36:02.959709+0000","last_clean":"2024-05-21T13:36:02.959709+0000","last_became_active":"2024-05-21T13:35:57.777962+0000","last_became_peered":"2024-05-21T13:35:57.777962+0000","last_unstale":"2024-05-21T13:36:02.959709+0000","last_undegraded":"2024-05-21T13:36:02.959709+0000","last_fullsized":"2024-05-21T13:36:02.959709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:51:49.102945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.963934+0000","last_change":"2024-05-21T13:35:57.798312+0000","last_active":"2024-05-21T13:36:02.963934+0000","last_peered":"2024-05-21T13:36:02.963934+0000","last_clean":"2024-05-21T13:36:02.963934+0000","last_became_active":"2024-05-21T13:35:57.797793+0000","last_became_peered":"2024-05-21T13:35:57.797793+0000","last_unstale":"2024-05-21T13:36:02.963934+0000","last_undegraded":"2024-05-21T13:36:02.963934+0000","last_fullsized":"2024-05-21T13:36:02.963934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:28:47.276868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-21T13:36:38.727461+0000","last_change":"2024-05-21T13:35:57.782412+0000","last_active":"2024-05-21T13:36:38.727461+0000","last_peered":"2024-05-21T13:36:38.727461+0000","last_clean":"2024-05-21T13:36:38.727461+0000","last_became_active":"2024-05-21T13:35:57.782058+0000","last_became_peered":"2024-05-21T13:35:57.782058+0000","last_unstale":"2024-05-21T13:36:38.727461+0000","last_undegraded":"2024-05-21T13:36:38.727461+0000","last_fullsized":"2024-05-21T13:36:38.727461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:39:49.142554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.959879+0000","last_change":"2024-05-21T13:35:57.779771+0000","last_active":"2024-05-21T13:36:02.959879+0000","last_peered":"2024-05-21T13:36:02.959879+0000","last_clean":"2024-05-21T13:36:02.959879+0000","last_became_active":"2024-05-21T13:35:57.779168+0000","last_became_peered":"2024-05-21T13:35:57.779168+0000","last_unstale":"2024-05-21T13:36:02.959879+0000","last_undegraded":"2024-05-21T13:36:02.959879+0000","last_fullsized":"2024-05-21T13:36:02.959879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T13:59:58.966203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.961896+0000","last_change":"2024-05-21T13:35:57.773098+0000","last_active":"2024-05-21T13:36:02.961896+0000","last_peered":"2024-05-21T13:36:02.961896+0000","last_clean":"2024-05-21T13:36:02.961896+0000","last_became_active":"2024-05-21T13:35:57.772268+0000","last_became_peered":"2024-05-21T13:35:57.772268+0000","last_unstale":"2024-05-21T13:36:02.961896+0000","last_undegraded":"2024-05-21T13:36:02.961896+0000","last_fullsized":"2024-05-21T13:36:02.961896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:05:25.482434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.960610+0000","last_change":"2024-05-21T13:35:57.788980+0000","last_active":"2024-05-21T13:36:02.960610+0000","last_peered":"2024-05-21T13:36:02.960610+0000","last_clean":"2024-05-21T13:36:02.960610+0000","last_became_active":"2024-05-21T13:35:57.788689+0000","last_became_peered":"2024-05-21T13:35:57.788689+0000","last_unstale":"2024-05-21T13:36:02.960610+0000","last_undegraded":"2024-05-21T13:36:02.960610+0000","last_fullsized":"2024-05-21T13:36:02.960610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:15:07.615363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.961136+0000","last_change":"2024-05-21T13:35:57.772867+0000","last_active":"2024-05-21T13:36:02.961136+0000","last_peered":"2024-05-21T13:36:02.961136+0000","last_clean":"2024-05-21T13:36:02.961136+0000","last_became_active":"2024-05-21T13:35:57.772160+0000","last_became_peered":"2024-05-21T13:35:57.772160+0000","last_unstale":"2024-05-21T13:36:02.961136+0000","last_undegraded":"2024-05-21T13:36:02.961136+0000","last_fullsized":"2024-05-21T13:36:02.961136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:11:24.428796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-21T13:36:38.728287+0000","last_change":"2024-05-21T13:35:57.785297+0000","last_active":"2024-05-21T13:36:38.728287+0000","last_peered":"2024-05-21T13:36:38.728287+0000","last_clean":"2024-05-21T13:36:38.728287+0000","last_became_active":"2024-05-21T13:35:57.784741+0000","last_became_peered":"2024-05-21T13:35:57.784741+0000","last_unstale":"2024-05-21T13:36:38.728287+0000","last_undegraded":"2024-05-21T13:36:38.728287+0000","last_fullsized":"2024-05-21T13:36:38.728287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:45:08.507286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-21T13:36:38.728614+0000","last_change":"2024-05-21T13:35:57.788875+0000","last_active":"2024-05-21T13:36:38.728614+0000","last_peered":"2024-05-21T13:36:38.728614+0000","last_clean":"2024-05-21T13:36:38.728614+0000","last_became_active":"2024-05-21T13:35:57.786629+0000","last_became_peered":"2024-05-21T13:35:57.786629+0000","last_unstale":"2024-05-21T13:36:38.728614+0000","last_undegraded":"2024-05-21T13:36:38.728614+0000","last_fullsized":"2024-05-21T13:36:38.728614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:40:07.549210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.959984+0000","last_change":"2024-05-21T13:35:57.803316+0000","last_active":"2024-05-21T13:36:02.959984+0000","last_peered":"2024-05-21T13:36:02.959984+0000","last_clean":"2024-05-21T13:36:02.959984+0000","last_became_active":"2024-05-21T13:35:57.802925+0000","last_became_peered":"2024-05-21T13:35:57.802925+0000","last_unstale":"2024-05-21T13:36:02.959984+0000","last_undegraded":"2024-05-21T13:36:02.959984+0000","last_fullsized":"2024-05-21T13:36:02.959984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:17:16.304097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":7452,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":14904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66916,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509454,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":102411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509454,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":270336,"data_stored":102707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509453,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":274432,"data_stored":102729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509454,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":274432,"data_stored":105379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509454,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31500,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340340,"statfs":{"total":96636764160,"available":96604508160,"internally_reserved":0,"allocated":331776,"data_stored":692031,"data_compressed":33458,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509453,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":278528,"data_stored":102819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542157,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":356352,"data_stored":699523,"data_compressed":33458,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574861,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":106913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33458,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33458,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":5410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-21T13:36:42.045 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-21T13:36:42.045 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-21T13:36:42.202 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.225+0000 7fb7008fb640 1 Processor -- start 2024-05-21T13:36:42.203 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.225+0000 7fb7008fb640 1 -- start start 2024-05-21T13:36:42.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.225+0000 7fb7008fb640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb6fc155dc0 0x7fb6fc0c75f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:42.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.225+0000 7fb7008fb640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb6fc0c82b0 0x7fb6fc0c86e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:42.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.225+0000 7fb7008fb640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6fc15ffb0 con 0x7fb6fc15c780 2024-05-21T13:36:42.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.225+0000 7fb7008fb640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7fb6fc0c9170 con 0x7fb6fc0c82b0 2024-05-21T13:36:42.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.225+0000 7fb7008fb640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7fb6fc0c9430 con 0x7fb6fc155dc0 2024-05-21T13:36:42.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.225+0000 7fb6f9d9b640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fb6fc15c780 0x7fb6fc0c9ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:56762/0 (socket says 172.21.15.22:56762) 2024-05-21T13:36:42.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.225+0000 7fb6f9d9b640 1 -- 172.21.15.22:0/1819022076 learned_addr learned my addr 172.21.15.22:0/1819022076 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-21T13:36:42.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.225+0000 7fb6f959a640 1 -- 172.21.15.22:0/1819022076 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2120118723 0 0) 0x7fb6fc15ffb0 con 0x7fb6fc15c780 2024-05-21T13:36:42.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.225+0000 7fb6fa59c640 1 --2- 172.21.15.22:0/1819022076 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb6fc155dc0 0x7fb6fc0c75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:42.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.225+0000 7fb6f959a640 1 -- 172.21.15.22:0/1819022076 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb6e4003530 con 0x7fb6fc15c780 2024-05-21T13:36:42.204 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.225+0000 7fb6fad9d640 1 --2- 172.21.15.22:0/1819022076 >> v2:172.21.15.115:3300/0 conn(0x7fb6fc0c82b0 0x7fb6fc0c86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:42.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.225+0000 7fb6f959a640 1 -- 172.21.15.22:0/1819022076 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3386769688 0 0) 0x7fb6e4003530 con 0x7fb6fc15c780 2024-05-21T13:36:42.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.225+0000 7fb6f959a640 1 -- 172.21.15.22:0/1819022076 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb6fc155dc0 msgr2=0x7fb6fc0c75f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:42.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.225+0000 7fb6f959a640 1 --2- 172.21.15.22:0/1819022076 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb6fc155dc0 0x7fb6fc0c75f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:42.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.225+0000 7fb6f959a640 1 -- 172.21.15.22:0/1819022076 >> v2:172.21.15.115:3300/0 conn(0x7fb6fc0c82b0 msgr2=0x7fb6fc0c86e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:42.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.225+0000 7fb6f959a640 1 --2- 172.21.15.22:0/1819022076 >> v2:172.21.15.115:3300/0 conn(0x7fb6fc0c82b0 0x7fb6fc0c86e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:42.206 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.225+0000 7fb6f959a640 1 -- 172.21.15.22:0/1819022076 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6fc15f1f0 con 0x7fb6fc15c780 2024-05-21T13:36:42.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.225+0000 7fb6f959a640 1 -- 172.21.15.22:0/1819022076 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2684847062 0 0) 0x7fb6f0001700 con 0x7fb6fc15c780 2024-05-21T13:36:42.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.225+0000 7fb6f959a640 1 -- 172.21.15.22:0/1819022076 >> v1:172.21.15.22:6789/0 conn(0x7fb6fc15c780 legacy=0x7fb6fc0c9ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:42.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.225+0000 7fb6f959a640 1 --2- 172.21.15.22:0/1819022076 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb6fc155dc0 0x7fb6e4003a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:42.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.225+0000 7fb6f959a640 1 --2- 172.21.15.22:0/1819022076 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb6e4003fe0 0x7fb6e4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:42.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.225+0000 7fb6f959a640 1 --2- 172.21.15.22:0/1819022076 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6e4004d50 0x7fb6e40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:42.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.225+0000 7fb6f959a640 1 -- 172.21.15.22:0/1819022076 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb6fc0c9170 con 0x7fb6e4004d50 2024-05-21T13:36:42.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.225+0000 7fb6f959a640 1 -- 172.21.15.22:0/1819022076 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fb6fc0c9430 con 0x7fb6e4003fe0 2024-05-21T13:36:42.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.225+0000 7fb6f959a640 1 -- 172.21.15.22:0/1819022076 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7fb6e400bad0 con 0x7fb6fc155dc0 2024-05-21T13:36:42.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.225+0000 7fb6fad9d640 1 --2- 172.21.15.22:0/1819022076 >> v2:172.21.15.115:3300/0 conn(0x7fb6fc0c82b0 0x7fb6fc0c86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T13:36:42.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.225+0000 7fb6fad9d640 1 --2- 172.21.15.22:0/1819022076 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6e4004d50 0x7fb6e40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:42.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.225+0000 7fb6fa59c640 1 --2- 172.21.15.22:0/1819022076 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb6fc155dc0 0x7fb6e4003a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:42.207 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.225+0000 7fb6f9d9b640 1 --2- 172.21.15.22:0/1819022076 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb6e4003fe0 0x7fb6e4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:42.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.225+0000 7fb6fad9d640 1 -- 172.21.15.22:0/1819022076 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb6fc155dc0 msgr2=0x7fb6e4003a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:42.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.225+0000 7fb6fad9d640 1 --2- 172.21.15.22:0/1819022076 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb6fc155dc0 0x7fb6e4003a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:42.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.225+0000 7fb6fad9d640 1 -- 172.21.15.22:0/1819022076 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb6e4003fe0 msgr2=0x7fb6e4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:42.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.225+0000 7fb6fad9d640 1 --2- 172.21.15.22:0/1819022076 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb6e4003fe0 0x7fb6e4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:42.208 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.225+0000 7fb6fad9d640 1 -- 172.21.15.22:0/1819022076 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6e4003530 con 0x7fb6e4004d50 2024-05-21T13:36:42.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.229+0000 7fb6fad9d640 1 --2- 172.21.15.22:0/1819022076 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6e4004d50 0x7fb6e40051d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb6f40098e0 tx=0x7fb6f401c610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54740ee8cd2ee794 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:42.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.229+0000 7fb6f959a640 1 -- 172.21.15.22:0/1819022076 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f40ac070 con 0x7fb6e4004d50 2024-05-21T13:36:42.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.229+0000 7fb6f959a640 1 -- 172.21.15.22:0/1819022076 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6f4004220 con 0x7fb6e4004d50 2024-05-21T13:36:42.209 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.229+0000 7fb6f959a640 1 -- 172.21.15.22:0/1819022076 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6f400f040 con 0x7fb6e4004d50 2024-05-21T13:36:42.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.229+0000 7fb7008fb640 1 -- 172.21.15.22:0/1819022076 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6e4004d50 msgr2=0x7fb6e40051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:42.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.229+0000 7fb7008fb640 1 --2- 172.21.15.22:0/1819022076 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6e4004d50 0x7fb6e40051d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fb6f40098e0 tx=0x7fb6f401c610 comp rx=0 tx=0).stop 2024-05-21T13:36:42.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.229+0000 7fb6fad9d640 1 -- 172.21.15.22:0/1819022076 reap_dead start 2024-05-21T13:36:42.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.229+0000 7fb7008fb640 1 -- 172.21.15.22:0/1819022076 shutdown_connections 2024-05-21T13:36:42.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.229+0000 7fb7008fb640 1 -- 172.21.15.22:0/1819022076 >> 172.21.15.22:0/1819022076 conn(0x7fb6fc06c4f0 msgr2=0x7fb6fc06c900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:42.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.229+0000 7fb7008fb640 1 -- 172.21.15.22:0/1819022076 shutdown_connections 2024-05-21T13:36:42.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.229+0000 7fb7008fb640 1 -- 172.21.15.22:0/1819022076 wait complete. 2024-05-21T13:36:42.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.229+0000 7fb7008fb640 1 Processor -- start 2024-05-21T13:36:42.210 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.229+0000 7fb7008fb640 1 -- start start 2024-05-21T13:36:42.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.233+0000 7fb7008fb640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6fc0c5a90 0x7fb6fc158ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:42.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.233+0000 7fb7008fb640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb6fc0c5e70 0x7fb6fc156840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:42.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.233+0000 7fb7008fb640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb6fc156d80 0x7fb6fc154580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:42.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.233+0000 7fb7008fb640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb6fc15fa90 con 0x7fb6fc0c5a90 2024-05-21T13:36:42.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.233+0000 7fb7008fb640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fb6fc15f7b0 con 0x7fb6fc156d80 2024-05-21T13:36:42.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.233+0000 7fb7008fb640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7fb6fc0ca2b0 con 0x7fb6fc0c5e70 2024-05-21T13:36:42.212 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.233+0000 7fb6fa59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6fc0c5a90 0x7fb6fc158ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:42.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.233+0000 7fb6fa59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6fc0c5a90 0x7fb6fc158ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43268/0 (socket says 172.21.15.22:43268) 2024-05-21T13:36:42.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.233+0000 7fb6fa59c640 1 -- 172.21.15.22:0/2753559984 learned_addr learned my addr 172.21.15.22:0/2753559984 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:42.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.233+0000 7fb6f9d9b640 1 --2- 172.21.15.22:0/2753559984 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb6fc0c5e70 0x7fb6fc156840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:42.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.233+0000 7fb6fad9d640 1 --2- 172.21.15.22:0/2753559984 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb6fc156d80 0x7fb6fc154580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:42.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.233+0000 7fb6fa59c640 1 -- 172.21.15.22:0/2753559984 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb6fc0c5e70 msgr2=0x7fb6fc156840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:42.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.233+0000 7fb6fa59c640 1 --2- 172.21.15.22:0/2753559984 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb6fc0c5e70 0x7fb6fc156840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:42.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.233+0000 7fb6fa59c640 1 -- 172.21.15.22:0/2753559984 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb6fc156d80 msgr2=0x7fb6fc154580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:42.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.233+0000 7fb6fa59c640 1 --2- 172.21.15.22:0/2753559984 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb6fc156d80 0x7fb6fc154580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:42.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.233+0000 7fb6fa59c640 1 -- 172.21.15.22:0/2753559984 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6fc159be0 con 0x7fb6fc0c5a90 2024-05-21T13:36:42.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.233+0000 7fb6fa59c640 1 --2- 172.21.15.22:0/2753559984 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6fc0c5a90 0x7fb6fc158ab0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec007f90 tx=0x7fb6ec011660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:42.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.233+0000 7fb6eaffd640 1 -- 172.21.15.22:0/2753559984 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6ec01a020 con 0x7fb6fc0c5a90 2024-05-21T13:36:42.213 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.233+0000 7fb6eaffd640 1 -- 172.21.15.22:0/2753559984 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6ec011e90 con 0x7fb6fc0c5a90 2024-05-21T13:36:42.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.233+0000 7fb7008fb640 1 -- 172.21.15.22:0/2753559984 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6fc159ec0 con 0x7fb6fc0c5a90 2024-05-21T13:36:42.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.233+0000 7fb6eaffd640 1 -- 172.21.15.22:0/2753559984 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6ec0168c0 con 0x7fb6fc0c5a90 2024-05-21T13:36:42.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.233+0000 7fb7008fb640 1 -- 172.21.15.22:0/2753559984 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6fc15a480 con 0x7fb6fc0c5a90 2024-05-21T13:36:42.214 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.233+0000 7fb7008fb640 1 -- 172.21.15.22:0/2753559984 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6fc077bb0 con 0x7fb6fc0c5a90 2024-05-21T13:36:42.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.233+0000 7fb6eaffd640 1 -- 172.21.15.22:0/2753559984 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fb6ec01d020 con 0x7fb6fc0c5a90 2024-05-21T13:36:42.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.233+0000 7fb6eaffd640 1 --2- 172.21.15.22:0/2753559984 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fb6dc06f400 0x7fb6dc0718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:42.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.233+0000 7fb6eaffd640 1 -- 172.21.15.22:0/2753559984 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7fb6ec0905b0 con 0x7fb6fc0c5a90 2024-05-21T13:36:42.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.233+0000 7fb6f9d9b640 1 --2- 172.21.15.22:0/2753559984 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fb6dc06f400 0x7fb6dc0718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:42.215 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.237+0000 7fb6f9d9b640 1 --2- 172.21.15.22:0/2753559984 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fb6dc06f400 0x7fb6dc0718c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb6f0001020 tx=0x7fb6f0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:42.217 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.237+0000 7fb6eaffd640 1 -- 172.21.15.22:0/2753559984 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fb6ec024020 con 0x7fb6fc0c5a90 2024-05-21T13:36:42.378 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.401+0000 7fb7008fb640 1 -- 172.21.15.22:0/2753559984 --> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb6fc159990 con 0x7fb6dc06f400 2024-05-21T13:36:42.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.421+0000 7fb6eaffd640 1 -- 172.21.15.22:0/2753559984 <== mgr.4103 v2:172.21.15.115:6832/184591771 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332711 (secure 0 0 0) 0x7fb6fc159990 con 0x7fb6dc06f400 2024-05-21T13:36:42.405 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-21T13:36:42.407 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-05-21T13:36:42.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.425+0000 7fb7008fb640 1 -- 172.21.15.22:0/2753559984 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fb6dc06f400 msgr2=0x7fb6dc0718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:42.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.425+0000 7fb7008fb640 1 --2- 172.21.15.22:0/2753559984 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fb6dc06f400 0x7fb6dc0718c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb6f0001020 tx=0x7fb6f0009040 comp rx=0 tx=0).stop 2024-05-21T13:36:42.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.425+0000 7fb7008fb640 1 -- 172.21.15.22:0/2753559984 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6fc0c5a90 msgr2=0x7fb6fc158ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:42.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.425+0000 7fb7008fb640 1 --2- 172.21.15.22:0/2753559984 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6fc0c5a90 0x7fb6fc158ab0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec007f90 tx=0x7fb6ec011660 comp rx=0 tx=0).stop 2024-05-21T13:36:42.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.425+0000 7fb7008fb640 1 -- 172.21.15.22:0/2753559984 shutdown_connections 2024-05-21T13:36:42.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.425+0000 7fb7008fb640 1 --2- 172.21.15.22:0/2753559984 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fb6dc06f400 0x7fb6dc0718c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:42.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.425+0000 7fb7008fb640 1 --2- 172.21.15.22:0/2753559984 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb6fc156d80 0x7fb6fc154580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:42.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.425+0000 7fb7008fb640 1 --2- 172.21.15.22:0/2753559984 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb6fc0c5e70 0x7fb6fc156840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:42.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.425+0000 7fb7008fb640 1 --2- 172.21.15.22:0/2753559984 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6fc0c5a90 0x7fb6fc158ab0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:42.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.425+0000 7fb7008fb640 1 -- 172.21.15.22:0/2753559984 >> 172.21.15.22:0/2753559984 conn(0x7fb6fc06c4f0 msgr2=0x7fb6fc0c72e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:42.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.429+0000 7fb7008fb640 1 -- 172.21.15.22:0/2753559984 shutdown_connections 2024-05-21T13:36:42.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.429+0000 7fb7008fb640 1 -- 172.21.15.22:0/2753559984 wait complete. 2024-05-21T13:36:42.425 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":49,"stamp":"2024-05-21T13:36:40.514958+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":597820,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":228,"num_write_kb":1670,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":183,"ondisk_log_size":183,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":235088,"kb_used_data":2316,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754739632,"statfs":{"total":773094113280,"available":772853383168,"internally_reserved":0,"allocated":2371584,"data_stored":2014512,"data_compressed":66916,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1406,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":40,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.003452"},"pg_stats":[{"pgid":"2.1f","version":"25'9","reported_seq":31,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:32.022623+0000","last_change":"2024-05-21T13:35:56.739488+0000","last_active":"2024-05-21T13:36:32.022623+0000","last_peered":"2024-05-21T13:36:32.022623+0000","last_clean":"2024-05-21T13:36:32.022623+0000","last_became_active":"2024-05-21T13:35:56.738481+0000","last_became_peered":"2024-05-21T13:35:56.738481+0000","last_unstale":"2024-05-21T13:36:32.022623+0000","last_undegraded":"2024-05-21T13:36:32.022623+0000","last_fullsized":"2024-05-21T13:36:32.022623+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:20:48.149770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-21T13:36:38.728860+0000","last_change":"2024-05-21T13:35:57.779462+0000","last_active":"2024-05-21T13:36:38.728860+0000","last_peered":"2024-05-21T13:36:38.728860+0000","last_clean":"2024-05-21T13:36:38.728860+0000","last_became_active":"2024-05-21T13:35:57.778721+0000","last_became_peered":"2024-05-21T13:35:57.778721+0000","last_unstale":"2024-05-21T13:36:38.728860+0000","last_undegraded":"2024-05-21T13:36:38.728860+0000","last_fullsized":"2024-05-21T13:36:38.728860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:13:05.005747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.963696+0000","last_change":"2024-05-21T13:36:01.868203+0000","last_active":"2024-05-21T13:36:02.963696+0000","last_peered":"2024-05-21T13:36:02.963696+0000","last_clean":"2024-05-21T13:36:02.963696+0000","last_became_active":"2024-05-21T13:36:01.864148+0000","last_became_peered":"2024-05-21T13:36:01.864148+0000","last_unstale":"2024-05-21T13:36:02.963696+0000","last_undegraded":"2024-05-21T13:36:02.963696+0000","last_fullsized":"2024-05-21T13:36:02.963696+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T13:57:33.088920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,4,1],"acting":[7,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1e","version":"25'2","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-21T13:36:38.729148+0000","last_change":"2024-05-21T13:35:56.775054+0000","last_active":"2024-05-21T13:36:38.729148+0000","last_peered":"2024-05-21T13:36:38.729148+0000","last_clean":"2024-05-21T13:36:38.729148+0000","last_became_active":"2024-05-21T13:35:56.770566+0000","last_became_peered":"2024-05-21T13:35:56.770566+0000","last_unstale":"2024-05-21T13:36:38.729148+0000","last_undegraded":"2024-05-21T13:36:38.729148+0000","last_fullsized":"2024-05-21T13:36:38.729148+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:05:11.539201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-21T13:36:38.729089+0000","last_change":"2024-05-21T13:35:57.782094+0000","last_active":"2024-05-21T13:36:38.729089+0000","last_peered":"2024-05-21T13:36:38.729089+0000","last_clean":"2024-05-21T13:36:38.729089+0000","last_became_active":"2024-05-21T13:35:57.780590+0000","last_became_peered":"2024-05-21T13:35:57.780590+0000","last_unstale":"2024-05-21T13:36:38.729089+0000","last_undegraded":"2024-05-21T13:36:38.729089+0000","last_fullsized":"2024-05-21T13:36:38.729089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:30:50.929103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.960911+0000","last_change":"2024-05-21T13:36:01.852092+0000","last_active":"2024-05-21T13:36:02.960911+0000","last_peered":"2024-05-21T13:36:02.960911+0000","last_clean":"2024-05-21T13:36:02.960911+0000","last_became_active":"2024-05-21T13:36:01.851745+0000","last_became_peered":"2024-05-21T13:36:01.851745+0000","last_unstale":"2024-05-21T13:36:02.960911+0000","last_undegraded":"2024-05-21T13:36:02.960911+0000","last_fullsized":"2024-05-21T13:36:02.960911+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:57:21.599860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"25'4","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:32.023565+0000","last_change":"2024-05-21T13:35:56.731106+0000","last_active":"2024-05-21T13:36:32.023565+0000","last_peered":"2024-05-21T13:36:32.023565+0000","last_clean":"2024-05-21T13:36:32.023565+0000","last_became_active":"2024-05-21T13:35:56.730746+0000","last_became_peered":"2024-05-21T13:35:56.730746+0000","last_unstale":"2024-05-21T13:36:32.023565+0000","last_undegraded":"2024-05-21T13:36:32.023565+0000","last_fullsized":"2024-05-21T13:36:32.023565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:23:17.798397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.963099+0000","last_change":"2024-05-21T13:35:57.771371+0000","last_active":"2024-05-21T13:36:02.963099+0000","last_peered":"2024-05-21T13:36:02.963099+0000","last_clean":"2024-05-21T13:36:02.963099+0000","last_became_active":"2024-05-21T13:35:57.770595+0000","last_became_peered":"2024-05-21T13:35:57.770595+0000","last_unstale":"2024-05-21T13:36:02.963099+0000","last_undegraded":"2024-05-21T13:36:02.963099+0000","last_fullsized":"2024-05-21T13:36:02.963099+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:53:17.771310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.961202+0000","last_change":"2024-05-21T13:36:01.849638+0000","last_active":"2024-05-21T13:36:02.961202+0000","last_peered":"2024-05-21T13:36:02.961202+0000","last_clean":"2024-05-21T13:36:02.961202+0000","last_became_active":"2024-05-21T13:36:01.848996+0000","last_became_peered":"2024-05-21T13:36:01.848996+0000","last_unstale":"2024-05-21T13:36:02.961202+0000","last_undegraded":"2024-05-21T13:36:02.961202+0000","last_fullsized":"2024-05-21T13:36:02.961202+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:24:31.613874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.960165+0000","last_change":"2024-05-21T13:35:56.737279+0000","last_active":"2024-05-21T13:36:02.960165+0000","last_peered":"2024-05-21T13:36:02.960165+0000","last_clean":"2024-05-21T13:36:02.960165+0000","last_became_active":"2024-05-21T13:35:56.731150+0000","last_became_peered":"2024-05-21T13:35:56.731150+0000","last_unstale":"2024-05-21T13:36:02.960165+0000","last_undegraded":"2024-05-21T13:36:02.960165+0000","last_fullsized":"2024-05-21T13:36:02.960165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:17:07.571294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.806009+0000","last_change":"2024-05-21T13:35:57.799803+0000","last_active":"2024-05-21T13:36:02.806009+0000","last_peered":"2024-05-21T13:36:02.806009+0000","last_clean":"2024-05-21T13:36:02.806009+0000","last_became_active":"2024-05-21T13:35:57.799043+0000","last_became_peered":"2024-05-21T13:35:57.799043+0000","last_unstale":"2024-05-21T13:36:02.806009+0000","last_undegraded":"2024-05-21T13:36:02.806009+0000","last_fullsized":"2024-05-21T13:36:02.806009+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:22:48.607953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.961831+0000","last_change":"2024-05-21T13:36:01.852469+0000","last_active":"2024-05-21T13:36:02.961831+0000","last_peered":"2024-05-21T13:36:02.961831+0000","last_clean":"2024-05-21T13:36:02.961831+0000","last_became_active":"2024-05-21T13:36:01.851913+0000","last_became_peered":"2024-05-21T13:36:01.851913+0000","last_unstale":"2024-05-21T13:36:02.961831+0000","last_undegraded":"2024-05-21T13:36:02.961831+0000","last_fullsized":"2024-05-21T13:36:02.961831+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:42:58.062540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.805533+0000","last_change":"2024-05-21T13:35:57.796516+0000","last_active":"2024-05-21T13:36:02.805533+0000","last_peered":"2024-05-21T13:36:02.805533+0000","last_clean":"2024-05-21T13:36:02.805533+0000","last_became_active":"2024-05-21T13:35:57.795638+0000","last_became_peered":"2024-05-21T13:35:57.795638+0000","last_unstale":"2024-05-21T13:36:02.805533+0000","last_undegraded":"2024-05-21T13:36:02.805533+0000","last_fullsized":"2024-05-21T13:36:02.805533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:46:40.541835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"25'4","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:26.905177+0000","last_change":"2024-05-21T13:35:56.748046+0000","last_active":"2024-05-21T13:36:26.905177+0000","last_peered":"2024-05-21T13:36:26.905177+0000","last_clean":"2024-05-21T13:36:26.905177+0000","last_became_active":"2024-05-21T13:35:56.747635+0000","last_became_peered":"2024-05-21T13:35:56.747635+0000","last_unstale":"2024-05-21T13:36:26.905177+0000","last_undegraded":"2024-05-21T13:36:26.905177+0000","last_fullsized":"2024-05-21T13:36:26.905177+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:52:28.665244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.805864+0000","last_change":"2024-05-21T13:36:01.862153+0000","last_active":"2024-05-21T13:36:02.805864+0000","last_peered":"2024-05-21T13:36:02.805864+0000","last_clean":"2024-05-21T13:36:02.805864+0000","last_became_active":"2024-05-21T13:36:01.861520+0000","last_became_peered":"2024-05-21T13:36:01.861520+0000","last_unstale":"2024-05-21T13:36:02.805864+0000","last_undegraded":"2024-05-21T13:36:02.805864+0000","last_fullsized":"2024-05-21T13:36:02.805864+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:04:37.306132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.964897+0000","last_change":"2024-05-21T13:35:57.786463+0000","last_active":"2024-05-21T13:36:02.964897+0000","last_peered":"2024-05-21T13:36:02.964897+0000","last_clean":"2024-05-21T13:36:02.964897+0000","last_became_active":"2024-05-21T13:35:57.786126+0000","last_became_peered":"2024-05-21T13:35:57.786126+0000","last_unstale":"2024-05-21T13:36:02.964897+0000","last_undegraded":"2024-05-21T13:36:02.964897+0000","last_fullsized":"2024-05-21T13:36:02.964897+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:39:32.076464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"25'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.966972+0000","last_change":"2024-05-21T13:35:56.765178+0000","last_active":"2024-05-21T13:36:02.966972+0000","last_peered":"2024-05-21T13:36:02.966972+0000","last_clean":"2024-05-21T13:36:02.966972+0000","last_became_active":"2024-05-21T13:35:56.764551+0000","last_became_peered":"2024-05-21T13:35:56.764551+0000","last_unstale":"2024-05-21T13:36:02.966972+0000","last_undegraded":"2024-05-21T13:36:02.966972+0000","last_fullsized":"2024-05-21T13:36:02.966972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:34:28.955222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.959609+0000","last_change":"2024-05-21T13:36:01.854410+0000","last_active":"2024-05-21T13:36:02.959609+0000","last_peered":"2024-05-21T13:36:02.959609+0000","last_clean":"2024-05-21T13:36:02.959609+0000","last_became_active":"2024-05-21T13:36:01.853975+0000","last_became_peered":"2024-05-21T13:36:01.853975+0000","last_unstale":"2024-05-21T13:36:02.959609+0000","last_undegraded":"2024-05-21T13:36:02.959609+0000","last_fullsized":"2024-05-21T13:36:02.959609+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:15:34.710504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.807180+0000","last_change":"2024-05-21T13:35:57.762509+0000","last_active":"2024-05-21T13:36:02.807180+0000","last_peered":"2024-05-21T13:36:02.807180+0000","last_clean":"2024-05-21T13:36:02.807180+0000","last_became_active":"2024-05-21T13:35:57.761739+0000","last_became_peered":"2024-05-21T13:35:57.761739+0000","last_unstale":"2024-05-21T13:36:02.807180+0000","last_undegraded":"2024-05-21T13:36:02.807180+0000","last_fullsized":"2024-05-21T13:36:02.807180+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:41:17.911126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"25'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:26.908898+0000","last_change":"2024-05-21T13:35:56.734017+0000","last_active":"2024-05-21T13:36:26.908898+0000","last_peered":"2024-05-21T13:36:26.908898+0000","last_clean":"2024-05-21T13:36:26.908898+0000","last_became_active":"2024-05-21T13:35:56.733249+0000","last_became_peered":"2024-05-21T13:35:56.733249+0000","last_unstale":"2024-05-21T13:36:26.908898+0000","last_undegraded":"2024-05-21T13:36:26.908898+0000","last_fullsized":"2024-05-21T13:36:26.908898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:13:27.279557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.967145+0000","last_change":"2024-05-21T13:36:01.868669+0000","last_active":"2024-05-21T13:36:02.967145+0000","last_peered":"2024-05-21T13:36:02.967145+0000","last_clean":"2024-05-21T13:36:02.967145+0000","last_became_active":"2024-05-21T13:36:01.867701+0000","last_became_peered":"2024-05-21T13:36:01.867701+0000","last_unstale":"2024-05-21T13:36:02.967145+0000","last_undegraded":"2024-05-21T13:36:02.967145+0000","last_fullsized":"2024-05-21T13:36:02.967145+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:09:21.615570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.804889+0000","last_change":"2024-05-21T13:35:57.789966+0000","last_active":"2024-05-21T13:36:02.804889+0000","last_peered":"2024-05-21T13:36:02.804889+0000","last_clean":"2024-05-21T13:36:02.804889+0000","last_became_active":"2024-05-21T13:35:57.789213+0000","last_became_peered":"2024-05-21T13:35:57.789213+0000","last_unstale":"2024-05-21T13:36:02.804889+0000","last_undegraded":"2024-05-21T13:36:02.804889+0000","last_fullsized":"2024-05-21T13:36:02.804889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:33:24.183958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"25'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:26.906102+0000","last_change":"2024-05-21T13:35:56.746878+0000","last_active":"2024-05-21T13:36:26.906102+0000","last_peered":"2024-05-21T13:36:26.906102+0000","last_clean":"2024-05-21T13:36:26.906102+0000","last_became_active":"2024-05-21T13:35:56.746534+0000","last_became_peered":"2024-05-21T13:35:56.746534+0000","last_unstale":"2024-05-21T13:36:26.906102+0000","last_undegraded":"2024-05-21T13:36:26.906102+0000","last_fullsized":"2024-05-21T13:36:26.906102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:45:56.935415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.961481+0000","last_change":"2024-05-21T13:36:01.841632+0000","last_active":"2024-05-21T13:36:02.961481+0000","last_peered":"2024-05-21T13:36:02.961481+0000","last_clean":"2024-05-21T13:36:02.961481+0000","last_became_active":"2024-05-21T13:36:01.841216+0000","last_became_peered":"2024-05-21T13:36:01.841216+0000","last_unstale":"2024-05-21T13:36:02.961481+0000","last_undegraded":"2024-05-21T13:36:02.961481+0000","last_fullsized":"2024-05-21T13:36:02.961481+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:49:05.576221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.807962+0000","last_change":"2024-05-21T13:35:57.764793+0000","last_active":"2024-05-21T13:36:02.807962+0000","last_peered":"2024-05-21T13:36:02.807962+0000","last_clean":"2024-05-21T13:36:02.807962+0000","last_became_active":"2024-05-21T13:35:57.764017+0000","last_became_peered":"2024-05-21T13:35:57.764017+0000","last_unstale":"2024-05-21T13:36:02.807962+0000","last_undegraded":"2024-05-21T13:36:02.807962+0000","last_fullsized":"2024-05-21T13:36:02.807962+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:25:45.006614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"25'4","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:26.906102+0000","last_change":"2024-05-21T13:35:56.752278+0000","last_active":"2024-05-21T13:36:26.906102+0000","last_peered":"2024-05-21T13:36:26.906102+0000","last_clean":"2024-05-21T13:36:26.906102+0000","last_became_active":"2024-05-21T13:35:56.751883+0000","last_became_peered":"2024-05-21T13:35:56.751883+0000","last_unstale":"2024-05-21T13:36:26.906102+0000","last_undegraded":"2024-05-21T13:36:26.906102+0000","last_fullsized":"2024-05-21T13:36:26.906102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:08:05.279701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.961503+0000","last_change":"2024-05-21T13:36:01.832621+0000","last_active":"2024-05-21T13:36:02.961503+0000","last_peered":"2024-05-21T13:36:02.961503+0000","last_clean":"2024-05-21T13:36:02.961503+0000","last_became_active":"2024-05-21T13:36:01.831609+0000","last_became_peered":"2024-05-21T13:36:01.831609+0000","last_unstale":"2024-05-21T13:36:02.961503+0000","last_undegraded":"2024-05-21T13:36:02.961503+0000","last_fullsized":"2024-05-21T13:36:02.961503+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:26:43.075259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.808212+0000","last_change":"2024-05-21T13:35:57.783487+0000","last_active":"2024-05-21T13:36:02.808212+0000","last_peered":"2024-05-21T13:36:02.808212+0000","last_clean":"2024-05-21T13:36:02.808212+0000","last_became_active":"2024-05-21T13:35:57.783150+0000","last_became_peered":"2024-05-21T13:35:57.783150+0000","last_unstale":"2024-05-21T13:36:02.808212+0000","last_undegraded":"2024-05-21T13:36:02.808212+0000","last_fullsized":"2024-05-21T13:36:02.808212+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:14:56.991945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"25'3","reported_seq":25,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:32.021084+0000","last_change":"2024-05-21T13:35:56.745122+0000","last_active":"2024-05-21T13:36:32.021084+0000","last_peered":"2024-05-21T13:36:32.021084+0000","last_clean":"2024-05-21T13:36:32.021084+0000","last_became_active":"2024-05-21T13:35:56.744218+0000","last_became_peered":"2024-05-21T13:35:56.744218+0000","last_unstale":"2024-05-21T13:36:32.021084+0000","last_undegraded":"2024-05-21T13:36:32.021084+0000","last_fullsized":"2024-05-21T13:36:32.021084+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:45:03.790591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.807106+0000","last_change":"2024-05-21T13:36:01.838971+0000","last_active":"2024-05-21T13:36:02.807106+0000","last_peered":"2024-05-21T13:36:02.807106+0000","last_clean":"2024-05-21T13:36:02.807106+0000","last_became_active":"2024-05-21T13:36:01.837401+0000","last_became_peered":"2024-05-21T13:36:01.837401+0000","last_unstale":"2024-05-21T13:36:02.807106+0000","last_undegraded":"2024-05-21T13:36:02.807106+0000","last_fullsized":"2024-05-21T13:36:02.807106+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:16:25.666568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.967981+0000","last_change":"2024-05-21T13:35:57.784993+0000","last_active":"2024-05-21T13:36:02.967981+0000","last_peered":"2024-05-21T13:36:02.967981+0000","last_clean":"2024-05-21T13:36:02.967981+0000","last_became_active":"2024-05-21T13:35:57.784664+0000","last_became_peered":"2024-05-21T13:35:57.784664+0000","last_unstale":"2024-05-21T13:36:02.967981+0000","last_undegraded":"2024-05-21T13:36:02.967981+0000","last_fullsized":"2024-05-21T13:36:02.967981+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:58:20.045901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"25'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.806918+0000","last_change":"2024-05-21T13:35:56.741285+0000","last_active":"2024-05-21T13:36:02.806918+0000","last_peered":"2024-05-21T13:36:02.806918+0000","last_clean":"2024-05-21T13:36:02.806918+0000","last_became_active":"2024-05-21T13:35:56.740846+0000","last_became_peered":"2024-05-21T13:35:56.740846+0000","last_unstale":"2024-05-21T13:36:02.806918+0000","last_undegraded":"2024-05-21T13:36:02.806918+0000","last_fullsized":"2024-05-21T13:36:02.806918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:34:17.960870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.963587+0000","last_change":"2024-05-21T13:36:01.873172+0000","last_active":"2024-05-21T13:36:02.963587+0000","last_peered":"2024-05-21T13:36:02.963587+0000","last_clean":"2024-05-21T13:36:02.963587+0000","last_became_active":"2024-05-21T13:36:01.872085+0000","last_became_peered":"2024-05-21T13:36:01.872085+0000","last_unstale":"2024-05-21T13:36:02.963587+0000","last_undegraded":"2024-05-21T13:36:02.963587+0000","last_fullsized":"2024-05-21T13:36:02.963587+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:24:57.031323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.961092+0000","last_change":"2024-05-21T13:35:57.783176+0000","last_active":"2024-05-21T13:36:02.961092+0000","last_peered":"2024-05-21T13:36:02.961092+0000","last_clean":"2024-05-21T13:36:02.961092+0000","last_became_active":"2024-05-21T13:35:57.782517+0000","last_became_peered":"2024-05-21T13:35:57.782517+0000","last_unstale":"2024-05-21T13:36:02.961092+0000","last_undegraded":"2024-05-21T13:36:02.961092+0000","last_fullsized":"2024-05-21T13:36:02.961092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:06:58.203996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-21T13:36:38.728215+0000","last_change":"2024-05-21T13:35:56.767544+0000","last_active":"2024-05-21T13:36:38.728215+0000","last_peered":"2024-05-21T13:36:38.728215+0000","last_clean":"2024-05-21T13:36:38.728215+0000","last_became_active":"2024-05-21T13:35:56.764987+0000","last_became_peered":"2024-05-21T13:35:56.764987+0000","last_unstale":"2024-05-21T13:36:38.728215+0000","last_undegraded":"2024-05-21T13:36:38.728215+0000","last_fullsized":"2024-05-21T13:36:38.728215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:12:46.828769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.966223+0000","last_change":"2024-05-21T13:36:01.872215+0000","last_active":"2024-05-21T13:36:02.966223+0000","last_peered":"2024-05-21T13:36:02.966223+0000","last_clean":"2024-05-21T13:36:02.966223+0000","last_became_active":"2024-05-21T13:36:01.870831+0000","last_became_peered":"2024-05-21T13:36:01.870831+0000","last_unstale":"2024-05-21T13:36:02.966223+0000","last_undegraded":"2024-05-21T13:36:02.966223+0000","last_fullsized":"2024-05-21T13:36:02.966223+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:04:09.689206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.959882+0000","last_change":"2024-05-21T13:35:57.783616+0000","last_active":"2024-05-21T13:36:02.959882+0000","last_peered":"2024-05-21T13:36:02.959882+0000","last_clean":"2024-05-21T13:36:02.959882+0000","last_became_active":"2024-05-21T13:35:57.780521+0000","last_became_peered":"2024-05-21T13:35:57.780521+0000","last_unstale":"2024-05-21T13:36:02.959882+0000","last_undegraded":"2024-05-21T13:36:02.959882+0000","last_fullsized":"2024-05-21T13:36:02.959882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:59:44.121631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"25'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.806903+0000","last_change":"2024-05-21T13:35:56.750341+0000","last_active":"2024-05-21T13:36:02.806903+0000","last_peered":"2024-05-21T13:36:02.806903+0000","last_clean":"2024-05-21T13:36:02.806903+0000","last_became_active":"2024-05-21T13:35:56.750006+0000","last_became_peered":"2024-05-21T13:35:56.750006+0000","last_unstale":"2024-05-21T13:36:02.806903+0000","last_undegraded":"2024-05-21T13:36:02.806903+0000","last_fullsized":"2024-05-21T13:36:02.806903+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:15:21.416234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.967726+0000","last_change":"2024-05-21T13:36:01.873693+0000","last_active":"2024-05-21T13:36:02.967726+0000","last_peered":"2024-05-21T13:36:02.967726+0000","last_clean":"2024-05-21T13:36:02.967726+0000","last_became_active":"2024-05-21T13:36:01.872363+0000","last_became_peered":"2024-05-21T13:36:01.872363+0000","last_unstale":"2024-05-21T13:36:02.967726+0000","last_undegraded":"2024-05-21T13:36:02.967726+0000","last_fullsized":"2024-05-21T13:36:02.967726+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:27:25.974289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-21T13:36:38.727538+0000","last_change":"2024-05-21T13:35:57.780809+0000","last_active":"2024-05-21T13:36:38.727538+0000","last_peered":"2024-05-21T13:36:38.727538+0000","last_clean":"2024-05-21T13:36:38.727538+0000","last_became_active":"2024-05-21T13:35:57.780313+0000","last_became_peered":"2024-05-21T13:35:57.780313+0000","last_unstale":"2024-05-21T13:36:38.727538+0000","last_undegraded":"2024-05-21T13:36:38.727538+0000","last_fullsized":"2024-05-21T13:36:38.727538+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:43:11.778238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"25'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:32.025109+0000","last_change":"2024-05-21T13:35:56.771138+0000","last_active":"2024-05-21T13:36:32.025109+0000","last_peered":"2024-05-21T13:36:32.025109+0000","last_clean":"2024-05-21T13:36:32.025109+0000","last_became_active":"2024-05-21T13:35:56.770465+0000","last_became_peered":"2024-05-21T13:35:56.770465+0000","last_unstale":"2024-05-21T13:36:32.025109+0000","last_undegraded":"2024-05-21T13:36:32.025109+0000","last_fullsized":"2024-05-21T13:36:32.025109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:21:16.702309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.968200+0000","last_change":"2024-05-21T13:36:01.871328+0000","last_active":"2024-05-21T13:36:02.968200+0000","last_peered":"2024-05-21T13:36:02.968200+0000","last_clean":"2024-05-21T13:36:02.968200+0000","last_became_active":"2024-05-21T13:36:01.870678+0000","last_became_peered":"2024-05-21T13:36:01.870678+0000","last_unstale":"2024-05-21T13:36:02.968200+0000","last_undegraded":"2024-05-21T13:36:02.968200+0000","last_fullsized":"2024-05-21T13:36:02.968200+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:22:47.393065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.962506+0000","last_change":"2024-05-21T13:35:57.782665+0000","last_active":"2024-05-21T13:36:02.962506+0000","last_peered":"2024-05-21T13:36:02.962506+0000","last_clean":"2024-05-21T13:36:02.962506+0000","last_became_active":"2024-05-21T13:35:57.781299+0000","last_became_peered":"2024-05-21T13:35:57.781299+0000","last_unstale":"2024-05-21T13:36:02.962506+0000","last_undegraded":"2024-05-21T13:36:02.962506+0000","last_fullsized":"2024-05-21T13:36:02.962506+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:21:22.721124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"25'3","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:32.019985+0000","last_change":"2024-05-21T13:35:56.768193+0000","last_active":"2024-05-21T13:36:32.019985+0000","last_peered":"2024-05-21T13:36:32.019985+0000","last_clean":"2024-05-21T13:36:32.019985+0000","last_became_active":"2024-05-21T13:35:56.767788+0000","last_became_peered":"2024-05-21T13:35:56.767788+0000","last_unstale":"2024-05-21T13:36:32.019985+0000","last_undegraded":"2024-05-21T13:36:32.019985+0000","last_fullsized":"2024-05-21T13:36:32.019985+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:12:52.911816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-21T13:36:38.728339+0000","last_change":"2024-05-21T13:36:01.860305+0000","last_active":"2024-05-21T13:36:38.728339+0000","last_peered":"2024-05-21T13:36:38.728339+0000","last_clean":"2024-05-21T13:36:38.728339+0000","last_became_active":"2024-05-21T13:36:01.859141+0000","last_became_peered":"2024-05-21T13:36:01.859141+0000","last_unstale":"2024-05-21T13:36:38.728339+0000","last_undegraded":"2024-05-21T13:36:38.728339+0000","last_fullsized":"2024-05-21T13:36:38.728339+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:05:45.203241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.807817+0000","last_change":"2024-05-21T13:35:57.775523+0000","last_active":"2024-05-21T13:36:02.807817+0000","last_peered":"2024-05-21T13:36:02.807817+0000","last_clean":"2024-05-21T13:36:02.807817+0000","last_became_active":"2024-05-21T13:35:57.774322+0000","last_became_peered":"2024-05-21T13:35:57.774322+0000","last_unstale":"2024-05-21T13:36:02.807817+0000","last_undegraded":"2024-05-21T13:36:02.807817+0000","last_fullsized":"2024-05-21T13:36:02.807817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:06:35.118540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"25'3","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:26.905395+0000","last_change":"2024-05-21T13:35:56.748185+0000","last_active":"2024-05-21T13:36:26.905395+0000","last_peered":"2024-05-21T13:36:26.905395+0000","last_clean":"2024-05-21T13:36:26.905395+0000","last_became_active":"2024-05-21T13:35:56.747823+0000","last_became_peered":"2024-05-21T13:35:56.747823+0000","last_unstale":"2024-05-21T13:36:26.905395+0000","last_undegraded":"2024-05-21T13:36:26.905395+0000","last_fullsized":"2024-05-21T13:36:26.905395+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:38:00.235330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":117,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.963125+0000","last_change":"2024-05-21T13:35:45.682484+0000","last_active":"2024-05-21T13:36:02.963125+0000","last_peered":"2024-05-21T13:36:02.963125+0000","last_clean":"2024-05-21T13:36:02.963125+0000","last_became_active":"2024-05-21T13:35:45.680732+0000","last_became_peered":"2024-05-21T13:35:45.680732+0000","last_unstale":"2024-05-21T13:36:02.963125+0000","last_undegraded":"2024-05-21T13:36:02.963125+0000","last_fullsized":"2024-05-21T13:36:02.963125+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:44.542324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:44.542324+0000","last_clean_scrub_stamp":"2024-05-21T13:35:44.542324+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:16:05.034161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.806631+0000","last_change":"2024-05-21T13:36:01.830034+0000","last_active":"2024-05-21T13:36:02.806631+0000","last_peered":"2024-05-21T13:36:02.806631+0000","last_clean":"2024-05-21T13:36:02.806631+0000","last_became_active":"2024-05-21T13:36:01.828957+0000","last_became_peered":"2024-05-21T13:36:01.828957+0000","last_unstale":"2024-05-21T13:36:02.806631+0000","last_undegraded":"2024-05-21T13:36:02.806631+0000","last_fullsized":"2024-05-21T13:36:02.806631+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:21:59.514268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.806258+0000","last_change":"2024-05-21T13:35:57.796419+0000","last_active":"2024-05-21T13:36:02.806258+0000","last_peered":"2024-05-21T13:36:02.806258+0000","last_clean":"2024-05-21T13:36:02.806258+0000","last_became_active":"2024-05-21T13:35:57.796050+0000","last_became_peered":"2024-05-21T13:35:57.796050+0000","last_unstale":"2024-05-21T13:36:02.806258+0000","last_undegraded":"2024-05-21T13:36:02.806258+0000","last_fullsized":"2024-05-21T13:36:02.806258+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:56:07.121391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"25'3","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:32.024966+0000","last_change":"2024-05-21T13:35:56.751619+0000","last_active":"2024-05-21T13:36:32.024966+0000","last_peered":"2024-05-21T13:36:32.024966+0000","last_clean":"2024-05-21T13:36:32.024966+0000","last_became_active":"2024-05-21T13:35:56.748604+0000","last_became_peered":"2024-05-21T13:35:56.748604+0000","last_unstale":"2024-05-21T13:36:32.024966+0000","last_undegraded":"2024-05-21T13:36:32.024966+0000","last_fullsized":"2024-05-21T13:36:32.024966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:19:03.052434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.961835+0000","last_change":"2024-05-21T13:36:01.825464+0000","last_active":"2024-05-21T13:36:02.961835+0000","last_peered":"2024-05-21T13:36:02.961835+0000","last_clean":"2024-05-21T13:36:02.961835+0000","last_became_active":"2024-05-21T13:36:01.824653+0000","last_became_peered":"2024-05-21T13:36:01.824653+0000","last_unstale":"2024-05-21T13:36:02.961835+0000","last_undegraded":"2024-05-21T13:36:02.961835+0000","last_fullsized":"2024-05-21T13:36:02.961835+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:29:32.830052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.960114+0000","last_change":"2024-05-21T13:35:57.784031+0000","last_active":"2024-05-21T13:36:02.960114+0000","last_peered":"2024-05-21T13:36:02.960114+0000","last_clean":"2024-05-21T13:36:02.960114+0000","last_became_active":"2024-05-21T13:35:57.771695+0000","last_became_peered":"2024-05-21T13:35:57.771695+0000","last_unstale":"2024-05-21T13:36:02.960114+0000","last_undegraded":"2024-05-21T13:36:02.960114+0000","last_fullsized":"2024-05-21T13:36:02.960114+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:46:33.308257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-21T13:36:38.728564+0000","last_change":"2024-05-21T13:35:56.768166+0000","last_active":"2024-05-21T13:36:38.728564+0000","last_peered":"2024-05-21T13:36:38.728564+0000","last_clean":"2024-05-21T13:36:38.728564+0000","last_became_active":"2024-05-21T13:35:56.767053+0000","last_became_peered":"2024-05-21T13:35:56.767053+0000","last_unstale":"2024-05-21T13:36:38.728564+0000","last_undegraded":"2024-05-21T13:36:38.728564+0000","last_fullsized":"2024-05-21T13:36:38.728564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:10:16.639491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-21T13:36:38.728163+0000","last_change":"2024-05-21T13:36:01.834253+0000","last_active":"2024-05-21T13:36:38.728163+0000","last_peered":"2024-05-21T13:36:38.728163+0000","last_clean":"2024-05-21T13:36:38.728163+0000","last_became_active":"2024-05-21T13:36:01.832972+0000","last_became_peered":"2024-05-21T13:36:01.832972+0000","last_unstale":"2024-05-21T13:36:38.728163+0000","last_undegraded":"2024-05-21T13:36:38.728163+0000","last_fullsized":"2024-05-21T13:36:38.728163+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:52:05.576063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.960150+0000","last_change":"2024-05-21T13:35:57.766504+0000","last_active":"2024-05-21T13:36:02.960150+0000","last_peered":"2024-05-21T13:36:02.960150+0000","last_clean":"2024-05-21T13:36:02.960150+0000","last_became_active":"2024-05-21T13:35:57.765756+0000","last_became_peered":"2024-05-21T13:35:57.765756+0000","last_unstale":"2024-05-21T13:36:02.960150+0000","last_undegraded":"2024-05-21T13:36:02.960150+0000","last_fullsized":"2024-05-21T13:36:02.960150+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:52:13.025110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.808071+0000","last_change":"2024-05-21T13:35:56.770347+0000","last_active":"2024-05-21T13:36:02.808071+0000","last_peered":"2024-05-21T13:36:02.808071+0000","last_clean":"2024-05-21T13:36:02.808071+0000","last_became_active":"2024-05-21T13:35:56.769767+0000","last_became_peered":"2024-05-21T13:35:56.769767+0000","last_unstale":"2024-05-21T13:36:02.808071+0000","last_undegraded":"2024-05-21T13:36:02.808071+0000","last_fullsized":"2024-05-21T13:36:02.808071+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:40:01.698967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.804632+0000","last_change":"2024-05-21T13:36:01.827091+0000","last_active":"2024-05-21T13:36:02.804632+0000","last_peered":"2024-05-21T13:36:02.804632+0000","last_clean":"2024-05-21T13:36:02.804632+0000","last_became_active":"2024-05-21T13:36:01.826686+0000","last_became_peered":"2024-05-21T13:36:01.826686+0000","last_unstale":"2024-05-21T13:36:02.804632+0000","last_undegraded":"2024-05-21T13:36:02.804632+0000","last_fullsized":"2024-05-21T13:36:02.804632+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:42:47.638921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.962149+0000","last_change":"2024-05-21T13:35:57.781528+0000","last_active":"2024-05-21T13:36:02.962149+0000","last_peered":"2024-05-21T13:36:02.962149+0000","last_clean":"2024-05-21T13:36:02.962149+0000","last_became_active":"2024-05-21T13:35:57.781111+0000","last_became_peered":"2024-05-21T13:35:57.781111+0000","last_unstale":"2024-05-21T13:36:02.962149+0000","last_undegraded":"2024-05-21T13:36:02.962149+0000","last_fullsized":"2024-05-21T13:36:02.962149+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:15:43.847640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"24'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.960114+0000","last_change":"2024-05-21T13:35:56.755413+0000","last_active":"2024-05-21T13:36:02.960114+0000","last_peered":"2024-05-21T13:36:02.960114+0000","last_clean":"2024-05-21T13:36:02.960114+0000","last_became_active":"2024-05-21T13:35:56.755158+0000","last_became_peered":"2024-05-21T13:35:56.755158+0000","last_unstale":"2024-05-21T13:36:02.960114+0000","last_undegraded":"2024-05-21T13:36:02.960114+0000","last_fullsized":"2024-05-21T13:36:02.960114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:23:05.102098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.962809+0000","last_change":"2024-05-21T13:36:01.827237+0000","last_active":"2024-05-21T13:36:02.962809+0000","last_peered":"2024-05-21T13:36:02.962809+0000","last_clean":"2024-05-21T13:36:02.962809+0000","last_became_active":"2024-05-21T13:36:01.826374+0000","last_became_peered":"2024-05-21T13:36:01.826374+0000","last_unstale":"2024-05-21T13:36:02.962809+0000","last_undegraded":"2024-05-21T13:36:02.962809+0000","last_fullsized":"2024-05-21T13:36:02.962809+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:12:33.528068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.804889+0000","last_change":"2024-05-21T13:35:57.787940+0000","last_active":"2024-05-21T13:36:02.804889+0000","last_peered":"2024-05-21T13:36:02.804889+0000","last_clean":"2024-05-21T13:36:02.804889+0000","last_became_active":"2024-05-21T13:35:57.787544+0000","last_became_peered":"2024-05-21T13:35:57.787544+0000","last_unstale":"2024-05-21T13:36:02.804889+0000","last_undegraded":"2024-05-21T13:36:02.804889+0000","last_fullsized":"2024-05-21T13:36:02.804889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:46:20.335316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"25'15","reported_seq":37,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:32.027063+0000","last_change":"2024-05-21T13:35:56.756262+0000","last_active":"2024-05-21T13:36:32.027063+0000","last_peered":"2024-05-21T13:36:32.027063+0000","last_clean":"2024-05-21T13:36:32.027063+0000","last_became_active":"2024-05-21T13:35:56.752342+0000","last_became_peered":"2024-05-21T13:35:56.752342+0000","last_unstale":"2024-05-21T13:36:32.027063+0000","last_undegraded":"2024-05-21T13:36:32.027063+0000","last_fullsized":"2024-05-21T13:36:32.027063+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:59:09.541382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-21T13:36:38.728680+0000","last_change":"2024-05-21T13:36:01.859498+0000","last_active":"2024-05-21T13:36:38.728680+0000","last_peered":"2024-05-21T13:36:38.728680+0000","last_clean":"2024-05-21T13:36:38.728680+0000","last_became_active":"2024-05-21T13:36:01.857707+0000","last_became_peered":"2024-05-21T13:36:01.857707+0000","last_unstale":"2024-05-21T13:36:38.728680+0000","last_undegraded":"2024-05-21T13:36:38.728680+0000","last_fullsized":"2024-05-21T13:36:38.728680+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:38:06.966814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.962835+0000","last_change":"2024-05-21T13:35:57.783007+0000","last_active":"2024-05-21T13:36:02.962835+0000","last_peered":"2024-05-21T13:36:02.962835+0000","last_clean":"2024-05-21T13:36:02.962835+0000","last_became_active":"2024-05-21T13:35:57.782330+0000","last_became_peered":"2024-05-21T13:35:57.782330+0000","last_unstale":"2024-05-21T13:36:02.962835+0000","last_undegraded":"2024-05-21T13:36:02.962835+0000","last_fullsized":"2024-05-21T13:36:02.962835+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:26:14.697766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"25'3","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:32.023577+0000","last_change":"2024-05-21T13:35:56.745787+0000","last_active":"2024-05-21T13:36:32.023577+0000","last_peered":"2024-05-21T13:36:32.023577+0000","last_clean":"2024-05-21T13:36:32.023577+0000","last_became_active":"2024-05-21T13:35:56.745202+0000","last_became_peered":"2024-05-21T13:35:56.745202+0000","last_unstale":"2024-05-21T13:36:32.023577+0000","last_undegraded":"2024-05-21T13:36:32.023577+0000","last_fullsized":"2024-05-21T13:36:32.023577+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:31:13.498003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":16,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-21T13:36:38.728909+0000","last_change":"2024-05-21T13:36:01.858550+0000","last_active":"2024-05-21T13:36:38.728909+0000","last_peered":"2024-05-21T13:36:38.728909+0000","last_clean":"2024-05-21T13:36:38.728909+0000","last_became_active":"2024-05-21T13:36:01.857716+0000","last_became_peered":"2024-05-21T13:36:01.857716+0000","last_unstale":"2024-05-21T13:36:38.728909+0000","last_undegraded":"2024-05-21T13:36:38.728909+0000","last_fullsized":"2024-05-21T13:36:38.728909+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:48:32.490678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.805527+0000","last_change":"2024-05-21T13:35:57.799702+0000","last_active":"2024-05-21T13:36:02.805527+0000","last_peered":"2024-05-21T13:36:02.805527+0000","last_clean":"2024-05-21T13:36:02.805527+0000","last_became_active":"2024-05-21T13:35:57.799225+0000","last_became_peered":"2024-05-21T13:35:57.799225+0000","last_unstale":"2024-05-21T13:36:02.805527+0000","last_undegraded":"2024-05-21T13:36:02.805527+0000","last_fullsized":"2024-05-21T13:36:02.805527+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:29:54.094448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"25'3","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:26.904458+0000","last_change":"2024-05-21T13:35:56.742650+0000","last_active":"2024-05-21T13:36:26.904458+0000","last_peered":"2024-05-21T13:36:26.904458+0000","last_clean":"2024-05-21T13:36:26.904458+0000","last_became_active":"2024-05-21T13:35:56.742296+0000","last_became_peered":"2024-05-21T13:35:56.742296+0000","last_unstale":"2024-05-21T13:36:26.904458+0000","last_undegraded":"2024-05-21T13:36:26.904458+0000","last_fullsized":"2024-05-21T13:36:26.904458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:18:55.514845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.967634+0000","last_change":"2024-05-21T13:36:01.873708+0000","last_active":"2024-05-21T13:36:02.967634+0000","last_peered":"2024-05-21T13:36:02.967634+0000","last_clean":"2024-05-21T13:36:02.967634+0000","last_became_active":"2024-05-21T13:36:01.872320+0000","last_became_peered":"2024-05-21T13:36:01.872320+0000","last_unstale":"2024-05-21T13:36:02.967634+0000","last_undegraded":"2024-05-21T13:36:02.967634+0000","last_fullsized":"2024-05-21T13:36:02.967634+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:01:15.545756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.966606+0000","last_change":"2024-05-21T13:35:57.802763+0000","last_active":"2024-05-21T13:36:02.966606+0000","last_peered":"2024-05-21T13:36:02.966606+0000","last_clean":"2024-05-21T13:36:02.966606+0000","last_became_active":"2024-05-21T13:35:57.802433+0000","last_became_peered":"2024-05-21T13:35:57.802433+0000","last_unstale":"2024-05-21T13:36:02.966606+0000","last_undegraded":"2024-05-21T13:36:02.966606+0000","last_fullsized":"2024-05-21T13:36:02.966606+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:09:48.463186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"25'6","reported_seq":28,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:32.021995+0000","last_change":"2024-05-21T13:35:56.754087+0000","last_active":"2024-05-21T13:36:32.021995+0000","last_peered":"2024-05-21T13:36:32.021995+0000","last_clean":"2024-05-21T13:36:32.021995+0000","last_became_active":"2024-05-21T13:35:56.753319+0000","last_became_peered":"2024-05-21T13:35:56.753319+0000","last_unstale":"2024-05-21T13:36:32.021995+0000","last_undegraded":"2024-05-21T13:36:32.021995+0000","last_fullsized":"2024-05-21T13:36:32.021995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:19:21.276993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.806089+0000","last_change":"2024-05-21T13:36:01.836017+0000","last_active":"2024-05-21T13:36:02.806089+0000","last_peered":"2024-05-21T13:36:02.806089+0000","last_clean":"2024-05-21T13:36:02.806089+0000","last_became_active":"2024-05-21T13:36:01.835450+0000","last_became_peered":"2024-05-21T13:36:01.835450+0000","last_unstale":"2024-05-21T13:36:02.806089+0000","last_undegraded":"2024-05-21T13:36:02.806089+0000","last_fullsized":"2024-05-21T13:36:02.806089+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:05:56.077605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.962152+0000","last_change":"2024-05-21T13:35:57.787177+0000","last_active":"2024-05-21T13:36:02.962152+0000","last_peered":"2024-05-21T13:36:02.962152+0000","last_clean":"2024-05-21T13:36:02.962152+0000","last_became_active":"2024-05-21T13:35:57.786401+0000","last_became_peered":"2024-05-21T13:35:57.786401+0000","last_unstale":"2024-05-21T13:36:02.962152+0000","last_undegraded":"2024-05-21T13:36:02.962152+0000","last_fullsized":"2024-05-21T13:36:02.962152+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:17:18.939002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"25'11","reported_seq":33,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:26.902139+0000","last_change":"2024-05-21T13:35:56.751229+0000","last_active":"2024-05-21T13:36:26.902139+0000","last_peered":"2024-05-21T13:36:26.902139+0000","last_clean":"2024-05-21T13:36:26.902139+0000","last_became_active":"2024-05-21T13:35:56.750831+0000","last_became_peered":"2024-05-21T13:35:56.750831+0000","last_unstale":"2024-05-21T13:36:26.902139+0000","last_undegraded":"2024-05-21T13:36:26.902139+0000","last_fullsized":"2024-05-21T13:36:26.902139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:03:40.186241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.807730+0000","last_change":"2024-05-21T13:36:01.832691+0000","last_active":"2024-05-21T13:36:02.807730+0000","last_peered":"2024-05-21T13:36:02.807730+0000","last_clean":"2024-05-21T13:36:02.807730+0000","last_became_active":"2024-05-21T13:36:01.831476+0000","last_became_peered":"2024-05-21T13:36:01.831476+0000","last_unstale":"2024-05-21T13:36:02.807730+0000","last_undegraded":"2024-05-21T13:36:02.807730+0000","last_fullsized":"2024-05-21T13:36:02.807730+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:08:38.092592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.805422+0000","last_change":"2024-05-21T13:35:57.788547+0000","last_active":"2024-05-21T13:36:02.805422+0000","last_peered":"2024-05-21T13:36:02.805422+0000","last_clean":"2024-05-21T13:36:02.805422+0000","last_became_active":"2024-05-21T13:35:57.787785+0000","last_became_peered":"2024-05-21T13:35:57.787785+0000","last_unstale":"2024-05-21T13:36:02.805422+0000","last_undegraded":"2024-05-21T13:36:02.805422+0000","last_fullsized":"2024-05-21T13:36:02.805422+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:51:08.781399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"25'4","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.964746+0000","last_change":"2024-05-21T13:35:56.760557+0000","last_active":"2024-05-21T13:36:02.964746+0000","last_peered":"2024-05-21T13:36:02.964746+0000","last_clean":"2024-05-21T13:36:02.964746+0000","last_became_active":"2024-05-21T13:35:56.759728+0000","last_became_peered":"2024-05-21T13:35:56.759728+0000","last_unstale":"2024-05-21T13:36:02.964746+0000","last_undegraded":"2024-05-21T13:36:02.964746+0000","last_fullsized":"2024-05-21T13:36:02.964746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:56:19.754940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.962040+0000","last_change":"2024-05-21T13:36:01.861622+0000","last_active":"2024-05-21T13:36:02.962040+0000","last_peered":"2024-05-21T13:36:02.962040+0000","last_clean":"2024-05-21T13:36:02.962040+0000","last_became_active":"2024-05-21T13:36:01.861172+0000","last_became_peered":"2024-05-21T13:36:01.861172+0000","last_unstale":"2024-05-21T13:36:02.962040+0000","last_undegraded":"2024-05-21T13:36:02.962040+0000","last_fullsized":"2024-05-21T13:36:02.962040+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:39:53.211812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-21T13:36:38.729090+0000","last_change":"2024-05-21T13:35:57.804520+0000","last_active":"2024-05-21T13:36:38.729090+0000","last_peered":"2024-05-21T13:36:38.729090+0000","last_clean":"2024-05-21T13:36:38.729090+0000","last_became_active":"2024-05-21T13:35:57.804139+0000","last_became_peered":"2024-05-21T13:35:57.804139+0000","last_unstale":"2024-05-21T13:36:38.729090+0000","last_undegraded":"2024-05-21T13:36:38.729090+0000","last_fullsized":"2024-05-21T13:36:38.729090+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:21:52.433019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"25'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:26.902540+0000","last_change":"2024-05-21T13:35:56.733821+0000","last_active":"2024-05-21T13:36:26.902540+0000","last_peered":"2024-05-21T13:36:26.902540+0000","last_clean":"2024-05-21T13:36:26.902540+0000","last_became_active":"2024-05-21T13:35:56.732488+0000","last_became_peered":"2024-05-21T13:35:56.732488+0000","last_unstale":"2024-05-21T13:36:26.902540+0000","last_undegraded":"2024-05-21T13:36:26.902540+0000","last_fullsized":"2024-05-21T13:36:26.902540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:10:01.786931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.961990+0000","last_change":"2024-05-21T13:36:01.868781+0000","last_active":"2024-05-21T13:36:02.961990+0000","last_peered":"2024-05-21T13:36:02.961990+0000","last_clean":"2024-05-21T13:36:02.961990+0000","last_became_active":"2024-05-21T13:36:01.864254+0000","last_became_peered":"2024-05-21T13:36:01.864254+0000","last_unstale":"2024-05-21T13:36:02.961990+0000","last_undegraded":"2024-05-21T13:36:02.961990+0000","last_fullsized":"2024-05-21T13:36:02.961990+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:34:12.632333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.962094+0000","last_change":"2024-05-21T13:35:57.788313+0000","last_active":"2024-05-21T13:36:02.962094+0000","last_peered":"2024-05-21T13:36:02.962094+0000","last_clean":"2024-05-21T13:36:02.962094+0000","last_became_active":"2024-05-21T13:35:57.787963+0000","last_became_peered":"2024-05-21T13:35:57.787963+0000","last_unstale":"2024-05-21T13:36:02.962094+0000","last_undegraded":"2024-05-21T13:36:02.962094+0000","last_fullsized":"2024-05-21T13:36:02.962094+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:16:21.586571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"25'3","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:26.903956+0000","last_change":"2024-05-21T13:35:56.748334+0000","last_active":"2024-05-21T13:36:26.903956+0000","last_peered":"2024-05-21T13:36:26.903956+0000","last_clean":"2024-05-21T13:36:26.903956+0000","last_became_active":"2024-05-21T13:35:56.748049+0000","last_became_peered":"2024-05-21T13:35:56.748049+0000","last_unstale":"2024-05-21T13:36:26.903956+0000","last_undegraded":"2024-05-21T13:36:26.903956+0000","last_fullsized":"2024-05-21T13:36:26.903956+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:59:02.802905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.807330+0000","last_change":"2024-05-21T13:36:01.856216+0000","last_active":"2024-05-21T13:36:02.807330+0000","last_peered":"2024-05-21T13:36:02.807330+0000","last_clean":"2024-05-21T13:36:02.807330+0000","last_became_active":"2024-05-21T13:36:01.855417+0000","last_became_peered":"2024-05-21T13:36:01.855417+0000","last_unstale":"2024-05-21T13:36:02.807330+0000","last_undegraded":"2024-05-21T13:36:02.807330+0000","last_fullsized":"2024-05-21T13:36:02.807330+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:36:01.423944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.807915+0000","last_change":"2024-05-21T13:36:01.838966+0000","last_active":"2024-05-21T13:36:02.807915+0000","last_peered":"2024-05-21T13:36:02.807915+0000","last_clean":"2024-05-21T13:36:02.807915+0000","last_became_active":"2024-05-21T13:36:01.837777+0000","last_became_peered":"2024-05-21T13:36:01.837777+0000","last_unstale":"2024-05-21T13:36:02.807915+0000","last_undegraded":"2024-05-21T13:36:02.807915+0000","last_fullsized":"2024-05-21T13:36:02.807915+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:40:55.688338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.807274+0000","last_change":"2024-05-21T13:35:57.762719+0000","last_active":"2024-05-21T13:36:02.807274+0000","last_peered":"2024-05-21T13:36:02.807274+0000","last_clean":"2024-05-21T13:36:02.807274+0000","last_became_active":"2024-05-21T13:35:57.762071+0000","last_became_peered":"2024-05-21T13:35:57.762071+0000","last_unstale":"2024-05-21T13:36:02.807274+0000","last_undegraded":"2024-05-21T13:36:02.807274+0000","last_fullsized":"2024-05-21T13:36:02.807274+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:55:37.631695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"25'1","reported_seq":22,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.805245+0000","last_change":"2024-05-21T13:35:56.751481+0000","last_active":"2024-05-21T13:36:02.805245+0000","last_peered":"2024-05-21T13:36:02.805245+0000","last_clean":"2024-05-21T13:36:02.805245+0000","last_became_active":"2024-05-21T13:35:56.751201+0000","last_became_peered":"2024-05-21T13:35:56.751201+0000","last_unstale":"2024-05-21T13:36:02.805245+0000","last_undegraded":"2024-05-21T13:36:02.805245+0000","last_fullsized":"2024-05-21T13:36:02.805245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:33:28.720246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.806144+0000","last_change":"2024-05-21T13:36:01.837042+0000","last_active":"2024-05-21T13:36:02.806144+0000","last_peered":"2024-05-21T13:36:02.806144+0000","last_clean":"2024-05-21T13:36:02.806144+0000","last_became_active":"2024-05-21T13:36:01.836194+0000","last_became_peered":"2024-05-21T13:36:01.836194+0000","last_unstale":"2024-05-21T13:36:02.806144+0000","last_undegraded":"2024-05-21T13:36:02.806144+0000","last_fullsized":"2024-05-21T13:36:02.806144+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:15:50.751693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-21T13:36:38.727810+0000","last_change":"2024-05-21T13:35:57.788838+0000","last_active":"2024-05-21T13:36:38.727810+0000","last_peered":"2024-05-21T13:36:38.727810+0000","last_clean":"2024-05-21T13:36:38.727810+0000","last_became_active":"2024-05-21T13:35:57.786307+0000","last_became_peered":"2024-05-21T13:35:57.786307+0000","last_unstale":"2024-05-21T13:36:38.727810+0000","last_undegraded":"2024-05-21T13:36:38.727810+0000","last_fullsized":"2024-05-21T13:36:38.727810+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:52:09.086807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"25'2","reported_seq":23,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:32.021842+0000","last_change":"2024-05-21T13:35:56.746564+0000","last_active":"2024-05-21T13:36:32.021842+0000","last_peered":"2024-05-21T13:36:32.021842+0000","last_clean":"2024-05-21T13:36:32.021842+0000","last_became_active":"2024-05-21T13:35:56.745884+0000","last_became_peered":"2024-05-21T13:35:56.745884+0000","last_unstale":"2024-05-21T13:36:32.021842+0000","last_undegraded":"2024-05-21T13:36:32.021842+0000","last_fullsized":"2024-05-21T13:36:32.021842+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:01:44.738607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"25'3","reported_seq":24,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:32.015963+0000","last_change":"2024-05-21T13:35:56.753930+0000","last_active":"2024-05-21T13:36:32.015963+0000","last_peered":"2024-05-21T13:36:32.015963+0000","last_clean":"2024-05-21T13:36:32.015963+0000","last_became_active":"2024-05-21T13:35:56.753499+0000","last_became_peered":"2024-05-21T13:35:56.753499+0000","last_unstale":"2024-05-21T13:36:32.015963+0000","last_undegraded":"2024-05-21T13:36:32.015963+0000","last_fullsized":"2024-05-21T13:36:32.015963+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:40:51.516544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.808045+0000","last_change":"2024-05-21T13:35:57.780101+0000","last_active":"2024-05-21T13:36:02.808045+0000","last_peered":"2024-05-21T13:36:02.808045+0000","last_clean":"2024-05-21T13:36:02.808045+0000","last_became_active":"2024-05-21T13:35:57.779368+0000","last_became_peered":"2024-05-21T13:35:57.779368+0000","last_unstale":"2024-05-21T13:36:02.808045+0000","last_undegraded":"2024-05-21T13:36:02.808045+0000","last_fullsized":"2024-05-21T13:36:02.808045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:37:39.347067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.808272+0000","last_change":"2024-05-21T13:36:01.844240+0000","last_active":"2024-05-21T13:36:02.808272+0000","last_peered":"2024-05-21T13:36:02.808272+0000","last_clean":"2024-05-21T13:36:02.808272+0000","last_became_active":"2024-05-21T13:36:01.842792+0000","last_became_peered":"2024-05-21T13:36:01.842792+0000","last_unstale":"2024-05-21T13:36:02.808272+0000","last_undegraded":"2024-05-21T13:36:02.808272+0000","last_fullsized":"2024-05-21T13:36:02.808272+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:19:54.016465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"25'5","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-21T13:36:38.728442+0000","last_change":"2024-05-21T13:35:56.770864+0000","last_active":"2024-05-21T13:36:38.728442+0000","last_peered":"2024-05-21T13:36:38.728442+0000","last_clean":"2024-05-21T13:36:38.728442+0000","last_became_active":"2024-05-21T13:35:56.766873+0000","last_became_peered":"2024-05-21T13:35:56.766873+0000","last_unstale":"2024-05-21T13:36:38.728442+0000","last_undegraded":"2024-05-21T13:36:38.728442+0000","last_fullsized":"2024-05-21T13:36:38.728442+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:13:02.633858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.963803+0000","last_change":"2024-05-21T13:35:57.787563+0000","last_active":"2024-05-21T13:36:02.963803+0000","last_peered":"2024-05-21T13:36:02.963803+0000","last_clean":"2024-05-21T13:36:02.963803+0000","last_became_active":"2024-05-21T13:35:57.787255+0000","last_became_peered":"2024-05-21T13:35:57.787255+0000","last_unstale":"2024-05-21T13:36:02.963803+0000","last_undegraded":"2024-05-21T13:36:02.963803+0000","last_fullsized":"2024-05-21T13:36:02.963803+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:32:49.325049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.964068+0000","last_change":"2024-05-21T13:36:01.868514+0000","last_active":"2024-05-21T13:36:02.964068+0000","last_peered":"2024-05-21T13:36:02.964068+0000","last_clean":"2024-05-21T13:36:02.964068+0000","last_became_active":"2024-05-21T13:36:01.867522+0000","last_became_peered":"2024-05-21T13:36:01.867522+0000","last_unstale":"2024-05-21T13:36:02.964068+0000","last_undegraded":"2024-05-21T13:36:02.964068+0000","last_fullsized":"2024-05-21T13:36:02.964068+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:19:13.533784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.960872+0000","last_change":"2024-05-21T13:35:57.782641+0000","last_active":"2024-05-21T13:36:02.960872+0000","last_peered":"2024-05-21T13:36:02.960872+0000","last_clean":"2024-05-21T13:36:02.960872+0000","last_became_active":"2024-05-21T13:35:57.782233+0000","last_became_peered":"2024-05-21T13:35:57.782233+0000","last_unstale":"2024-05-21T13:36:02.960872+0000","last_undegraded":"2024-05-21T13:36:02.960872+0000","last_fullsized":"2024-05-21T13:36:02.960872+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:55:18.808229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.963845+0000","last_change":"2024-05-21T13:35:57.770591+0000","last_active":"2024-05-21T13:36:02.963845+0000","last_peered":"2024-05-21T13:36:02.963845+0000","last_clean":"2024-05-21T13:36:02.963845+0000","last_became_active":"2024-05-21T13:35:57.769785+0000","last_became_peered":"2024-05-21T13:35:57.769785+0000","last_unstale":"2024-05-21T13:36:02.963845+0000","last_undegraded":"2024-05-21T13:36:02.963845+0000","last_fullsized":"2024-05-21T13:36:02.963845+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:18:28.168393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.805267+0000","last_change":"2024-05-21T13:35:57.799153+0000","last_active":"2024-05-21T13:36:02.805267+0000","last_peered":"2024-05-21T13:36:02.805267+0000","last_clean":"2024-05-21T13:36:02.805267+0000","last_became_active":"2024-05-21T13:35:57.796495+0000","last_became_peered":"2024-05-21T13:35:57.796495+0000","last_unstale":"2024-05-21T13:36:02.805267+0000","last_undegraded":"2024-05-21T13:36:02.805267+0000","last_fullsized":"2024-05-21T13:36:02.805267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:53:04.109036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-21T13:36:38.728181+0000","last_change":"2024-05-21T13:35:57.784335+0000","last_active":"2024-05-21T13:36:38.728181+0000","last_peered":"2024-05-21T13:36:38.728181+0000","last_clean":"2024-05-21T13:36:38.728181+0000","last_became_active":"2024-05-21T13:35:57.783968+0000","last_became_peered":"2024-05-21T13:35:57.783968+0000","last_unstale":"2024-05-21T13:36:38.728181+0000","last_undegraded":"2024-05-21T13:36:38.728181+0000","last_fullsized":"2024-05-21T13:36:38.728181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:57:20.832617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.967890+0000","last_change":"2024-05-21T13:35:57.795153+0000","last_active":"2024-05-21T13:36:02.967890+0000","last_peered":"2024-05-21T13:36:02.967890+0000","last_clean":"2024-05-21T13:36:02.967890+0000","last_became_active":"2024-05-21T13:35:57.794885+0000","last_became_peered":"2024-05-21T13:35:57.794885+0000","last_unstale":"2024-05-21T13:36:02.967890+0000","last_undegraded":"2024-05-21T13:36:02.967890+0000","last_fullsized":"2024-05-21T13:36:02.967890+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:17:00.454371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.967778+0000","last_change":"2024-05-21T13:35:57.778916+0000","last_active":"2024-05-21T13:36:02.967778+0000","last_peered":"2024-05-21T13:36:02.967778+0000","last_clean":"2024-05-21T13:36:02.967778+0000","last_became_active":"2024-05-21T13:35:57.778171+0000","last_became_peered":"2024-05-21T13:35:57.778171+0000","last_unstale":"2024-05-21T13:36:02.967778+0000","last_undegraded":"2024-05-21T13:36:02.967778+0000","last_fullsized":"2024-05-21T13:36:02.967778+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:15:37.425836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.961364+0000","last_change":"2024-05-21T13:35:57.791367+0000","last_active":"2024-05-21T13:36:02.961364+0000","last_peered":"2024-05-21T13:36:02.961364+0000","last_clean":"2024-05-21T13:36:02.961364+0000","last_became_active":"2024-05-21T13:35:57.790971+0000","last_became_peered":"2024-05-21T13:35:57.790971+0000","last_unstale":"2024-05-21T13:36:02.961364+0000","last_undegraded":"2024-05-21T13:36:02.961364+0000","last_fullsized":"2024-05-21T13:36:02.961364+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:14:47.428631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-21T13:36:38.728814+0000","last_change":"2024-05-21T13:35:57.785257+0000","last_active":"2024-05-21T13:36:38.728814+0000","last_peered":"2024-05-21T13:36:38.728814+0000","last_clean":"2024-05-21T13:36:38.728814+0000","last_became_active":"2024-05-21T13:35:57.781533+0000","last_became_peered":"2024-05-21T13:35:57.781533+0000","last_unstale":"2024-05-21T13:36:38.728814+0000","last_undegraded":"2024-05-21T13:36:38.728814+0000","last_fullsized":"2024-05-21T13:36:38.728814+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:18:32.591803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.804917+0000","last_change":"2024-05-21T13:35:57.799128+0000","last_active":"2024-05-21T13:36:02.804917+0000","last_peered":"2024-05-21T13:36:02.804917+0000","last_clean":"2024-05-21T13:36:02.804917+0000","last_became_active":"2024-05-21T13:35:57.797044+0000","last_became_peered":"2024-05-21T13:35:57.797044+0000","last_unstale":"2024-05-21T13:36:02.804917+0000","last_undegraded":"2024-05-21T13:36:02.804917+0000","last_fullsized":"2024-05-21T13:36:02.804917+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:57:13.472309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-21T13:36:38.727777+0000","last_change":"2024-05-21T13:35:57.789768+0000","last_active":"2024-05-21T13:36:38.727777+0000","last_peered":"2024-05-21T13:36:38.727777+0000","last_clean":"2024-05-21T13:36:38.727777+0000","last_became_active":"2024-05-21T13:35:57.789474+0000","last_became_peered":"2024-05-21T13:35:57.789474+0000","last_unstale":"2024-05-21T13:36:38.727777+0000","last_undegraded":"2024-05-21T13:36:38.727777+0000","last_fullsized":"2024-05-21T13:36:38.727777+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:42:53.993281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.963561+0000","last_change":"2024-05-21T13:35:57.756607+0000","last_active":"2024-05-21T13:36:02.963561+0000","last_peered":"2024-05-21T13:36:02.963561+0000","last_clean":"2024-05-21T13:36:02.963561+0000","last_became_active":"2024-05-21T13:35:57.755889+0000","last_became_peered":"2024-05-21T13:35:57.755889+0000","last_unstale":"2024-05-21T13:36:02.963561+0000","last_undegraded":"2024-05-21T13:36:02.963561+0000","last_fullsized":"2024-05-21T13:36:02.963561+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:16:19.541597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.808181+0000","last_change":"2024-05-21T13:35:57.775322+0000","last_active":"2024-05-21T13:36:02.808181+0000","last_peered":"2024-05-21T13:36:02.808181+0000","last_clean":"2024-05-21T13:36:02.808181+0000","last_became_active":"2024-05-21T13:35:57.774386+0000","last_became_peered":"2024-05-21T13:35:57.774386+0000","last_unstale":"2024-05-21T13:36:02.808181+0000","last_undegraded":"2024-05-21T13:36:02.808181+0000","last_fullsized":"2024-05-21T13:36:02.808181+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:01:02.106172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.959969+0000","last_change":"2024-05-21T13:35:57.769931+0000","last_active":"2024-05-21T13:36:02.959969+0000","last_peered":"2024-05-21T13:36:02.959969+0000","last_clean":"2024-05-21T13:36:02.959969+0000","last_became_active":"2024-05-21T13:35:57.769149+0000","last_became_peered":"2024-05-21T13:35:57.769149+0000","last_unstale":"2024-05-21T13:36:02.959969+0000","last_undegraded":"2024-05-21T13:36:02.959969+0000","last_fullsized":"2024-05-21T13:36:02.959969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:55:56.268307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.806502+0000","last_change":"2024-05-21T13:35:57.796153+0000","last_active":"2024-05-21T13:36:02.806502+0000","last_peered":"2024-05-21T13:36:02.806502+0000","last_clean":"2024-05-21T13:36:02.806502+0000","last_became_active":"2024-05-21T13:35:57.795799+0000","last_became_peered":"2024-05-21T13:35:57.795799+0000","last_unstale":"2024-05-21T13:36:02.806502+0000","last_undegraded":"2024-05-21T13:36:02.806502+0000","last_fullsized":"2024-05-21T13:36:02.806502+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:52:04.794391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.966824+0000","last_change":"2024-05-21T13:35:57.776414+0000","last_active":"2024-05-21T13:36:02.966824+0000","last_peered":"2024-05-21T13:36:02.966824+0000","last_clean":"2024-05-21T13:36:02.966824+0000","last_became_active":"2024-05-21T13:35:57.775573+0000","last_became_peered":"2024-05-21T13:35:57.775573+0000","last_unstale":"2024-05-21T13:36:02.966824+0000","last_undegraded":"2024-05-21T13:36:02.966824+0000","last_fullsized":"2024-05-21T13:36:02.966824+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:47:47.624662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.808011+0000","last_change":"2024-05-21T13:35:57.799673+0000","last_active":"2024-05-21T13:36:02.808011+0000","last_peered":"2024-05-21T13:36:02.808011+0000","last_clean":"2024-05-21T13:36:02.808011+0000","last_became_active":"2024-05-21T13:35:57.799313+0000","last_became_peered":"2024-05-21T13:35:57.799313+0000","last_unstale":"2024-05-21T13:36:02.808011+0000","last_undegraded":"2024-05-21T13:36:02.808011+0000","last_fullsized":"2024-05-21T13:36:02.808011+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:40:52.516216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.804786+0000","last_change":"2024-05-21T13:35:57.790705+0000","last_active":"2024-05-21T13:36:02.804786+0000","last_peered":"2024-05-21T13:36:02.804786+0000","last_clean":"2024-05-21T13:36:02.804786+0000","last_became_active":"2024-05-21T13:35:57.787735+0000","last_became_peered":"2024-05-21T13:35:57.787735+0000","last_unstale":"2024-05-21T13:36:02.804786+0000","last_undegraded":"2024-05-21T13:36:02.804786+0000","last_fullsized":"2024-05-21T13:36:02.804786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:17:24.376182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-21T13:36:38.727480+0000","last_change":"2024-05-21T13:35:57.786838+0000","last_active":"2024-05-21T13:36:38.727480+0000","last_peered":"2024-05-21T13:36:38.727480+0000","last_clean":"2024-05-21T13:36:38.727480+0000","last_became_active":"2024-05-21T13:35:57.786403+0000","last_became_peered":"2024-05-21T13:35:57.786403+0000","last_unstale":"2024-05-21T13:36:38.727480+0000","last_undegraded":"2024-05-21T13:36:38.727480+0000","last_fullsized":"2024-05-21T13:36:38.727480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:29:28.760793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.966410+0000","last_change":"2024-05-21T13:35:57.783561+0000","last_active":"2024-05-21T13:36:02.966410+0000","last_peered":"2024-05-21T13:36:02.966410+0000","last_clean":"2024-05-21T13:36:02.966410+0000","last_became_active":"2024-05-21T13:35:57.783060+0000","last_became_peered":"2024-05-21T13:35:57.783060+0000","last_unstale":"2024-05-21T13:36:02.966410+0000","last_undegraded":"2024-05-21T13:36:02.966410+0000","last_fullsized":"2024-05-21T13:36:02.966410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:27:27.261449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.964046+0000","last_change":"2024-05-21T13:35:57.788210+0000","last_active":"2024-05-21T13:36:02.964046+0000","last_peered":"2024-05-21T13:36:02.964046+0000","last_clean":"2024-05-21T13:36:02.964046+0000","last_became_active":"2024-05-21T13:35:57.787508+0000","last_became_peered":"2024-05-21T13:35:57.787508+0000","last_unstale":"2024-05-21T13:36:02.964046+0000","last_undegraded":"2024-05-21T13:36:02.964046+0000","last_fullsized":"2024-05-21T13:36:02.964046+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:12:56.914580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.959869+0000","last_change":"2024-05-21T13:35:57.787335+0000","last_active":"2024-05-21T13:36:02.959869+0000","last_peered":"2024-05-21T13:36:02.959869+0000","last_clean":"2024-05-21T13:36:02.959869+0000","last_became_active":"2024-05-21T13:35:57.786292+0000","last_became_peered":"2024-05-21T13:35:57.786292+0000","last_unstale":"2024-05-21T13:36:02.959869+0000","last_undegraded":"2024-05-21T13:36:02.959869+0000","last_fullsized":"2024-05-21T13:36:02.959869+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:49:40.480948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.960610+0000","last_change":"2024-05-21T13:35:57.801121+0000","last_active":"2024-05-21T13:36:02.960610+0000","last_peered":"2024-05-21T13:36:02.960610+0000","last_clean":"2024-05-21T13:36:02.960610+0000","last_became_active":"2024-05-21T13:35:57.800858+0000","last_became_peered":"2024-05-21T13:35:57.800858+0000","last_unstale":"2024-05-21T13:36:02.960610+0000","last_undegraded":"2024-05-21T13:36:02.960610+0000","last_fullsized":"2024-05-21T13:36:02.960610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:41:08.765821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.959709+0000","last_change":"2024-05-21T13:35:57.778753+0000","last_active":"2024-05-21T13:36:02.959709+0000","last_peered":"2024-05-21T13:36:02.959709+0000","last_clean":"2024-05-21T13:36:02.959709+0000","last_became_active":"2024-05-21T13:35:57.777962+0000","last_became_peered":"2024-05-21T13:35:57.777962+0000","last_unstale":"2024-05-21T13:36:02.959709+0000","last_undegraded":"2024-05-21T13:36:02.959709+0000","last_fullsized":"2024-05-21T13:36:02.959709+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:51:49.102945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.963934+0000","last_change":"2024-05-21T13:35:57.798312+0000","last_active":"2024-05-21T13:36:02.963934+0000","last_peered":"2024-05-21T13:36:02.963934+0000","last_clean":"2024-05-21T13:36:02.963934+0000","last_became_active":"2024-05-21T13:35:57.797793+0000","last_became_peered":"2024-05-21T13:35:57.797793+0000","last_unstale":"2024-05-21T13:36:02.963934+0000","last_undegraded":"2024-05-21T13:36:02.963934+0000","last_fullsized":"2024-05-21T13:36:02.963934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:28:47.276868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-21T13:36:38.727461+0000","last_change":"2024-05-21T13:35:57.782412+0000","last_active":"2024-05-21T13:36:38.727461+0000","last_peered":"2024-05-21T13:36:38.727461+0000","last_clean":"2024-05-21T13:36:38.727461+0000","last_became_active":"2024-05-21T13:35:57.782058+0000","last_became_peered":"2024-05-21T13:35:57.782058+0000","last_unstale":"2024-05-21T13:36:38.727461+0000","last_undegraded":"2024-05-21T13:36:38.727461+0000","last_fullsized":"2024-05-21T13:36:38.727461+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:39:49.142554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.959879+0000","last_change":"2024-05-21T13:35:57.779771+0000","last_active":"2024-05-21T13:36:02.959879+0000","last_peered":"2024-05-21T13:36:02.959879+0000","last_clean":"2024-05-21T13:36:02.959879+0000","last_became_active":"2024-05-21T13:35:57.779168+0000","last_became_peered":"2024-05-21T13:35:57.779168+0000","last_unstale":"2024-05-21T13:36:02.959879+0000","last_undegraded":"2024-05-21T13:36:02.959879+0000","last_fullsized":"2024-05-21T13:36:02.959879+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T13:59:58.966203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.961896+0000","last_change":"2024-05-21T13:35:57.773098+0000","last_active":"2024-05-21T13:36:02.961896+0000","last_peered":"2024-05-21T13:36:02.961896+0000","last_clean":"2024-05-21T13:36:02.961896+0000","last_became_active":"2024-05-21T13:35:57.772268+0000","last_became_peered":"2024-05-21T13:35:57.772268+0000","last_unstale":"2024-05-21T13:36:02.961896+0000","last_undegraded":"2024-05-21T13:36:02.961896+0000","last_fullsized":"2024-05-21T13:36:02.961896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:05:25.482434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.960610+0000","last_change":"2024-05-21T13:35:57.788980+0000","last_active":"2024-05-21T13:36:02.960610+0000","last_peered":"2024-05-21T13:36:02.960610+0000","last_clean":"2024-05-21T13:36:02.960610+0000","last_became_active":"2024-05-21T13:35:57.788689+0000","last_became_peered":"2024-05-21T13:35:57.788689+0000","last_unstale":"2024-05-21T13:36:02.960610+0000","last_undegraded":"2024-05-21T13:36:02.960610+0000","last_fullsized":"2024-05-21T13:36:02.960610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:15:07.615363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.961136+0000","last_change":"2024-05-21T13:35:57.772867+0000","last_active":"2024-05-21T13:36:02.961136+0000","last_peered":"2024-05-21T13:36:02.961136+0000","last_clean":"2024-05-21T13:36:02.961136+0000","last_became_active":"2024-05-21T13:35:57.772160+0000","last_became_peered":"2024-05-21T13:35:57.772160+0000","last_unstale":"2024-05-21T13:36:02.961136+0000","last_undegraded":"2024-05-21T13:36:02.961136+0000","last_fullsized":"2024-05-21T13:36:02.961136+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:11:24.428796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-21T13:36:38.728287+0000","last_change":"2024-05-21T13:35:57.785297+0000","last_active":"2024-05-21T13:36:38.728287+0000","last_peered":"2024-05-21T13:36:38.728287+0000","last_clean":"2024-05-21T13:36:38.728287+0000","last_became_active":"2024-05-21T13:35:57.784741+0000","last_became_peered":"2024-05-21T13:35:57.784741+0000","last_unstale":"2024-05-21T13:36:38.728287+0000","last_undegraded":"2024-05-21T13:36:38.728287+0000","last_fullsized":"2024-05-21T13:36:38.728287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:45:08.507286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":21,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-05-21T13:36:38.728614+0000","last_change":"2024-05-21T13:35:57.788875+0000","last_active":"2024-05-21T13:36:38.728614+0000","last_peered":"2024-05-21T13:36:38.728614+0000","last_clean":"2024-05-21T13:36:38.728614+0000","last_became_active":"2024-05-21T13:35:57.786629+0000","last_became_peered":"2024-05-21T13:35:57.786629+0000","last_unstale":"2024-05-21T13:36:38.728614+0000","last_undegraded":"2024-05-21T13:36:38.728614+0000","last_fullsized":"2024-05-21T13:36:38.728614+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:40:07.549210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":19,"reported_epoch":25,"state":"active+clean","last_fresh":"2024-05-21T13:36:02.959984+0000","last_change":"2024-05-21T13:35:57.803316+0000","last_active":"2024-05-21T13:36:02.959984+0000","last_peered":"2024-05-21T13:36:02.959984+0000","last_clean":"2024-05-21T13:36:02.959984+0000","last_became_active":"2024-05-21T13:35:57.802925+0000","last_became_peered":"2024-05-21T13:35:57.802925+0000","last_unstale":"2024-05-21T13:36:02.959984+0000","last_undegraded":"2024-05-21T13:36:02.959984+0000","last_fullsized":"2024-05-21T13:36:02.959984+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:17:16.304097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":7452,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":39,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":14904,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66916,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509454,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27292,"kb_used_data":276,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344548,"statfs":{"total":96636764160,"available":96608817152,"internally_reserved":0,"allocated":282624,"data_stored":102411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509454,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":270336,"data_stored":102707,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509453,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":274432,"data_stored":102729,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509454,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31444,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340396,"statfs":{"total":96636764160,"available":96604565504,"internally_reserved":0,"allocated":274432,"data_stored":105379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509454,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31500,"kb_used_data":324,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340340,"statfs":{"total":96636764160,"available":96604508160,"internally_reserved":0,"allocated":331776,"data_stored":692031,"data_compressed":33458,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509453,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31448,"kb_used_data":272,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340392,"statfs":{"total":96636764160,"available":96604561408,"internally_reserved":0,"allocated":278528,"data_stored":102819,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542157,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":356352,"data_stored":699523,"data_compressed":33458,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574861,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":106913,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33458,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33458,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3876,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":5410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1204,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-21T13:36:42.430 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-21T13:36:42.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.621+0000 7f6337e58640 1 Processor -- start 2024-05-21T13:36:42.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.621+0000 7f6337e58640 1 -- start start 2024-05-21T13:36:42.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.621+0000 7f6337e58640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f63300ca480 0x7f63300c5570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:42.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.621+0000 7f6337e58640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6330160c50 con 0x7f633015a260 2024-05-21T13:36:42.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.621+0000 7f6337e58640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6330160ef0 con 0x7f63300c8510 2024-05-21T13:36:42.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.621+0000 7f6337e58640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f63300ca890 con 0x7f63300ca480 2024-05-21T13:36:42.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.621+0000 7f6335bf4640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f633015a260 0x7f633006c4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:56764/0 (socket says 172.21.15.22:56764) 2024-05-21T13:36:42.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.621+0000 7f6335bf4640 1 -- 172.21.15.22:0/3929002592 learned_addr learned my addr 172.21.15.22:0/3929002592 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-21T13:36:42.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.621+0000 7f63363f5640 1 --2- 172.21.15.22:0/3929002592 >> v2:172.21.15.115:3300/0 conn(0x7f63300ca480 0x7f63300c5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:42.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.621+0000 7f6334bf2640 1 -- 172.21.15.22:0/3929002592 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 483150249 0 0) 0x7f6330160c50 con 0x7f633015a260 2024-05-21T13:36:42.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.621+0000 7f6334bf2640 1 -- 172.21.15.22:0/3929002592 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f631c003530 con 0x7f633015a260 2024-05-21T13:36:42.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.621+0000 7f6334bf2640 1 -- 172.21.15.22:0/3929002592 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2498771811 0 0) 0x7f631c003530 con 0x7f633015a260 2024-05-21T13:36:42.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.621+0000 7f6334bf2640 1 -- 172.21.15.22:0/3929002592 >> v2:172.21.15.115:3300/0 conn(0x7f63300ca480 msgr2=0x7f63300c5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:42.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.621+0000 7f6334bf2640 1 --2- 172.21.15.22:0/3929002592 >> v2:172.21.15.115:3300/0 conn(0x7f63300ca480 0x7f63300c5570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:42.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.621+0000 7f6334bf2640 1 -- 172.21.15.22:0/3929002592 >> v1:172.21.15.115:6789/0 conn(0x7f63300c8510 legacy=0x7f633006cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:42.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.621+0000 7f6334bf2640 1 -- 172.21.15.22:0/3929002592 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63300c93e0 con 0x7f633015a260 2024-05-21T13:36:42.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.621+0000 7f6334bf2640 1 -- 172.21.15.22:0/3929002592 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2684847062 0 0) 0x7f632c001700 con 0x7f633015a260 2024-05-21T13:36:42.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.621+0000 7f6334bf2640 1 -- 172.21.15.22:0/3929002592 >> v1:172.21.15.22:6789/0 conn(0x7f633015a260 legacy=0x7f633006c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:42.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.621+0000 7f6334bf2640 1 --2- 172.21.15.22:0/3929002592 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f631c003a60 0x7f631c003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:42.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.621+0000 7f6334bf2640 1 --2- 172.21.15.22:0/3929002592 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f631c004810 0x7f631c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:42.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.621+0000 7f6334bf2640 1 --2- 172.21.15.22:0/3929002592 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f631c0051d0 0x7f631c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:42.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.621+0000 7f6334bf2640 1 -- 172.21.15.22:0/3929002592 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f63300ca890 con 0x7f631c003a60 2024-05-21T13:36:42.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.621+0000 7f6334bf2640 1 -- 172.21.15.22:0/3929002592 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f631c00c150 con 0x7f631c004810 2024-05-21T13:36:42.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.621+0000 7f6334bf2640 1 -- 172.21.15.22:0/3929002592 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f631c00c350 con 0x7f631c0051d0 2024-05-21T13:36:42.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.621+0000 7f6335bf4640 1 --2- 172.21.15.22:0/3929002592 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f631c003a60 0x7f631c003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:42.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.621+0000 7f63353f3640 1 --2- 172.21.15.22:0/3929002592 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f631c004810 0x7f631c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:42.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.621+0000 7f63363f5640 1 --2- 172.21.15.22:0/3929002592 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f631c0051d0 0x7f631c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:42.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.621+0000 7f6335bf4640 1 -- 172.21.15.22:0/3929002592 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f631c0051d0 msgr2=0x7f631c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:42.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.621+0000 7f6335bf4640 1 --2- 172.21.15.22:0/3929002592 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f631c0051d0 0x7f631c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:42.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.621+0000 7f6335bf4640 1 -- 172.21.15.22:0/3929002592 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f631c004810 msgr2=0x7f631c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:42.603 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.621+0000 7f6335bf4640 1 --2- 172.21.15.22:0/3929002592 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f631c004810 0x7f631c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:42.604 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.621+0000 7f6335bf4640 1 -- 172.21.15.22:0/3929002592 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f631c003530 con 0x7f631c003a60 2024-05-21T13:36:42.604 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.621+0000 7f63363f5640 1 -- 172.21.15.22:0/3929002592 reap_dead start 2024-05-21T13:36:42.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.625+0000 7f6335bf4640 1 --2- 172.21.15.22:0/3929002592 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f631c003a60 0x7f631c003e80 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f632c001060 tx=0x7f632c01f2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4e641717e0fbc3d server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:42.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.625+0000 7f6334bf2640 1 -- 172.21.15.22:0/3929002592 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f632c007d40 con 0x7f631c003a60 2024-05-21T13:36:42.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.625+0000 7f6334bf2640 1 -- 172.21.15.22:0/3929002592 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f632c005b00 con 0x7f631c003a60 2024-05-21T13:36:42.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.625+0000 7f6334bf2640 1 -- 172.21.15.22:0/3929002592 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f632c007070 con 0x7f631c003a60 2024-05-21T13:36:42.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.625+0000 7f6337e58640 1 -- 172.21.15.22:0/3929002592 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f631c003a60 msgr2=0x7f631c003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:42.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.625+0000 7f6337e58640 1 --2- 172.21.15.22:0/3929002592 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f631c003a60 0x7f631c003e80 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f632c001060 tx=0x7f632c01f2f0 comp rx=0 tx=0).stop 2024-05-21T13:36:42.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.625+0000 7f6337e58640 1 -- 172.21.15.22:0/3929002592 shutdown_connections 2024-05-21T13:36:42.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.625+0000 7f6337e58640 1 --2- 172.21.15.22:0/3929002592 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f631c003a60 0x7f631c003e80 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:42.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.625+0000 7f6337e58640 1 -- 172.21.15.22:0/3929002592 >> 172.21.15.22:0/3929002592 conn(0x7f633006ea10 msgr2=0x7f633006ff50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:42.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.625+0000 7f6337e58640 1 -- 172.21.15.22:0/3929002592 shutdown_connections 2024-05-21T13:36:42.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.625+0000 7f6337e58640 1 -- 172.21.15.22:0/3929002592 wait complete. 2024-05-21T13:36:42.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.625+0000 7f6337e58640 1 Processor -- start 2024-05-21T13:36:42.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.625+0000 7f6337e58640 1 -- start start 2024-05-21T13:36:42.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.625+0000 7f6337e58640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f631c003a60 0x7f63301632f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:42.608 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.625+0000 7f6337e58640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f633015a960 0x7f633015b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:42.608 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.625+0000 7f6337e58640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6330158190 0x7f633015b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:42.608 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.625+0000 7f6337e58640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f63300c8c30 con 0x7f631c003a60 2024-05-21T13:36:42.608 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.625+0000 7f6337e58640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f63300c9ff0 con 0x7f6330158190 2024-05-21T13:36:42.608 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.625+0000 7f6337e58640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f63300c99a0 con 0x7f633015a960 2024-05-21T13:36:42.608 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.625+0000 7f6335bf4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f631c003a60 0x7f63301632f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:42.608 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.625+0000 7f6335bf4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f631c003a60 0x7f63301632f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43278/0 (socket says 172.21.15.22:43278) 2024-05-21T13:36:42.608 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.625+0000 7f6335bf4640 1 -- 172.21.15.22:0/3141670526 learned_addr learned my addr 172.21.15.22:0/3141670526 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:42.608 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.629+0000 7f63363f5640 1 --2- 172.21.15.22:0/3141670526 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6330158190 0x7f633015b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:42.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.629+0000 7f63353f3640 1 --2- 172.21.15.22:0/3141670526 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f633015a960 0x7f633015b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:42.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.629+0000 7f6335bf4640 1 -- 172.21.15.22:0/3141670526 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f633015a960 msgr2=0x7f633015b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:42.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.629+0000 7f6335bf4640 1 --2- 172.21.15.22:0/3141670526 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f633015a960 0x7f633015b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:42.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.629+0000 7f6335bf4640 1 -- 172.21.15.22:0/3141670526 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6330158190 msgr2=0x7f633015b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:42.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.629+0000 7f6335bf4640 1 --2- 172.21.15.22:0/3141670526 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6330158190 0x7f633015b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:42.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.629+0000 7f6335bf4640 1 -- 172.21.15.22:0/3141670526 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6330163830 con 0x7f631c003a60 2024-05-21T13:36:42.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.629+0000 7f6335bf4640 1 --2- 172.21.15.22:0/3141670526 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f631c003a60 0x7f63301632f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f632c001060 tx=0x7f631c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:42.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.629+0000 7f63227fc640 1 -- 172.21.15.22:0/3141670526 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f632c0bf070 con 0x7f631c003a60 2024-05-21T13:36:42.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.629+0000 7f63227fc640 1 -- 172.21.15.22:0/3141670526 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f632c007d20 con 0x7f631c003a60 2024-05-21T13:36:42.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.629+0000 7f63227fc640 1 -- 172.21.15.22:0/3141670526 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f632c007690 con 0x7f631c003a60 2024-05-21T13:36:42.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.629+0000 7f6337e58640 1 -- 172.21.15.22:0/3141670526 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6330161940 con 0x7f631c003a60 2024-05-21T13:36:42.609 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.629+0000 7f6337e58640 1 -- 172.21.15.22:0/3141670526 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6330161ee0 con 0x7f631c003a60 2024-05-21T13:36:42.610 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.629+0000 7f6337e58640 1 -- 172.21.15.22:0/3141670526 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63301620e0 con 0x7f631c003a60 2024-05-21T13:36:42.610 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.629+0000 7f63227fc640 1 -- 172.21.15.22:0/3141670526 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f632c001500 con 0x7f631c003a60 2024-05-21T13:36:42.610 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.629+0000 7f63227fc640 1 --2- 172.21.15.22:0/3141670526 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f631406f430 0x7f63140718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:42.610 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.629+0000 7f63227fc640 1 -- 172.21.15.22:0/3141670526 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f632c12c640 con 0x7f631c003a60 2024-05-21T13:36:42.610 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.633+0000 7f63353f3640 1 --2- 172.21.15.22:0/3141670526 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f631406f430 0x7f63140718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:42.611 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.633+0000 7f63353f3640 1 --2- 172.21.15.22:0/3141670526 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f631406f430 0x7f63140718f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6324000c10 tx=0x7f6324009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:42.614 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.637+0000 7f63227fc640 1 -- 172.21.15.22:0/3141670526 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f632c0190a0 con 0x7f631c003a60 2024-05-21T13:36:42.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.833+0000 7f6337e58640 1 -- 172.21.15.22:0/3141670526 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6330077bb0 con 0x7f631c003a60 2024-05-21T13:36:42.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.833+0000 7f63227fc640 1 -- 172.21.15.22:0/3141670526 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6875 (secure 0 0 0) 0x7f632c0f92e0 con 0x7f631c003a60 2024-05-21T13:36:42.813 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-21T13:36:42.813 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4224,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/355756580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":355756580},{"type":"v1","addr":"172.21.15.22:6833","nonce":355756580}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4230,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3277017116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":3277017116},{"type":"v1","addr":"172.21.15.22:6835","nonce":3277017116}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4233,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3840772609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3840772609},{"type":"v1","addr":"172.21.15.22:6837","nonce":3840772609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-21T13:35:57.106892+0000","modified":"2024-05-21T13:36:32.396351+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4300,"mds_1":4294,"mds_2":4248},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4248":{"gid":4248,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":12,"addr":"172.21.15.115:6837/2009761279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":2009761279},{"type":"v1","addr":"172.21.15.115:6837","nonce":2009761279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4294":{"gid":4294,"name":"b","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.115:6835/3894678097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3894678097},{"type":"v1","addr":"172.21.15.115:6835","nonce":3894678097}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4300":{"gid":4300,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.115:6839/1525097577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6838","nonce":1525097577},{"type":"v1","addr":"172.21.15.115:6839","nonce":1525097577}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4300,"qdb_cluster":[4248,4300,4294]},"id":1}]} 2024-05-21T13:36:42.814 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 14 2024-05-21T13:36:42.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.837+0000 7f6337e58640 1 -- 172.21.15.22:0/3141670526 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f631406f430 msgr2=0x7f63140718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:42.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.837+0000 7f6337e58640 1 --2- 172.21.15.22:0/3141670526 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f631406f430 0x7f63140718f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6324000c10 tx=0x7f6324009040 comp rx=0 tx=0).stop 2024-05-21T13:36:42.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.837+0000 7f6337e58640 1 -- 172.21.15.22:0/3141670526 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f631c003a60 msgr2=0x7f63301632f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:42.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.837+0000 7f6337e58640 1 --2- 172.21.15.22:0/3141670526 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f631c003a60 0x7f63301632f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f632c001060 tx=0x7f631c005840 comp rx=0 tx=0).stop 2024-05-21T13:36:42.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.837+0000 7f6337e58640 1 -- 172.21.15.22:0/3141670526 shutdown_connections 2024-05-21T13:36:42.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.837+0000 7f6337e58640 1 --2- 172.21.15.22:0/3141670526 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f631406f430 0x7f63140718f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:42.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.837+0000 7f6337e58640 1 --2- 172.21.15.22:0/3141670526 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6330158190 0x7f633015b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:42.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.837+0000 7f6337e58640 1 --2- 172.21.15.22:0/3141670526 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f633015a960 0x7f633015b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:42.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.837+0000 7f6337e58640 1 --2- 172.21.15.22:0/3141670526 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f631c003a60 0x7f63301632f0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:42.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.837+0000 7f6337e58640 1 -- 172.21.15.22:0/3141670526 >> 172.21.15.22:0/3141670526 conn(0x7f633006ea10 msgr2=0x7f6330160290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:42.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.837+0000 7f6337e58640 1 -- 172.21.15.22:0/3141670526 shutdown_connections 2024-05-21T13:36:42.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.837+0000 7f6337e58640 1 -- 172.21.15.22:0/3141670526 wait complete. 2024-05-21T13:36:42.833 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-21T13:36:42.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.981+0000 7f311337e640 1 Processor -- start 2024-05-21T13:36:42.959 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.981+0000 7f311337e640 1 -- start start 2024-05-21T13:36:42.960 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.981+0000 7f311337e640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f310c15c840 0x7f310c0cae90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:42.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.981+0000 7f311337e640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f310c0cb3d0 0x7f310c073a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:42.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.981+0000 7f311337e640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f310c0c8390 con 0x7f310c0c7fb0 2024-05-21T13:36:42.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.981+0000 7f311337e640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f310c0cb820 con 0x7f310c0cb3d0 2024-05-21T13:36:42.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.981+0000 7f311337e640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f310c15ccd0 con 0x7f310c15c840 2024-05-21T13:36:42.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.981+0000 7f311191b640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f310c0cb3d0 0x7f310c073a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:42.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.981+0000 7f311191b640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f310c0cb3d0 0x7f310c073a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43282/0 (socket says 172.21.15.22:43282) 2024-05-21T13:36:42.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.981+0000 7f311191b640 1 -- 172.21.15.22:0/477876664 learned_addr learned my addr 172.21.15.22:0/477876664 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:42.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.981+0000 7f3110919640 1 --2- 172.21.15.22:0/477876664 >> v2:172.21.15.115:3300/0 conn(0x7f310c15c840 0x7f310c0cae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:42.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.981+0000 7f311191b640 1 -- 172.21.15.22:0/477876664 >> v2:172.21.15.115:3300/0 conn(0x7f310c15c840 msgr2=0x7f310c0cae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:42.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.981+0000 7f311191b640 1 --2- 172.21.15.22:0/477876664 >> v2:172.21.15.115:3300/0 conn(0x7f310c15c840 0x7f310c0cae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:42.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.981+0000 7f311191b640 1 -- 172.21.15.22:0/477876664 >> v1:172.21.15.115:6789/0 conn(0x7f310c0c7fb0 legacy=0x7f310c071610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:42.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.981+0000 7f311191b640 1 -- 172.21.15.22:0/477876664 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f310c15f3e0 con 0x7f310c0cb3d0 2024-05-21T13:36:42.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.985+0000 7f311191b640 1 --2- 172.21.15.22:0/477876664 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f310c0cb3d0 0x7f310c073a80 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f310c0c60f0 tx=0x7f310401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=165ac077e6b96345 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:42.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.985+0000 7f3103fff640 1 -- 172.21.15.22:0/477876664 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31040a56c0 con 0x7f310c0cb3d0 2024-05-21T13:36:42.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.985+0000 7f3103fff640 1 -- 172.21.15.22:0/477876664 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31040a5860 con 0x7f310c0cb3d0 2024-05-21T13:36:42.963 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.985+0000 7f3103fff640 1 -- 172.21.15.22:0/477876664 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31040a5c30 con 0x7f310c0cb3d0 2024-05-21T13:36:42.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.985+0000 7f311337e640 1 -- 172.21.15.22:0/477876664 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f310c0cb3d0 msgr2=0x7f310c073a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:42.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.985+0000 7f311337e640 1 --2- 172.21.15.22:0/477876664 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f310c0cb3d0 0x7f310c073a80 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f310c0c60f0 tx=0x7f310401c9f0 comp rx=0 tx=0).stop 2024-05-21T13:36:42.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.985+0000 7f311337e640 1 -- 172.21.15.22:0/477876664 shutdown_connections 2024-05-21T13:36:42.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.985+0000 7f311337e640 1 --2- 172.21.15.22:0/477876664 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f310c0cb3d0 0x7f310c073a80 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:42.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.985+0000 7f311337e640 1 --2- 172.21.15.22:0/477876664 >> v2:172.21.15.115:3300/0 conn(0x7f310c15c840 0x7f310c0cae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:42.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.985+0000 7f311337e640 1 -- 172.21.15.22:0/477876664 >> 172.21.15.22:0/477876664 conn(0x7f310c068bb0 msgr2=0x7f310c06d600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:42.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.985+0000 7f311337e640 1 -- 172.21.15.22:0/477876664 shutdown_connections 2024-05-21T13:36:42.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.985+0000 7f311337e640 1 -- 172.21.15.22:0/477876664 wait complete. 2024-05-21T13:36:42.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.985+0000 7f311337e640 1 Processor -- start 2024-05-21T13:36:42.965 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.985+0000 7f311337e640 1 -- start start 2024-05-21T13:36:42.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.989+0000 7f311337e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f310c0c7fb0 0x7f310c0cd080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:42.967 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.989+0000 7f311337e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f310c0cb3d0 0x7f310c14b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:42.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.989+0000 7f311337e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f310c15c840 0x7f310c14ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:42.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.989+0000 7f311337e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f310c0743d0 con 0x7f310c15c840 2024-05-21T13:36:42.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.989+0000 7f311337e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f310c15ff60 con 0x7f310c0c7fb0 2024-05-21T13:36:42.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.989+0000 7f311337e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f310c071d20 con 0x7f310c0cb3d0 2024-05-21T13:36:42.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.989+0000 7f311191b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f310c15c840 0x7f310c14ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:42.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.989+0000 7f311191b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f310c15c840 0x7f310c14ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43298/0 (socket says 172.21.15.22:43298) 2024-05-21T13:36:42.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.989+0000 7f311191b640 1 -- 172.21.15.22:0/4017425957 learned_addr learned my addr 172.21.15.22:0/4017425957 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:42.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.989+0000 7f311111a640 1 --2- 172.21.15.22:0/4017425957 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f310c0c7fb0 0x7f310c0cd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:42.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.989+0000 7f3110919640 1 --2- 172.21.15.22:0/4017425957 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f310c0cb3d0 0x7f310c14b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:42.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.989+0000 7f311191b640 1 -- 172.21.15.22:0/4017425957 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f310c0cb3d0 msgr2=0x7f310c14b530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:42.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.989+0000 7f311191b640 1 --2- 172.21.15.22:0/4017425957 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f310c0cb3d0 0x7f310c14b530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:42.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.989+0000 7f311191b640 1 -- 172.21.15.22:0/4017425957 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f310c0c7fb0 msgr2=0x7f310c0cd080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:42.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.989+0000 7f311191b640 1 --2- 172.21.15.22:0/4017425957 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f310c0c7fb0 0x7f310c0cd080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:42.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.989+0000 7f311191b640 1 -- 172.21.15.22:0/4017425957 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f310c1f8ce0 con 0x7f310c15c840 2024-05-21T13:36:42.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.989+0000 7f311111a640 1 --2- 172.21.15.22:0/4017425957 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f310c0c7fb0 0x7f310c0cd080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T13:36:42.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.989+0000 7f311191b640 1 --2- 172.21.15.22:0/4017425957 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f310c15c840 0x7f310c14ba70 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f310401a620 tx=0x7f3104019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:42.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.989+0000 7f3101ffb640 1 -- 172.21.15.22:0/4017425957 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3104009510 con 0x7f310c15c840 2024-05-21T13:36:42.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.989+0000 7f3101ffb640 1 -- 172.21.15.22:0/4017425957 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f31040be070 con 0x7f310c15c840 2024-05-21T13:36:42.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.989+0000 7f311337e640 1 -- 172.21.15.22:0/4017425957 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f310c150c00 con 0x7f310c15c840 2024-05-21T13:36:42.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.989+0000 7f3101ffb640 1 -- 172.21.15.22:0/4017425957 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31040b88b0 con 0x7f310c15c840 2024-05-21T13:36:42.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.989+0000 7f311337e640 1 -- 172.21.15.22:0/4017425957 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f310c1511c0 con 0x7f310c15c840 2024-05-21T13:36:42.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.989+0000 7f311337e640 1 -- 172.21.15.22:0/4017425957 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f310c151880 con 0x7f310c15c840 2024-05-21T13:36:42.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.989+0000 7f3101ffb640 1 -- 172.21.15.22:0/4017425957 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f31040b8a50 con 0x7f310c15c840 2024-05-21T13:36:42.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.989+0000 7f3101ffb640 1 --2- 172.21.15.22:0/4017425957 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f30f006f430 0x7f30f00718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:42.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.989+0000 7f3101ffb640 1 -- 172.21.15.22:0/4017425957 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f310412a570 con 0x7f310c15c840 2024-05-21T13:36:42.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.989+0000 7f311111a640 1 --2- 172.21.15.22:0/4017425957 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f30f006f430 0x7f30f00718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:42.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.993+0000 7f311111a640 1 --2- 172.21.15.22:0/4017425957 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f30f006f430 0x7f30f00718f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3108001750 tx=0x7f3108009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:42.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:42.993+0000 7f3101ffb640 1 -- 172.21.15.22:0/4017425957 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f31040165e0 con 0x7f310c15c840 2024-05-21T13:36:43.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.193+0000 7f311337e640 1 -- 172.21.15.22:0/4017425957 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f310c0697d0 con 0x7f310c15c840 2024-05-21T13:36:43.174 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.193+0000 7f3101ffb640 1 -- 172.21.15.22:0/4017425957 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6875 (secure 0 0 0) 0x7f31040f7240 con 0x7f310c15c840 2024-05-21T13:36:43.174 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-21T13:36:43.174 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4224,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/355756580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":355756580},{"type":"v1","addr":"172.21.15.22:6833","nonce":355756580}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4230,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3277017116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":3277017116},{"type":"v1","addr":"172.21.15.22:6835","nonce":3277017116}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4233,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3840772609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3840772609},{"type":"v1","addr":"172.21.15.22:6837","nonce":3840772609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-21T13:35:57.106892+0000","modified":"2024-05-21T13:36:32.396351+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4300,"mds_1":4294,"mds_2":4248},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4248":{"gid":4248,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":12,"addr":"172.21.15.115:6837/2009761279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":2009761279},{"type":"v1","addr":"172.21.15.115:6837","nonce":2009761279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4294":{"gid":4294,"name":"b","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.115:6835/3894678097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3894678097},{"type":"v1","addr":"172.21.15.115:6835","nonce":3894678097}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4300":{"gid":4300,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.115:6839/1525097577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6838","nonce":1525097577},{"type":"v1","addr":"172.21.15.115:6839","nonce":1525097577}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4300,"qdb_cluster":[4248,4300,4294]},"id":1}]} 2024-05-21T13:36:43.174 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 14 2024-05-21T13:36:43.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.197+0000 7f311337e640 1 -- 172.21.15.22:0/4017425957 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f30f006f430 msgr2=0x7f30f00718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:43.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.197+0000 7f311337e640 1 --2- 172.21.15.22:0/4017425957 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f30f006f430 0x7f30f00718f0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3108001750 tx=0x7f3108009040 comp rx=0 tx=0).stop 2024-05-21T13:36:43.176 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.197+0000 7f311337e640 1 -- 172.21.15.22:0/4017425957 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f310c15c840 msgr2=0x7f310c14ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:43.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.197+0000 7f311337e640 1 --2- 172.21.15.22:0/4017425957 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f310c15c840 0x7f310c14ba70 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f310401a620 tx=0x7f3104019790 comp rx=0 tx=0).stop 2024-05-21T13:36:43.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.197+0000 7f311337e640 1 -- 172.21.15.22:0/4017425957 shutdown_connections 2024-05-21T13:36:43.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.197+0000 7f311337e640 1 --2- 172.21.15.22:0/4017425957 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f30f006f430 0x7f30f00718f0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:43.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.197+0000 7f311337e640 1 --2- 172.21.15.22:0/4017425957 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f310c15c840 0x7f310c14ba70 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:43.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.197+0000 7f311337e640 1 --2- 172.21.15.22:0/4017425957 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f310c0cb3d0 0x7f310c14b530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:43.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.197+0000 7f311337e640 1 --2- 172.21.15.22:0/4017425957 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f310c0c7fb0 0x7f310c0cd080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:43.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.197+0000 7f311337e640 1 -- 172.21.15.22:0/4017425957 >> 172.21.15.22:0/4017425957 conn(0x7f310c068bb0 msgr2=0x7f310c15be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:43.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.197+0000 7f311337e640 1 -- 172.21.15.22:0/4017425957 shutdown_connections 2024-05-21T13:36:43.177 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.197+0000 7f311337e640 1 -- 172.21.15.22:0/4017425957 wait complete. 2024-05-21T13:36:43.194 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-21T13:36:43.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.337+0000 7f264e68a640 1 Processor -- start 2024-05-21T13:36:43.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.337+0000 7f264e68a640 1 -- start start 2024-05-21T13:36:43.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.341+0000 7f264e68a640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f26480b46d0 0x7f264815c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:43.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.341+0000 7f264e68a640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f26480b4ab0 0x7f26480b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:43.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.341+0000 7f264e68a640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f264806da20 0x7f264806deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:43.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.341+0000 7f264e68a640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f264806e3f0 con 0x7f26480b4ab0 2024-05-21T13:36:43.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.341+0000 7f264e68a640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f264815cac0 con 0x7f264806da20 2024-05-21T13:36:43.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.341+0000 7f264e68a640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f26480b58c0 con 0x7f26480b46d0 2024-05-21T13:36:43.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.341+0000 7f26477fe640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f26480b4ab0 0x7f26480b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:43.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.341+0000 7f26477fe640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f26480b4ab0 0x7f26480b5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43300/0 (socket says 172.21.15.22:43300) 2024-05-21T13:36:43.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.341+0000 7f26477fe640 1 -- 172.21.15.22:0/759507122 learned_addr learned my addr 172.21.15.22:0/759507122 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:43.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.341+0000 7f264cc27640 1 --2- 172.21.15.22:0/759507122 >> v2:172.21.15.115:3300/0 conn(0x7f264806da20 0x7f264806deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:43.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.341+0000 7f2647fff640 1 --2- 172.21.15.22:0/759507122 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f26480b46d0 0x7f264815c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:43.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.341+0000 7f26477fe640 1 -- 172.21.15.22:0/759507122 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f26480b46d0 msgr2=0x7f264815c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:43.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.341+0000 7f26477fe640 1 --2- 172.21.15.22:0/759507122 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f26480b46d0 0x7f264815c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:43.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.341+0000 7f26477fe640 1 -- 172.21.15.22:0/759507122 >> v2:172.21.15.115:3300/0 conn(0x7f264806da20 msgr2=0x7f264806deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:43.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.341+0000 7f26477fe640 1 --2- 172.21.15.22:0/759507122 >> v2:172.21.15.115:3300/0 conn(0x7f264806da20 0x7f264806deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:43.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.341+0000 7f26477fe640 1 -- 172.21.15.22:0/759507122 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26480b5ba0 con 0x7f26480b4ab0 2024-05-21T13:36:43.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.341+0000 7f26477fe640 1 --2- 172.21.15.22:0/759507122 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26480b4ab0 0x7f26480b5080 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f26480c8910 tx=0x7f263801f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9db68eba020361e server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:43.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.341+0000 7f2646ffd640 1 -- 172.21.15.22:0/759507122 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26380b4070 con 0x7f26480b4ab0 2024-05-21T13:36:43.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.341+0000 7f2646ffd640 1 -- 172.21.15.22:0/759507122 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26380af400 con 0x7f26480b4ab0 2024-05-21T13:36:43.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.341+0000 7f2646ffd640 1 -- 172.21.15.22:0/759507122 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26380af7d0 con 0x7f26480b4ab0 2024-05-21T13:36:43.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.345+0000 7f264e68a640 1 -- 172.21.15.22:0/759507122 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26480b4ab0 msgr2=0x7f26480b5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:43.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.345+0000 7f264e68a640 1 --2- 172.21.15.22:0/759507122 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26480b4ab0 0x7f26480b5080 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f26480c8910 tx=0x7f263801f1e0 comp rx=0 tx=0).stop 2024-05-21T13:36:43.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.345+0000 7f264e68a640 1 -- 172.21.15.22:0/759507122 shutdown_connections 2024-05-21T13:36:43.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.345+0000 7f264e68a640 1 --2- 172.21.15.22:0/759507122 >> v2:172.21.15.115:3300/0 conn(0x7f264806da20 0x7f264806deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:43.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.345+0000 7f264e68a640 1 --2- 172.21.15.22:0/759507122 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26480b4ab0 0x7f26480b5080 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:43.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.345+0000 7f264e68a640 1 --2- 172.21.15.22:0/759507122 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f26480b46d0 0x7f264815c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:43.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.345+0000 7f264e68a640 1 -- 172.21.15.22:0/759507122 >> 172.21.15.22:0/759507122 conn(0x7f2648068860 msgr2=0x7f26480d1510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:43.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.345+0000 7f264e68a640 1 -- 172.21.15.22:0/759507122 shutdown_connections 2024-05-21T13:36:43.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.345+0000 7f264e68a640 1 -- 172.21.15.22:0/759507122 wait complete. 2024-05-21T13:36:43.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.345+0000 7f264e68a640 1 Processor -- start 2024-05-21T13:36:43.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.345+0000 7f264e68a640 1 -- start start 2024-05-21T13:36:43.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.345+0000 7f264e68a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f264806da20 0x7f26480c5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:43.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.345+0000 7f264e68a640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f26480b46d0 0x7f2648154e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:43.325 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.345+0000 7f264e68a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26480b4ab0 0x7f26480c5bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:43.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.345+0000 7f264e68a640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f264806d500 con 0x7f264806da20 2024-05-21T13:36:43.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.345+0000 7f264e68a640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f264806d220 con 0x7f26480b4ab0 2024-05-21T13:36:43.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.345+0000 7f264e68a640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f26480b55c0 con 0x7f26480b46d0 2024-05-21T13:36:43.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.345+0000 7f2647fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f264806da20 0x7f26480c5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:43.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.345+0000 7f2647fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f264806da20 0x7f26480c5410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43308/0 (socket says 172.21.15.22:43308) 2024-05-21T13:36:43.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.345+0000 7f2647fff640 1 -- 172.21.15.22:0/631687853 learned_addr learned my addr 172.21.15.22:0/631687853 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:43.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.345+0000 7f26477fe640 1 --2- 172.21.15.22:0/631687853 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f26480b46d0 0x7f2648154e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:43.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.345+0000 7f264cc27640 1 --2- 172.21.15.22:0/631687853 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26480b4ab0 0x7f26480c5bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:43.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.345+0000 7f2647fff640 1 -- 172.21.15.22:0/631687853 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f26480b46d0 msgr2=0x7f2648154e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:43.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.345+0000 7f2647fff640 1 --2- 172.21.15.22:0/631687853 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f26480b46d0 0x7f2648154e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:43.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.345+0000 7f2647fff640 1 -- 172.21.15.22:0/631687853 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26480b4ab0 msgr2=0x7f26480c5bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:43.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.345+0000 7f2647fff640 1 --2- 172.21.15.22:0/631687853 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26480b4ab0 0x7f26480c5bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:43.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.345+0000 7f2647fff640 1 -- 172.21.15.22:0/631687853 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26481f4760 con 0x7f264806da20 2024-05-21T13:36:43.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.345+0000 7f2647fff640 1 --2- 172.21.15.22:0/631687853 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f264806da20 0x7f26480c5410 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f263000d830 tx=0x7f263000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:43.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.345+0000 7f2644ff9640 1 -- 172.21.15.22:0/631687853 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f263000b6c0 con 0x7f264806da20 2024-05-21T13:36:43.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.345+0000 7f2644ff9640 1 -- 172.21.15.22:0/631687853 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2630019070 con 0x7f264806da20 2024-05-21T13:36:43.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.345+0000 7f264e68a640 1 -- 172.21.15.22:0/631687853 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26480c8c40 con 0x7f264806da20 2024-05-21T13:36:43.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.345+0000 7f264e68a640 1 -- 172.21.15.22:0/631687853 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26481f4cc0 con 0x7f264806da20 2024-05-21T13:36:43.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.345+0000 7f2644ff9640 1 -- 172.21.15.22:0/631687853 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f263000ba60 con 0x7f264806da20 2024-05-21T13:36:43.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.349+0000 7f264e68a640 1 -- 172.21.15.22:0/631687853 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26480697d0 con 0x7f264806da20 2024-05-21T13:36:43.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.349+0000 7f2644ff9640 1 -- 172.21.15.22:0/631687853 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f263001e460 con 0x7f264806da20 2024-05-21T13:36:43.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.349+0000 7f2644ff9640 1 --2- 172.21.15.22:0/631687853 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f262806f400 0x7f26280718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:43.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.349+0000 7f2644ff9640 1 -- 172.21.15.22:0/631687853 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f263008fcc0 con 0x7f264806da20 2024-05-21T13:36:43.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.349+0000 7f26477fe640 1 --2- 172.21.15.22:0/631687853 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f262806f400 0x7f26280718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:43.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.349+0000 7f26477fe640 1 --2- 172.21.15.22:0/631687853 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f262806f400 0x7f26280718c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f26380b1000 tx=0x7f26380aa000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:43.332 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.353+0000 7f2644ff9640 1 -- 172.21.15.22:0/631687853 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f26481f4760 con 0x7f264806da20 2024-05-21T13:36:43.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.517+0000 7f264e68a640 1 -- 172.21.15.22:0/631687853 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f26480c7fa0 con 0x7f264806da20 2024-05-21T13:36:43.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.521+0000 7f2644ff9640 1 -- 172.21.15.22:0/631687853 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18554 (secure 0 0 0) 0x7f263005c850 con 0x7f264806da20 2024-05-21T13:36:43.500 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-21T13:36:43.500 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":27,"fsid":"f2c96204-e240-4e7f-8a76-927b4f80f534","created":"2024-05-21T13:35:33.827005+0000","modified":"2024-05-21T13:36:39.578654+0000","last_up_change":"2024-05-21T13:35:44.542324+0000","last_in_change":"2024-05-21T13:35:36.061492+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-21T13:35:44.536105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-21T13:35:54.972996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-21T13:35:56.065755+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-21T13:35:59.791448+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"09157d4a-9443-4e10-bbb3-cf8ed7c42cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":222752954},{"type":"v1","addr":"172.21.15.22:6801","nonce":222752954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":222752954},{"type":"v1","addr":"172.21.15.22:6803","nonce":222752954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":222752954},{"type":"v1","addr":"172.21.15.22:6807","nonce":222752954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":222752954},{"type":"v1","addr":"172.21.15.22:6805","nonce":222752954}]},"public_addr":"172.21.15.22:6801/222752954","cluster_addr":"172.21.15.22:6803/222752954","heartbeat_back_addr":"172.21.15.22:6807/222752954","heartbeat_front_addr":"172.21.15.22:6805/222752954","state":["exists","up"]},{"osd":1,"uuid":"2a6a87c0-01ad-4a98-a538-c0a8e865b05d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":685426272},{"type":"v1","addr":"172.21.15.22:6809","nonce":685426272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":685426272},{"type":"v1","addr":"172.21.15.22:6811","nonce":685426272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":685426272},{"type":"v1","addr":"172.21.15.22:6815","nonce":685426272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":685426272},{"type":"v1","addr":"172.21.15.22:6813","nonce":685426272}]},"public_addr":"172.21.15.22:6809/685426272","cluster_addr":"172.21.15.22:6811/685426272","heartbeat_back_addr":"172.21.15.22:6815/685426272","heartbeat_front_addr":"172.21.15.22:6813/685426272","state":["exists","up"]},{"osd":2,"uuid":"4c18f931-40a4-46ac-a752-0d1be35b01a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":2092224336},{"type":"v1","addr":"172.21.15.22:6817","nonce":2092224336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":2092224336},{"type":"v1","addr":"172.21.15.22:6819","nonce":2092224336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":2092224336},{"type":"v1","addr":"172.21.15.22:6823","nonce":2092224336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":2092224336},{"type":"v1","addr":"172.21.15.22:6821","nonce":2092224336}]},"public_addr":"172.21.15.22:6817/2092224336","cluster_addr":"172.21.15.22:6819/2092224336","heartbeat_back_addr":"172.21.15.22:6823/2092224336","heartbeat_front_addr":"172.21.15.22:6821/2092224336","state":["exists","up"]},{"osd":3,"uuid":"d57ee7fd-b73e-41ec-8e3b-e62fb8898128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":1232311110},{"type":"v1","addr":"172.21.15.22:6825","nonce":1232311110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":1232311110},{"type":"v1","addr":"172.21.15.22:6827","nonce":1232311110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":1232311110},{"type":"v1","addr":"172.21.15.22:6831","nonce":1232311110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":1232311110},{"type":"v1","addr":"172.21.15.22:6829","nonce":1232311110}]},"public_addr":"172.21.15.22:6825/1232311110","cluster_addr":"172.21.15.22:6827/1232311110","heartbeat_back_addr":"172.21.15.22:6831/1232311110","heartbeat_front_addr":"172.21.15.22:6829/1232311110","state":["exists","up"]},{"osd":4,"uuid":"43c6494f-352b-42a7-b6a9-fe7e3573fab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":832695158},{"type":"v1","addr":"172.21.15.115:6801","nonce":832695158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":832695158},{"type":"v1","addr":"172.21.15.115:6803","nonce":832695158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":832695158},{"type":"v1","addr":"172.21.15.115:6807","nonce":832695158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":832695158},{"type":"v1","addr":"172.21.15.115:6805","nonce":832695158}]},"public_addr":"172.21.15.115:6801/832695158","cluster_addr":"172.21.15.115:6803/832695158","heartbeat_back_addr":"172.21.15.115:6807/832695158","heartbeat_front_addr":"172.21.15.115:6805/832695158","state":["exists","up"]},{"osd":5,"uuid":"25fc861c-593d-4d49-942a-c75c19f25994","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":1504764223},{"type":"v1","addr":"172.21.15.115:6815","nonce":1504764223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":1504764223},{"type":"v1","addr":"172.21.15.115:6823","nonce":1504764223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":1504764223},{"type":"v1","addr":"172.21.15.115:6830","nonce":1504764223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6825","nonce":1504764223},{"type":"v1","addr":"172.21.15.115:6827","nonce":1504764223}]},"public_addr":"172.21.15.115:6815/1504764223","cluster_addr":"172.21.15.115:6823/1504764223","heartbeat_back_addr":"172.21.15.115:6830/1504764223","heartbeat_front_addr":"172.21.15.115:6827/1504764223","state":["exists","up"]},{"osd":6,"uuid":"2e7fb0b8-1162-497f-bffc-e2c02b9b9ef4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":959292720},{"type":"v1","addr":"172.21.15.115:6809","nonce":959292720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":959292720},{"type":"v1","addr":"172.21.15.115:6813","nonce":959292720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":959292720},{"type":"v1","addr":"172.21.15.115:6822","nonce":959292720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":959292720},{"type":"v1","addr":"172.21.15.115:6818","nonce":959292720}]},"public_addr":"172.21.15.115:6809/959292720","cluster_addr":"172.21.15.115:6813/959292720","heartbeat_back_addr":"172.21.15.115:6822/959292720","heartbeat_front_addr":"172.21.15.115:6818/959292720","state":["exists","up"]},{"osd":7,"uuid":"a97df0dc-e370-45ce-8742-25ae31e2212e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6811","nonce":20268513},{"type":"v1","addr":"172.21.15.115:6814","nonce":20268513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":20268513},{"type":"v1","addr":"172.21.15.115:6821","nonce":20268513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6829","nonce":20268513},{"type":"v1","addr":"172.21.15.115:6831","nonce":20268513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":20268513},{"type":"v1","addr":"172.21.15.115:6826","nonce":20268513}]},"public_addr":"172.21.15.115:6814/20268513","cluster_addr":"172.21.15.115:6821/20268513","heartbeat_back_addr":"172.21.15.115:6831/20268513","heartbeat_front_addr":"172.21.15.115:6826/20268513","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.692890+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.545577+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.712724+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.681944+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.492954+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.553222+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.597022+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.601698+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1b","mappings":[{"from":0,"to":7}]},{"pgid":"4.19","mappings":[{"from":7,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-21T13:36:43.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.521+0000 7f264e68a640 1 -- 172.21.15.22:0/631687853 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f262806f400 msgr2=0x7f26280718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:43.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.521+0000 7f264e68a640 1 --2- 172.21.15.22:0/631687853 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f262806f400 0x7f26280718c0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f26380b1000 tx=0x7f26380aa000 comp rx=0 tx=0).stop 2024-05-21T13:36:43.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.521+0000 7f264e68a640 1 -- 172.21.15.22:0/631687853 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f264806da20 msgr2=0x7f26480c5410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:43.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.525+0000 7f264e68a640 1 --2- 172.21.15.22:0/631687853 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f264806da20 0x7f26480c5410 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f263000d830 tx=0x7f263000dcf0 comp rx=0 tx=0).stop 2024-05-21T13:36:43.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.525+0000 7f264e68a640 1 -- 172.21.15.22:0/631687853 shutdown_connections 2024-05-21T13:36:43.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.525+0000 7f264e68a640 1 --2- 172.21.15.22:0/631687853 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f262806f400 0x7f26280718c0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:43.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.525+0000 7f264e68a640 1 --2- 172.21.15.22:0/631687853 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26480b4ab0 0x7f26480c5bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:43.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.525+0000 7f264e68a640 1 --2- 172.21.15.22:0/631687853 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f26480b46d0 0x7f2648154e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:43.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.525+0000 7f264e68a640 1 --2- 172.21.15.22:0/631687853 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f264806da20 0x7f26480c5410 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:43.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.525+0000 7f264e68a640 1 -- 172.21.15.22:0/631687853 >> 172.21.15.22:0/631687853 conn(0x7f2648068860 msgr2=0x7f264815b390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:43.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.525+0000 7f264e68a640 1 -- 172.21.15.22:0/631687853 shutdown_connections 2024-05-21T13:36:43.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.525+0000 7f264e68a640 1 -- 172.21.15.22:0/631687853 wait complete. 2024-05-21T13:36:43.519 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get run_dir 2024-05-21T13:36:43.643 INFO:teuthology.orchestra.run.smithi022.stdout:{"run_dir":"/var/run/ceph"} 2024-05-21T13:36:43.644 DEBUG:tasks.cephfs.filesystem:_json_asok output { "run_dir": "/var/run/ceph" } 2024-05-21T13:36:43.644 INFO:tasks.quiescer.fs.[cephfs]:Initializing Quiescer with seed 5442 2024-05-21T13:36:43.644 DEBUG:tasks.quiescer:Yielding 2024-05-21T13:36:43.644 INFO:teuthology.run_tasks:Running task workunit... 2024-05-21T13:36:43.657 INFO:tasks.workunit:Pulling workunits from ref 7956b5e965f6ee5669688b5643c11d881b72442c 2024-05-21T13:36:43.657 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-05-21T13:36:43.657 INFO:tasks.workunit:timeout=3h 2024-05-21T13:36:43.657 INFO:tasks.workunit:cleanup=True 2024-05-21T13:36:43.658 DEBUG:teuthology.orchestra.run.smithi022:> stat -- /home/ubuntu/cephtest/mnt.0 2024-05-21T13:36:43.658 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-21T13:36:43.663 INFO:teuthology.orchestra.run.smithi022.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-05-21T13:36:43.664 INFO:teuthology.orchestra.run.smithi022.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-05-21T13:36:43.664 INFO:teuthology.orchestra.run.smithi022.stdout:Device: 2dh/45d Inode: 1 Links: 2 2024-05-21T13:36:43.664 INFO:teuthology.orchestra.run.smithi022.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-21T13:36:43.664 INFO:teuthology.orchestra.run.smithi022.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-05-21T13:36:43.664 INFO:teuthology.orchestra.run.smithi022.stdout:Modify: 2024-05-21 13:36:02.779453134 +0000 2024-05-21T13:36:43.664 INFO:teuthology.orchestra.run.smithi022.stdout:Change: 2024-05-21 13:36:12.166959508 +0000 2024-05-21T13:36:43.664 INFO:teuthology.orchestra.run.smithi022.stdout: Birth: - 2024-05-21T13:36:43.664 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-05-21T13:36:43.664 DEBUG:teuthology.orchestra.run.smithi022:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-05-21T13:36:43.733 DEBUG:teuthology.orchestra.run.smithi022:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 7956b5e965f6ee5669688b5643c11d881b72442c 2024-05-21T13:36:43.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.797+0000 7fe504c4d640 1 Processor -- start 2024-05-21T13:36:43.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.797+0000 7fe504c4d640 1 -- start start 2024-05-21T13:36:43.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.797+0000 7fe504c4d640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe5000b4ab0 0x7fe5000b5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:43.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.797+0000 7fe504c4d640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe50006da20 0x7fe50006de90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:43.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.797+0000 7fe504c4d640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe50006e3d0 con 0x7fe5000b46d0 2024-05-21T13:36:43.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.797+0000 7fe504c4d640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7fe5000b58c0 con 0x7fe5000b4ab0 2024-05-21T13:36:43.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.797+0000 7fe504c4d640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7fe5000b5ba0 con 0x7fe50006da20 2024-05-21T13:36:43.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.797+0000 7fe4fdd9b640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe5000b4ab0 0x7fe5000b5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:43.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.797+0000 7fe4fed9d640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe50006da20 0x7fe50006de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:43.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.797+0000 7fe4fe59c640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fe5000b46d0 0x7fe50015c580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.22:46688/0 (socket says 172.21.15.22:46688) 2024-05-21T13:36:43.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.797+0000 7fe4fe59c640 1 -- 172.21.15.22:0/1907532119 learned_addr learned my addr 172.21.15.22:0/1907532119 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-21T13:36:43.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.797+0000 7fe4fdd9b640 1 -- 172.21.15.22:0/1907532119 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe50006da20 msgr2=0x7fe50006de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:43.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.797+0000 7fe4fdd9b640 1 --2- 172.21.15.22:0/1907532119 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe50006da20 0x7fe50006de90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:43.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.797+0000 7fe4fdd9b640 1 -- 172.21.15.22:0/1907532119 >> v1:172.21.15.115:6789/0 conn(0x7fe5000b46d0 legacy=0x7fe50015c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:43.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.797+0000 7fe4fdd9b640 1 -- 172.21.15.22:0/1907532119 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5000b5e80 con 0x7fe5000b4ab0 2024-05-21T13:36:43.779 INFO:tasks.workunit.client.0.smithi022.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-05-21T13:36:43.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.801+0000 7fe4fdd9b640 1 --2- 172.21.15.22:0/1907532119 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe5000b4ab0 0x7fe5000b5080 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe4f00097c0 tx=0x7fe4f001ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eaab1adbe4381a71 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:43.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.801+0000 7fe4fd59a640 1 -- 172.21.15.22:0/1907532119 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4f00b5070 con 0x7fe5000b4ab0 2024-05-21T13:36:43.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.801+0000 7fe4fd59a640 1 -- 172.21.15.22:0/1907532119 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4f00a8990 con 0x7fe5000b4ab0 2024-05-21T13:36:43.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.801+0000 7fe4fd59a640 1 -- 172.21.15.22:0/1907532119 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4f00a8d60 con 0x7fe5000b4ab0 2024-05-21T13:36:43.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.801+0000 7fe504c4d640 1 -- 172.21.15.22:0/1907532119 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe5000b4ab0 msgr2=0x7fe5000b5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:43.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.801+0000 7fe504c4d640 1 --2- 172.21.15.22:0/1907532119 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe5000b4ab0 0x7fe5000b5080 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe4f00097c0 tx=0x7fe4f001ec90 comp rx=0 tx=0).stop 2024-05-21T13:36:43.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.801+0000 7fe504c4d640 1 -- 172.21.15.22:0/1907532119 shutdown_connections 2024-05-21T13:36:43.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.801+0000 7fe504c4d640 1 --2- 172.21.15.22:0/1907532119 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe50006da20 0x7fe50006de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:43.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.801+0000 7fe504c4d640 1 --2- 172.21.15.22:0/1907532119 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe5000b4ab0 0x7fe5000b5080 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:43.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.801+0000 7fe504c4d640 1 -- 172.21.15.22:0/1907532119 >> 172.21.15.22:0/1907532119 conn(0x7fe500068860 msgr2=0x7fe5000d1510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:43.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.801+0000 7fe504c4d640 1 -- 172.21.15.22:0/1907532119 shutdown_connections 2024-05-21T13:36:43.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.801+0000 7fe504c4d640 1 -- 172.21.15.22:0/1907532119 wait complete. 2024-05-21T13:36:43.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.801+0000 7fe504c4d640 1 Processor -- start 2024-05-21T13:36:43.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.801+0000 7fe504c4d640 1 -- start start 2024-05-21T13:36:43.783 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.805+0000 7fe504c4d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe50006da20 0x7fe5001f2290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:43.783 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.805+0000 7fe504c4d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe5000b46d0 0x7fe500159b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:43.783 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.805+0000 7fe504c4d640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe5000b4ab0 0x7fe5001e20c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:43.783 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.805+0000 7fe504c4d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe5000b55c0 con 0x7fe50006da20 2024-05-21T13:36:43.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.805+0000 7fe504c4d640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fe50006d500 con 0x7fe5000b46d0 2024-05-21T13:36:43.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.805+0000 7fe504c4d640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7fe5000b6160 con 0x7fe5000b4ab0 2024-05-21T13:36:43.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.805+0000 7fe4fe59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe50006da20 0x7fe5001f2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:43.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.805+0000 7fe4fe59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe50006da20 0x7fe5001f2290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43310/0 (socket says 172.21.15.22:43310) 2024-05-21T13:36:43.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.805+0000 7fe4fe59c640 1 -- 172.21.15.22:0/1853619463 learned_addr learned my addr 172.21.15.22:0/1853619463 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:43.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.805+0000 7fe4fdd9b640 1 --2- 172.21.15.22:0/1853619463 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe5000b46d0 0x7fe500159b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:43.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.805+0000 7fe4fed9d640 1 --2- 172.21.15.22:0/1853619463 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe5000b4ab0 0x7fe5001e20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:43.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.805+0000 7fe4fe59c640 1 -- 172.21.15.22:0/1853619463 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe5000b4ab0 msgr2=0x7fe5001e20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:43.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.805+0000 7fe4fe59c640 1 --2- 172.21.15.22:0/1853619463 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe5000b4ab0 0x7fe5001e20c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:43.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.805+0000 7fe4fe59c640 1 -- 172.21.15.22:0/1853619463 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe5000b46d0 msgr2=0x7fe500159b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:43.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.805+0000 7fe4fe59c640 1 --2- 172.21.15.22:0/1853619463 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe5000b46d0 0x7fe500159b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:43.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.805+0000 7fe4fe59c640 1 -- 172.21.15.22:0/1853619463 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5000cbc90 con 0x7fe50006da20 2024-05-21T13:36:43.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.805+0000 7fe4fdd9b640 1 --2- 172.21.15.22:0/1853619463 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe5000b46d0 0x7fe500159b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:36:43.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.805+0000 7fe4fe59c640 1 --2- 172.21.15.22:0/1853619463 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe50006da20 0x7fe5001f2290 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe4f400c480 tx=0x7fe4f400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:43.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.805+0000 7fe4eeffd640 1 -- 172.21.15.22:0/1853619463 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4f4017070 con 0x7fe50006da20 2024-05-21T13:36:43.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.805+0000 7fe4eeffd640 1 -- 172.21.15.22:0/1853619463 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4f4005d10 con 0x7fe50006da20 2024-05-21T13:36:43.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.805+0000 7fe504c4d640 1 -- 172.21.15.22:0/1853619463 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5000cbf70 con 0x7fe50006da20 2024-05-21T13:36:43.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.805+0000 7fe4eeffd640 1 -- 172.21.15.22:0/1853619463 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4f40072b0 con 0x7fe50006da20 2024-05-21T13:36:43.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.805+0000 7fe504c4d640 1 -- 172.21.15.22:0/1853619463 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5000cc530 con 0x7fe50006da20 2024-05-21T13:36:43.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.805+0000 7fe504c4d640 1 -- 172.21.15.22:0/1853619463 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5000697d0 con 0x7fe50006da20 2024-05-21T13:36:43.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.805+0000 7fe4eeffd640 1 -- 172.21.15.22:0/1853619463 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fe4f401a070 con 0x7fe50006da20 2024-05-21T13:36:43.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.805+0000 7fe4eeffd640 1 --2- 172.21.15.22:0/1853619463 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fe4e006f400 0x7fe4e00718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:43.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.805+0000 7fe4eeffd640 1 -- 172.21.15.22:0/1853619463 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7fe4f408e980 con 0x7fe50006da20 2024-05-21T13:36:43.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.805+0000 7fe4fdd9b640 1 --2- 172.21.15.22:0/1853619463 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fe4e006f400 0x7fe4e00718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:43.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.809+0000 7fe4fdd9b640 1 --2- 172.21.15.22:0/1853619463 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fe4e006f400 0x7fe4e00718c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe4f00b2000 tx=0x7fe4f00aa070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:43.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:43.809+0000 7fe4eeffd640 1 -- 172.21.15.22:0/1853619463 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fe4f405b620 con 0x7fe50006da20 2024-05-21T13:36:43.986 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.005+0000 7fe504c4d640 1 -- 172.21.15.22:0/1853619463 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe5000c4e10 con 0x7fe50006da20 2024-05-21T13:36:43.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.009+0000 7fe4eeffd640 1 -- 172.21.15.22:0/1853619463 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6875 (secure 0 0 0) 0x7fe4f405af20 con 0x7fe50006da20 2024-05-21T13:36:43.987 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-21T13:36:43.987 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4224,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/355756580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":355756580},{"type":"v1","addr":"172.21.15.22:6833","nonce":355756580}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4230,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3277017116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":3277017116},{"type":"v1","addr":"172.21.15.22:6835","nonce":3277017116}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4233,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3840772609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3840772609},{"type":"v1","addr":"172.21.15.22:6837","nonce":3840772609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-21T13:35:57.106892+0000","modified":"2024-05-21T13:36:32.396351+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4300,"mds_1":4294,"mds_2":4248},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4248":{"gid":4248,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":12,"addr":"172.21.15.115:6837/2009761279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":2009761279},{"type":"v1","addr":"172.21.15.115:6837","nonce":2009761279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4294":{"gid":4294,"name":"b","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.115:6835/3894678097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3894678097},{"type":"v1","addr":"172.21.15.115:6835","nonce":3894678097}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4300":{"gid":4300,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.115:6839/1525097577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6838","nonce":1525097577},{"type":"v1","addr":"172.21.15.115:6839","nonce":1525097577}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4300,"qdb_cluster":[4248,4300,4294]},"id":1}]} 2024-05-21T13:36:43.988 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 14 2024-05-21T13:36:43.989 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.009+0000 7fe504c4d640 1 -- 172.21.15.22:0/1853619463 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fe4e006f400 msgr2=0x7fe4e00718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:43.989 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.009+0000 7fe504c4d640 1 --2- 172.21.15.22:0/1853619463 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fe4e006f400 0x7fe4e00718c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fe4f00b2000 tx=0x7fe4f00aa070 comp rx=0 tx=0).stop 2024-05-21T13:36:43.989 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.009+0000 7fe504c4d640 1 -- 172.21.15.22:0/1853619463 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe50006da20 msgr2=0x7fe5001f2290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:43.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.009+0000 7fe504c4d640 1 --2- 172.21.15.22:0/1853619463 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe50006da20 0x7fe5001f2290 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe4f400c480 tx=0x7fe4f400c940 comp rx=0 tx=0).stop 2024-05-21T13:36:43.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.009+0000 7fe504c4d640 1 -- 172.21.15.22:0/1853619463 shutdown_connections 2024-05-21T13:36:43.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.009+0000 7fe504c4d640 1 --2- 172.21.15.22:0/1853619463 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fe4e006f400 0x7fe4e00718c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:43.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.009+0000 7fe504c4d640 1 --2- 172.21.15.22:0/1853619463 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe5000b4ab0 0x7fe5001e20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:43.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.009+0000 7fe504c4d640 1 --2- 172.21.15.22:0/1853619463 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe5000b46d0 0x7fe500159b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:43.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.009+0000 7fe504c4d640 1 --2- 172.21.15.22:0/1853619463 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe50006da20 0x7fe5001f2290 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:43.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.009+0000 7fe504c4d640 1 -- 172.21.15.22:0/1853619463 >> 172.21.15.22:0/1853619463 conn(0x7fe500068860 msgr2=0x7fe5001575c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:43.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.009+0000 7fe504c4d640 1 -- 172.21.15.22:0/1853619463 shutdown_connections 2024-05-21T13:36:43.990 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.009+0000 7fe504c4d640 1 -- 172.21.15.22:0/1853619463 wait complete. 2024-05-21T13:36:44.609 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 14, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-05-21T13:35:57.106892+0000', 'modified': '2024-05-21T13:36:32.396351+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 4300, 'mds_1': 4294, 'mds_2': 4248}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4248': {'gid': 4248, 'name': 'd', 'rank': 2, 'incarnation': 13, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.115:6837/2009761279', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6836', 'nonce': 2009761279}, {'type': 'v1', 'addr': '172.21.15.115:6837', 'nonce': 2009761279}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4294': {'gid': 4294, 'name': 'b', 'rank': 1, 'incarnation': 9, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.115:6835/3894678097', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6834', 'nonce': 3894678097}, {'type': 'v1', 'addr': '172.21.15.115:6835', 'nonce': 3894678097}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4300': {'gid': 4300, 'name': 'f', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.115:6839/1525097577', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.115:6838', 'nonce': 1525097577}, {'type': 'v1', 'addr': '172.21.15.115:6839', 'nonce': 1525097577}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4300, 'qdb_cluster': [4248, 4300, 4294]} 2024-05-21T13:36:44.609 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-05-21T13:36:44.610 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-05-21T13:36:44.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.769+0000 7fab6d65b640 1 Processor -- start 2024-05-21T13:36:44.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.769+0000 7fab6d65b640 1 -- start start 2024-05-21T13:36:44.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.769+0000 7fab6d65b640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fab6815bd40 0x7fab680c9410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:44.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.769+0000 7fab6d65b640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab680c86b0 con 0x7fab680c7740 2024-05-21T13:36:44.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.769+0000 7fab6d65b640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab680684b0 con 0x7fab68155fe0 2024-05-21T13:36:44.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.769+0000 7fab6d65b640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7fab6815c1d0 con 0x7fab6815bd40 2024-05-21T13:36:44.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.773+0000 7fab5ffff640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fab680c7740 0x7fab681645d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:56780/0 (socket says 172.21.15.22:56780) 2024-05-21T13:36:44.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.773+0000 7fab5ffff640 1 -- 172.21.15.22:0/2113083560 learned_addr learned my addr 172.21.15.22:0/2113083560 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-21T13:36:44.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.773+0000 7fab677fe640 1 --2- 172.21.15.22:0/2113083560 >> v2:172.21.15.115:3300/0 conn(0x7fab6815bd40 0x7fab680c9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:44.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.773+0000 7fab667fc640 1 -- 172.21.15.22:0/2113083560 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1450731401 0 0) 0x7fab680c86b0 con 0x7fab680c7740 2024-05-21T13:36:44.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.773+0000 7fab667fc640 1 -- 172.21.15.22:0/2113083560 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fab54003530 con 0x7fab680c7740 2024-05-21T13:36:44.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.773+0000 7fab667fc640 1 -- 172.21.15.22:0/2113083560 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1580937639 0 0) 0x7fab54003530 con 0x7fab680c7740 2024-05-21T13:36:44.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.773+0000 7fab667fc640 1 -- 172.21.15.22:0/2113083560 >> v2:172.21.15.115:3300/0 conn(0x7fab6815bd40 msgr2=0x7fab680c9410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:44.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.773+0000 7fab667fc640 1 --2- 172.21.15.22:0/2113083560 >> v2:172.21.15.115:3300/0 conn(0x7fab6815bd40 0x7fab680c9410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:44.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.773+0000 7fab667fc640 1 -- 172.21.15.22:0/2113083560 >> v1:172.21.15.115:6789/0 conn(0x7fab68155fe0 legacy=0x7fab680704d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:44.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.773+0000 7fab667fc640 1 -- 172.21.15.22:0/2113083560 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab68068790 con 0x7fab680c7740 2024-05-21T13:36:44.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.773+0000 7fab667fc640 1 -- 172.21.15.22:0/2113083560 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2684847062 0 0) 0x7fab50001700 con 0x7fab680c7740 2024-05-21T13:36:44.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.773+0000 7fab667fc640 1 -- 172.21.15.22:0/2113083560 >> v1:172.21.15.22:6789/0 conn(0x7fab680c7740 legacy=0x7fab681645d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:44.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.773+0000 7fab667fc640 1 --2- 172.21.15.22:0/2113083560 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fab54003a60 0x7fab54003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:44.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.773+0000 7fab667fc640 1 --2- 172.21.15.22:0/2113083560 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fab54004810 0x7fab54004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:44.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.773+0000 7fab667fc640 1 --2- 172.21.15.22:0/2113083560 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fab540051d0 0x7fab5400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:44.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.773+0000 7fab667fc640 1 -- 172.21.15.22:0/2113083560 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fab5400c140 con 0x7fab54003a60 2024-05-21T13:36:44.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.773+0000 7fab667fc640 1 -- 172.21.15.22:0/2113083560 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fab5400c2f0 con 0x7fab54004810 2024-05-21T13:36:44.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.773+0000 7fab667fc640 1 -- 172.21.15.22:0/2113083560 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7fab5400c4f0 con 0x7fab540051d0 2024-05-21T13:36:44.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.773+0000 7fab66ffd640 1 --2- 172.21.15.22:0/2113083560 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fab54003a60 0x7fab54003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:44.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.773+0000 7fab5ffff640 1 --2- 172.21.15.22:0/2113083560 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fab54004810 0x7fab54004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:44.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.773+0000 7fab677fe640 1 --2- 172.21.15.22:0/2113083560 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fab540051d0 0x7fab5400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:44.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.773+0000 7fab66ffd640 1 -- 172.21.15.22:0/2113083560 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fab540051d0 msgr2=0x7fab5400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:44.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.773+0000 7fab66ffd640 1 --2- 172.21.15.22:0/2113083560 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fab540051d0 0x7fab5400b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:44.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.773+0000 7fab66ffd640 1 -- 172.21.15.22:0/2113083560 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fab54004810 msgr2=0x7fab54004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:44.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.773+0000 7fab66ffd640 1 --2- 172.21.15.22:0/2113083560 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fab54004810 0x7fab54004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:44.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.773+0000 7fab66ffd640 1 -- 172.21.15.22:0/2113083560 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab54003530 con 0x7fab54003a60 2024-05-21T13:36:44.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.773+0000 7fab677fe640 1 -- 172.21.15.22:0/2113083560 reap_dead start 2024-05-21T13:36:44.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.773+0000 7fab66ffd640 1 --2- 172.21.15.22:0/2113083560 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fab54003a60 0x7fab54003e80 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fab58001790 tx=0x7fab5801c3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be1cb9ffa77e9433 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:44.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.773+0000 7fab667fc640 1 -- 172.21.15.22:0/2113083560 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab580013e0 con 0x7fab54003a60 2024-05-21T13:36:44.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.773+0000 7fab667fc640 1 -- 172.21.15.22:0/2113083560 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab580052d0 con 0x7fab54003a60 2024-05-21T13:36:44.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.773+0000 7fab667fc640 1 -- 172.21.15.22:0/2113083560 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab58003840 con 0x7fab54003a60 2024-05-21T13:36:44.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.777+0000 7fab6d65b640 1 -- 172.21.15.22:0/2113083560 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fab54003a60 msgr2=0x7fab54003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:44.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.777+0000 7fab6d65b640 1 --2- 172.21.15.22:0/2113083560 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fab54003a60 0x7fab54003e80 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fab58001790 tx=0x7fab5801c3d0 comp rx=0 tx=0).stop 2024-05-21T13:36:44.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.777+0000 7fab6d65b640 1 -- 172.21.15.22:0/2113083560 shutdown_connections 2024-05-21T13:36:44.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.777+0000 7fab6d65b640 1 --2- 172.21.15.22:0/2113083560 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fab54003a60 0x7fab54003e80 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:44.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.777+0000 7fab6d65b640 1 -- 172.21.15.22:0/2113083560 >> 172.21.15.22:0/2113083560 conn(0x7fab680cd8b0 msgr2=0x7fab680cdcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:44.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.777+0000 7fab6d65b640 1 -- 172.21.15.22:0/2113083560 shutdown_connections 2024-05-21T13:36:44.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.777+0000 7fab6d65b640 1 -- 172.21.15.22:0/2113083560 wait complete. 2024-05-21T13:36:44.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.777+0000 7fab6d65b640 1 Processor -- start 2024-05-21T13:36:44.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.777+0000 7fab6d65b640 1 -- start start 2024-05-21T13:36:44.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.777+0000 7fab6d65b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fab54003a60 0x7fab6815cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:44.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.777+0000 7fab6d65b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fab681e7ce0 0x7fab6815ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:44.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.777+0000 7fab6d65b640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fab681520e0 0x7fab681e8870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:44.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.777+0000 7fab6d65b640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fab680c8ca0 con 0x7fab54003a60 2024-05-21T13:36:44.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.777+0000 7fab6d65b640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fab68068260 con 0x7fab681e7ce0 2024-05-21T13:36:44.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.777+0000 7fab6d65b640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7fab680ce6f0 con 0x7fab681520e0 2024-05-21T13:36:44.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.777+0000 7fab66ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fab54003a60 0x7fab6815cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:44.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.777+0000 7fab66ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fab54003a60 0x7fab6815cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43332/0 (socket says 172.21.15.22:43332) 2024-05-21T13:36:44.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.777+0000 7fab66ffd640 1 -- 172.21.15.22:0/761496319 learned_addr learned my addr 172.21.15.22:0/761496319 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:44.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.777+0000 7fab677fe640 1 --2- 172.21.15.22:0/761496319 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fab681520e0 0x7fab681e8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:44.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.777+0000 7fab5ffff640 1 --2- 172.21.15.22:0/761496319 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fab681e7ce0 0x7fab6815ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:44.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.777+0000 7fab66ffd640 1 -- 172.21.15.22:0/761496319 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fab681520e0 msgr2=0x7fab681e8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:44.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.777+0000 7fab66ffd640 1 --2- 172.21.15.22:0/761496319 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fab681520e0 0x7fab681e8870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:44.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.777+0000 7fab66ffd640 1 -- 172.21.15.22:0/761496319 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fab681e7ce0 msgr2=0x7fab6815ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:44.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.777+0000 7fab66ffd640 1 --2- 172.21.15.22:0/761496319 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fab681e7ce0 0x7fab6815ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:44.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.777+0000 7fab66ffd640 1 -- 172.21.15.22:0/761496319 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab68152690 con 0x7fab54003a60 2024-05-21T13:36:44.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.777+0000 7fab66ffd640 1 --2- 172.21.15.22:0/761496319 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fab54003a60 0x7fab6815cea0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fab5801aad0 tx=0x7fab54005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:44.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.777+0000 7fab5f7fe640 1 -- 172.21.15.22:0/761496319 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab580013c0 con 0x7fab54003a60 2024-05-21T13:36:44.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.777+0000 7fab5f7fe640 1 -- 172.21.15.22:0/761496319 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab58005480 con 0x7fab54003a60 2024-05-21T13:36:44.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.777+0000 7fab6d65b640 1 -- 172.21.15.22:0/761496319 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab6815eed0 con 0x7fab54003a60 2024-05-21T13:36:44.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.777+0000 7fab5f7fe640 1 -- 172.21.15.22:0/761496319 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab58003ce0 con 0x7fab54003a60 2024-05-21T13:36:44.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.777+0000 7fab6d65b640 1 -- 172.21.15.22:0/761496319 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab6815f490 con 0x7fab54003a60 2024-05-21T13:36:44.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.781+0000 7fab5f7fe640 1 -- 172.21.15.22:0/761496319 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fab580be020 con 0x7fab54003a60 2024-05-21T13:36:44.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.781+0000 7fab5f7fe640 1 --2- 172.21.15.22:0/761496319 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fab4806f430 0x7fab480718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:44.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.781+0000 7fab5f7fe640 1 -- 172.21.15.22:0/761496319 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7fab58128c60 con 0x7fab54003a60 2024-05-21T13:36:44.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.781+0000 7fab5ffff640 1 --2- 172.21.15.22:0/761496319 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fab4806f430 0x7fab480718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:44.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.781+0000 7fab707e6000 1 Processor -- start 2024-05-21T13:36:44.783 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.781+0000 7fab5ffff640 1 --2- 172.21.15.22:0/761496319 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fab4806f430 0x7fab480718f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fab6806e300 tx=0x7fab50009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:44.783 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.781+0000 7fab707e6000 1 -- start start 2024-05-21T13:36:44.783 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.781+0000 7fab707e6000 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55baa5c604a0 0x55baa5c29200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:44.783 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.781+0000 7fab707e6000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55baa5c29740 0x55baa5c489b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:44.783 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.781+0000 7fab707e6000 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55baa5c48ef0 0x55baa5c492d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:44.783 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.781+0000 7fab707e6000 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55baa5a7d6d0 con 0x55baa5c48ef0 2024-05-21T13:36:44.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.781+0000 7fab707e6000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55baa5a6d270 con 0x55baa5c29740 2024-05-21T13:36:44.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.781+0000 7fab707e6000 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x55baa5a712b0 con 0x55baa5c604a0 2024-05-21T13:36:44.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.781+0000 7fab677fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55baa5c48ef0 0x55baa5c492d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:44.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.781+0000 7fab677fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55baa5c48ef0 0x55baa5c492d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43338/0 (socket says 172.21.15.22:43338) 2024-05-21T13:36:44.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.781+0000 7fab677fe640 1 -- 172.21.15.22:0/1072422115 learned_addr learned my addr 172.21.15.22:0/1072422115 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:44.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.781+0000 7fab5ffff640 1 --2- 172.21.15.22:0/1072422115 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55baa5c29740 0x55baa5c489b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:44.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.781+0000 7fab66ffd640 1 --2- 172.21.15.22:0/1072422115 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55baa5c604a0 0x55baa5c29200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:44.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.781+0000 7fab677fe640 1 -- 172.21.15.22:0/1072422115 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55baa5c604a0 msgr2=0x55baa5c29200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:44.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.781+0000 7fab677fe640 1 --2- 172.21.15.22:0/1072422115 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55baa5c604a0 0x55baa5c29200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:44.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.781+0000 7fab677fe640 1 -- 172.21.15.22:0/1072422115 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55baa5c29740 msgr2=0x55baa5c489b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:44.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.781+0000 7fab677fe640 1 --2- 172.21.15.22:0/1072422115 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55baa5c29740 0x55baa5c489b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:44.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.781+0000 7fab677fe640 1 -- 172.21.15.22:0/1072422115 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55baa5a4bbf0 con 0x55baa5c48ef0 2024-05-21T13:36:44.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.781+0000 7fab677fe640 1 --2- 172.21.15.22:0/1072422115 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55baa5c48ef0 0x55baa5c492d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fab680716f0 tx=0x7fab60009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63fda9ea35478a73 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:44.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.781+0000 7fab5cff9640 1 -- 172.21.15.22:0/1072422115 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab6001a020 con 0x55baa5c48ef0 2024-05-21T13:36:44.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.781+0000 7fab5cff9640 1 -- 172.21.15.22:0/1072422115 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab60007e40 con 0x55baa5c48ef0 2024-05-21T13:36:44.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.781+0000 7fab5cff9640 1 -- 172.21.15.22:0/1072422115 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab60016860 con 0x55baa5c48ef0 2024-05-21T13:36:44.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.785+0000 7fab707e6000 1 -- 172.21.15.22:0/1072422115 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55baa5c48ef0 msgr2=0x55baa5c492d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:44.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.785+0000 7fab707e6000 1 --2- 172.21.15.22:0/1072422115 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55baa5c48ef0 0x55baa5c492d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fab680716f0 tx=0x7fab60009750 comp rx=0 tx=0).stop 2024-05-21T13:36:44.786 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.785+0000 7fab707e6000 1 -- 172.21.15.22:0/1072422115 shutdown_connections 2024-05-21T13:36:44.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.785+0000 7fab707e6000 1 --2- 172.21.15.22:0/1072422115 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55baa5c48ef0 0x55baa5c492d0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:44.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.785+0000 7fab707e6000 1 --2- 172.21.15.22:0/1072422115 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55baa5c29740 0x55baa5c489b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:44.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.785+0000 7fab707e6000 1 --2- 172.21.15.22:0/1072422115 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55baa5c604a0 0x55baa5c29200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:44.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.785+0000 7fab707e6000 1 -- 172.21.15.22:0/1072422115 >> 172.21.15.22:0/1072422115 conn(0x55baa5b08ef0 msgr2=0x55baa5c5fb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:44.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.785+0000 7fab707e6000 1 -- 172.21.15.22:0/1072422115 shutdown_connections 2024-05-21T13:36:44.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.785+0000 7fab707e6000 1 -- 172.21.15.22:0/1072422115 wait complete. 2024-05-21T13:36:44.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.785+0000 7fab707e6000 1 -- start start 2024-05-21T13:36:44.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.785+0000 7fab707e6000 1 Processor -- start 2024-05-21T13:36:44.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.785+0000 7fab707e6000 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55baa5c29740 0x55baa5c6d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:44.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.785+0000 7fab707e6000 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55baa5c48ef0 0x55baa5c6d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:44.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.785+0000 7fab707e6000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55baa5c604a0 0x55baa5c24c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:44.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.785+0000 7fab707e6000 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55baa5a30630 con 0x55baa5c29740 2024-05-21T13:36:44.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.785+0000 7fab707e6000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55baa5af1570 con 0x55baa5c604a0 2024-05-21T13:36:44.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.785+0000 7fab707e6000 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x55baa5a7c4a0 con 0x55baa5c48ef0 2024-05-21T13:36:44.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.785+0000 7fab707e6000 10 client.0 _ll_register_callbacks cb 0x55baa5c0c540 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-21T13:36:44.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.785+0000 7fab66ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55baa5c29740 0x55baa5c6d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:44.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.785+0000 7fab66ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55baa5c29740 0x55baa5c6d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43342/0 (socket says 172.21.15.22:43342) 2024-05-21T13:36:44.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.785+0000 7fab66ffd640 1 -- 172.21.15.22:0/755188865 learned_addr learned my addr 172.21.15.22:0/755188865 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:44.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.785+0000 7fab5ffff640 1 --2- 172.21.15.22:0/755188865 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55baa5c48ef0 0x55baa5c6d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:44.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.785+0000 7fab66ffd640 1 -- 172.21.15.22:0/755188865 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55baa5c48ef0 msgr2=0x55baa5c6d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:44.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.785+0000 7fab66ffd640 1 --2- 172.21.15.22:0/755188865 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55baa5c48ef0 0x55baa5c6d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:44.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.785+0000 7fab677fe640 1 --2- 172.21.15.22:0/755188865 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55baa5c604a0 0x55baa5c24c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:44.790 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.785+0000 7fab66ffd640 1 -- 172.21.15.22:0/755188865 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55baa5c604a0 msgr2=0x55baa5c24c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:44.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.785+0000 7fab66ffd640 1 --2- 172.21.15.22:0/755188865 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55baa5c604a0 0x55baa5c24c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:44.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.785+0000 7fab66ffd640 1 -- 172.21.15.22:0/755188865 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55baa5ab59b0 con 0x55baa5c29740 2024-05-21T13:36:44.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.785+0000 7fab5ffff640 1 --2- 172.21.15.22:0/755188865 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55baa5c48ef0 0x55baa5c6d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:36:44.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.785+0000 7fab66ffd640 1 --2- 172.21.15.22:0/755188865 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55baa5c29740 0x55baa5c6d050 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fab580f4e70 tx=0x7fab580f5790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b29be8bd692d03ad server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:44.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.785+0000 7fab45ffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-05-21T13:36:44.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.785+0000 7fab45ffb640 1 -- 172.21.15.22:0/755188865 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab580f4c80 con 0x55baa5c29740 2024-05-21T13:36:44.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.785+0000 7fab45ffb640 1 -- 172.21.15.22:0/755188865 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7fab580f90d0 con 0x55baa5c29740 2024-05-21T13:36:44.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.785+0000 7fab707e6000 1 -- 172.21.15.22:0/755188865 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fab60007e40 con 0x55baa5c29740 2024-05-21T13:36:44.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.785+0000 7fab45ffb640 1 -- 172.21.15.22:0/755188865 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7fab580f5870 con 0x55baa5c29740 2024-05-21T13:36:44.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.785+0000 7fab707e6000 10 client.4806 fetch_fsmap learned FSMap version 14 2024-05-21T13:36:44.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.785+0000 7fab707e6000 1 -- 172.21.15.22:0/755188865 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x55baa5a48510 con 0x55baa5c29740 2024-05-21T13:36:44.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.785+0000 7fab45ffb640 1 -- 172.21.15.22:0/755188865 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab60007e40 con 0x55baa5c29740 2024-05-21T13:36:44.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.785+0000 7fab45ffb640 1 -- 172.21.15.22:0/755188865 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7fab580f43d0 con 0x55baa5c29740 2024-05-21T13:36:44.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.785+0000 7fab707e6000 10 client.4806 fetch_fsmap finished waiting for FSMap version 14 2024-05-21T13:36:44.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.785+0000 7fab707e6000 10 client.4806 resolve_mds: resolved name 'd' to daemon mds.d 2024-05-21T13:36:44.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.785+0000 7fab707e6000 20 client.4806 populate_metadata read hostname 'smithi022' 2024-05-21T13:36:44.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.785+0000 7fab707e6000 1 --2- 172.21.15.22:0/755188865 >> [v2:172.21.15.115:6836/2009761279,v1:172.21.15.115:6837/2009761279] conn(0x55baa5c25990 0x55baa5c25d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:44.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.785+0000 7fab707e6000 4 client.4806 mds_command: new command op to 4248 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-21T13:36:44.793 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.785+0000 7fab707e6000 1 -- 172.21.15.22:0/755188865 --> [v2:172.21.15.115:6836/2009761279,v1:172.21.15.115:6837/2009761279] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55baa5a08bc0 con 0x55baa5c25990 2024-05-21T13:36:44.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.785+0000 7fab5ffff640 1 --2- 172.21.15.22:0/755188865 >> [v2:172.21.15.115:6836/2009761279,v1:172.21.15.115:6837/2009761279] conn(0x55baa5c25990 0x55baa5c25d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:44.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.789+0000 7fab45ffb640 10 client.4806 ms_handle_connect on v2:172.21.15.115:6836/2009761279 2024-05-21T13:36:44.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.789+0000 7fab5ffff640 1 --2- 172.21.15.22:0/755188865 >> [v2:172.21.15.115:6836/2009761279,v1:172.21.15.115:6837/2009761279] conn(0x55baa5c25990 0x55baa5c25d70 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7096a909240e3355 server_cookie=9bc048776aac8459 in_seq=0 out_seq=0 2024-05-21T13:36:44.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.789+0000 7fab45ffb640 1 -- 172.21.15.22:0/755188865 <== mds.2 v2:172.21.15.115:6836/2009761279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x55baa5a08bc0 con 0x55baa5c25990 2024-05-21T13:36:44.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.789+0000 7fab45ffb640 10 client.4806 handle_command_reply: tid=0 2024-05-21T13:36:44.794 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.789+0000 7fab707e6000 1 client.4806 shutdown 2024-05-21T13:36:44.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.789+0000 7fab707e6000 1 -- 172.21.15.22:0/755188865 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55baa5c29740 msgr2=0x55baa5c6d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:44.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.789+0000 7fab707e6000 1 --2- 172.21.15.22:0/755188865 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55baa5c29740 0x55baa5c6d050 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fab580f4e70 tx=0x7fab580f5790 comp rx=0 tx=0).stop 2024-05-21T13:36:44.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.789+0000 7fab707e6000 1 -- 172.21.15.22:0/755188865 shutdown_connections 2024-05-21T13:36:44.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.789+0000 7fab707e6000 1 --2- 172.21.15.22:0/755188865 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55baa5c604a0 0x55baa5c24c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:44.795 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.789+0000 7fab707e6000 1 --2- 172.21.15.22:0/755188865 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55baa5c48ef0 0x55baa5c6d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:44.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.789+0000 7fab707e6000 1 --2- 172.21.15.22:0/755188865 >> [v2:172.21.15.115:6836/2009761279,v1:172.21.15.115:6837/2009761279] conn(0x55baa5c25990 0x55baa5c25d70 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:44.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.789+0000 7fab707e6000 1 --2- 172.21.15.22:0/755188865 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55baa5c29740 0x55baa5c6d050 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:44.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.789+0000 7fab45ffb640 0 client.4806 ms_handle_reset on v2:172.21.15.115:6836/2009761279 2024-05-21T13:36:44.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.789+0000 7fab707e6000 1 -- 172.21.15.22:0/755188865 >> 172.21.15.22:0/755188865 conn(0x55baa5b08ef0 msgr2=0x55baa5c1f8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:44.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.789+0000 7fab707e6000 1 -- 172.21.15.22:0/755188865 shutdown_connections 2024-05-21T13:36:44.796 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.789+0000 7fab707e6000 1 -- 172.21.15.22:0/755188865 wait complete. 2024-05-21T13:36:44.797 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.789+0000 7fab707e6000 20 client.4806 trim_cache size 0 max 16384 2024-05-21T13:36:44.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.809+0000 7fab707e6000 1 Processor -- start 2024-05-21T13:36:44.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.809+0000 7fab707e6000 1 -- start start 2024-05-21T13:36:44.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.809+0000 7fab707e6000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55baa5c29740 0x55baa5c7d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:44.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.809+0000 7fab707e6000 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55baa5c48ef0 0x55baa5c5b360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:44.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.809+0000 7fab707e6000 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55baa5c604a0 0x55baa5c5b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:44.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.809+0000 7fab707e6000 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55baa5a0a200 con 0x55baa5c48ef0 2024-05-21T13:36:44.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.809+0000 7fab707e6000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55baa5a057b0 con 0x55baa5c29740 2024-05-21T13:36:44.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.809+0000 7fab707e6000 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x55baa5a705c0 con 0x55baa5c604a0 2024-05-21T13:36:44.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.809+0000 7fab5ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55baa5c48ef0 0x55baa5c5b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:44.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.809+0000 7fab5ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55baa5c48ef0 0x55baa5c5b360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43354/0 (socket says 172.21.15.22:43354) 2024-05-21T13:36:44.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.809+0000 7fab5ffff640 1 -- 172.21.15.22:0/2984165807 learned_addr learned my addr 172.21.15.22:0/2984165807 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:44.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.809+0000 7fab5ffff640 1 -- 172.21.15.22:0/2984165807 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55baa5c604a0 msgr2=0x55baa5c5b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:44.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.809+0000 7fab5ffff640 1 --2- 172.21.15.22:0/2984165807 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55baa5c604a0 0x55baa5c5b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:44.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.809+0000 7fab5ffff640 1 -- 172.21.15.22:0/2984165807 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55baa5c29740 msgr2=0x55baa5c7d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:44.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.809+0000 7fab5ffff640 1 --2- 172.21.15.22:0/2984165807 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55baa5c29740 0x55baa5c7d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:44.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.809+0000 7fab5ffff640 1 -- 172.21.15.22:0/2984165807 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55baa5a0e860 con 0x55baa5c48ef0 2024-05-21T13:36:44.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.809+0000 7fab5ffff640 1 --2- 172.21.15.22:0/2984165807 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55baa5c48ef0 0x55baa5c5b360 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fab6806aee0 tx=0x7fab5000c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e22550caf724b423 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:44.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.809+0000 7fab47fff640 1 -- 172.21.15.22:0/2984165807 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab50024ad0 con 0x55baa5c48ef0 2024-05-21T13:36:44.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.809+0000 7fab47fff640 1 -- 172.21.15.22:0/2984165807 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab5001b070 con 0x55baa5c48ef0 2024-05-21T13:36:44.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.809+0000 7fab47fff640 1 -- 172.21.15.22:0/2984165807 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab50010e60 con 0x55baa5c48ef0 2024-05-21T13:36:44.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.809+0000 7fab707e6000 1 -- 172.21.15.22:0/2984165807 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55baa5c48ef0 msgr2=0x55baa5c5b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:44.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.809+0000 7fab707e6000 1 --2- 172.21.15.22:0/2984165807 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55baa5c48ef0 0x55baa5c5b360 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fab6806aee0 tx=0x7fab5000c000 comp rx=0 tx=0).stop 2024-05-21T13:36:44.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.809+0000 7fab707e6000 1 -- 172.21.15.22:0/2984165807 shutdown_connections 2024-05-21T13:36:44.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.809+0000 7fab707e6000 1 --2- 172.21.15.22:0/2984165807 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55baa5c604a0 0x55baa5c5b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:44.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.809+0000 7fab707e6000 1 --2- 172.21.15.22:0/2984165807 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55baa5c48ef0 0x55baa5c5b360 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:44.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.809+0000 7fab707e6000 1 --2- 172.21.15.22:0/2984165807 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55baa5c29740 0x55baa5c7d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:44.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.809+0000 7fab707e6000 1 -- 172.21.15.22:0/2984165807 >> 172.21.15.22:0/2984165807 conn(0x55baa5b08ef0 msgr2=0x55baa5c47f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:44.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.809+0000 7fab707e6000 1 -- 172.21.15.22:0/2984165807 shutdown_connections 2024-05-21T13:36:44.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.809+0000 7fab707e6000 1 -- 172.21.15.22:0/2984165807 wait complete. 2024-05-21T13:36:44.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.809+0000 7fab707e6000 1 -- start start 2024-05-21T13:36:44.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.809+0000 7fab707e6000 1 Processor -- start 2024-05-21T13:36:44.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.813+0000 7fab707e6000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55baa5c29740 0x55baa5c72e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:44.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.813+0000 7fab707e6000 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55baa5c48ef0 0x55baa5c733d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:44.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.813+0000 7fab707e6000 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55baa5c604a0 0x55baa5cd5640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:44.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.813+0000 7fab707e6000 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55baa59f1b10 con 0x55baa5c604a0 2024-05-21T13:36:44.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.813+0000 7fab707e6000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55baa5a758e0 con 0x55baa5c29740 2024-05-21T13:36:44.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.813+0000 7fab707e6000 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x55baa5a30630 con 0x55baa5c48ef0 2024-05-21T13:36:44.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.813+0000 7fab707e6000 10 client.0 _ll_register_callbacks cb 0x7fab580f4f40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-21T13:36:44.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.813+0000 7fab677fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55baa5c604a0 0x55baa5cd5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:44.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.813+0000 7fab677fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55baa5c604a0 0x55baa5cd5640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43356/0 (socket says 172.21.15.22:43356) 2024-05-21T13:36:44.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.813+0000 7fab677fe640 1 -- 172.21.15.22:0/1605365381 learned_addr learned my addr 172.21.15.22:0/1605365381 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:44.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.813+0000 7fab5ffff640 1 --2- 172.21.15.22:0/1605365381 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55baa5c48ef0 0x55baa5c733d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:44.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.813+0000 7fab677fe640 1 -- 172.21.15.22:0/1605365381 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55baa5c48ef0 msgr2=0x55baa5c733d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:44.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.813+0000 7fab66ffd640 1 --2- 172.21.15.22:0/1605365381 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55baa5c29740 0x55baa5c72e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:44.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.813+0000 7fab677fe640 1 --2- 172.21.15.22:0/1605365381 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55baa5c48ef0 0x55baa5c733d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:44.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.813+0000 7fab677fe640 1 -- 172.21.15.22:0/1605365381 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55baa5c29740 msgr2=0x55baa5c72e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:44.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.813+0000 7fab677fe640 1 --2- 172.21.15.22:0/1605365381 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55baa5c29740 0x55baa5c72e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:44.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.813+0000 7fab677fe640 1 -- 172.21.15.22:0/1605365381 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55baa5a24e80 con 0x55baa5c604a0 2024-05-21T13:36:44.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.813+0000 7fab677fe640 1 --2- 172.21.15.22:0/1605365381 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55baa5c604a0 0x55baa5cd5640 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fab60009790 tx=0x7fab60004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=228ab201f52edfa9 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:44.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.813+0000 7fab45ffb640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-05-21T13:36:44.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.813+0000 7fab45ffb640 1 -- 172.21.15.22:0/1605365381 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab6001a050 con 0x55baa5c604a0 2024-05-21T13:36:44.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.813+0000 7fab45ffb640 1 -- 172.21.15.22:0/1605365381 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7fab6001f630 con 0x55baa5c604a0 2024-05-21T13:36:44.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.813+0000 7fab707e6000 1 -- 172.21.15.22:0/1605365381 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fab5001b070 con 0x55baa5c604a0 2024-05-21T13:36:44.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.813+0000 7fab45ffb640 1 -- 172.21.15.22:0/1605365381 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7fab60031050 con 0x55baa5c604a0 2024-05-21T13:36:44.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.813+0000 7fab707e6000 10 client.4812 fetch_fsmap learned FSMap version 14 2024-05-21T13:36:44.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.813+0000 7fab707e6000 1 -- 172.21.15.22:0/1605365381 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x55baa5af1a00 con 0x55baa5c604a0 2024-05-21T13:36:44.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.813+0000 7fab45ffb640 1 -- 172.21.15.22:0/1605365381 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab5001b070 con 0x55baa5c604a0 2024-05-21T13:36:44.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.813+0000 7fab45ffb640 1 -- 172.21.15.22:0/1605365381 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7fab60034020 con 0x55baa5c604a0 2024-05-21T13:36:44.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.813+0000 7fab707e6000 10 client.4812 fetch_fsmap finished waiting for FSMap version 14 2024-05-21T13:36:44.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.813+0000 7fab707e6000 10 client.4812 resolve_mds: resolved name 'd' to daemon mds.d 2024-05-21T13:36:44.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.813+0000 7fab707e6000 20 client.4812 populate_metadata read hostname 'smithi022' 2024-05-21T13:36:44.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.813+0000 7fab707e6000 1 --2- 172.21.15.22:0/1605365381 >> [v2:172.21.15.115:6836/2009761279,v1:172.21.15.115:6837/2009761279] conn(0x55baa5cd5fa0 0x55baa5cd6380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:44.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.813+0000 7fab707e6000 4 client.4812 mds_command: new command op to 4248 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-21T13:36:44.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.813+0000 7fab707e6000 1 -- 172.21.15.22:0/1605365381 --> [v2:172.21.15.115:6836/2009761279,v1:172.21.15.115:6837/2009761279] -- command(tid 0: {"prefix": "status"}) -- 0x55baa5a0cdc0 con 0x55baa5cd5fa0 2024-05-21T13:36:44.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.813+0000 7fab66ffd640 1 --2- 172.21.15.22:0/1605365381 >> [v2:172.21.15.115:6836/2009761279,v1:172.21.15.115:6837/2009761279] conn(0x55baa5cd5fa0 0x55baa5cd6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:44.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.813+0000 7fab45ffb640 10 client.4812 ms_handle_connect on v2:172.21.15.115:6836/2009761279 2024-05-21T13:36:44.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.813+0000 7fab66ffd640 1 --2- 172.21.15.22:0/1605365381 >> [v2:172.21.15.115:6836/2009761279,v1:172.21.15.115:6837/2009761279] conn(0x55baa5cd5fa0 0x55baa5cd6380 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=78c03826444db2bc server_cookie=1c4cc9d9797d040d in_seq=0 out_seq=0 2024-05-21T13:36:44.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.813+0000 7fab45ffb640 1 -- 172.21.15.22:0/1605365381 <== mds.2 v2:172.21.15.115:6836/2009761279 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55baa5a0cdc0 con 0x55baa5cd5fa0 2024-05-21T13:36:44.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.813+0000 7fab45ffb640 10 client.4812 handle_command_reply: tid=0 2024-05-21T13:36:44.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.813+0000 7fab707e6000 1 client.4812 shutdown 2024-05-21T13:36:44.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.813+0000 7fab707e6000 1 -- 172.21.15.22:0/1605365381 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55baa5c604a0 msgr2=0x55baa5cd5640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:44.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.813+0000 7fab707e6000 1 --2- 172.21.15.22:0/1605365381 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55baa5c604a0 0x55baa5cd5640 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fab60009790 tx=0x7fab60004ac0 comp rx=0 tx=0).stop 2024-05-21T13:36:44.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.813+0000 7fab707e6000 1 -- 172.21.15.22:0/1605365381 shutdown_connections 2024-05-21T13:36:44.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.813+0000 7fab707e6000 1 --2- 172.21.15.22:0/1605365381 >> [v2:172.21.15.115:6836/2009761279,v1:172.21.15.115:6837/2009761279] conn(0x55baa5cd5fa0 0x55baa5cd6380 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:44.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.813+0000 7fab707e6000 1 --2- 172.21.15.22:0/1605365381 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55baa5c604a0 0x55baa5cd5640 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:44.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.813+0000 7fab707e6000 1 --2- 172.21.15.22:0/1605365381 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55baa5c48ef0 0x55baa5c733d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:44.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.813+0000 7fab707e6000 1 --2- 172.21.15.22:0/1605365381 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55baa5c29740 0x55baa5c72e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:44.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.813+0000 7fab45ffb640 0 client.4812 ms_handle_reset on v2:172.21.15.115:6836/2009761279 2024-05-21T13:36:44.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.813+0000 7fab707e6000 1 -- 172.21.15.22:0/1605365381 >> 172.21.15.22:0/1605365381 conn(0x55baa5b08ef0 msgr2=0x55baa5c23970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:44.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.817+0000 7fab707e6000 1 -- 172.21.15.22:0/1605365381 shutdown_connections 2024-05-21T13:36:44.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.817+0000 7fab707e6000 1 -- 172.21.15.22:0/1605365381 wait complete. 2024-05-21T13:36:44.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.817+0000 7fab707e6000 20 client.4812 trim_cache size 0 max 16384 2024-05-21T13:36:44.817 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-05-21T13:36:44.818 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_fsid": "f2c96204-e240-4e7f-8a76-927b4f80f534", 2024-05-21T13:36:44.818 INFO:teuthology.orchestra.run.smithi022.stdout: "whoami": 2, 2024-05-21T13:36:44.818 INFO:teuthology.orchestra.run.smithi022.stdout: "id": 4248, 2024-05-21T13:36:44.818 INFO:teuthology.orchestra.run.smithi022.stdout: "want_state": "up:active", 2024-05-21T13:36:44.818 INFO:teuthology.orchestra.run.smithi022.stdout: "state": "up:active", 2024-05-21T13:36:44.818 INFO:teuthology.orchestra.run.smithi022.stdout: "fs_name": "cephfs", 2024-05-21T13:36:44.818 INFO:teuthology.orchestra.run.smithi022.stdout: "rank_uptime": 17.810157154999999, 2024-05-21T13:36:44.818 INFO:teuthology.orchestra.run.smithi022.stdout: "mdsmap_epoch": 14, 2024-05-21T13:36:44.818 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch": 27, 2024-05-21T13:36:44.818 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch_barrier": 25, 2024-05-21T13:36:44.818 INFO:teuthology.orchestra.run.smithi022.stdout: "uptime": 53.111142254999997 2024-05-21T13:36:44.818 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-05-21T13:36:44.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.817+0000 7fab6d65b640 1 -- 172.21.15.22:0/761496319 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fab4806f430 msgr2=0x7fab480718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:44.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.817+0000 7fab6d65b640 1 --2- 172.21.15.22:0/761496319 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fab4806f430 0x7fab480718f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fab6806e300 tx=0x7fab50009040 comp rx=0 tx=0).stop 2024-05-21T13:36:44.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.817+0000 7fab6d65b640 1 -- 172.21.15.22:0/761496319 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fab54003a60 msgr2=0x7fab6815cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:44.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.817+0000 7fab6d65b640 1 --2- 172.21.15.22:0/761496319 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fab54003a60 0x7fab6815cea0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fab5801aad0 tx=0x7fab54005840 comp rx=0 tx=0).stop 2024-05-21T13:36:44.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.817+0000 7fab6d65b640 1 -- 172.21.15.22:0/761496319 shutdown_connections 2024-05-21T13:36:44.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.817+0000 7fab6d65b640 1 --2- 172.21.15.22:0/761496319 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fab4806f430 0x7fab480718f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:44.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.817+0000 7fab6d65b640 1 --2- 172.21.15.22:0/761496319 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fab681520e0 0x7fab681e8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:44.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.817+0000 7fab6d65b640 1 --2- 172.21.15.22:0/761496319 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fab681e7ce0 0x7fab6815ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:44.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.817+0000 7fab6d65b640 1 --2- 172.21.15.22:0/761496319 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fab54003a60 0x7fab6815cea0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:44.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.817+0000 7fab6d65b640 1 -- 172.21.15.22:0/761496319 >> 172.21.15.22:0/761496319 conn(0x7fab680cd8b0 msgr2=0x7fab680ccdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:44.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.817+0000 7fab6d65b640 1 -- 172.21.15.22:0/761496319 shutdown_connections 2024-05-21T13:36:44.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.817+0000 7fab6d65b640 1 -- 172.21.15.22:0/761496319 wait complete. 2024-05-21T13:36:44.821 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-05-21T13:36:44.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.961+0000 7ff5d8327640 1 Processor -- start 2024-05-21T13:36:44.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.961+0000 7ff5d8327640 1 -- start start 2024-05-21T13:36:44.941 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.961+0000 7ff5d8327640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff5d0155fb0 0x7ff5d00cc030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:44.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.961+0000 7ff5d8327640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff5d015bf90 0x7ff5d00ccd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:44.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.961+0000 7ff5d8327640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5d015c620 con 0x7ff5d015bb70 2024-05-21T13:36:44.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.961+0000 7ff5d8327640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7ff5d00cc570 con 0x7ff5d015bf90 2024-05-21T13:36:44.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.961+0000 7ff5d8327640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7ff5d015c900 con 0x7ff5d0155fb0 2024-05-21T13:36:44.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.961+0000 7ff5d68c4640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff5d015bf90 0x7ff5d00ccd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:44.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.961+0000 7ff5d60c3640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff5d0155fb0 0x7ff5d00cc030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:44.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.961+0000 7ff5d68c4640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff5d015bf90 0x7ff5d00ccd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.22:56738/0 (socket says 172.21.15.22:56738) 2024-05-21T13:36:44.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.961+0000 7ff5d60c3640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff5d0155fb0 0x7ff5d00cc030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.22:56260/0 (socket says 172.21.15.22:56260) 2024-05-21T13:36:44.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.961+0000 7ff5d68c4640 1 -- 172.21.15.22:0/2535314738 learned_addr learned my addr 172.21.15.22:0/2535314738 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:44.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.961+0000 7ff5d58c2640 1 --1- 172.21.15.22:0/2535314738 >> v1:172.21.15.115:6789/0 conn(0x7ff5d015bb70 0x7ff5d00ce4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.22:46708/0 (socket says 172.21.15.22:46708) 2024-05-21T13:36:44.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.961+0000 7ff5d60c3640 1 -- 172.21.15.22:0/2535314738 >> v2:172.21.15.115:3300/0 conn(0x7ff5d015bf90 msgr2=0x7ff5d00ccd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:44.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.961+0000 7ff5d60c3640 1 --2- 172.21.15.22:0/2535314738 >> v2:172.21.15.115:3300/0 conn(0x7ff5d015bf90 0x7ff5d00ccd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:44.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.961+0000 7ff5d60c3640 1 -- 172.21.15.22:0/2535314738 >> v1:172.21.15.115:6789/0 conn(0x7ff5d015bb70 legacy=0x7ff5d00ce4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:44.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.961+0000 7ff5d60c3640 1 -- 172.21.15.22:0/2535314738 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5d00cda10 con 0x7ff5d0155fb0 2024-05-21T13:36:44.950 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.965+0000 7ff5d60c3640 1 --2- 172.21.15.22:0/2535314738 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff5d0155fb0 0x7ff5d00cc030 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc0097c0 tx=0x7ff5cc01ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd7c0f95e1d9a6a0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:44.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.965+0000 7ff5d50c1640 1 -- 172.21.15.22:0/2535314738 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5cc0b5070 con 0x7ff5d0155fb0 2024-05-21T13:36:44.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.965+0000 7ff5d50c1640 1 -- 172.21.15.22:0/2535314738 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5cc0a8990 con 0x7ff5d0155fb0 2024-05-21T13:36:44.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.965+0000 7ff5d50c1640 1 -- 172.21.15.22:0/2535314738 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5cc0a8d60 con 0x7ff5d0155fb0 2024-05-21T13:36:44.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.965+0000 7ff5d8327640 1 -- 172.21.15.22:0/2535314738 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff5d0155fb0 msgr2=0x7ff5d00cc030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:44.951 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.965+0000 7ff5d8327640 1 --2- 172.21.15.22:0/2535314738 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff5d0155fb0 0x7ff5d00cc030 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc0097c0 tx=0x7ff5cc01ec90 comp rx=0 tx=0).stop 2024-05-21T13:36:44.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.965+0000 7ff5d8327640 1 -- 172.21.15.22:0/2535314738 shutdown_connections 2024-05-21T13:36:44.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.965+0000 7ff5d8327640 1 --2- 172.21.15.22:0/2535314738 >> v2:172.21.15.115:3300/0 conn(0x7ff5d015bf90 0x7ff5d00ccd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:44.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.965+0000 7ff5d8327640 1 --2- 172.21.15.22:0/2535314738 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff5d0155fb0 0x7ff5d00cc030 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:44.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.965+0000 7ff5d8327640 1 -- 172.21.15.22:0/2535314738 >> 172.21.15.22:0/2535314738 conn(0x7ff5d006f3b0 msgr2=0x7ff5d006d430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:44.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.965+0000 7ff5d8327640 1 -- 172.21.15.22:0/2535314738 shutdown_connections 2024-05-21T13:36:44.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.965+0000 7ff5d8327640 1 -- 172.21.15.22:0/2535314738 wait complete. 2024-05-21T13:36:44.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.965+0000 7ff5d8327640 1 Processor -- start 2024-05-21T13:36:44.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.965+0000 7ff5d8327640 1 -- start start 2024-05-21T13:36:44.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.969+0000 7ff5d8327640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff5d0155fb0 0x7ff5d0149100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:44.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.969+0000 7ff5d8327640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff5d015bb70 0x7ff5d01f2a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:44.953 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.969+0000 7ff5d8327640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff5d015bf90 0x7ff5d01f2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:44.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.969+0000 7ff5d8327640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff5d00cec00 con 0x7ff5d015bf90 2024-05-21T13:36:44.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.969+0000 7ff5d8327640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7ff5d00cdfd0 con 0x7ff5d0155fb0 2024-05-21T13:36:44.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.969+0000 7ff5d8327640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7ff5d00ced80 con 0x7ff5d015bb70 2024-05-21T13:36:44.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.969+0000 7ff5d68c4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff5d015bf90 0x7ff5d01f2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:44.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.969+0000 7ff5d68c4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff5d015bf90 0x7ff5d01f2fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43358/0 (socket says 172.21.15.22:43358) 2024-05-21T13:36:44.954 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.969+0000 7ff5d68c4640 1 -- 172.21.15.22:0/2492471986 learned_addr learned my addr 172.21.15.22:0/2492471986 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:44.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.969+0000 7ff5d58c2640 1 --2- 172.21.15.22:0/2492471986 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff5d015bb70 0x7ff5d01f2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:44.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.969+0000 7ff5d60c3640 1 --2- 172.21.15.22:0/2492471986 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff5d0155fb0 0x7ff5d0149100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:44.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.969+0000 7ff5d68c4640 1 -- 172.21.15.22:0/2492471986 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff5d015bb70 msgr2=0x7ff5d01f2a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:44.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.969+0000 7ff5d68c4640 1 --2- 172.21.15.22:0/2492471986 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff5d015bb70 0x7ff5d01f2a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:44.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.969+0000 7ff5d68c4640 1 -- 172.21.15.22:0/2492471986 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff5d0155fb0 msgr2=0x7ff5d0149100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:44.955 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.969+0000 7ff5d68c4640 1 --2- 172.21.15.22:0/2492471986 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff5d0155fb0 0x7ff5d0149100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:44.956 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.969+0000 7ff5d68c4640 1 -- 172.21.15.22:0/2492471986 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5d014bdd0 con 0x7ff5d015bf90 2024-05-21T13:36:44.956 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.969+0000 7ff5d58c2640 1 --2- 172.21.15.22:0/2492471986 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff5d015bb70 0x7ff5d01f2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T13:36:44.956 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.969+0000 7ff5d68c4640 1 --2- 172.21.15.22:0/2492471986 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff5d015bf90 0x7ff5d01f2fc0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff5c8009cf0 tx=0x7ff5c800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:44.956 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.969+0000 7ff5c6ffd640 1 -- 172.21.15.22:0/2492471986 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5c800cd20 con 0x7ff5d015bf90 2024-05-21T13:36:44.956 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.969+0000 7ff5d8327640 1 -- 172.21.15.22:0/2492471986 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5d0146d20 con 0x7ff5d015bf90 2024-05-21T13:36:44.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.969+0000 7ff5c6ffd640 1 -- 172.21.15.22:0/2492471986 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5c80039a0 con 0x7ff5d015bf90 2024-05-21T13:36:44.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.969+0000 7ff5c6ffd640 1 -- 172.21.15.22:0/2492471986 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5c8003d90 con 0x7ff5d015bf90 2024-05-21T13:36:44.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.969+0000 7ff5d8327640 1 -- 172.21.15.22:0/2492471986 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5d01472e0 con 0x7ff5d015bf90 2024-05-21T13:36:44.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.969+0000 7ff5c6ffd640 1 -- 172.21.15.22:0/2492471986 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ff5c8012050 con 0x7ff5d015bf90 2024-05-21T13:36:44.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.969+0000 7ff5c6ffd640 1 --2- 172.21.15.22:0/2492471986 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7ff5b406f430 0x7ff5b40718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:44.957 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.969+0000 7ff5c6ffd640 1 -- 172.21.15.22:0/2492471986 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7ff5c808fb10 con 0x7ff5d015bf90 2024-05-21T13:36:44.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.973+0000 7ff5d60c3640 1 --2- 172.21.15.22:0/2492471986 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7ff5b406f430 0x7ff5b40718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:44.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.973+0000 7ff5db4b2000 1 Processor -- start 2024-05-21T13:36:44.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.973+0000 7ff5db4b2000 1 -- start start 2024-05-21T13:36:44.958 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.973+0000 7ff5d60c3640 1 --2- 172.21.15.22:0/2492471986 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7ff5b406f430 0x7ff5b40718f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc0b2000 tx=0x7ff5cc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:44.968 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.973+0000 7ff5db4b2000 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x562f8ce904a0 0x562f8ce59200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:44.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.973+0000 7ff5db4b2000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562f8ce59740 0x562f8ce789b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:44.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.973+0000 7ff5db4b2000 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562f8ce78ef0 0x562f8ce792d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:44.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.973+0000 7ff5db4b2000 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x562f8ccad6d0 con 0x562f8ce78ef0 2024-05-21T13:36:44.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.973+0000 7ff5db4b2000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x562f8cc9d270 con 0x562f8ce59740 2024-05-21T13:36:44.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.973+0000 7ff5db4b2000 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x562f8cca12b0 con 0x562f8ce904a0 2024-05-21T13:36:44.969 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.973+0000 7ff5d68c4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562f8ce78ef0 0x562f8ce792d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:44.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.973+0000 7ff5d68c4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562f8ce78ef0 0x562f8ce792d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43366/0 (socket says 172.21.15.22:43366) 2024-05-21T13:36:44.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.973+0000 7ff5d68c4640 1 -- 172.21.15.22:0/1885105443 learned_addr learned my addr 172.21.15.22:0/1885105443 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:44.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.973+0000 7ff5d60c3640 1 --2- 172.21.15.22:0/1885105443 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x562f8ce904a0 0x562f8ce59200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:44.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.973+0000 7ff5d58c2640 1 --2- 172.21.15.22:0/1885105443 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562f8ce59740 0x562f8ce789b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:44.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.973+0000 7ff5d68c4640 1 -- 172.21.15.22:0/1885105443 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x562f8ce904a0 msgr2=0x562f8ce59200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:44.970 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.973+0000 7ff5d68c4640 1 --2- 172.21.15.22:0/1885105443 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x562f8ce904a0 0x562f8ce59200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:44.971 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.973+0000 7ff5d68c4640 1 -- 172.21.15.22:0/1885105443 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562f8ce59740 msgr2=0x562f8ce789b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:44.971 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.973+0000 7ff5d68c4640 1 --2- 172.21.15.22:0/1885105443 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562f8ce59740 0x562f8ce789b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:44.971 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.973+0000 7ff5d68c4640 1 -- 172.21.15.22:0/1885105443 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f8cc7bbf0 con 0x562f8ce78ef0 2024-05-21T13:36:44.971 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.973+0000 7ff5d68c4640 1 --2- 172.21.15.22:0/1885105443 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562f8ce78ef0 0x562f8ce792d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff5c8058590 tx=0x7ff5c8058720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=591752782ff2e251 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:44.971 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.973+0000 7ff5b3fff640 1 -- 172.21.15.22:0/1885105443 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5c805bfa0 con 0x562f8ce78ef0 2024-05-21T13:36:44.971 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.973+0000 7ff5b3fff640 1 -- 172.21.15.22:0/1885105443 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5c8060350 con 0x562f8ce78ef0 2024-05-21T13:36:44.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.973+0000 7ff5b3fff640 1 -- 172.21.15.22:0/1885105443 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5c8064d70 con 0x562f8ce78ef0 2024-05-21T13:36:44.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.973+0000 7ff5db4b2000 1 -- 172.21.15.22:0/1885105443 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562f8ce78ef0 msgr2=0x562f8ce792d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:44.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.973+0000 7ff5db4b2000 1 --2- 172.21.15.22:0/1885105443 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562f8ce78ef0 0x562f8ce792d0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff5c8058590 tx=0x7ff5c8058720 comp rx=0 tx=0).stop 2024-05-21T13:36:44.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.973+0000 7ff5db4b2000 1 -- 172.21.15.22:0/1885105443 shutdown_connections 2024-05-21T13:36:44.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.973+0000 7ff5db4b2000 1 --2- 172.21.15.22:0/1885105443 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562f8ce78ef0 0x562f8ce792d0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:44.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.973+0000 7ff5db4b2000 1 --2- 172.21.15.22:0/1885105443 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562f8ce59740 0x562f8ce789b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:44.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.973+0000 7ff5db4b2000 1 --2- 172.21.15.22:0/1885105443 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x562f8ce904a0 0x562f8ce59200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:44.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.973+0000 7ff5db4b2000 1 -- 172.21.15.22:0/1885105443 >> 172.21.15.22:0/1885105443 conn(0x562f8cd38ef0 msgr2=0x562f8ce8fb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:44.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.973+0000 7ff5db4b2000 1 -- 172.21.15.22:0/1885105443 shutdown_connections 2024-05-21T13:36:44.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.973+0000 7ff5db4b2000 1 -- 172.21.15.22:0/1885105443 wait complete. 2024-05-21T13:36:44.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.973+0000 7ff5db4b2000 1 -- start start 2024-05-21T13:36:44.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.973+0000 7ff5db4b2000 1 Processor -- start 2024-05-21T13:36:44.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.977+0000 7ff5db4b2000 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562f8ce59740 0x562f8ce9d050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:44.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.977+0000 7ff5db4b2000 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x562f8ce78ef0 0x562f8ce9d590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:44.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.977+0000 7ff5db4b2000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562f8ce904a0 0x562f8ce54c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:44.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.977+0000 7ff5db4b2000 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x562f8cc60630 con 0x562f8ce59740 2024-05-21T13:36:44.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.977+0000 7ff5db4b2000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x562f8cd21570 con 0x562f8ce904a0 2024-05-21T13:36:44.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.977+0000 7ff5db4b2000 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x562f8ccac4a0 con 0x562f8ce78ef0 2024-05-21T13:36:44.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.977+0000 7ff5db4b2000 10 client.0 _ll_register_callbacks cb 0x562f8ce3c540 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-21T13:36:44.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.977+0000 7ff5d60c3640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562f8ce59740 0x562f8ce9d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:44.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.977+0000 7ff5d60c3640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562f8ce59740 0x562f8ce9d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43382/0 (socket says 172.21.15.22:43382) 2024-05-21T13:36:44.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.977+0000 7ff5d60c3640 1 -- 172.21.15.22:0/2926611938 learned_addr learned my addr 172.21.15.22:0/2926611938 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:44.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.977+0000 7ff5d58c2640 1 --2- 172.21.15.22:0/2926611938 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x562f8ce78ef0 0x562f8ce9d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:44.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.977+0000 7ff5d68c4640 1 --2- 172.21.15.22:0/2926611938 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562f8ce904a0 0x562f8ce54c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:44.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.977+0000 7ff5d60c3640 1 -- 172.21.15.22:0/2926611938 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x562f8ce78ef0 msgr2=0x562f8ce9d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:44.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.977+0000 7ff5d60c3640 1 --2- 172.21.15.22:0/2926611938 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x562f8ce78ef0 0x562f8ce9d590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:44.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.977+0000 7ff5d60c3640 1 -- 172.21.15.22:0/2926611938 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562f8ce904a0 msgr2=0x562f8ce54c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:44.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.977+0000 7ff5d60c3640 1 --2- 172.21.15.22:0/2926611938 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562f8ce904a0 0x562f8ce54c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:44.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.977+0000 7ff5d60c3640 1 -- 172.21.15.22:0/2926611938 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f8cce59b0 con 0x562f8ce59740 2024-05-21T13:36:44.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.977+0000 7ff5d58c2640 1 --2- 172.21.15.22:0/2926611938 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x562f8ce78ef0 0x562f8ce9d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:36:44.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.977+0000 7ff5d68c4640 1 --2- 172.21.15.22:0/2926611938 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562f8ce904a0 0x562f8ce54c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:36:44.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.977+0000 7ff5d60c3640 1 --2- 172.21.15.22:0/2926611938 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562f8ce59740 0x562f8ce9d050 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc01ecd0 tx=0x7ff5cc0046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c0c4a6f25a65a38 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:44.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.977+0000 7ff5b17fa640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-05-21T13:36:44.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.977+0000 7ff5b17fa640 1 -- 172.21.15.22:0/2926611938 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5cc0b0950 con 0x562f8ce59740 2024-05-21T13:36:44.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.977+0000 7ff5b17fa640 1 -- 172.21.15.22:0/2926611938 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7ff5cc0b0af0 con 0x562f8ce59740 2024-05-21T13:36:44.978 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.977+0000 7ff5db4b2000 1 -- 172.21.15.22:0/2926611938 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff5c8060350 con 0x562f8ce59740 2024-05-21T13:36:44.978 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.977+0000 7ff5b17fa640 1 -- 172.21.15.22:0/2926611938 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7ff5cc0d3050 con 0x562f8ce59740 2024-05-21T13:36:44.978 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.977+0000 7ff5db4b2000 10 client.4821 fetch_fsmap learned FSMap version 14 2024-05-21T13:36:44.978 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.977+0000 7ff5db4b2000 1 -- 172.21.15.22:0/2926611938 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x562f8cc78510 con 0x562f8ce59740 2024-05-21T13:36:44.978 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.977+0000 7ff5b17fa640 1 -- 172.21.15.22:0/2926611938 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5c8060350 con 0x562f8ce59740 2024-05-21T13:36:44.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.977+0000 7ff5b17fa640 1 -- 172.21.15.22:0/2926611938 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7ff5cc0d6020 con 0x562f8ce59740 2024-05-21T13:36:44.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.977+0000 7ff5db4b2000 10 client.4821 fetch_fsmap finished waiting for FSMap version 14 2024-05-21T13:36:44.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.977+0000 7ff5db4b2000 10 client.4821 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-21T13:36:44.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.977+0000 7ff5db4b2000 20 client.4821 populate_metadata read hostname 'smithi022' 2024-05-21T13:36:44.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.977+0000 7ff5db4b2000 1 --2- 172.21.15.22:0/2926611938 >> [v2:172.21.15.115:6834/3894678097,v1:172.21.15.115:6835/3894678097] conn(0x562f8ce55900 0x562f8ce55ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:44.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.977+0000 7ff5db4b2000 4 client.4821 mds_command: new command op to 4294 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-21T13:36:44.980 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.977+0000 7ff5db4b2000 1 -- 172.21.15.22:0/2926611938 --> [v2:172.21.15.115:6834/3894678097,v1:172.21.15.115:6835/3894678097] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562f8cc38bc0 con 0x562f8ce55900 2024-05-21T13:36:44.980 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.977+0000 7ff5d58c2640 1 --2- 172.21.15.22:0/2926611938 >> [v2:172.21.15.115:6834/3894678097,v1:172.21.15.115:6835/3894678097] conn(0x562f8ce55900 0x562f8ce55ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:44.980 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.977+0000 7ff5d58c2640 1 --2- 172.21.15.22:0/2926611938 >> [v2:172.21.15.115:6834/3894678097,v1:172.21.15.115:6835/3894678097] conn(0x562f8ce55900 0x562f8ce55ce0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=adddd93248481dfc server_cookie=af8b298c747fa95e in_seq=0 out_seq=0 2024-05-21T13:36:44.980 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.977+0000 7ff5b17fa640 10 client.4821 ms_handle_connect on v2:172.21.15.115:6834/3894678097 2024-05-21T13:36:44.980 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.981+0000 7ff5b17fa640 1 -- 172.21.15.22:0/2926611938 <== mds.1 v2:172.21.15.115:6834/3894678097 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x562f8cc38bc0 con 0x562f8ce55900 2024-05-21T13:36:44.980 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.981+0000 7ff5b17fa640 10 client.4821 handle_command_reply: tid=0 2024-05-21T13:36:44.981 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.981+0000 7ff5db4b2000 1 client.4821 shutdown 2024-05-21T13:36:44.981 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.981+0000 7ff5db4b2000 1 -- 172.21.15.22:0/2926611938 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562f8ce59740 msgr2=0x562f8ce9d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:44.981 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.981+0000 7ff5db4b2000 1 --2- 172.21.15.22:0/2926611938 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562f8ce59740 0x562f8ce9d050 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc01ecd0 tx=0x7ff5cc0046d0 comp rx=0 tx=0).stop 2024-05-21T13:36:44.981 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.981+0000 7ff5db4b2000 1 -- 172.21.15.22:0/2926611938 shutdown_connections 2024-05-21T13:36:44.981 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.981+0000 7ff5db4b2000 1 --2- 172.21.15.22:0/2926611938 >> [v2:172.21.15.115:6834/3894678097,v1:172.21.15.115:6835/3894678097] conn(0x562f8ce55900 0x562f8ce55ce0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:44.981 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.981+0000 7ff5db4b2000 1 --2- 172.21.15.22:0/2926611938 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562f8ce904a0 0x562f8ce54c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:44.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.981+0000 7ff5db4b2000 1 --2- 172.21.15.22:0/2926611938 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x562f8ce78ef0 0x562f8ce9d590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:44.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.981+0000 7ff5b17fa640 0 client.4821 ms_handle_reset on v2:172.21.15.115:6834/3894678097 2024-05-21T13:36:44.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.981+0000 7ff5db4b2000 1 --2- 172.21.15.22:0/2926611938 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562f8ce59740 0x562f8ce9d050 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:44.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.981+0000 7ff5db4b2000 1 -- 172.21.15.22:0/2926611938 >> 172.21.15.22:0/2926611938 conn(0x562f8cd38ef0 msgr2=0x562f8ce4f8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:44.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.981+0000 7ff5db4b2000 1 -- 172.21.15.22:0/2926611938 shutdown_connections 2024-05-21T13:36:44.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.981+0000 7ff5db4b2000 1 -- 172.21.15.22:0/2926611938 wait complete. 2024-05-21T13:36:44.983 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.981+0000 7ff5db4b2000 20 client.4821 trim_cache size 0 max 16384 2024-05-21T13:36:44.993 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.997+0000 7ff5db4b2000 1 Processor -- start 2024-05-21T13:36:44.993 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:44.997+0000 7ff5db4b2000 1 -- start start 2024-05-21T13:36:44.993 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.001+0000 7ff5db4b2000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562f8ce59740 0x562f8ce53970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:44.993 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.001+0000 7ff5db4b2000 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562f8ce78ef0 0x562f8ce53eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:44.993 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.001+0000 7ff5db4b2000 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x562f8ce904a0 0x562f8ce543f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:44.993 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.001+0000 7ff5db4b2000 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff5d01fe080 con 0x562f8ce78ef0 2024-05-21T13:36:44.993 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.001+0000 7ff5db4b2000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x562f8cc3a200 con 0x562f8ce59740 2024-05-21T13:36:44.993 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.001+0000 7ff5db4b2000 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x562f8cc357b0 con 0x562f8ce904a0 2024-05-21T13:36:44.993 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.001+0000 7ff5d58c2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562f8ce78ef0 0x562f8ce53eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:44.994 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.001+0000 7ff5d58c2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562f8ce78ef0 0x562f8ce53eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43388/0 (socket says 172.21.15.22:43388) 2024-05-21T13:36:44.994 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.001+0000 7ff5d58c2640 1 -- 172.21.15.22:0/2759638342 learned_addr learned my addr 172.21.15.22:0/2759638342 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:44.994 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.001+0000 7ff5d60c3640 1 --2- 172.21.15.22:0/2759638342 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562f8ce59740 0x562f8ce53970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:44.994 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.001+0000 7ff5d58c2640 1 -- 172.21.15.22:0/2759638342 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x562f8ce904a0 msgr2=0x562f8ce543f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:44.994 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.001+0000 7ff5d58c2640 1 --2- 172.21.15.22:0/2759638342 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x562f8ce904a0 0x562f8ce543f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:44.994 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.001+0000 7ff5d58c2640 1 -- 172.21.15.22:0/2759638342 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562f8ce59740 msgr2=0x562f8ce53970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:44.994 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.001+0000 7ff5d58c2640 1 --2- 172.21.15.22:0/2759638342 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562f8ce59740 0x562f8ce53970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:44.994 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.001+0000 7ff5d58c2640 1 -- 172.21.15.22:0/2759638342 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f8cc3e860 con 0x562f8ce78ef0 2024-05-21T13:36:44.994 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.001+0000 7ff5d60c3640 1 --2- 172.21.15.22:0/2759638342 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562f8ce59740 0x562f8ce53970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:36:44.994 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.001+0000 7ff5d58c2640 1 --2- 172.21.15.22:0/2759638342 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562f8ce78ef0 0x562f8ce53eb0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff5c00058b0 tx=0x7ff5c0007480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=361693fcb041f8ea server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:44.994 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.001+0000 7ff5b37fe640 1 -- 172.21.15.22:0/2759638342 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5c0010040 con 0x562f8ce78ef0 2024-05-21T13:36:44.994 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.001+0000 7ff5b37fe640 1 -- 172.21.15.22:0/2759638342 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5c0017aa0 con 0x562f8ce78ef0 2024-05-21T13:36:44.994 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.001+0000 7ff5b37fe640 1 -- 172.21.15.22:0/2759638342 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5c0017e70 con 0x562f8ce78ef0 2024-05-21T13:36:44.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.001+0000 7ff5db4b2000 1 -- 172.21.15.22:0/2759638342 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562f8ce78ef0 msgr2=0x562f8ce53eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:44.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.001+0000 7ff5db4b2000 1 --2- 172.21.15.22:0/2759638342 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562f8ce78ef0 0x562f8ce53eb0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff5c00058b0 tx=0x7ff5c0007480 comp rx=0 tx=0).stop 2024-05-21T13:36:44.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.001+0000 7ff5db4b2000 1 -- 172.21.15.22:0/2759638342 shutdown_connections 2024-05-21T13:36:44.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.001+0000 7ff5db4b2000 1 --2- 172.21.15.22:0/2759638342 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x562f8ce904a0 0x562f8ce543f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:44.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.001+0000 7ff5db4b2000 1 --2- 172.21.15.22:0/2759638342 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562f8ce78ef0 0x562f8ce53eb0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:44.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.001+0000 7ff5db4b2000 1 --2- 172.21.15.22:0/2759638342 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562f8ce59740 0x562f8ce53970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:44.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.001+0000 7ff5db4b2000 1 -- 172.21.15.22:0/2759638342 >> 172.21.15.22:0/2759638342 conn(0x562f8cd38ef0 msgr2=0x562f8ce57cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:44.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.001+0000 7ff5db4b2000 1 -- 172.21.15.22:0/2759638342 shutdown_connections 2024-05-21T13:36:44.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.001+0000 7ff5db4b2000 1 -- 172.21.15.22:0/2759638342 wait complete. 2024-05-21T13:36:44.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.001+0000 7ff5db4b2000 1 -- start start 2024-05-21T13:36:44.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.001+0000 7ff5db4b2000 1 Processor -- start 2024-05-21T13:36:44.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.001+0000 7ff5db4b2000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562f8ce59740 0x562f8ce9fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:44.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.001+0000 7ff5db4b2000 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562f8ce78ef0 0x562f8cea0370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:44.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.001+0000 7ff5db4b2000 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x562f8ce904a0 0x562f8cea08b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:44.996 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.001+0000 7ff5db4b2000 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x562f8cca58e0 con 0x562f8ce78ef0 2024-05-21T13:36:44.996 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.001+0000 7ff5db4b2000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x562f8cca05c0 con 0x562f8ce59740 2024-05-21T13:36:44.996 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.001+0000 7ff5db4b2000 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x562f8cc41c40 con 0x562f8ce904a0 2024-05-21T13:36:44.996 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.001+0000 7ff5db4b2000 10 client.0 _ll_register_callbacks cb 0x7ff5c80096b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-21T13:36:44.996 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.001+0000 7ff5d58c2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562f8ce78ef0 0x562f8cea0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:44.996 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.001+0000 7ff5d58c2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562f8ce78ef0 0x562f8cea0370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43398/0 (socket says 172.21.15.22:43398) 2024-05-21T13:36:44.996 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.001+0000 7ff5d58c2640 1 -- 172.21.15.22:0/2179793328 learned_addr learned my addr 172.21.15.22:0/2179793328 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:44.996 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.001+0000 7ff5d58c2640 1 -- 172.21.15.22:0/2179793328 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x562f8ce904a0 msgr2=0x562f8cea08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:44.996 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.001+0000 7ff5d68c4640 1 --2- 172.21.15.22:0/2179793328 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x562f8ce904a0 0x562f8cea08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:44.996 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.001+0000 7ff5d60c3640 1 --2- 172.21.15.22:0/2179793328 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562f8ce59740 0x562f8ce9fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:44.996 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.001+0000 7ff5d58c2640 1 --2- 172.21.15.22:0/2179793328 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x562f8ce904a0 0x562f8cea08b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:44.996 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.001+0000 7ff5d58c2640 1 -- 172.21.15.22:0/2179793328 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562f8ce59740 msgr2=0x562f8ce9fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:44.996 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.001+0000 7ff5d58c2640 1 --2- 172.21.15.22:0/2179793328 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562f8ce59740 0x562f8ce9fe30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:44.997 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.001+0000 7ff5d58c2640 1 -- 172.21.15.22:0/2179793328 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f8cc54e80 con 0x562f8ce78ef0 2024-05-21T13:36:44.997 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.005+0000 7ff5d58c2640 1 --2- 172.21.15.22:0/2179793328 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562f8ce78ef0 0x562f8cea0370 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff5c00074c0 tx=0x7ff5c0000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=775c050e97353b8 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:44.997 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.005+0000 7ff5b17fa640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-05-21T13:36:44.997 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.005+0000 7ff5b17fa640 1 -- 172.21.15.22:0/2179793328 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5c002e060 con 0x562f8ce78ef0 2024-05-21T13:36:44.997 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.005+0000 7ff5b17fa640 1 -- 172.21.15.22:0/2179793328 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7ff5c0026040 con 0x562f8ce78ef0 2024-05-21T13:36:44.997 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.005+0000 7ff5db4b2000 1 -- 172.21.15.22:0/2179793328 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff5c0017aa0 con 0x562f8ce78ef0 2024-05-21T13:36:44.997 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.005+0000 7ff5b17fa640 1 -- 172.21.15.22:0/2179793328 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7ff5c0034050 con 0x562f8ce78ef0 2024-05-21T13:36:44.997 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.005+0000 7ff5db4b2000 10 client.4827 fetch_fsmap learned FSMap version 14 2024-05-21T13:36:44.997 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.005+0000 7ff5db4b2000 1 -- 172.21.15.22:0/2179793328 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x562f8cd21a00 con 0x562f8ce78ef0 2024-05-21T13:36:44.997 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.005+0000 7ff5b17fa640 1 -- 172.21.15.22:0/2179793328 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5c0017aa0 con 0x562f8ce78ef0 2024-05-21T13:36:44.997 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.005+0000 7ff5b17fa640 1 -- 172.21.15.22:0/2179793328 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7ff5c0037020 con 0x562f8ce78ef0 2024-05-21T13:36:44.997 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.005+0000 7ff5db4b2000 10 client.4827 fetch_fsmap finished waiting for FSMap version 14 2024-05-21T13:36:44.997 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.005+0000 7ff5db4b2000 10 client.4827 resolve_mds: resolved name 'b' to daemon mds.b 2024-05-21T13:36:44.997 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.005+0000 7ff5db4b2000 20 client.4827 populate_metadata read hostname 'smithi022' 2024-05-21T13:36:44.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.005+0000 7ff5db4b2000 1 --2- 172.21.15.22:0/2179793328 >> [v2:172.21.15.115:6834/3894678097,v1:172.21.15.115:6835/3894678097] conn(0x562f8cf102a0 0x562f8cf12690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:44.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.005+0000 7ff5db4b2000 4 client.4827 mds_command: new command op to 4294 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-21T13:36:44.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.005+0000 7ff5db4b2000 1 -- 172.21.15.22:0/2179793328 --> [v2:172.21.15.115:6834/3894678097,v1:172.21.15.115:6835/3894678097] -- command(tid 0: {"prefix": "status"}) -- 0x562f8cc3cdc0 con 0x562f8cf102a0 2024-05-21T13:36:44.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.005+0000 7ff5d60c3640 1 --2- 172.21.15.22:0/2179793328 >> [v2:172.21.15.115:6834/3894678097,v1:172.21.15.115:6835/3894678097] conn(0x562f8cf102a0 0x562f8cf12690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:44.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.005+0000 7ff5d60c3640 1 --2- 172.21.15.22:0/2179793328 >> [v2:172.21.15.115:6834/3894678097,v1:172.21.15.115:6835/3894678097] conn(0x562f8cf102a0 0x562f8cf12690 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=915e01f8a0311bfc server_cookie=f7d316a4279e8965 in_seq=0 out_seq=0 2024-05-21T13:36:44.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.005+0000 7ff5b17fa640 10 client.4827 ms_handle_connect on v2:172.21.15.115:6834/3894678097 2024-05-21T13:36:44.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.005+0000 7ff5b17fa640 1 -- 172.21.15.22:0/2179793328 <== mds.1 v2:172.21.15.115:6834/3894678097 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x562f8cc3cdc0 con 0x562f8cf102a0 2024-05-21T13:36:44.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.005+0000 7ff5b17fa640 10 client.4827 handle_command_reply: tid=0 2024-05-21T13:36:44.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.005+0000 7ff5db4b2000 1 client.4827 shutdown 2024-05-21T13:36:44.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.005+0000 7ff5db4b2000 1 -- 172.21.15.22:0/2179793328 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562f8ce78ef0 msgr2=0x562f8cea0370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:44.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.005+0000 7ff5db4b2000 1 --2- 172.21.15.22:0/2179793328 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562f8ce78ef0 0x562f8cea0370 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff5c00074c0 tx=0x7ff5c0000ee0 comp rx=0 tx=0).stop 2024-05-21T13:36:44.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.005+0000 7ff5db4b2000 1 -- 172.21.15.22:0/2179793328 shutdown_connections 2024-05-21T13:36:44.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.005+0000 7ff5db4b2000 1 --2- 172.21.15.22:0/2179793328 >> [v2:172.21.15.115:6834/3894678097,v1:172.21.15.115:6835/3894678097] conn(0x562f8cf102a0 0x562f8cf12690 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:44.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.005+0000 7ff5db4b2000 1 --2- 172.21.15.22:0/2179793328 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x562f8ce904a0 0x562f8cea08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:44.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.005+0000 7ff5db4b2000 1 --2- 172.21.15.22:0/2179793328 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x562f8ce78ef0 0x562f8cea0370 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:44.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.005+0000 7ff5b17fa640 0 client.4827 ms_handle_reset on v2:172.21.15.115:6834/3894678097 2024-05-21T13:36:44.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.005+0000 7ff5db4b2000 1 --2- 172.21.15.22:0/2179793328 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x562f8ce59740 0x562f8ce9fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:44.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.005+0000 7ff5db4b2000 1 -- 172.21.15.22:0/2179793328 >> 172.21.15.22:0/2179793328 conn(0x562f8cd38ef0 msgr2=0x562f8ce776b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:44.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.005+0000 7ff5db4b2000 1 -- 172.21.15.22:0/2179793328 shutdown_connections 2024-05-21T13:36:44.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.005+0000 7ff5db4b2000 1 -- 172.21.15.22:0/2179793328 wait complete. 2024-05-21T13:36:44.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.005+0000 7ff5db4b2000 20 client.4827 trim_cache size 0 max 16384 2024-05-21T13:36:44.999 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-05-21T13:36:44.999 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_fsid": "f2c96204-e240-4e7f-8a76-927b4f80f534", 2024-05-21T13:36:45.000 INFO:teuthology.orchestra.run.smithi022.stdout: "whoami": 1, 2024-05-21T13:36:45.000 INFO:teuthology.orchestra.run.smithi022.stdout: "id": 4294, 2024-05-21T13:36:45.000 INFO:teuthology.orchestra.run.smithi022.stdout: "want_state": "up:active", 2024-05-21T13:36:45.000 INFO:teuthology.orchestra.run.smithi022.stdout: "state": "up:active", 2024-05-21T13:36:45.000 INFO:teuthology.orchestra.run.smithi022.stdout: "fs_name": "cephfs", 2024-05-21T13:36:45.000 INFO:teuthology.orchestra.run.smithi022.stdout: "rank_uptime": 23.123582739, 2024-05-21T13:36:45.000 INFO:teuthology.orchestra.run.smithi022.stdout: "mdsmap_epoch": 14, 2024-05-21T13:36:45.000 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch": 27, 2024-05-21T13:36:45.000 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch_barrier": 25, 2024-05-21T13:36:45.000 INFO:teuthology.orchestra.run.smithi022.stdout: "uptime": 53.303097655000002 2024-05-21T13:36:45.000 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-05-21T13:36:45.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.005+0000 7ff5d8327640 1 -- 172.21.15.22:0/2492471986 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7ff5b406f430 msgr2=0x7ff5b40718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:45.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.005+0000 7ff5d8327640 1 --2- 172.21.15.22:0/2492471986 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7ff5b406f430 0x7ff5b40718f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff5cc0b2000 tx=0x7ff5cc008040 comp rx=0 tx=0).stop 2024-05-21T13:36:45.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.005+0000 7ff5d8327640 1 -- 172.21.15.22:0/2492471986 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff5d015bf90 msgr2=0x7ff5d01f2fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:45.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.005+0000 7ff5d8327640 1 --2- 172.21.15.22:0/2492471986 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff5d015bf90 0x7ff5d01f2fc0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff5c8009cf0 tx=0x7ff5c800c490 comp rx=0 tx=0).stop 2024-05-21T13:36:45.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.005+0000 7ff5d8327640 1 -- 172.21.15.22:0/2492471986 shutdown_connections 2024-05-21T13:36:45.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.005+0000 7ff5d8327640 1 --2- 172.21.15.22:0/2492471986 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7ff5b406f430 0x7ff5b40718f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:45.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.005+0000 7ff5d8327640 1 --2- 172.21.15.22:0/2492471986 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff5d015bf90 0x7ff5d01f2fc0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:45.001 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.005+0000 7ff5d8327640 1 --2- 172.21.15.22:0/2492471986 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff5d015bb70 0x7ff5d01f2a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:45.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.005+0000 7ff5d8327640 1 --2- 172.21.15.22:0/2492471986 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff5d0155fb0 0x7ff5d0149100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:45.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.005+0000 7ff5d8327640 1 -- 172.21.15.22:0/2492471986 >> 172.21.15.22:0/2492471986 conn(0x7ff5d006f3b0 msgr2=0x7ff5d00ccd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:45.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.005+0000 7ff5d8327640 1 -- 172.21.15.22:0/2492471986 shutdown_connections 2024-05-21T13:36:45.002 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.005+0000 7ff5d8327640 1 -- 172.21.15.22:0/2492471986 wait complete. 2024-05-21T13:36:45.003 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2024-05-21T13:36:45.119 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.141+0000 7f3bd6285640 1 Processor -- start 2024-05-21T13:36:45.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.141+0000 7f3bd6285640 1 -- start start 2024-05-21T13:36:45.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.141+0000 7f3bd6285640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f3bd0160060 0x7f3bd0072360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:45.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.141+0000 7f3bd6285640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3bd00c9660 0x7f3bd006df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:45.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.141+0000 7f3bd6285640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3bd00c8220 con 0x7f3bd0155cf0 2024-05-21T13:36:45.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.141+0000 7f3bd6285640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f3bd015f330 con 0x7f3bd0160060 2024-05-21T13:36:45.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.141+0000 7f3bd6285640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f3bd015fbd0 con 0x7f3bd00c9660 2024-05-21T13:36:45.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.141+0000 7f3bcf7fe640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f3bd0160060 0x7f3bd0072360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:45.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.141+0000 7f3bd4822640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3bd00c9660 0x7f3bd006df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:45.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.141+0000 7f3bcf7fe640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f3bd0160060 0x7f3bd0072360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.22:56790/0 (socket says 172.21.15.22:56790) 2024-05-21T13:36:45.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.141+0000 7f3bcf7fe640 1 -- 172.21.15.22:0/2074221611 learned_addr learned my addr 172.21.15.22:0/2074221611 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:45.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.141+0000 7f3bcffff640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f3bd0155cf0 0x7f3bd015c7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.22:46718/0 (socket says 172.21.15.22:46718) 2024-05-21T13:36:45.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.141+0000 7f3bcf7fe640 1 -- 172.21.15.22:0/2074221611 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3bd00c9660 msgr2=0x7f3bd006df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:45.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.141+0000 7f3bcf7fe640 1 --2- 172.21.15.22:0/2074221611 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3bd00c9660 0x7f3bd006df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:45.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.141+0000 7f3bcf7fe640 1 -- 172.21.15.22:0/2074221611 >> v1:172.21.15.115:6789/0 conn(0x7f3bd0155cf0 legacy=0x7f3bd015c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:45.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.141+0000 7f3bcf7fe640 1 -- 172.21.15.22:0/2074221611 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bd00c8500 con 0x7f3bd0160060 2024-05-21T13:36:45.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.145+0000 7f3bcf7fe640 1 --2- 172.21.15.22:0/2074221611 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3bd0160060 0x7f3bd0072360 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3bc4009870 tx=0x7f3bc401c4d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=56624fdec74b92ab server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:45.124 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.145+0000 7f3bceffd640 1 -- 172.21.15.22:0/2074221611 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bc40b0070 con 0x7f3bd0160060 2024-05-21T13:36:45.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.145+0000 7f3bceffd640 1 -- 172.21.15.22:0/2074221611 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bc40ab600 con 0x7f3bd0160060 2024-05-21T13:36:45.125 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.145+0000 7f3bceffd640 1 -- 172.21.15.22:0/2074221611 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bc40ab9d0 con 0x7f3bd0160060 2024-05-21T13:36:45.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.145+0000 7f3bd6285640 1 -- 172.21.15.22:0/2074221611 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3bd0160060 msgr2=0x7f3bd0072360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:45.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.145+0000 7f3bd6285640 1 --2- 172.21.15.22:0/2074221611 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3bd0160060 0x7f3bd0072360 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3bc4009870 tx=0x7f3bc401c4d0 comp rx=0 tx=0).stop 2024-05-21T13:36:45.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.145+0000 7f3bd6285640 1 -- 172.21.15.22:0/2074221611 shutdown_connections 2024-05-21T13:36:45.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.145+0000 7f3bd6285640 1 --2- 172.21.15.22:0/2074221611 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3bd00c9660 0x7f3bd006df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:45.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.145+0000 7f3bd6285640 1 --2- 172.21.15.22:0/2074221611 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3bd0160060 0x7f3bd0072360 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:45.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.145+0000 7f3bd6285640 1 -- 172.21.15.22:0/2074221611 >> 172.21.15.22:0/2074221611 conn(0x7f3bd006ce70 msgr2=0x7f3bd00cd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:45.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.145+0000 7f3bd6285640 1 -- 172.21.15.22:0/2074221611 shutdown_connections 2024-05-21T13:36:45.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.145+0000 7f3bd6285640 1 -- 172.21.15.22:0/2074221611 wait complete. 2024-05-21T13:36:45.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.149+0000 7f3bd6285640 1 Processor -- start 2024-05-21T13:36:45.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.149+0000 7f3bd6285640 1 -- start start 2024-05-21T13:36:45.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.149+0000 7f3bd6285640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3bd00c9660 0x7f3bd0142ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:45.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.149+0000 7f3bd6285640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3bd0155cf0 0x7f3bd015cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:45.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.149+0000 7f3bd6285640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3bd0160060 0x7f3bd00c0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:45.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.149+0000 7f3bd6285640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd01560d0 con 0x7f3bd0155cf0 2024-05-21T13:36:45.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.149+0000 7f3bd6285640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd00c8920 con 0x7f3bd00c9660 2024-05-21T13:36:45.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.149+0000 7f3bd6285640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f3bd0156250 con 0x7f3bd0160060 2024-05-21T13:36:45.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.149+0000 7f3bcf7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3bd0155cf0 0x7f3bd015cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:45.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.149+0000 7f3bcf7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3bd0155cf0 0x7f3bd015cf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43400/0 (socket says 172.21.15.22:43400) 2024-05-21T13:36:45.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.149+0000 7f3bcf7fe640 1 -- 172.21.15.22:0/2517592221 learned_addr learned my addr 172.21.15.22:0/2517592221 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:45.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.149+0000 7f3bd4822640 1 --2- 172.21.15.22:0/2517592221 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3bd0160060 0x7f3bd00c0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:45.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.149+0000 7f3bcffff640 1 --2- 172.21.15.22:0/2517592221 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3bd00c9660 0x7f3bd0142ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:45.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.149+0000 7f3bcf7fe640 1 -- 172.21.15.22:0/2517592221 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3bd0160060 msgr2=0x7f3bd00c0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:45.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.149+0000 7f3bcf7fe640 1 --2- 172.21.15.22:0/2517592221 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3bd0160060 0x7f3bd00c0560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:45.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.149+0000 7f3bcf7fe640 1 -- 172.21.15.22:0/2517592221 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3bd00c9660 msgr2=0x7f3bd0142ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:45.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.149+0000 7f3bcf7fe640 1 --2- 172.21.15.22:0/2517592221 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3bd00c9660 0x7f3bd0142ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:45.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.149+0000 7f3bcf7fe640 1 -- 172.21.15.22:0/2517592221 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bd0143430 con 0x7f3bd0155cf0 2024-05-21T13:36:45.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.149+0000 7f3bcf7fe640 1 --2- 172.21.15.22:0/2517592221 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3bd0155cf0 0x7f3bd015cf00 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3bc40ae040 tx=0x7f3bc4019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:45.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.149+0000 7f3bccff9640 1 -- 172.21.15.22:0/2517592221 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bc40b0040 con 0x7f3bd0155cf0 2024-05-21T13:36:45.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.149+0000 7f3bccff9640 1 -- 172.21.15.22:0/2517592221 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bc40ab400 con 0x7f3bd0155cf0 2024-05-21T13:36:45.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.149+0000 7f3bd6285640 1 -- 172.21.15.22:0/2517592221 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bd00cc7b0 con 0x7f3bd0155cf0 2024-05-21T13:36:45.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.149+0000 7f3bccff9640 1 -- 172.21.15.22:0/2517592221 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bc40b4680 con 0x7f3bd0155cf0 2024-05-21T13:36:45.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.149+0000 7f3bd6285640 1 -- 172.21.15.22:0/2517592221 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bd014bfe0 con 0x7f3bd0155cf0 2024-05-21T13:36:45.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.153+0000 7f3bccff9640 1 -- 172.21.15.22:0/2517592221 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f3bc40bb020 con 0x7f3bd0155cf0 2024-05-21T13:36:45.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.153+0000 7f3bccff9640 1 --2- 172.21.15.22:0/2517592221 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f3bbc06f400 0x7f3bbc0718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:45.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.153+0000 7f3bccff9640 1 -- 172.21.15.22:0/2517592221 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f3bc41289c0 con 0x7f3bd0155cf0 2024-05-21T13:36:45.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.153+0000 7f3bd9410000 1 Processor -- start 2024-05-21T13:36:45.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.153+0000 7f3bcffff640 1 --2- 172.21.15.22:0/2517592221 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f3bbc06f400 0x7f3bbc0718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:45.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.153+0000 7f3bd9410000 1 -- start start 2024-05-21T13:36:45.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.153+0000 7f3bd9410000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558235fe24a0 0x558235fab200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:45.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.153+0000 7f3bd9410000 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558235fab740 0x558235fca9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:45.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.153+0000 7f3bcffff640 1 --2- 172.21.15.22:0/2517592221 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f3bbc06f400 0x7f3bbc0718c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3bc0000f70 tx=0x7f3bc0007c90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:45.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.153+0000 7f3bd9410000 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x558235fcaef0 0x558235fcb2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:45.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.153+0000 7f3bd9410000 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x558235dff6d0 con 0x558235fab740 2024-05-21T13:36:45.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.153+0000 7f3bd9410000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x558235def270 con 0x558235fe24a0 2024-05-21T13:36:45.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.153+0000 7f3bd9410000 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x558235df32b0 con 0x558235fcaef0 2024-05-21T13:36:45.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.153+0000 7f3bcf7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558235fab740 0x558235fca9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:45.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.153+0000 7f3bcf7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558235fab740 0x558235fca9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43404/0 (socket says 172.21.15.22:43404) 2024-05-21T13:36:45.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.153+0000 7f3bcf7fe640 1 -- 172.21.15.22:0/635702760 learned_addr learned my addr 172.21.15.22:0/635702760 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:45.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.153+0000 7f3bcffff640 1 --2- 172.21.15.22:0/635702760 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558235fe24a0 0x558235fab200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:45.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.153+0000 7f3bd4822640 1 --2- 172.21.15.22:0/635702760 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x558235fcaef0 0x558235fcb2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:45.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.153+0000 7f3bcf7fe640 1 -- 172.21.15.22:0/635702760 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x558235fcaef0 msgr2=0x558235fcb2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:45.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.153+0000 7f3bcf7fe640 1 --2- 172.21.15.22:0/635702760 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x558235fcaef0 0x558235fcb2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:45.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.153+0000 7f3bcf7fe640 1 -- 172.21.15.22:0/635702760 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558235fe24a0 msgr2=0x558235fab200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:45.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.153+0000 7f3bcf7fe640 1 --2- 172.21.15.22:0/635702760 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558235fe24a0 0x558235fab200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:45.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.153+0000 7f3bcf7fe640 1 -- 172.21.15.22:0/635702760 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558235dcdbf0 con 0x558235fab740 2024-05-21T13:36:45.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.153+0000 7f3bcf7fe640 1 --2- 172.21.15.22:0/635702760 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558235fab740 0x558235fca9b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3bc40f1440 tx=0x7f3bc40f45c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7943e809cd5ff586 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:45.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.153+0000 7f3bb5ffb640 1 -- 172.21.15.22:0/635702760 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bc410e3b0 con 0x558235fab740 2024-05-21T13:36:45.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.153+0000 7f3bb5ffb640 1 -- 172.21.15.22:0/635702760 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bc40f7030 con 0x558235fab740 2024-05-21T13:36:45.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.153+0000 7f3bb5ffb640 1 -- 172.21.15.22:0/635702760 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bc40f4e50 con 0x558235fab740 2024-05-21T13:36:45.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.157+0000 7f3bd9410000 1 -- 172.21.15.22:0/635702760 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558235fab740 msgr2=0x558235fca9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:45.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.157+0000 7f3bd9410000 1 --2- 172.21.15.22:0/635702760 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558235fab740 0x558235fca9b0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3bc40f1440 tx=0x7f3bc40f45c0 comp rx=0 tx=0).stop 2024-05-21T13:36:45.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.157+0000 7f3bd9410000 1 -- 172.21.15.22:0/635702760 shutdown_connections 2024-05-21T13:36:45.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.157+0000 7f3bd9410000 1 --2- 172.21.15.22:0/635702760 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x558235fcaef0 0x558235fcb2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:45.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.157+0000 7f3bd9410000 1 --2- 172.21.15.22:0/635702760 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558235fab740 0x558235fca9b0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:45.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.157+0000 7f3bd9410000 1 --2- 172.21.15.22:0/635702760 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558235fe24a0 0x558235fab200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:45.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.157+0000 7f3bd9410000 1 -- 172.21.15.22:0/635702760 >> 172.21.15.22:0/635702760 conn(0x558235e8aef0 msgr2=0x558235fe1b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:45.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.157+0000 7f3bd9410000 1 -- 172.21.15.22:0/635702760 shutdown_connections 2024-05-21T13:36:45.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.157+0000 7f3bd9410000 1 -- 172.21.15.22:0/635702760 wait complete. 2024-05-21T13:36:45.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.157+0000 7f3bd9410000 1 -- start start 2024-05-21T13:36:45.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.157+0000 7f3bd9410000 1 Processor -- start 2024-05-21T13:36:45.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.157+0000 7f3bd9410000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558235fab740 0x558235fef050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:45.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.157+0000 7f3bd9410000 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x558235fcaef0 0x558235fef590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:45.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.157+0000 7f3bd9410000 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558235fe24a0 0x558235fa68f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:45.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.157+0000 7f3bd9410000 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x558235db2630 con 0x558235fe24a0 2024-05-21T13:36:45.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.157+0000 7f3bd9410000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x558235e73570 con 0x558235fab740 2024-05-21T13:36:45.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.157+0000 7f3bd9410000 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x558235dfe4a0 con 0x558235fcaef0 2024-05-21T13:36:45.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.157+0000 7f3bd9410000 10 client.0 _ll_register_callbacks cb 0x558235f8e540 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-21T13:36:45.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.157+0000 7f3bd4822640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558235fe24a0 0x558235fa68f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:45.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.157+0000 7f3bd4822640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558235fe24a0 0x558235fa68f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43410/0 (socket says 172.21.15.22:43410) 2024-05-21T13:36:45.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.157+0000 7f3bd4822640 1 -- 172.21.15.22:0/454401906 learned_addr learned my addr 172.21.15.22:0/454401906 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:45.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.157+0000 7f3bcf7fe640 1 --2- 172.21.15.22:0/454401906 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x558235fcaef0 0x558235fef590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:45.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.157+0000 7f3bcffff640 1 --2- 172.21.15.22:0/454401906 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558235fab740 0x558235fef050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:45.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.157+0000 7f3bd4822640 1 -- 172.21.15.22:0/454401906 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x558235fcaef0 msgr2=0x558235fef590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:45.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.157+0000 7f3bd4822640 1 --2- 172.21.15.22:0/454401906 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x558235fcaef0 0x558235fef590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:45.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.157+0000 7f3bd4822640 1 -- 172.21.15.22:0/454401906 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558235fab740 msgr2=0x558235fef050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:45.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.157+0000 7f3bd4822640 1 --2- 172.21.15.22:0/454401906 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558235fab740 0x558235fef050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:45.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.157+0000 7f3bd4822640 1 -- 172.21.15.22:0/454401906 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558235e379b0 con 0x558235fe24a0 2024-05-21T13:36:45.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.157+0000 7f3bcf7fe640 1 --2- 172.21.15.22:0/454401906 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x558235fcaef0 0x558235fef590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T13:36:45.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.157+0000 7f3bd4822640 1 --2- 172.21.15.22:0/454401906 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558235fe24a0 0x558235fa68f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3bc8007d30 tx=0x7f3bc8012610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30a2bec9d6ad3994 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:45.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.157+0000 7f3baeffd640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-05-21T13:36:45.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.157+0000 7f3baeffd640 1 -- 172.21.15.22:0/454401906 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bc801c020 con 0x558235fe24a0 2024-05-21T13:36:45.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.157+0000 7f3baeffd640 1 -- 172.21.15.22:0/454401906 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f3bc8018670 con 0x558235fe24a0 2024-05-21T13:36:45.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.157+0000 7f3bd9410000 1 -- 172.21.15.22:0/454401906 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3bc40f7030 con 0x558235fe24a0 2024-05-21T13:36:45.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.157+0000 7f3baeffd640 1 -- 172.21.15.22:0/454401906 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f3bc8026050 con 0x558235fe24a0 2024-05-21T13:36:45.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.157+0000 7f3bd9410000 10 client.4836 fetch_fsmap learned FSMap version 14 2024-05-21T13:36:45.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.157+0000 7f3bd9410000 1 -- 172.21.15.22:0/454401906 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x558235dca510 con 0x558235fe24a0 2024-05-21T13:36:45.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.157+0000 7f3baeffd640 1 -- 172.21.15.22:0/454401906 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bc40f7030 con 0x558235fe24a0 2024-05-21T13:36:45.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.157+0000 7f3baeffd640 1 -- 172.21.15.22:0/454401906 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7f3bc8029020 con 0x558235fe24a0 2024-05-21T13:36:45.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.157+0000 7f3bd9410000 10 client.4836 fetch_fsmap finished waiting for FSMap version 14 2024-05-21T13:36:45.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.157+0000 7f3bd9410000 10 client.4836 resolve_mds: resolved name 'f' to daemon mds.f 2024-05-21T13:36:45.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.157+0000 7f3bd9410000 20 client.4836 populate_metadata read hostname 'smithi022' 2024-05-21T13:36:45.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.157+0000 7f3bd9410000 1 --2- 172.21.15.22:0/454401906 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x558235fa7690 0x558235fa7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:45.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.157+0000 7f3bd9410000 4 client.4836 mds_command: new command op to 4300 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-21T13:36:45.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.157+0000 7f3bd9410000 1 -- 172.21.15.22:0/454401906 --> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558235d8abc0 con 0x558235fa7690 2024-05-21T13:36:45.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.157+0000 7f3bcffff640 1 --2- 172.21.15.22:0/454401906 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x558235fa7690 0x558235fa7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:45.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.161+0000 7f3bcffff640 1 --2- 172.21.15.22:0/454401906 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x558235fa7690 0x558235fa7a70 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25cdea30cc5d2d98 server_cookie=539c2f771770f9c2 in_seq=0 out_seq=0 2024-05-21T13:36:45.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.161+0000 7f3baeffd640 10 client.4836 ms_handle_connect on v2:172.21.15.115:6838/1525097577 2024-05-21T13:36:45.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.161+0000 7f3baeffd640 1 -- 172.21.15.22:0/454401906 <== mds.0 v2:172.21.15.115:6838/1525097577 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x558235d8abc0 con 0x558235fa7690 2024-05-21T13:36:45.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.161+0000 7f3baeffd640 10 client.4836 handle_command_reply: tid=0 2024-05-21T13:36:45.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.161+0000 7f3bd9410000 1 client.4836 shutdown 2024-05-21T13:36:45.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.161+0000 7f3bd9410000 1 -- 172.21.15.22:0/454401906 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558235fe24a0 msgr2=0x558235fa68f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:45.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.161+0000 7f3bd9410000 1 --2- 172.21.15.22:0/454401906 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558235fe24a0 0x558235fa68f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f3bc8007d30 tx=0x7f3bc8012610 comp rx=0 tx=0).stop 2024-05-21T13:36:45.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.161+0000 7f3bd9410000 1 -- 172.21.15.22:0/454401906 shutdown_connections 2024-05-21T13:36:45.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.161+0000 7f3bd9410000 1 --2- 172.21.15.22:0/454401906 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558235fe24a0 0x558235fa68f0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:45.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.161+0000 7f3bd9410000 1 --2- 172.21.15.22:0/454401906 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x558235fcaef0 0x558235fef590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:45.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.161+0000 7f3bd9410000 1 --2- 172.21.15.22:0/454401906 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x558235fa7690 0x558235fa7a70 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:45.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.161+0000 7f3bd9410000 1 --2- 172.21.15.22:0/454401906 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558235fab740 0x558235fef050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:45.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.161+0000 7f3bd9410000 1 -- 172.21.15.22:0/454401906 >> 172.21.15.22:0/454401906 conn(0x558235e8aef0 msgr2=0x558235fa18e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:45.148 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.161+0000 7f3baeffd640 0 client.4836 ms_handle_reset on v2:172.21.15.115:6838/1525097577 2024-05-21T13:36:45.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.161+0000 7f3bd9410000 1 -- 172.21.15.22:0/454401906 shutdown_connections 2024-05-21T13:36:45.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.161+0000 7f3bd9410000 1 -- 172.21.15.22:0/454401906 wait complete. 2024-05-21T13:36:45.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.161+0000 7f3bd9410000 20 client.4836 trim_cache size 0 max 16384 2024-05-21T13:36:45.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.181+0000 7f3bd9410000 1 Processor -- start 2024-05-21T13:36:45.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.181+0000 7f3bd9410000 1 -- start start 2024-05-21T13:36:45.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.181+0000 7f3bd9410000 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558235fab740 0x558235fa38f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:45.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.181+0000 7f3bd9410000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558235fcaef0 0x558235fa3e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:45.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.181+0000 7f3bd9410000 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x558235fe24a0 0x558235fff1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:45.160 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.181+0000 7f3bd9410000 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd0201830 con 0x558235fab740 2024-05-21T13:36:45.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.181+0000 7f3bd9410000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd01f8d50 con 0x558235fcaef0 2024-05-21T13:36:45.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.181+0000 7f3bd9410000 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f3bd02011e0 con 0x558235fe24a0 2024-05-21T13:36:45.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.181+0000 7f3bcffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558235fab740 0x558235fa38f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:45.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.181+0000 7f3bcffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558235fab740 0x558235fa38f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43416/0 (socket says 172.21.15.22:43416) 2024-05-21T13:36:45.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.181+0000 7f3bcffff640 1 -- 172.21.15.22:0/22962386 learned_addr learned my addr 172.21.15.22:0/22962386 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:45.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.181+0000 7f3bcffff640 1 -- 172.21.15.22:0/22962386 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x558235fe24a0 msgr2=0x558235fff1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:45.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.181+0000 7f3bcffff640 1 --2- 172.21.15.22:0/22962386 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x558235fe24a0 0x558235fff1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:45.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.181+0000 7f3bcffff640 1 -- 172.21.15.22:0/22962386 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558235fcaef0 msgr2=0x558235fa3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:45.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.181+0000 7f3bcffff640 1 --2- 172.21.15.22:0/22962386 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558235fcaef0 0x558235fa3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:45.161 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.181+0000 7f3bcffff640 1 -- 172.21.15.22:0/22962386 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558235fcad20 con 0x558235fab740 2024-05-21T13:36:45.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.181+0000 7f3bcffff640 1 --2- 172.21.15.22:0/22962386 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558235fab740 0x558235fa38f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3bc0005be0 tx=0x7f3bc0012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1bd2f24efd2f753 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:45.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.181+0000 7f3bb57fa640 1 -- 172.21.15.22:0/22962386 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bc0014930 con 0x558235fab740 2024-05-21T13:36:45.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.181+0000 7f3bb57fa640 1 -- 172.21.15.22:0/22962386 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bc0014ad0 con 0x558235fab740 2024-05-21T13:36:45.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.181+0000 7f3bb57fa640 1 -- 172.21.15.22:0/22962386 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bc0014c80 con 0x558235fab740 2024-05-21T13:36:45.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.181+0000 7f3bd9410000 1 -- 172.21.15.22:0/22962386 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558235fab740 msgr2=0x558235fa38f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:45.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.181+0000 7f3bd9410000 1 --2- 172.21.15.22:0/22962386 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558235fab740 0x558235fa38f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3bc0005be0 tx=0x7f3bc0012000 comp rx=0 tx=0).stop 2024-05-21T13:36:45.165 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.181+0000 7f3bd9410000 1 -- 172.21.15.22:0/22962386 shutdown_connections 2024-05-21T13:36:45.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.181+0000 7f3bd9410000 1 --2- 172.21.15.22:0/22962386 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x558235fe24a0 0x558235fff1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:45.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.181+0000 7f3bd9410000 1 --2- 172.21.15.22:0/22962386 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558235fcaef0 0x558235fa3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:45.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.181+0000 7f3bd9410000 1 --2- 172.21.15.22:0/22962386 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558235fab740 0x558235fa38f0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:45.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.181+0000 7f3bd9410000 1 -- 172.21.15.22:0/22962386 >> 172.21.15.22:0/22962386 conn(0x558235e8aef0 msgr2=0x558235fde260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:45.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.181+0000 7f3bd9410000 1 -- 172.21.15.22:0/22962386 shutdown_connections 2024-05-21T13:36:45.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.181+0000 7f3bd9410000 1 -- 172.21.15.22:0/22962386 wait complete. 2024-05-21T13:36:45.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.181+0000 7f3bd9410000 1 -- start start 2024-05-21T13:36:45.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.185+0000 7f3bd9410000 1 Processor -- start 2024-05-21T13:36:45.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.185+0000 7f3bd9410000 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x558235fab740 0x558235ff4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:45.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.185+0000 7f3bd9410000 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558235fcaef0 0x558235ff50f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:45.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.185+0000 7f3bd9410000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558235fe24a0 0x55823605a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:45.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.185+0000 7f3bd9410000 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x558235d877b0 con 0x558235fcaef0 2024-05-21T13:36:45.166 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.185+0000 7f3bd9410000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x558235d8c200 con 0x558235fe24a0 2024-05-21T13:36:45.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.185+0000 7f3bd9410000 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x558235df25c0 con 0x558235fab740 2024-05-21T13:36:45.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.185+0000 7f3bd9410000 10 client.0 _ll_register_callbacks cb 0x7f3bc8009d80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-21T13:36:45.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.185+0000 7f3bcf7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558235fcaef0 0x558235ff50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:45.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.185+0000 7f3bcf7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558235fcaef0 0x558235ff50f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:43428/0 (socket says 172.21.15.22:43428) 2024-05-21T13:36:45.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.185+0000 7f3bcf7fe640 1 -- 172.21.15.22:0/3303398489 learned_addr learned my addr 172.21.15.22:0/3303398489 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:36:45.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.185+0000 7f3bcffff640 1 --2- 172.21.15.22:0/3303398489 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x558235fab740 0x558235ff4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:45.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.185+0000 7f3bcf7fe640 1 -- 172.21.15.22:0/3303398489 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x558235fab740 msgr2=0x558235ff4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:45.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.185+0000 7f3bcf7fe640 1 --2- 172.21.15.22:0/3303398489 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x558235fab740 0x558235ff4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:45.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.185+0000 7f3bcf7fe640 1 -- 172.21.15.22:0/3303398489 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558235fe24a0 msgr2=0x55823605a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:36:45.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.185+0000 7f3bcf7fe640 1 --2- 172.21.15.22:0/3303398489 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558235fe24a0 0x55823605a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:45.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.185+0000 7f3bcf7fe640 1 -- 172.21.15.22:0/3303398489 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558235d90860 con 0x558235fcaef0 2024-05-21T13:36:45.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.185+0000 7f3bcffff640 1 --2- 172.21.15.22:0/3303398489 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x558235fab740 0x558235ff4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:36:45.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.185+0000 7f3bcf7fe640 1 --2- 172.21.15.22:0/3303398489 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558235fcaef0 0x558235ff50f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3bc40f4de0 tx=0x7f3bc4126a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b98047f543ea38ef server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:36:45.167 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.185+0000 7f3baeffd640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-05-21T13:36:45.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.185+0000 7f3baeffd640 1 -- 172.21.15.22:0/3303398489 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bc410e3b0 con 0x558235fcaef0 2024-05-21T13:36:45.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.185+0000 7f3baeffd640 1 -- 172.21.15.22:0/3303398489 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f3bc4114020 con 0x558235fcaef0 2024-05-21T13:36:45.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.185+0000 7f3bd9410000 1 -- 172.21.15.22:0/3303398489 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3bc0014ad0 con 0x558235fcaef0 2024-05-21T13:36:45.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.185+0000 7f3baeffd640 1 -- 172.21.15.22:0/3303398489 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f3bc40ba4d0 con 0x558235fcaef0 2024-05-21T13:36:45.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.185+0000 7f3bd9410000 10 client.4842 fetch_fsmap learned FSMap version 14 2024-05-21T13:36:45.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.185+0000 7f3bd9410000 1 -- 172.21.15.22:0/3303398489 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x558235da6e80 con 0x558235fcaef0 2024-05-21T13:36:45.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.185+0000 7f3baeffd640 1 -- 172.21.15.22:0/3303398489 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bc0014ad0 con 0x558235fcaef0 2024-05-21T13:36:45.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.185+0000 7f3baeffd640 1 -- 172.21.15.22:0/3303398489 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7f3bc4115030 con 0x558235fcaef0 2024-05-21T13:36:45.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.185+0000 7f3bd9410000 10 client.4842 fetch_fsmap finished waiting for FSMap version 14 2024-05-21T13:36:45.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.185+0000 7f3bd9410000 10 client.4842 resolve_mds: resolved name 'f' to daemon mds.f 2024-05-21T13:36:45.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.185+0000 7f3bd9410000 20 client.4842 populate_metadata read hostname 'smithi022' 2024-05-21T13:36:45.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.185+0000 7f3bd9410000 1 --2- 172.21.15.22:0/3303398489 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x55823605ac20 0x55823605b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:36:45.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.185+0000 7f3bd9410000 4 client.4842 mds_command: new command op to 4300 tid=0 multi_id=0 [{"prefix": "status"}] 2024-05-21T13:36:45.168 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.185+0000 7f3bd9410000 1 -- 172.21.15.22:0/3303398489 --> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] -- command(tid 0: {"prefix": "status"}) -- 0x558235d8edc0 con 0x55823605ac20 2024-05-21T13:36:45.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.185+0000 7f3bcffff640 1 --2- 172.21.15.22:0/3303398489 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x55823605ac20 0x55823605b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:36:45.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.185+0000 7f3baeffd640 10 client.4842 ms_handle_connect on v2:172.21.15.115:6838/1525097577 2024-05-21T13:36:45.169 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.185+0000 7f3bcffff640 1 --2- 172.21.15.22:0/3303398489 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x55823605ac20 0x55823605b000 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1d90f17fb77aaefb server_cookie=9df5a75adda85ee0 in_seq=0 out_seq=0 2024-05-21T13:36:45.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.185+0000 7f3baeffd640 1 -- 172.21.15.22:0/3303398489 <== mds.0 v2:172.21.15.115:6838/1525097577 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x558235d8edc0 con 0x55823605ac20 2024-05-21T13:36:45.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.185+0000 7f3baeffd640 10 client.4842 handle_command_reply: tid=0 2024-05-21T13:36:45.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.185+0000 7f3bd9410000 1 client.4842 shutdown 2024-05-21T13:36:45.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.185+0000 7f3bd9410000 1 -- 172.21.15.22:0/3303398489 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558235fcaef0 msgr2=0x558235ff50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:45.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.185+0000 7f3bd9410000 1 --2- 172.21.15.22:0/3303398489 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558235fcaef0 0x558235ff50f0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3bc40f4de0 tx=0x7f3bc4126a50 comp rx=0 tx=0).stop 2024-05-21T13:36:45.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.185+0000 7f3bd9410000 1 -- 172.21.15.22:0/3303398489 shutdown_connections 2024-05-21T13:36:45.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.185+0000 7f3bd9410000 1 --2- 172.21.15.22:0/3303398489 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x55823605ac20 0x55823605b000 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:45.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.185+0000 7f3bd9410000 1 --2- 172.21.15.22:0/3303398489 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x558235fe24a0 0x55823605a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:45.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.185+0000 7f3bd9410000 1 --2- 172.21.15.22:0/3303398489 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x558235fcaef0 0x558235ff50f0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:45.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.185+0000 7f3baeffd640 0 client.4842 ms_handle_reset on v2:172.21.15.115:6838/1525097577 2024-05-21T13:36:45.170 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.185+0000 7f3bd9410000 1 --2- 172.21.15.22:0/3303398489 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x558235fab740 0x558235ff4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:45.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.185+0000 7f3bd9410000 1 -- 172.21.15.22:0/3303398489 >> 172.21.15.22:0/3303398489 conn(0x558235e8aef0 msgr2=0x558235fde260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:45.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.185+0000 7f3bd9410000 1 -- 172.21.15.22:0/3303398489 shutdown_connections 2024-05-21T13:36:45.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.189+0000 7f3bd9410000 1 -- 172.21.15.22:0/3303398489 wait complete. 2024-05-21T13:36:45.171 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.189+0000 7f3bd9410000 20 client.4842 trim_cache size 0 max 16384 2024-05-21T13:36:45.171 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-05-21T13:36:45.171 INFO:teuthology.orchestra.run.smithi022.stdout: "cluster_fsid": "f2c96204-e240-4e7f-8a76-927b4f80f534", 2024-05-21T13:36:45.171 INFO:teuthology.orchestra.run.smithi022.stdout: "whoami": 0, 2024-05-21T13:36:45.171 INFO:teuthology.orchestra.run.smithi022.stdout: "id": 4300, 2024-05-21T13:36:45.171 INFO:teuthology.orchestra.run.smithi022.stdout: "want_state": "up:active", 2024-05-21T13:36:45.171 INFO:teuthology.orchestra.run.smithi022.stdout: "state": "up:active", 2024-05-21T13:36:45.171 INFO:teuthology.orchestra.run.smithi022.stdout: "fs_name": "cephfs", 2024-05-21T13:36:45.172 INFO:teuthology.orchestra.run.smithi022.stdout: "rank_uptime": 47.413731810999998, 2024-05-21T13:36:45.172 INFO:teuthology.orchestra.run.smithi022.stdout: "mdsmap_epoch": 14, 2024-05-21T13:36:45.172 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch": 27, 2024-05-21T13:36:45.172 INFO:teuthology.orchestra.run.smithi022.stdout: "osdmap_epoch_barrier": 25, 2024-05-21T13:36:45.172 INFO:teuthology.orchestra.run.smithi022.stdout: "uptime": 53.482041440000003 2024-05-21T13:36:45.172 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-05-21T13:36:45.172 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.189+0000 7f3bd6285640 1 -- 172.21.15.22:0/2517592221 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f3bbc06f400 msgr2=0x7f3bbc0718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:45.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.189+0000 7f3bd6285640 1 --2- 172.21.15.22:0/2517592221 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f3bbc06f400 0x7f3bbc0718c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3bc0000f70 tx=0x7f3bc0007c90 comp rx=0 tx=0).stop 2024-05-21T13:36:45.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.189+0000 7f3bd6285640 1 -- 172.21.15.22:0/2517592221 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3bd0155cf0 msgr2=0x7f3bd015cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:36:45.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.189+0000 7f3bd6285640 1 --2- 172.21.15.22:0/2517592221 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3bd0155cf0 0x7f3bd015cf00 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3bc40ae040 tx=0x7f3bc4019270 comp rx=0 tx=0).stop 2024-05-21T13:36:45.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.189+0000 7f3bd6285640 1 -- 172.21.15.22:0/2517592221 shutdown_connections 2024-05-21T13:36:45.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.189+0000 7f3bd6285640 1 --2- 172.21.15.22:0/2517592221 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f3bbc06f400 0x7f3bbc0718c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:45.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.189+0000 7f3bd6285640 1 --2- 172.21.15.22:0/2517592221 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3bd0160060 0x7f3bd00c0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:45.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.189+0000 7f3bd6285640 1 --2- 172.21.15.22:0/2517592221 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3bd0155cf0 0x7f3bd015cf00 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:45.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.189+0000 7f3bd6285640 1 --2- 172.21.15.22:0/2517592221 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3bd00c9660 0x7f3bd0142ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:36:45.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.189+0000 7f3bd6285640 1 -- 172.21.15.22:0/2517592221 >> 172.21.15.22:0/2517592221 conn(0x7f3bd006ce70 msgr2=0x7f3bd0152fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:36:45.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.189+0000 7f3bd6285640 1 -- 172.21.15.22:0/2517592221 shutdown_connections 2024-05-21T13:36:45.173 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:36:45.189+0000 7f3bd6285640 1 -- 172.21.15.22:0/2517592221 wait complete. 2024-05-21T13:36:45.183 INFO:tasks.quiescer:Ready to start quiesce thrashing; initial delay: 15 sec 2024-05-21T13:36:59.216 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-21T13:36:59.220 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-21T13:37:00.185 INFO:tasks.quiescer.fs.[cephfs]:Total duration (48.4) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-05-21T13:37:00.185 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 24.2 2024-05-21T13:37:00.185 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-21T13:37:00.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.341+0000 7f4059cc1640 1 Processor -- start 2024-05-21T13:37:00.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.341+0000 7f4059cc1640 1 -- start start 2024-05-21T13:37:00.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.341+0000 7f4059cc1640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f40540c85e0 0x7f4054073950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:00.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.341+0000 7f4059cc1640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4054070080 con 0x7f4054155e40 2024-05-21T13:37:00.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.341+0000 7f4059cc1640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f40540c9da0 con 0x7f40540c97f0 2024-05-21T13:37:00.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.341+0000 7f4059cc1640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f40540ca080 con 0x7f40540c85e0 2024-05-21T13:37:00.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.341+0000 7f40537fe640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f4054155e40 0x7f405415bb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:34272/0 (socket says 172.21.15.22:34272) 2024-05-21T13:37:00.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.341+0000 7f40537fe640 1 -- 172.21.15.22:0/1692338011 learned_addr learned my addr 172.21.15.22:0/1692338011 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-21T13:37:00.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.341+0000 7f4052ffd640 1 --2- 172.21.15.22:0/1692338011 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f40540c85e0 0x7f4054073950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:00.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.341+0000 7f40527fc640 1 -- 172.21.15.22:0/1692338011 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2421795081 0 0) 0x7f4044001120 con 0x7f4054155e40 2024-05-21T13:37:00.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.341+0000 7f40527fc640 1 -- 172.21.15.22:0/1692338011 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f403c003530 con 0x7f4054155e40 2024-05-21T13:37:00.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.341+0000 7f40527fc640 1 -- 172.21.15.22:0/1692338011 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 865423500 0 0) 0x7f403c003530 con 0x7f4054155e40 2024-05-21T13:37:00.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.341+0000 7f40527fc640 1 -- 172.21.15.22:0/1692338011 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f40540c85e0 msgr2=0x7f4054073950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:37:00.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.341+0000 7f40527fc640 1 --2- 172.21.15.22:0/1692338011 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f40540c85e0 0x7f4054073950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:00.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.341+0000 7f40527fc640 1 -- 172.21.15.22:0/1692338011 >> v1:172.21.15.115:6789/0 conn(0x7f40540c97f0 legacy=0x7f405406c4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:37:00.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.341+0000 7f40527fc640 1 -- 172.21.15.22:0/1692338011 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f405406f5a0 con 0x7f4054155e40 2024-05-21T13:37:00.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.341+0000 7f40527fc640 1 -- 172.21.15.22:0/1692338011 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2684847062 0 0) 0x7f40440018d0 con 0x7f4054155e40 2024-05-21T13:37:00.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.341+0000 7f40527fc640 1 -- 172.21.15.22:0/1692338011 >> v1:172.21.15.22:6789/0 conn(0x7f4054155e40 legacy=0x7f405415bb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:37:00.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.341+0000 7f40527fc640 1 --2- 172.21.15.22:0/1692338011 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f40540c85e0 0x7f403c003a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:00.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.341+0000 7f40527fc640 1 --2- 172.21.15.22:0/1692338011 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f403c004010 0x7f403c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:00.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.341+0000 7f40527fc640 1 --2- 172.21.15.22:0/1692338011 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f403c004d50 0x7f403c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:00.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.341+0000 7f40527fc640 1 -- 172.21.15.22:0/1692338011 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f40540ca080 con 0x7f403c004010 2024-05-21T13:37:00.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.341+0000 7f40527fc640 1 -- 172.21.15.22:0/1692338011 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f403c00bb60 con 0x7f403c004d50 2024-05-21T13:37:00.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.341+0000 7f40527fc640 1 -- 172.21.15.22:0/1692338011 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f403c00bd60 con 0x7f40540c85e0 2024-05-21T13:37:00.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.341+0000 7f4052ffd640 1 --2- 172.21.15.22:0/1692338011 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f403c004010 0x7f403c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:00.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.341+0000 7f40537fe640 1 --2- 172.21.15.22:0/1692338011 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f40540c85e0 0x7f403c003a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:00.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.341+0000 7f4053fff640 1 --2- 172.21.15.22:0/1692338011 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f403c004d50 0x7f403c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:00.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.341+0000 7f4052ffd640 1 -- 172.21.15.22:0/1692338011 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f40540c85e0 msgr2=0x7f403c003a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:37:00.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.341+0000 7f4052ffd640 1 --2- 172.21.15.22:0/1692338011 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f40540c85e0 0x7f403c003a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:00.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.341+0000 7f4052ffd640 1 -- 172.21.15.22:0/1692338011 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f403c004d50 msgr2=0x7f403c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:37:00.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.341+0000 7f4052ffd640 1 --2- 172.21.15.22:0/1692338011 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f403c004d50 0x7f403c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:00.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.341+0000 7f4052ffd640 1 -- 172.21.15.22:0/1692338011 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f403c003530 con 0x7f403c004010 2024-05-21T13:37:00.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.341+0000 7f40537fe640 1 --2- 172.21.15.22:0/1692338011 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f40540c85e0 0x7f403c003a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:37:00.324 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.341+0000 7f4053fff640 1 --2- 172.21.15.22:0/1692338011 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f403c004d50 0x7f403c0051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:37:00.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.345+0000 7f4052ffd640 1 --2- 172.21.15.22:0/1692338011 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f403c004010 0x7f403c004810 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4048009ae0 tx=0x7f404801ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1afc5c327020db6e server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:37:00.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.345+0000 7f40527fc640 1 -- 172.21.15.22:0/1692338011 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40480b2070 con 0x7f403c004010 2024-05-21T13:37:00.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.345+0000 7f40527fc640 1 -- 172.21.15.22:0/1692338011 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40480a5550 con 0x7f403c004010 2024-05-21T13:37:00.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.345+0000 7f40527fc640 1 -- 172.21.15.22:0/1692338011 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40480096b0 con 0x7f403c004010 2024-05-21T13:37:00.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.345+0000 7f4059cc1640 1 -- 172.21.15.22:0/1692338011 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f403c004010 msgr2=0x7f403c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:37:00.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.345+0000 7f4059cc1640 1 --2- 172.21.15.22:0/1692338011 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f403c004010 0x7f403c004810 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f4048009ae0 tx=0x7f404801ca70 comp rx=0 tx=0).stop 2024-05-21T13:37:00.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.345+0000 7f4053fff640 1 -- 172.21.15.22:0/1692338011 reap_dead start 2024-05-21T13:37:00.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.345+0000 7f4059cc1640 1 -- 172.21.15.22:0/1692338011 shutdown_connections 2024-05-21T13:37:00.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.345+0000 7f4059cc1640 1 -- 172.21.15.22:0/1692338011 >> 172.21.15.22:0/1692338011 conn(0x7f40540ce640 msgr2=0x7f40540cea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:37:00.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.345+0000 7f4059cc1640 1 -- 172.21.15.22:0/1692338011 shutdown_connections 2024-05-21T13:37:00.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.345+0000 7f4059cc1640 1 -- 172.21.15.22:0/1692338011 wait complete. 2024-05-21T13:37:00.328 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.345+0000 7f4059cc1640 1 Processor -- start 2024-05-21T13:37:00.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.345+0000 7f4059cc1640 1 -- start start 2024-05-21T13:37:00.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.345+0000 7f4059cc1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f403c004010 0x7f405414b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:00.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.349+0000 7f4059cc1640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f405414ba20 0x7f40540c7120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:00.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.349+0000 7f4059cc1640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f405414ecc0 0x7f405414f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:00.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.349+0000 7f4059cc1640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4054156220 con 0x7f403c004010 2024-05-21T13:37:00.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.349+0000 7f4059cc1640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f405406fb60 con 0x7f405414ba20 2024-05-21T13:37:00.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.349+0000 7f4059cc1640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f40540ca360 con 0x7f405414ecc0 2024-05-21T13:37:00.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.349+0000 7f40537fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f403c004010 0x7f405414b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:00.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.349+0000 7f40537fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f403c004010 0x7f405414b270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35666/0 (socket says 172.21.15.22:35666) 2024-05-21T13:37:00.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.349+0000 7f40537fe640 1 -- 172.21.15.22:0/3764320110 learned_addr learned my addr 172.21.15.22:0/3764320110 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:37:00.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.349+0000 7f4052ffd640 1 --2- 172.21.15.22:0/3764320110 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f405414ba20 0x7f40540c7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:00.329 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.349+0000 7f40537fe640 1 -- 172.21.15.22:0/3764320110 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f405414ecc0 msgr2=0x7f405414f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:37:00.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.349+0000 7f40537fe640 1 --2- 172.21.15.22:0/3764320110 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f405414ecc0 0x7f405414f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:00.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.349+0000 7f40537fe640 1 -- 172.21.15.22:0/3764320110 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f405414ba20 msgr2=0x7f40540c7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:37:00.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.349+0000 7f40537fe640 1 --2- 172.21.15.22:0/3764320110 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f405414ba20 0x7f40540c7120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:00.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.349+0000 7f40537fe640 1 -- 172.21.15.22:0/3764320110 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f405414dc90 con 0x7f403c004010 2024-05-21T13:37:00.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.349+0000 7f40537fe640 1 --2- 172.21.15.22:0/3764320110 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f403c004010 0x7f405414b270 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4044010b10 tx=0x7f4044005700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:37:00.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.349+0000 7f403bfff640 1 -- 172.21.15.22:0/3764320110 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f404401a070 con 0x7f403c004010 2024-05-21T13:37:00.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.349+0000 7f403bfff640 1 -- 172.21.15.22:0/3764320110 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4044011040 con 0x7f403c004010 2024-05-21T13:37:00.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.349+0000 7f4059cc1640 1 -- 172.21.15.22:0/3764320110 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f405414f680 con 0x7f403c004010 2024-05-21T13:37:00.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.349+0000 7f403bfff640 1 -- 172.21.15.22:0/3764320110 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f404400ed80 con 0x7f403c004010 2024-05-21T13:37:00.330 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.349+0000 7f4059cc1640 1 -- 172.21.15.22:0/3764320110 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f405414d960 con 0x7f403c004010 2024-05-21T13:37:00.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.349+0000 7f4059cc1640 1 -- 172.21.15.22:0/3764320110 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40540697d0 con 0x7f403c004010 2024-05-21T13:37:00.331 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.349+0000 7f403bfff640 1 -- 172.21.15.22:0/3764320110 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f404401d070 con 0x7f403c004010 2024-05-21T13:37:00.332 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.349+0000 7f403bfff640 1 --2- 172.21.15.22:0/3764320110 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f404006f430 0x7f40400718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:00.332 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.349+0000 7f403bfff640 1 -- 172.21.15.22:0/3764320110 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f4044091ef0 con 0x7f403c004010 2024-05-21T13:37:00.332 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.349+0000 7f4052ffd640 1 --2- 172.21.15.22:0/3764320110 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f404006f430 0x7f40400718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:00.332 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.353+0000 7f4052ffd640 1 --2- 172.21.15.22:0/3764320110 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f404006f430 0x7f40400718f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4048009ae0 tx=0x7f40480046d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:37:00.333 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.353+0000 7f403bfff640 1 -- 172.21.15.22:0/3764320110 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f405414f680 con 0x7f403c004010 2024-05-21T13:37:00.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.549+0000 7f4059cc1640 1 -- 172.21.15.22:0/3764320110 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f40540ccd70 con 0x7f403c004010 2024-05-21T13:37:00.530 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.553+0000 7f403bfff640 1 -- 172.21.15.22:0/3764320110 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6875 (secure 0 0 0) 0x7f4054070080 con 0x7f403c004010 2024-05-21T13:37:00.531 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-21T13:37:00.531 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4224,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/355756580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":355756580},{"type":"v1","addr":"172.21.15.22:6833","nonce":355756580}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4230,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3277017116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":3277017116},{"type":"v1","addr":"172.21.15.22:6835","nonce":3277017116}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4233,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3840772609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3840772609},{"type":"v1","addr":"172.21.15.22:6837","nonce":3840772609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-21T13:35:57.106892+0000","modified":"2024-05-21T13:36:32.396351+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4300,"mds_1":4294,"mds_2":4248},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4248":{"gid":4248,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":12,"addr":"172.21.15.115:6837/2009761279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":2009761279},{"type":"v1","addr":"172.21.15.115:6837","nonce":2009761279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4294":{"gid":4294,"name":"b","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.115:6835/3894678097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3894678097},{"type":"v1","addr":"172.21.15.115:6835","nonce":3894678097}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4300":{"gid":4300,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.115:6839/1525097577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6838","nonce":1525097577},{"type":"v1","addr":"172.21.15.115:6839","nonce":1525097577}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4300,"qdb_cluster":[4248,4300,4294]},"id":1}]} 2024-05-21T13:37:00.531 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 14 2024-05-21T13:37:00.532 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.553+0000 7f4059cc1640 1 -- 172.21.15.22:0/3764320110 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f404006f430 msgr2=0x7f40400718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:37:00.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.553+0000 7f4059cc1640 1 --2- 172.21.15.22:0/3764320110 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f404006f430 0x7f40400718f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4048009ae0 tx=0x7f40480046d0 comp rx=0 tx=0).stop 2024-05-21T13:37:00.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.553+0000 7f4059cc1640 1 -- 172.21.15.22:0/3764320110 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f403c004010 msgr2=0x7f405414b270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:37:00.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.553+0000 7f4059cc1640 1 --2- 172.21.15.22:0/3764320110 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f403c004010 0x7f405414b270 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f4044010b10 tx=0x7f4044005700 comp rx=0 tx=0).stop 2024-05-21T13:37:00.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.553+0000 7f4059cc1640 1 -- 172.21.15.22:0/3764320110 shutdown_connections 2024-05-21T13:37:00.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.553+0000 7f4059cc1640 1 --2- 172.21.15.22:0/3764320110 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f404006f430 0x7f40400718f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:00.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.553+0000 7f4059cc1640 1 --2- 172.21.15.22:0/3764320110 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f405414ecc0 0x7f405414f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:00.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.553+0000 7f4059cc1640 1 --2- 172.21.15.22:0/3764320110 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f405414ba20 0x7f40540c7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:00.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.553+0000 7f4059cc1640 1 --2- 172.21.15.22:0/3764320110 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f403c004010 0x7f405414b270 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:00.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.553+0000 7f4059cc1640 1 -- 172.21.15.22:0/3764320110 >> 172.21.15.22:0/3764320110 conn(0x7f40540ce640 msgr2=0x7f40540c61e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:37:00.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.553+0000 7f4059cc1640 1 -- 172.21.15.22:0/3764320110 shutdown_connections 2024-05-21T13:37:00.533 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.553+0000 7f4059cc1640 1 -- 172.21.15.22:0/3764320110 wait complete. 2024-05-21T13:37:00.548 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4300 quiesce db / --timeout 90 --expiration 144.2 --await-for 45.0' 2024-05-21T13:37:00.548 DEBUG:teuthology.orchestra.run.smithi022:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4300 quiesce db / --timeout 90 --expiration 144.2 --await-for 45.0 2024-05-21T13:37:00.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.709+0000 7fbf1d820640 1 Processor -- start 2024-05-21T13:37:00.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.709+0000 7fbf1d820640 1 -- start start 2024-05-21T13:37:00.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.709+0000 7fbf1d820640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fbf1815bce0 0x7fbf180cc1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:00.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.709+0000 7fbf1d820640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf1815c2c0 con 0x7fbf180cc6f0 2024-05-21T13:37:00.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.709+0000 7fbf1d820640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbf1815c5a0 con 0x7fbf18155fe0 2024-05-21T13:37:00.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.709+0000 7fbf1d820640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fbf1815c880 con 0x7fbf1815bce0 2024-05-21T13:37:00.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.709+0000 7fbf167fc640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fbf1815bce0 0x7fbf180cc1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:00.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.709+0000 7fbf177fe640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fbf180cc6f0 0x7fbf180720f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:34284/0 (socket says 172.21.15.22:34284) 2024-05-21T13:37:00.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.709+0000 7fbf167fc640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fbf1815bce0 0x7fbf180cc1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35680/0 (socket says 172.21.15.22:35680) 2024-05-21T13:37:00.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.709+0000 7fbf177fe640 1 -- 172.21.15.22:0/1814958956 learned_addr learned my addr 172.21.15.22:0/1814958956 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-21T13:37:00.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.709+0000 7fbf167fc640 1 -- 172.21.15.22:0/1814958956 >> v1:172.21.15.115:6789/0 conn(0x7fbf18155fe0 legacy=0x7fbf1815fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:37:00.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.709+0000 7fbf167fc640 1 -- 172.21.15.22:0/1814958956 >> v1:172.21.15.22:6789/0 conn(0x7fbf180cc6f0 legacy=0x7fbf180720f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:37:00.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.709+0000 7fbf167fc640 1 -- 172.21.15.22:0/1814958956 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf1815cb60 con 0x7fbf1815bce0 2024-05-21T13:37:00.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.713+0000 7fbf167fc640 1 --2- 172.21.15.22:0/1814958956 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf1815bce0 0x7fbf180cc1b0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c0097c0 tx=0x7fbf0c01ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea845a678488db1c server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:37:00.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.713+0000 7fbf15ffb640 1 -- 172.21.15.22:0/1814958956 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf0c0b5070 con 0x7fbf1815bce0 2024-05-21T13:37:00.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.713+0000 7fbf15ffb640 1 -- 172.21.15.22:0/1814958956 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf0c0a8990 con 0x7fbf1815bce0 2024-05-21T13:37:00.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.713+0000 7fbf15ffb640 1 -- 172.21.15.22:0/1814958956 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf0c0a8d60 con 0x7fbf1815bce0 2024-05-21T13:37:00.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.713+0000 7fbf1d820640 1 -- 172.21.15.22:0/1814958956 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf1815bce0 msgr2=0x7fbf180cc1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:37:00.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.713+0000 7fbf1d820640 1 --2- 172.21.15.22:0/1814958956 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf1815bce0 0x7fbf180cc1b0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c0097c0 tx=0x7fbf0c01ec90 comp rx=0 tx=0).stop 2024-05-21T13:37:00.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.713+0000 7fbf1d820640 1 -- 172.21.15.22:0/1814958956 shutdown_connections 2024-05-21T13:37:00.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.713+0000 7fbf1d820640 1 --2- 172.21.15.22:0/1814958956 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf1815bce0 0x7fbf180cc1b0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:00.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.713+0000 7fbf1d820640 1 -- 172.21.15.22:0/1814958956 >> 172.21.15.22:0/1814958956 conn(0x7fbf18070750 msgr2=0x7fbf1806c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:37:00.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.713+0000 7fbf1d820640 1 -- 172.21.15.22:0/1814958956 shutdown_connections 2024-05-21T13:37:00.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.713+0000 7fbf1d820640 1 -- 172.21.15.22:0/1814958956 wait complete. 2024-05-21T13:37:00.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.713+0000 7fbf1d820640 1 Processor -- start 2024-05-21T13:37:00.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.713+0000 7fbf1d820640 1 -- start start 2024-05-21T13:37:00.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.713+0000 7fbf1d820640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbf180cc6f0 0x7fbf181f5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:00.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.713+0000 7fbf1d820640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf18155fe0 0x7fbf181e7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:00.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.713+0000 7fbf1d820640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbf1815bce0 0x7fbf181e8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:00.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.713+0000 7fbf1d820640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fbf181601a0 con 0x7fbf18155fe0 2024-05-21T13:37:00.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.713+0000 7fbf1d820640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fbf1815f570 con 0x7fbf180cc6f0 2024-05-21T13:37:00.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.713+0000 7fbf1d820640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7fbf180ca890 con 0x7fbf1815bce0 2024-05-21T13:37:00.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.717+0000 7fbf167fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf18155fe0 0x7fbf181e7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:00.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.717+0000 7fbf167fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf18155fe0 0x7fbf181e7cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35686/0 (socket says 172.21.15.22:35686) 2024-05-21T13:37:00.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.717+0000 7fbf167fc640 1 -- 172.21.15.22:0/398377982 learned_addr learned my addr 172.21.15.22:0/398377982 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:37:00.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.717+0000 7fbf16ffd640 1 --2- 172.21.15.22:0/398377982 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbf180cc6f0 0x7fbf181f5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:00.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.717+0000 7fbf177fe640 1 --2- 172.21.15.22:0/398377982 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbf1815bce0 0x7fbf181e8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:00.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.717+0000 7fbf167fc640 1 -- 172.21.15.22:0/398377982 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbf1815bce0 msgr2=0x7fbf181e8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:37:00.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.717+0000 7fbf167fc640 1 --2- 172.21.15.22:0/398377982 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbf1815bce0 0x7fbf181e8200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:00.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.717+0000 7fbf167fc640 1 -- 172.21.15.22:0/398377982 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbf180cc6f0 msgr2=0x7fbf181f5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:37:00.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.717+0000 7fbf167fc640 1 --2- 172.21.15.22:0/398377982 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbf180cc6f0 0x7fbf181f5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:00.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.717+0000 7fbf167fc640 1 -- 172.21.15.22:0/398377982 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf181f1a90 con 0x7fbf18155fe0 2024-05-21T13:37:00.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.717+0000 7fbf167fc640 1 --2- 172.21.15.22:0/398377982 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf18155fe0 0x7fbf181e7cc0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c01c8c0 tx=0x7fbf0c01ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:37:00.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.717+0000 7fbefffff640 1 -- 172.21.15.22:0/398377982 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf0c0bf070 con 0x7fbf18155fe0 2024-05-21T13:37:00.696 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.717+0000 7fbefffff640 1 -- 172.21.15.22:0/398377982 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf0c0b0820 con 0x7fbf18155fe0 2024-05-21T13:37:00.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.717+0000 7fbefffff640 1 -- 172.21.15.22:0/398377982 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf0c0b5040 con 0x7fbf18155fe0 2024-05-21T13:37:00.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.717+0000 7fbf1d820640 1 -- 172.21.15.22:0/398377982 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf181f5180 con 0x7fbf18155fe0 2024-05-21T13:37:00.697 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.717+0000 7fbf1d820640 1 -- 172.21.15.22:0/398377982 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf181f1ff0 con 0x7fbf18155fe0 2024-05-21T13:37:00.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.717+0000 7fbefffff640 1 -- 172.21.15.22:0/398377982 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fbf0c0b0c10 con 0x7fbf18155fe0 2024-05-21T13:37:00.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.717+0000 7fbefffff640 1 --2- 172.21.15.22:0/398377982 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fbf0406f400 0x7fbf040718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:00.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.717+0000 7fbefffff640 1 -- 172.21.15.22:0/398377982 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7fbf0c12bff0 con 0x7fbf18155fe0 2024-05-21T13:37:00.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.717+0000 7fbf16ffd640 1 --2- 172.21.15.22:0/398377982 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fbf0406f400 0x7fbf040718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:00.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.717+0000 7fbf209ab000 1 Processor -- start 2024-05-21T13:37:00.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.717+0000 7fbf209ab000 1 -- start start 2024-05-21T13:37:00.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.721+0000 7fbf16ffd640 1 --2- 172.21.15.22:0/398377982 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fbf0406f400 0x7fbf040718c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fbf08004e30 tx=0x7fbf08009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:37:00.701 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.721+0000 7fbf209ab000 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x561b7e62f130 0x561b7e5f8bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:00.701 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.721+0000 7fbf209ab000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561b7e5f9100 0x561b7e633bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:00.701 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.721+0000 7fbf209ab000 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561b7e634100 0x561b7e6344e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:00.701 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.721+0000 7fbf209ab000 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x561b7e44e740 con 0x561b7e634100 2024-05-21T13:37:00.701 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.721+0000 7fbf209ab000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x561b7e43e2e0 con 0x561b7e5f9100 2024-05-21T13:37:00.701 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.721+0000 7fbf209ab000 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x561b7e442320 con 0x561b7e62f130 2024-05-21T13:37:00.701 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.721+0000 7fbf177fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561b7e634100 0x561b7e6344e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:00.701 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.721+0000 7fbf177fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561b7e634100 0x561b7e6344e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35692/0 (socket says 172.21.15.22:35692) 2024-05-21T13:37:00.701 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.721+0000 7fbf177fe640 1 -- 172.21.15.22:0/382229669 learned_addr learned my addr 172.21.15.22:0/382229669 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:37:00.701 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.721+0000 7fbf167fc640 1 --2- 172.21.15.22:0/382229669 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561b7e5f9100 0x561b7e633bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:00.701 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.721+0000 7fbf16ffd640 1 --2- 172.21.15.22:0/382229669 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x561b7e62f130 0x561b7e5f8bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:00.701 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.721+0000 7fbf177fe640 1 -- 172.21.15.22:0/382229669 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x561b7e62f130 msgr2=0x561b7e5f8bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:37:00.702 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.721+0000 7fbf177fe640 1 --2- 172.21.15.22:0/382229669 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x561b7e62f130 0x561b7e5f8bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:00.702 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.721+0000 7fbf177fe640 1 -- 172.21.15.22:0/382229669 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561b7e5f9100 msgr2=0x561b7e633bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:37:00.702 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.721+0000 7fbf177fe640 1 --2- 172.21.15.22:0/382229669 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561b7e5f9100 0x561b7e633bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:00.702 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.721+0000 7fbf177fe640 1 -- 172.21.15.22:0/382229669 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b7e3e0490 con 0x561b7e634100 2024-05-21T13:37:00.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.721+0000 7fbf16ffd640 1 --2- 172.21.15.22:0/382229669 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x561b7e62f130 0x561b7e5f8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:37:00.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.721+0000 7fbf177fe640 1 --2- 172.21.15.22:0/382229669 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561b7e634100 0x561b7e6344e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fbf10002180 tx=0x7fbf1000d520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39f14be8b998eb16 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:37:00.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.721+0000 7fbefd7fa640 1 -- 172.21.15.22:0/382229669 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf10018070 con 0x561b7e634100 2024-05-21T13:37:00.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.721+0000 7fbefd7fa640 1 -- 172.21.15.22:0/382229669 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf10013670 con 0x561b7e634100 2024-05-21T13:37:00.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.721+0000 7fbefd7fa640 1 -- 172.21.15.22:0/382229669 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf10013a60 con 0x561b7e634100 2024-05-21T13:37:00.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.721+0000 7fbf209ab000 1 -- 172.21.15.22:0/382229669 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561b7e634100 msgr2=0x561b7e6344e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:37:00.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.721+0000 7fbf209ab000 1 --2- 172.21.15.22:0/382229669 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561b7e634100 0x561b7e6344e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fbf10002180 tx=0x7fbf1000d520 comp rx=0 tx=0).stop 2024-05-21T13:37:00.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.721+0000 7fbf209ab000 1 -- 172.21.15.22:0/382229669 shutdown_connections 2024-05-21T13:37:00.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.721+0000 7fbf209ab000 1 --2- 172.21.15.22:0/382229669 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561b7e634100 0x561b7e6344e0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:00.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.721+0000 7fbf209ab000 1 --2- 172.21.15.22:0/382229669 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561b7e5f9100 0x561b7e633bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:00.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.721+0000 7fbf209ab000 1 --2- 172.21.15.22:0/382229669 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x561b7e62f130 0x561b7e5f8bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:00.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.721+0000 7fbf209ab000 1 -- 172.21.15.22:0/382229669 >> 172.21.15.22:0/382229669 conn(0x561b7e4dad80 msgr2=0x561b7e631980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:37:00.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.721+0000 7fbf209ab000 1 -- 172.21.15.22:0/382229669 shutdown_connections 2024-05-21T13:37:00.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.721+0000 7fbf209ab000 1 -- 172.21.15.22:0/382229669 wait complete. 2024-05-21T13:37:00.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.721+0000 7fbf209ab000 1 -- start start 2024-05-21T13:37:00.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.721+0000 7fbf209ab000 1 Processor -- start 2024-05-21T13:37:00.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.721+0000 7fbf209ab000 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561b7e5f9100 0x561b7e5f38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:00.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.721+0000 7fbf209ab000 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x561b7e62f130 0x561b7e5f3e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:00.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.721+0000 7fbf209ab000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561b7e634100 0x561b7e5f4350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:00.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.721+0000 7fbf209ab000 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x561b7e109b10 con 0x561b7e5f9100 2024-05-21T13:37:00.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.721+0000 7fbf209ab000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x561b7e3fa670 con 0x561b7e634100 2024-05-21T13:37:00.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.721+0000 7fbf209ab000 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x561b7e446950 con 0x561b7e62f130 2024-05-21T13:37:00.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.721+0000 7fbf209ab000 10 client.0 _ll_register_callbacks cb 0x561b7e5de540 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-21T13:37:00.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.721+0000 7fbf16ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561b7e5f9100 0x561b7e5f38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:00.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.721+0000 7fbf16ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561b7e5f9100 0x561b7e5f38d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35706/0 (socket says 172.21.15.22:35706) 2024-05-21T13:37:00.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.721+0000 7fbf16ffd640 1 -- 172.21.15.22:0/2743046625 learned_addr learned my addr 172.21.15.22:0/2743046625 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:37:00.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.721+0000 7fbf167fc640 1 --2- 172.21.15.22:0/2743046625 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x561b7e62f130 0x561b7e5f3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:00.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.721+0000 7fbf177fe640 1 --2- 172.21.15.22:0/2743046625 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561b7e634100 0x561b7e5f4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:00.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.721+0000 7fbf16ffd640 1 -- 172.21.15.22:0/2743046625 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x561b7e62f130 msgr2=0x561b7e5f3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:37:00.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.721+0000 7fbf16ffd640 1 --2- 172.21.15.22:0/2743046625 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x561b7e62f130 0x561b7e5f3e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:00.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.721+0000 7fbf16ffd640 1 -- 172.21.15.22:0/2743046625 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561b7e634100 msgr2=0x561b7e5f4350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:37:00.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.721+0000 7fbf16ffd640 1 --2- 172.21.15.22:0/2743046625 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561b7e634100 0x561b7e5f4350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:00.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.721+0000 7fbf16ffd640 1 -- 172.21.15.22:0/2743046625 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b7e3f3e40 con 0x561b7e5f9100 2024-05-21T13:37:00.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.721+0000 7fbf177fe640 1 --2- 172.21.15.22:0/2743046625 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561b7e634100 0x561b7e5f4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:37:00.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.725+0000 7fbf16ffd640 1 --2- 172.21.15.22:0/2743046625 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561b7e5f9100 0x561b7e5f38d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fbf0800ee10 tx=0x7fbf08003700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8979d81896cf5924 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:37:00.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.725+0000 7fbef67fc640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-05-21T13:37:00.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.725+0000 7fbef67fc640 1 -- 172.21.15.22:0/2743046625 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf0800ee40 con 0x561b7e5f9100 2024-05-21T13:37:00.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.725+0000 7fbef67fc640 1 -- 172.21.15.22:0/2743046625 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7fbf080135f0 con 0x561b7e5f9100 2024-05-21T13:37:00.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.725+0000 7fbf209ab000 1 -- 172.21.15.22:0/2743046625 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbf10013670 con 0x561b7e5f9100 2024-05-21T13:37:00.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.725+0000 7fbef67fc640 1 -- 172.21.15.22:0/2743046625 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7fbf08003810 con 0x561b7e5f9100 2024-05-21T13:37:00.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.725+0000 7fbf209ab000 10 client.4863 fetch_fsmap learned FSMap version 14 2024-05-21T13:37:00.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.725+0000 7fbf209ab000 1 -- 172.21.15.22:0/2743046625 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x561b7e4c3890 con 0x561b7e5f9100 2024-05-21T13:37:00.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.725+0000 7fbef67fc640 1 -- 172.21.15.22:0/2743046625 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf10013670 con 0x561b7e5f9100 2024-05-21T13:37:00.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.725+0000 7fbef67fc640 1 -- 172.21.15.22:0/2743046625 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7fbf08030080 con 0x561b7e5f9100 2024-05-21T13:37:00.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.725+0000 7fbf209ab000 10 client.4863 fetch_fsmap finished waiting for FSMap version 14 2024-05-21T13:37:00.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.725+0000 7fbf209ab000 10 client.4863 resolve_mds: validated gid 4300 aka daemon mds.f 2024-05-21T13:37:00.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.725+0000 7fbf209ab000 20 client.4863 populate_metadata read hostname 'smithi022' 2024-05-21T13:37:00.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.725+0000 7fbf209ab000 1 --2- 172.21.15.22:0/2743046625 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x561b7e6478c0 0x561b7e649cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:00.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.725+0000 7fbf209ab000 4 client.4863 mds_command: new command op to 4300 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-21T13:37:00.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.725+0000 7fbf209ab000 1 -- 172.21.15.22:0/2743046625 --> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561b7e3da7f0 con 0x561b7e6478c0 2024-05-21T13:37:00.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.725+0000 7fbf167fc640 1 --2- 172.21.15.22:0/2743046625 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x561b7e6478c0 0x561b7e649cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:00.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.725+0000 7fbf167fc640 1 --2- 172.21.15.22:0/2743046625 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x561b7e6478c0 0x561b7e649cb0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f7351cf92331dc55 server_cookie=3d96c523f4772ae1 in_seq=0 out_seq=0 2024-05-21T13:37:00.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.725+0000 7fbef67fc640 10 client.4863 ms_handle_connect on v2:172.21.15.115:6838/1525097577 2024-05-21T13:37:00.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.725+0000 7fbef67fc640 1 -- 172.21.15.22:0/2743046625 <== mds.0 v2:172.21.15.115:6838/1525097577 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x561b7e3da7f0 con 0x561b7e6478c0 2024-05-21T13:37:00.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.725+0000 7fbef67fc640 10 client.4863 handle_command_reply: tid=0 2024-05-21T13:37:00.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.725+0000 7fbf209ab000 1 client.4863 shutdown 2024-05-21T13:37:00.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.725+0000 7fbf209ab000 1 -- 172.21.15.22:0/2743046625 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561b7e5f9100 msgr2=0x561b7e5f38d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:37:00.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.725+0000 7fbf209ab000 1 --2- 172.21.15.22:0/2743046625 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561b7e5f9100 0x561b7e5f38d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fbf0800ee10 tx=0x7fbf08003700 comp rx=0 tx=0).stop 2024-05-21T13:37:00.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.725+0000 7fbf209ab000 1 -- 172.21.15.22:0/2743046625 shutdown_connections 2024-05-21T13:37:00.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.725+0000 7fbf209ab000 1 --2- 172.21.15.22:0/2743046625 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x561b7e6478c0 0x561b7e649cb0 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:00.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.725+0000 7fbf209ab000 1 --2- 172.21.15.22:0/2743046625 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561b7e634100 0x561b7e5f4350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:00.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.725+0000 7fbf209ab000 1 --2- 172.21.15.22:0/2743046625 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x561b7e62f130 0x561b7e5f3e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:00.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.725+0000 7fbf209ab000 1 --2- 172.21.15.22:0/2743046625 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561b7e5f9100 0x561b7e5f38d0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:00.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.725+0000 7fbef67fc640 0 client.4863 ms_handle_reset on v2:172.21.15.115:6838/1525097577 2024-05-21T13:37:00.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.725+0000 7fbf209ab000 1 -- 172.21.15.22:0/2743046625 >> 172.21.15.22:0/2743046625 conn(0x561b7e4dad80 msgr2=0x561b7e5f8330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:37:00.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.725+0000 7fbf209ab000 1 -- 172.21.15.22:0/2743046625 shutdown_connections 2024-05-21T13:37:00.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.725+0000 7fbf209ab000 1 -- 172.21.15.22:0/2743046625 wait complete. 2024-05-21T13:37:00.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.725+0000 7fbf209ab000 20 client.4863 trim_cache size 0 max 16384 2024-05-21T13:37:00.724 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.745+0000 7fbf209ab000 1 Processor -- start 2024-05-21T13:37:00.724 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.745+0000 7fbf209ab000 1 -- start start 2024-05-21T13:37:00.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.745+0000 7fbf209ab000 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x561b7e5f9100 0x561b7e64d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:00.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.745+0000 7fbf209ab000 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561b7e62f130 0x561b7e62d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:00.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.745+0000 7fbf209ab000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561b7e634100 0x561b7e62deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:00.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.745+0000 7fbf209ab000 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fbf181fe5f0 con 0x561b7e62f130 2024-05-21T13:37:00.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.745+0000 7fbf209ab000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fbf181540e0 con 0x561b7e634100 2024-05-21T13:37:00.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.745+0000 7fbf209ab000 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7fbf181fdfa0 con 0x561b7e5f9100 2024-05-21T13:37:00.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.745+0000 7fbf167fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561b7e62f130 0x561b7e62d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:00.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.745+0000 7fbf167fc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561b7e62f130 0x561b7e62d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35718/0 (socket says 172.21.15.22:35718) 2024-05-21T13:37:00.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.745+0000 7fbf167fc640 1 -- 172.21.15.22:0/2786190577 learned_addr learned my addr 172.21.15.22:0/2786190577 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:37:00.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.745+0000 7fbf16ffd640 1 --2- 172.21.15.22:0/2786190577 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x561b7e5f9100 0x561b7e64d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:00.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.745+0000 7fbf177fe640 1 --2- 172.21.15.22:0/2786190577 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561b7e634100 0x561b7e62deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:00.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.745+0000 7fbf167fc640 1 -- 172.21.15.22:0/2786190577 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x561b7e5f9100 msgr2=0x561b7e64d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:37:00.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.745+0000 7fbf167fc640 1 --2- 172.21.15.22:0/2786190577 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x561b7e5f9100 0x561b7e64d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:00.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.745+0000 7fbf167fc640 1 -- 172.21.15.22:0/2786190577 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561b7e634100 msgr2=0x561b7e62deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:37:00.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.745+0000 7fbf167fc640 1 --2- 172.21.15.22:0/2786190577 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561b7e634100 0x561b7e62deb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:00.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.745+0000 7fbf167fc640 1 -- 172.21.15.22:0/2786190577 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561b7e49ada0 con 0x561b7e62f130 2024-05-21T13:37:00.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.745+0000 7fbf167fc640 1 --2- 172.21.15.22:0/2786190577 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561b7e62f130 0x561b7e62d970 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c0098b0 tx=0x7fbf0c01ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=644aa89331d9a29c server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:37:00.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.745+0000 7fbefcff9640 1 -- 172.21.15.22:0/2786190577 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf0c0f8b40 con 0x561b7e62f130 2024-05-21T13:37:00.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.745+0000 7fbefcff9640 1 -- 172.21.15.22:0/2786190577 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf0c123070 con 0x561b7e62f130 2024-05-21T13:37:00.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.745+0000 7fbefcff9640 1 -- 172.21.15.22:0/2786190577 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf0c0f8440 con 0x561b7e62f130 2024-05-21T13:37:00.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.749+0000 7fbf209ab000 1 -- 172.21.15.22:0/2786190577 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561b7e62f130 msgr2=0x561b7e62d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:37:00.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.749+0000 7fbf209ab000 1 --2- 172.21.15.22:0/2786190577 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561b7e62f130 0x561b7e62d970 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c0098b0 tx=0x7fbf0c01ec90 comp rx=0 tx=0).stop 2024-05-21T13:37:00.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.749+0000 7fbf209ab000 1 -- 172.21.15.22:0/2786190577 shutdown_connections 2024-05-21T13:37:00.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.749+0000 7fbf209ab000 1 --2- 172.21.15.22:0/2786190577 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561b7e634100 0x561b7e62deb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:00.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.749+0000 7fbf209ab000 1 --2- 172.21.15.22:0/2786190577 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561b7e62f130 0x561b7e62d970 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:00.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.749+0000 7fbf209ab000 1 --2- 172.21.15.22:0/2786190577 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x561b7e5f9100 0x561b7e64d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:00.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.749+0000 7fbf209ab000 1 -- 172.21.15.22:0/2786190577 >> 172.21.15.22:0/2786190577 conn(0x561b7e4dad80 msgr2=0x561b7e62e820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:37:00.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.749+0000 7fbf209ab000 1 -- 172.21.15.22:0/2786190577 shutdown_connections 2024-05-21T13:37:00.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.749+0000 7fbf209ab000 1 -- 172.21.15.22:0/2786190577 wait complete. 2024-05-21T13:37:00.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.749+0000 7fbf209ab000 1 -- start start 2024-05-21T13:37:00.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.749+0000 7fbf209ab000 1 Processor -- start 2024-05-21T13:37:00.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.749+0000 7fbf209ab000 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561b7e5f9100 0x561b7e66cf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:00.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.749+0000 7fbf209ab000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561b7e62f130 0x561b7e66d450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:00.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.749+0000 7fbf209ab000 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x561b7e634100 0x561b7e66d990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:00.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.749+0000 7fbf209ab000 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x561b7e43a0e0 con 0x561b7e5f9100 2024-05-21T13:37:00.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.749+0000 7fbf209ab000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x561b7e4c3400 con 0x561b7e62f130 2024-05-21T13:37:00.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.749+0000 7fbf209ab000 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x561b7e3d73e0 con 0x561b7e634100 2024-05-21T13:37:00.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.749+0000 7fbf16ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561b7e5f9100 0x561b7e66cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:00.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.749+0000 7fbf16ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561b7e5f9100 0x561b7e66cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35726/0 (socket says 172.21.15.22:35726) 2024-05-21T13:37:00.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.749+0000 7fbf16ffd640 1 -- 172.21.15.22:0/2929241943 learned_addr learned my addr 172.21.15.22:0/2929241943 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:37:00.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.749+0000 7fbf209ab000 10 client.0 _ll_register_callbacks cb 0x7fbf08007e60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-21T13:37:00.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.749+0000 7fbf167fc640 1 --2- 172.21.15.22:0/2929241943 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561b7e62f130 0x561b7e66d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:00.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.749+0000 7fbf177fe640 1 --2- 172.21.15.22:0/2929241943 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x561b7e634100 0x561b7e66d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:00.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.749+0000 7fbf16ffd640 1 -- 172.21.15.22:0/2929241943 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x561b7e634100 msgr2=0x561b7e66d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:37:00.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.749+0000 7fbf16ffd640 1 --2- 172.21.15.22:0/2929241943 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x561b7e634100 0x561b7e66d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:00.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.749+0000 7fbf16ffd640 1 -- 172.21.15.22:0/2929241943 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561b7e62f130 msgr2=0x561b7e66d450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:37:00.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.749+0000 7fbf16ffd640 1 --2- 172.21.15.22:0/2929241943 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561b7e62f130 0x561b7e66d450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:00.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.749+0000 7fbf16ffd640 1 -- 172.21.15.22:0/2929241943 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561b7e3d2f40 con 0x561b7e5f9100 2024-05-21T13:37:00.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.749+0000 7fbf167fc640 1 --2- 172.21.15.22:0/2929241943 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561b7e62f130 0x561b7e66d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:37:00.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.749+0000 7fbf16ffd640 1 --2- 172.21.15.22:0/2929241943 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561b7e5f9100 0x561b7e66cf10 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fbf0800e860 tx=0x7fbf08013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3775e010d9bc341a server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:37:00.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.749+0000 7fbef67fc640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-05-21T13:37:00.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.749+0000 7fbef67fc640 1 -- 172.21.15.22:0/2929241943 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf08036030 con 0x561b7e5f9100 2024-05-21T13:37:00.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.749+0000 7fbef67fc640 1 -- 172.21.15.22:0/2929241943 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7fbf08010040 con 0x561b7e5f9100 2024-05-21T13:37:00.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.749+0000 7fbf209ab000 1 -- 172.21.15.22:0/2929241943 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbf0c123070 con 0x561b7e5f9100 2024-05-21T13:37:00.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.749+0000 7fbef67fc640 1 -- 172.21.15.22:0/2929241943 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7fbf0803f050 con 0x561b7e5f9100 2024-05-21T13:37:00.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.749+0000 7fbf209ab000 10 client.4869 fetch_fsmap learned FSMap version 14 2024-05-21T13:37:00.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.749+0000 7fbf209ab000 1 -- 172.21.15.22:0/2929241943 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x561b7e3e5f80 con 0x561b7e5f9100 2024-05-21T13:37:00.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.749+0000 7fbef67fc640 1 -- 172.21.15.22:0/2929241943 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbf0c123070 con 0x561b7e5f9100 2024-05-21T13:37:00.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.749+0000 7fbef67fc640 1 -- 172.21.15.22:0/2929241943 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7fbf08042020 con 0x561b7e5f9100 2024-05-21T13:37:00.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.749+0000 7fbf209ab000 10 client.4869 fetch_fsmap finished waiting for FSMap version 14 2024-05-21T13:37:00.735 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.749+0000 7fbf209ab000 10 client.4869 resolve_mds: validated gid 4300 aka daemon mds.f 2024-05-21T13:37:00.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.749+0000 7fbf209ab000 20 client.4869 populate_metadata read hostname 'smithi022' 2024-05-21T13:37:00.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.749+0000 7fbf209ab000 1 --2- 172.21.15.22:0/2929241943 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x561b7e6b2dc0 0x561b7e6b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:00.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.749+0000 7fbf209ab000 4 client.4869 mds_command: new command op to 4300 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 144.2, "await_for": 45.0}] 2024-05-21T13:37:00.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.749+0000 7fbf209ab000 1 -- 172.21.15.22:0/2929241943 --> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 144.2, "await_for": 45.0}) -- 0x561b7e41be60 con 0x561b7e6b2dc0 2024-05-21T13:37:00.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.749+0000 7fbf167fc640 1 --2- 172.21.15.22:0/2929241943 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x561b7e6b2dc0 0x561b7e6b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:00.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.753+0000 7fbef67fc640 10 client.4869 ms_handle_connect on v2:172.21.15.115:6838/1525097577 2024-05-21T13:37:00.736 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.753+0000 7fbf167fc640 1 --2- 172.21.15.22:0/2929241943 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x561b7e6b2dc0 0x561b7e6b51b0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb33c14f38e4aec2 server_cookie=3d3e6cf025cb5124 in_seq=0 out_seq=0 2024-05-21T13:37:00.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.757+0000 7fbef67fc640 1 -- 172.21.15.22:0/2929241943 <== mds.0 v2:172.21.15.115:6838/1525097577 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x561b7e41be60 con 0x561b7e6b2dc0 2024-05-21T13:37:00.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.757+0000 7fbef67fc640 10 client.4869 handle_command_reply: tid=0 2024-05-21T13:37:00.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.757+0000 7fbf209ab000 1 client.4869 shutdown 2024-05-21T13:37:00.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.757+0000 7fbf209ab000 1 -- 172.21.15.22:0/2929241943 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561b7e5f9100 msgr2=0x561b7e66cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:37:00.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.757+0000 7fbf209ab000 1 --2- 172.21.15.22:0/2929241943 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561b7e5f9100 0x561b7e66cf10 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7fbf0800e860 tx=0x7fbf08013000 comp rx=0 tx=0).stop 2024-05-21T13:37:00.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.757+0000 7fbf209ab000 1 -- 172.21.15.22:0/2929241943 shutdown_connections 2024-05-21T13:37:00.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.757+0000 7fbf209ab000 1 --2- 172.21.15.22:0/2929241943 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x561b7e634100 0x561b7e66d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:00.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.757+0000 7fbf209ab000 1 --2- 172.21.15.22:0/2929241943 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x561b7e6b2dc0 0x561b7e6b51b0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:00.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.757+0000 7fbf209ab000 1 --2- 172.21.15.22:0/2929241943 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x561b7e62f130 0x561b7e66d450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:00.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.757+0000 7fbf209ab000 1 --2- 172.21.15.22:0/2929241943 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x561b7e5f9100 0x561b7e66cf10 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:00.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.757+0000 7fbf209ab000 1 -- 172.21.15.22:0/2929241943 >> 172.21.15.22:0/2929241943 conn(0x561b7e4dad80 msgr2=0x561b7e62e610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:37:00.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.757+0000 7fbef67fc640 0 client.4869 ms_handle_reset on v2:172.21.15.115:6838/1525097577 2024-05-21T13:37:00.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.757+0000 7fbf209ab000 1 -- 172.21.15.22:0/2929241943 shutdown_connections 2024-05-21T13:37:00.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.757+0000 7fbf209ab000 1 -- 172.21.15.22:0/2929241943 wait complete. 2024-05-21T13:37:00.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.757+0000 7fbf209ab000 20 client.4869 trim_cache size 0 max 16384 2024-05-21T13:37:00.739 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-05-21T13:37:00.739 INFO:teuthology.orchestra.run.smithi022.stdout: "epoch": 14, 2024-05-21T13:37:00.739 INFO:teuthology.orchestra.run.smithi022.stdout: "leader": 4300, 2024-05-21T13:37:00.739 INFO:teuthology.orchestra.run.smithi022.stdout: "set_version": 2, 2024-05-21T13:37:00.739 INFO:teuthology.orchestra.run.smithi022.stdout: "sets": { 2024-05-21T13:37:00.739 INFO:teuthology.orchestra.run.smithi022.stdout: "1c6f8938": { 2024-05-21T13:37:00.740 INFO:teuthology.orchestra.run.smithi022.stdout: "version": 2, 2024-05-21T13:37:00.740 INFO:teuthology.orchestra.run.smithi022.stdout: "age_ref": 0.0, 2024-05-21T13:37:00.740 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-05-21T13:37:00.740 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "QUIESCED", 2024-05-21T13:37:00.740 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-05-21T13:37:00.740 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-05-21T13:37:00.740 INFO:teuthology.orchestra.run.smithi022.stdout: "timeout": 90.0, 2024-05-21T13:37:00.740 INFO:teuthology.orchestra.run.smithi022.stdout: "expiration": 144.2, 2024-05-21T13:37:00.740 INFO:teuthology.orchestra.run.smithi022.stdout: "members": { 2024-05-21T13:37:00.740 INFO:teuthology.orchestra.run.smithi022.stdout: "file:/": { 2024-05-21T13:37:00.740 INFO:teuthology.orchestra.run.smithi022.stdout: "excluded": false, 2024-05-21T13:37:00.740 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-05-21T13:37:00.741 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "QUIESCED", 2024-05-21T13:37:00.741 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-05-21T13:37:00.741 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-05-21T13:37:00.741 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-05-21T13:37:00.741 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-05-21T13:37:00.741 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-05-21T13:37:00.741 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-05-21T13:37:00.741 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-05-21T13:37:00.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.757+0000 7fbf1d820640 1 -- 172.21.15.22:0/398377982 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fbf0406f400 msgr2=0x7fbf040718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:37:00.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.757+0000 7fbf1d820640 1 --2- 172.21.15.22:0/398377982 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fbf0406f400 0x7fbf040718c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fbf08004e30 tx=0x7fbf08009040 comp rx=0 tx=0).stop 2024-05-21T13:37:00.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.757+0000 7fbf1d820640 1 -- 172.21.15.22:0/398377982 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf18155fe0 msgr2=0x7fbf181e7cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:37:00.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.757+0000 7fbf1d820640 1 --2- 172.21.15.22:0/398377982 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf18155fe0 0x7fbf181e7cc0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fbf0c01c8c0 tx=0x7fbf0c01ba30 comp rx=0 tx=0).stop 2024-05-21T13:37:00.742 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.757+0000 7fbf1d820640 1 -- 172.21.15.22:0/398377982 shutdown_connections 2024-05-21T13:37:00.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.757+0000 7fbf1d820640 1 --2- 172.21.15.22:0/398377982 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fbf0406f400 0x7fbf040718c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:00.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.757+0000 7fbf1d820640 1 --2- 172.21.15.22:0/398377982 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbf1815bce0 0x7fbf181e8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:00.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.757+0000 7fbf1d820640 1 --2- 172.21.15.22:0/398377982 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbf18155fe0 0x7fbf181e7cc0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:00.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.757+0000 7fbf1d820640 1 --2- 172.21.15.22:0/398377982 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbf180cc6f0 0x7fbf181f5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:00.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.757+0000 7fbf1d820640 1 -- 172.21.15.22:0/398377982 >> 172.21.15.22:0/398377982 conn(0x7fbf18070750 msgr2=0x7fbf1815b510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:37:00.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.757+0000 7fbf1d820640 1 -- 172.21.15.22:0/398377982 shutdown_connections 2024-05-21T13:37:00.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:00.757+0000 7fbf1d820640 1 -- 172.21.15.22:0/398377982 wait complete. 2024-05-21T13:37:00.752 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '1c6f8938', quiesce took 0.6 seconds. Will release after: 23.599999999999998 2024-05-21T13:37:24.353 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-21T13:37:24.490 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.512+0000 7f478410c640 1 Processor -- start 2024-05-21T13:37:24.491 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.512+0000 7f478410c640 1 -- start start 2024-05-21T13:37:24.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.512+0000 7f478410c640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f477c152cc0 0x7f477c0c4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:24.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.512+0000 7f478410c640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f477c1530a0 con 0x7f477c0c66b0 2024-05-21T13:37:24.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.512+0000 7f478410c640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f477c1589a0 con 0x7f477c0c9e30 2024-05-21T13:37:24.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.512+0000 7f478410c640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f477c1592b0 con 0x7f477c152cc0 2024-05-21T13:37:24.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.512+0000 7f47816a7640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f477c0c66b0 0x7f477c0c7df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:46892/0 (socket says 172.21.15.22:46892) 2024-05-21T13:37:24.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.512+0000 7f47816a7640 1 -- 172.21.15.22:0/3843298953 learned_addr learned my addr 172.21.15.22:0/3843298953 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-21T13:37:24.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.512+0000 7f4780ea6640 1 -- 172.21.15.22:0/3843298953 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2254327834 0 0) 0x7f477c1530a0 con 0x7f477c0c66b0 2024-05-21T13:37:24.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.512+0000 7f4781ea8640 1 --2- 172.21.15.22:0/3843298953 >> v2:172.21.15.115:3300/0 conn(0x7f477c152cc0 0x7f477c0c4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:24.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.512+0000 7f4780ea6640 1 -- 172.21.15.22:0/3843298953 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4768003530 con 0x7f477c0c66b0 2024-05-21T13:37:24.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.512+0000 7f4780ea6640 1 -- 172.21.15.22:0/3843298953 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1763500551 0 0) 0x7f4768003530 con 0x7f477c0c66b0 2024-05-21T13:37:24.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.512+0000 7f4780ea6640 1 -- 172.21.15.22:0/3843298953 >> v2:172.21.15.115:3300/0 conn(0x7f477c152cc0 msgr2=0x7f477c0c4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:37:24.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.512+0000 7f4780ea6640 1 --2- 172.21.15.22:0/3843298953 >> v2:172.21.15.115:3300/0 conn(0x7f477c152cc0 0x7f477c0c4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:24.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.512+0000 7f4780ea6640 1 -- 172.21.15.22:0/3843298953 >> v1:172.21.15.115:6789/0 conn(0x7f477c0c9e30 legacy=0x7f477c163320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:37:24.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.512+0000 7f4780ea6640 1 -- 172.21.15.22:0/3843298953 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f477c0c8830 con 0x7f477c0c66b0 2024-05-21T13:37:24.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.512+0000 7f4780ea6640 1 -- 172.21.15.22:0/3843298953 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2684847062 0 0) 0x7f476c001700 con 0x7f477c0c66b0 2024-05-21T13:37:24.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.512+0000 7f4780ea6640 1 -- 172.21.15.22:0/3843298953 >> v1:172.21.15.22:6789/0 conn(0x7f477c0c66b0 legacy=0x7f477c0c7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:37:24.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.512+0000 7f4780ea6640 1 --2- 172.21.15.22:0/3843298953 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4768003a60 0x7f4768003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:24.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.512+0000 7f4780ea6640 1 --2- 172.21.15.22:0/3843298953 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4768004810 0x7f4768004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:24.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.512+0000 7f4780ea6640 1 --2- 172.21.15.22:0/3843298953 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f47680051d0 0x7f476800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:24.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.512+0000 7f4780ea6640 1 -- 172.21.15.22:0/3843298953 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f477c1592b0 con 0x7f4768003a60 2024-05-21T13:37:24.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.512+0000 7f4780ea6640 1 -- 172.21.15.22:0/3843298953 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f476800c170 con 0x7f47680051d0 2024-05-21T13:37:24.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.512+0000 7f4780ea6640 1 -- 172.21.15.22:0/3843298953 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f476800c370 con 0x7f4768004810 2024-05-21T13:37:24.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.512+0000 7f4781ea8640 1 --2- 172.21.15.22:0/3843298953 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4768003a60 0x7f4768003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:24.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.512+0000 7f47826a9640 1 --2- 172.21.15.22:0/3843298953 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f47680051d0 0x7f476800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:24.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.512+0000 7f47816a7640 1 --2- 172.21.15.22:0/3843298953 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4768004810 0x7f4768004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:24.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.512+0000 7f4781ea8640 1 -- 172.21.15.22:0/3843298953 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4768004810 msgr2=0x7f4768004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:37:24.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.512+0000 7f4781ea8640 1 --2- 172.21.15.22:0/3843298953 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4768004810 0x7f4768004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:24.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.512+0000 7f4781ea8640 1 -- 172.21.15.22:0/3843298953 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f47680051d0 msgr2=0x7f476800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:37:24.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.512+0000 7f4781ea8640 1 --2- 172.21.15.22:0/3843298953 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f47680051d0 0x7f476800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:24.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.512+0000 7f4781ea8640 1 -- 172.21.15.22:0/3843298953 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4768003530 con 0x7f4768003a60 2024-05-21T13:37:24.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.512+0000 7f47826a9640 1 -- 172.21.15.22:0/3843298953 reap_dead start 2024-05-21T13:37:24.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.516+0000 7f4781ea8640 1 --2- 172.21.15.22:0/3843298953 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4768003a60 0x7f4768003e80 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f4778009ae0 tx=0x7f477801ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8da44a9c03ae03a server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:37:24.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.516+0000 7f4780ea6640 1 -- 172.21.15.22:0/3843298953 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47780b2070 con 0x7f4768003a60 2024-05-21T13:37:24.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.516+0000 7f4780ea6640 1 -- 172.21.15.22:0/3843298953 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47780a5530 con 0x7f4768003a60 2024-05-21T13:37:24.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.516+0000 7f4780ea6640 1 -- 172.21.15.22:0/3843298953 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47780096b0 con 0x7f4768003a60 2024-05-21T13:37:24.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.516+0000 7f478410c640 1 -- 172.21.15.22:0/3843298953 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4768003a60 msgr2=0x7f4768003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:37:24.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.516+0000 7f478410c640 1 --2- 172.21.15.22:0/3843298953 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4768003a60 0x7f4768003e80 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f4778009ae0 tx=0x7f477801ca70 comp rx=0 tx=0).stop 2024-05-21T13:37:24.497 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.516+0000 7f478410c640 1 -- 172.21.15.22:0/3843298953 shutdown_connections 2024-05-21T13:37:24.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.516+0000 7f478410c640 1 --2- 172.21.15.22:0/3843298953 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4768003a60 0x7f4768003e80 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:24.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.516+0000 7f478410c640 1 -- 172.21.15.22:0/3843298953 >> 172.21.15.22:0/3843298953 conn(0x7f477c06ea10 msgr2=0x7f477c06ff50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:37:24.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.516+0000 7f478410c640 1 -- 172.21.15.22:0/3843298953 shutdown_connections 2024-05-21T13:37:24.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.516+0000 7f478410c640 1 -- 172.21.15.22:0/3843298953 wait complete. 2024-05-21T13:37:24.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.516+0000 7f478410c640 1 Processor -- start 2024-05-21T13:37:24.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.516+0000 7f478410c640 1 -- start start 2024-05-21T13:37:24.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.520+0000 7f478410c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4768003a60 0x7f477c150840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:24.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.520+0000 7f478410c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f477c072730 0x7f477c1579c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:24.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.520+0000 7f478410c640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f477c0cd9b0 0x7f477c15c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:24.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.520+0000 7f478410c640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f477c0c5000 con 0x7f477c072730 2024-05-21T13:37:24.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.520+0000 7f478410c640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f477c159720 con 0x7f4768003a60 2024-05-21T13:37:24.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.520+0000 7f478410c640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f477c1598a0 con 0x7f477c0cd9b0 2024-05-21T13:37:24.500 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.520+0000 7f47816a7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f477c072730 0x7f477c1579c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:24.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.520+0000 7f47816a7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f477c072730 0x7f477c1579c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35558/0 (socket says 172.21.15.22:35558) 2024-05-21T13:37:24.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.520+0000 7f47816a7640 1 -- 172.21.15.22:0/776831423 learned_addr learned my addr 172.21.15.22:0/776831423 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:37:24.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.520+0000 7f4781ea8640 1 --2- 172.21.15.22:0/776831423 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4768003a60 0x7f477c150840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:24.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.520+0000 7f47826a9640 1 --2- 172.21.15.22:0/776831423 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f477c0cd9b0 0x7f477c15c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:24.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.520+0000 7f47816a7640 1 -- 172.21.15.22:0/776831423 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f477c0cd9b0 msgr2=0x7f477c15c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:37:24.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.520+0000 7f47816a7640 1 --2- 172.21.15.22:0/776831423 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f477c0cd9b0 0x7f477c15c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:24.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.520+0000 7f47816a7640 1 -- 172.21.15.22:0/776831423 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4768003a60 msgr2=0x7f477c150840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:37:24.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.520+0000 7f47816a7640 1 --2- 172.21.15.22:0/776831423 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4768003a60 0x7f477c150840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:24.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.520+0000 7f47816a7640 1 -- 172.21.15.22:0/776831423 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f477c150f40 con 0x7f477c072730 2024-05-21T13:37:24.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.520+0000 7f47816a7640 1 --2- 172.21.15.22:0/776831423 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f477c072730 0x7f477c1579c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f476c004f80 tx=0x7f476c0074f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:37:24.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.520+0000 7f47727fc640 1 -- 172.21.15.22:0/776831423 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f476c007740 con 0x7f477c072730 2024-05-21T13:37:24.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.520+0000 7f47727fc640 1 -- 172.21.15.22:0/776831423 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f476c018070 con 0x7f477c072730 2024-05-21T13:37:24.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.520+0000 7f478410c640 1 -- 172.21.15.22:0/776831423 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f477c151220 con 0x7f477c072730 2024-05-21T13:37:24.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.520+0000 7f47727fc640 1 -- 172.21.15.22:0/776831423 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f476c00fc00 con 0x7f477c072730 2024-05-21T13:37:24.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.520+0000 7f478410c640 1 -- 172.21.15.22:0/776831423 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f477c1534e0 con 0x7f477c072730 2024-05-21T13:37:24.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.520+0000 7f478410c640 1 -- 172.21.15.22:0/776831423 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f477c077bb0 con 0x7f477c072730 2024-05-21T13:37:24.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.520+0000 7f47727fc640 1 -- 172.21.15.22:0/776831423 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f476c01d460 con 0x7f477c072730 2024-05-21T13:37:24.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.520+0000 7f47727fc640 1 --2- 172.21.15.22:0/776831423 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f476006f400 0x7f47600718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:24.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.520+0000 7f47727fc640 1 -- 172.21.15.22:0/776831423 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f476c08f5b0 con 0x7f477c072730 2024-05-21T13:37:24.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.520+0000 7f4781ea8640 1 --2- 172.21.15.22:0/776831423 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f476006f400 0x7f47600718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:24.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.524+0000 7f4781ea8640 1 --2- 172.21.15.22:0/776831423 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f476006f400 0x7f47600718c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f47780af000 tx=0x7f4778008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:37:24.506 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.528+0000 7f47727fc640 1 -- 172.21.15.22:0/776831423 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f476c05c1c0 con 0x7f477c072730 2024-05-21T13:37:24.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.720+0000 7f478410c640 1 -- 172.21.15.22:0/776831423 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f477c1562c0 con 0x7f477c072730 2024-05-21T13:37:24.701 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.720+0000 7f47727fc640 1 -- 172.21.15.22:0/776831423 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6875 (secure 0 0 0) 0x7f476c05bac0 con 0x7f477c072730 2024-05-21T13:37:24.701 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-21T13:37:24.701 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4224,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/355756580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":355756580},{"type":"v1","addr":"172.21.15.22:6833","nonce":355756580}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4230,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3277017116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":3277017116},{"type":"v1","addr":"172.21.15.22:6835","nonce":3277017116}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4233,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3840772609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3840772609},{"type":"v1","addr":"172.21.15.22:6837","nonce":3840772609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-21T13:35:57.106892+0000","modified":"2024-05-21T13:36:32.396351+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4300,"mds_1":4294,"mds_2":4248},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4248":{"gid":4248,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":12,"addr":"172.21.15.115:6837/2009761279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":2009761279},{"type":"v1","addr":"172.21.15.115:6837","nonce":2009761279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4294":{"gid":4294,"name":"b","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.115:6835/3894678097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3894678097},{"type":"v1","addr":"172.21.15.115:6835","nonce":3894678097}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4300":{"gid":4300,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.115:6839/1525097577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6838","nonce":1525097577},{"type":"v1","addr":"172.21.15.115:6839","nonce":1525097577}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4300,"qdb_cluster":[4248,4300,4294]},"id":1}]} 2024-05-21T13:37:24.702 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 14 2024-05-21T13:37:24.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.724+0000 7f478410c640 1 -- 172.21.15.22:0/776831423 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f476006f400 msgr2=0x7f47600718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:37:24.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.724+0000 7f478410c640 1 --2- 172.21.15.22:0/776831423 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f476006f400 0x7f47600718c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f47780af000 tx=0x7f4778008040 comp rx=0 tx=0).stop 2024-05-21T13:37:24.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.724+0000 7f478410c640 1 -- 172.21.15.22:0/776831423 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f477c072730 msgr2=0x7f477c1579c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:37:24.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.724+0000 7f478410c640 1 --2- 172.21.15.22:0/776831423 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f477c072730 0x7f477c1579c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f476c004f80 tx=0x7f476c0074f0 comp rx=0 tx=0).stop 2024-05-21T13:37:24.703 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.724+0000 7f478410c640 1 -- 172.21.15.22:0/776831423 shutdown_connections 2024-05-21T13:37:24.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.724+0000 7f478410c640 1 --2- 172.21.15.22:0/776831423 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f476006f400 0x7f47600718c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:24.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.724+0000 7f478410c640 1 --2- 172.21.15.22:0/776831423 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f477c0cd9b0 0x7f477c15c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:24.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.724+0000 7f478410c640 1 --2- 172.21.15.22:0/776831423 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f477c072730 0x7f477c1579c0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:24.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.724+0000 7f478410c640 1 --2- 172.21.15.22:0/776831423 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4768003a60 0x7f477c150840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:24.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.724+0000 7f478410c640 1 -- 172.21.15.22:0/776831423 >> 172.21.15.22:0/776831423 conn(0x7f477c06ea10 msgr2=0x7f477c14e160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:37:24.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.724+0000 7f478410c640 1 -- 172.21.15.22:0/776831423 shutdown_connections 2024-05-21T13:37:24.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.724+0000 7f478410c640 1 -- 172.21.15.22:0/776831423 wait complete. 2024-05-21T13:37:24.719 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4300 quiesce db --set-id 1c6f8938 --release --await' 2024-05-21T13:37:24.719 DEBUG:teuthology.orchestra.run.smithi022:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4300 quiesce db --set-id 1c6f8938 --release --await 2024-05-21T13:37:24.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.868+0000 7fdac4209640 1 Processor -- start 2024-05-21T13:37:24.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.872+0000 7fdac4209640 1 -- start start 2024-05-21T13:37:24.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.872+0000 7fdac4209640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fdabc150400 0x7fdabc0c47f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:24.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.872+0000 7fdac4209640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdabc0c9990 0x7fdabc0c5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:24.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.872+0000 7fdac4209640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdabc0c7ed0 con 0x7fdabc0c7440 2024-05-21T13:37:24.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.872+0000 7fdac4209640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fdabc0c81b0 con 0x7fdabc150400 2024-05-21T13:37:24.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.872+0000 7fdac4209640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7fdabc0c52a0 con 0x7fdabc0c9990 2024-05-21T13:37:24.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.872+0000 7fdac27a6640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fdabc0c7440 0x7fdabc06df50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:46898/0 (socket says 172.21.15.22:46898) 2024-05-21T13:37:24.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.872+0000 7fdac27a6640 1 -- 172.21.15.22:0/3313243283 learned_addr learned my addr 172.21.15.22:0/3313243283 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-21T13:37:24.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.872+0000 7fdac1fa5640 1 --2- 172.21.15.22:0/3313243283 >> v2:172.21.15.22:3300/0 conn(0x7fdabc150400 0x7fdabc0c47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:24.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.872+0000 7fdac1fa5640 1 -- 172.21.15.22:0/3313243283 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdabc0c9990 msgr2=0x7fdabc0c5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:37:24.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.872+0000 7fdac1fa5640 1 --2- 172.21.15.22:0/3313243283 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdabc0c9990 0x7fdabc0c5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:24.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.872+0000 7fdac1fa5640 1 -- 172.21.15.22:0/3313243283 >> v1:172.21.15.22:6789/0 conn(0x7fdabc0c7440 legacy=0x7fdabc06df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:37:24.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.872+0000 7fdac1fa5640 1 -- 172.21.15.22:0/3313243283 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdabc0c5580 con 0x7fdabc150400 2024-05-21T13:37:24.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.872+0000 7fdac0fa3640 1 -- 172.21.15.22:0/3313243283 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1112427269 0 0) 0x7fdabc0c7ed0 con 0x7fdabc0c7440 2024-05-21T13:37:24.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.872+0000 7fdac1fa5640 1 --2- 172.21.15.22:0/3313243283 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdabc150400 0x7fdabc0c47f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fdab80097c0 tx=0x7fdab801ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cdb8fc7720b67e4 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:37:24.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.872+0000 7fdac0fa3640 1 -- 172.21.15.22:0/3313243283 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdab80b5070 con 0x7fdabc150400 2024-05-21T13:37:24.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.872+0000 7fdac0fa3640 1 -- 172.21.15.22:0/3313243283 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdab80a8990 con 0x7fdabc150400 2024-05-21T13:37:24.854 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.872+0000 7fdac0fa3640 1 -- 172.21.15.22:0/3313243283 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdab80a8d60 con 0x7fdabc150400 2024-05-21T13:37:24.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.876+0000 7fdac4209640 1 -- 172.21.15.22:0/3313243283 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdabc150400 msgr2=0x7fdabc0c47f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:37:24.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.876+0000 7fdac4209640 1 --2- 172.21.15.22:0/3313243283 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdabc150400 0x7fdabc0c47f0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fdab80097c0 tx=0x7fdab801ec90 comp rx=0 tx=0).stop 2024-05-21T13:37:24.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.876+0000 7fdac4209640 1 -- 172.21.15.22:0/3313243283 shutdown_connections 2024-05-21T13:37:24.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.876+0000 7fdac4209640 1 --2- 172.21.15.22:0/3313243283 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdabc0c9990 0x7fdabc0c5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:24.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.876+0000 7fdac4209640 1 --2- 172.21.15.22:0/3313243283 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdabc150400 0x7fdabc0c47f0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:24.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.876+0000 7fdac4209640 1 -- 172.21.15.22:0/3313243283 >> 172.21.15.22:0/3313243283 conn(0x7fdabc06cc50 msgr2=0x7fdabc0cd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:37:24.855 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.876+0000 7fdac4209640 1 -- 172.21.15.22:0/3313243283 shutdown_connections 2024-05-21T13:37:24.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.876+0000 7fdac4209640 1 -- 172.21.15.22:0/3313243283 wait complete. 2024-05-21T13:37:24.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.876+0000 7fdac4209640 1 Processor -- start 2024-05-21T13:37:24.856 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.876+0000 7fdac4209640 1 -- start start 2024-05-21T13:37:24.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.876+0000 7fdac4209640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdabc0c7440 0x7fdabc0cc3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:24.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.876+0000 7fdac4209640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdabc0c9990 0x7fdabc140c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:24.857 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.876+0000 7fdac4209640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdabc150400 0x7fdabc141160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:24.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.876+0000 7fdac4209640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fdabc1599b0 con 0x7fdabc0c7440 2024-05-21T13:37:24.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.876+0000 7fdac4209640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fdabc159830 con 0x7fdabc0c9990 2024-05-21T13:37:24.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.876+0000 7fdac4209640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7fdabc159b30 con 0x7fdabc150400 2024-05-21T13:37:24.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.876+0000 7fdac1fa5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdabc0c7440 0x7fdabc0cc3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:24.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.876+0000 7fdac1fa5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdabc0c7440 0x7fdabc0cc3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35578/0 (socket says 172.21.15.22:35578) 2024-05-21T13:37:24.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.876+0000 7fdac1fa5640 1 -- 172.21.15.22:0/203857813 learned_addr learned my addr 172.21.15.22:0/203857813 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:37:24.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.876+0000 7fdac1fa5640 1 -- 172.21.15.22:0/203857813 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdabc150400 msgr2=0x7fdabc141160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:37:24.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.876+0000 7fdac1fa5640 1 --2- 172.21.15.22:0/203857813 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdabc150400 0x7fdabc141160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:24.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.876+0000 7fdac1fa5640 1 -- 172.21.15.22:0/203857813 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdabc0c9990 msgr2=0x7fdabc140c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:37:24.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.876+0000 7fdac1fa5640 1 --2- 172.21.15.22:0/203857813 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdabc0c9990 0x7fdabc140c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:24.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.876+0000 7fdac1fa5640 1 -- 172.21.15.22:0/203857813 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdabc1496c0 con 0x7fdabc0c7440 2024-05-21T13:37:24.858 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.876+0000 7fdac1fa5640 1 --2- 172.21.15.22:0/203857813 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdabc0c7440 0x7fdabc0cc3a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fdab80b3040 tx=0x7fdab801ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:37:24.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.876+0000 7fdab27fc640 1 -- 172.21.15.22:0/203857813 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdab80b5040 con 0x7fdabc0c7440 2024-05-21T13:37:24.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.876+0000 7fdab27fc640 1 -- 172.21.15.22:0/203857813 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdab80c0070 con 0x7fdabc0c7440 2024-05-21T13:37:24.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.876+0000 7fdab27fc640 1 -- 172.21.15.22:0/203857813 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdab80b0a80 con 0x7fdabc0c7440 2024-05-21T13:37:24.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.876+0000 7fdac4209640 1 -- 172.21.15.22:0/203857813 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdabc1499a0 con 0x7fdabc0c7440 2024-05-21T13:37:24.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.876+0000 7fdac4209640 1 -- 172.21.15.22:0/203857813 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdabc1f0990 con 0x7fdabc0c7440 2024-05-21T13:37:24.859 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.880+0000 7fdab27fc640 1 -- 172.21.15.22:0/203857813 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fdab80b0c20 con 0x7fdabc0c7440 2024-05-21T13:37:24.860 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.880+0000 7fdab27fc640 1 --2- 172.21.15.22:0/203857813 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fdaa006f430 0x7fdaa00718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:24.860 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.880+0000 7fdab27fc640 1 -- 172.21.15.22:0/203857813 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7fdab812cbb0 con 0x7fdabc0c7440 2024-05-21T13:37:24.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.880+0000 7fdac7394000 1 Processor -- start 2024-05-21T13:37:24.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.880+0000 7fdac7394000 1 -- start start 2024-05-21T13:37:24.861 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.880+0000 7fdac17a4640 1 --2- 172.21.15.22:0/203857813 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fdaa006f430 0x7fdaa00718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:24.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.880+0000 7fdac7394000 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x564c7771d350 0x564c7771d730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:24.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.880+0000 7fdac7394000 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564c7771dc70 0x564c77722620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:24.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.880+0000 7fdac7394000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564c77722b60 0x564c77722f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:24.863 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.880+0000 7fdac7394000 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x564c7753c8a0 con 0x564c7771dc70 2024-05-21T13:37:24.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.880+0000 7fdac7394000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x564c7752c440 con 0x564c77722b60 2024-05-21T13:37:24.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.880+0000 7fdac7394000 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x564c77530480 con 0x564c7771d350 2024-05-21T13:37:24.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.880+0000 7fdac17a4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564c7771dc70 0x564c77722620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:24.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.880+0000 7fdac17a4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564c7771dc70 0x564c77722620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35584/0 (socket says 172.21.15.22:35584) 2024-05-21T13:37:24.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.880+0000 7fdac17a4640 1 -- 172.21.15.22:0/963565576 learned_addr learned my addr 172.21.15.22:0/963565576 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:37:24.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.880+0000 7fdac17a4640 1 -- 172.21.15.22:0/963565576 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x564c7771d350 msgr2=0x564c7771d730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:37:24.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.880+0000 7fdac27a6640 1 --2- 172.21.15.22:0/963565576 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564c77722b60 0x564c77722f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:24.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.880+0000 7fdac1fa5640 1 --2- 172.21.15.22:0/963565576 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x564c7771d350 0x564c7771d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:24.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.880+0000 7fdac17a4640 1 --2- 172.21.15.22:0/963565576 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x564c7771d350 0x564c7771d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:24.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.880+0000 7fdac17a4640 1 -- 172.21.15.22:0/963565576 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564c77722b60 msgr2=0x564c77722f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:37:24.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.880+0000 7fdac17a4640 1 --2- 172.21.15.22:0/963565576 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564c77722b60 0x564c77722f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:24.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.880+0000 7fdac17a4640 1 -- 172.21.15.22:0/963565576 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c775d8370 con 0x564c7771dc70 2024-05-21T13:37:24.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.880+0000 7fdac27a6640 1 --2- 172.21.15.22:0/963565576 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564c77722b60 0x564c77722f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:37:24.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.880+0000 7fdac17a4640 1 --2- 172.21.15.22:0/203857813 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fdaa006f430 0x7fdaa00718f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fdabc069b10 tx=0x7fdaac006ca0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:37:24.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.880+0000 7fdac17a4640 1 --2- 172.21.15.22:0/963565576 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564c7771dc70 0x564c77722620 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fdaac00b700 tx=0x7fdaac016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f140a37f505d4af5 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:37:24.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.880+0000 7fda9f7fe640 1 -- 172.21.15.22:0/963565576 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaac022070 con 0x564c7771dc70 2024-05-21T13:37:24.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.880+0000 7fda9f7fe640 1 -- 172.21.15.22:0/963565576 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdaac019040 con 0x564c7771dc70 2024-05-21T13:37:24.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.880+0000 7fda9f7fe640 1 -- 172.21.15.22:0/963565576 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaac014a60 con 0x564c7771dc70 2024-05-21T13:37:24.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.884+0000 7fdac7394000 1 -- 172.21.15.22:0/963565576 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564c7771dc70 msgr2=0x564c77722620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:37:24.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.884+0000 7fdac7394000 1 --2- 172.21.15.22:0/963565576 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564c7771dc70 0x564c77722620 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fdaac00b700 tx=0x7fdaac016000 comp rx=0 tx=0).stop 2024-05-21T13:37:24.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.884+0000 7fdac7394000 1 -- 172.21.15.22:0/963565576 shutdown_connections 2024-05-21T13:37:24.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.884+0000 7fdac7394000 1 --2- 172.21.15.22:0/963565576 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564c77722b60 0x564c77722f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:24.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.884+0000 7fdac7394000 1 --2- 172.21.15.22:0/963565576 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564c7771dc70 0x564c77722620 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:24.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.884+0000 7fdac7394000 1 --2- 172.21.15.22:0/963565576 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x564c7771d350 0x564c7771d730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:24.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.884+0000 7fdac7394000 1 -- 172.21.15.22:0/963565576 >> 172.21.15.22:0/963565576 conn(0x564c775c9f90 msgr2=0x564c777203e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:37:24.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.884+0000 7fdac7394000 1 -- 172.21.15.22:0/963565576 shutdown_connections 2024-05-21T13:37:24.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.884+0000 7fdac7394000 1 -- 172.21.15.22:0/963565576 wait complete. 2024-05-21T13:37:24.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.884+0000 7fdac7394000 1 -- start start 2024-05-21T13:37:24.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.884+0000 7fdac7394000 1 Processor -- start 2024-05-21T13:37:24.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.884+0000 7fdac7394000 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564c7771d350 0x564c776e6920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:24.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.884+0000 7fdac7394000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564c7771dc70 0x564c7772faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:24.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.884+0000 7fdac7394000 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x564c77722b60 0x564c7772ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:24.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.884+0000 7fdac7394000 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x564c774d5170 con 0x564c7771d350 2024-05-21T13:37:24.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.884+0000 7fdac7394000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x564c774d34d0 con 0x564c7771dc70 2024-05-21T13:37:24.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.884+0000 7fdac7394000 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x564c77534ab0 con 0x564c77722b60 2024-05-21T13:37:24.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.884+0000 7fdac7394000 10 client.0 _ll_register_callbacks cb 0x564c774ceee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-21T13:37:24.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.884+0000 7fdac1fa5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564c7771d350 0x564c776e6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:24.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.884+0000 7fdac1fa5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564c7771d350 0x564c776e6920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35590/0 (socket says 172.21.15.22:35590) 2024-05-21T13:37:24.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.884+0000 7fdac1fa5640 1 -- 172.21.15.22:0/4146894578 learned_addr learned my addr 172.21.15.22:0/4146894578 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:37:24.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.884+0000 7fdac27a6640 1 --2- 172.21.15.22:0/4146894578 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x564c77722b60 0x564c7772ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:24.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.884+0000 7fdac1fa5640 1 -- 172.21.15.22:0/4146894578 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x564c77722b60 msgr2=0x564c7772ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:37:24.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.884+0000 7fdac1fa5640 1 --2- 172.21.15.22:0/4146894578 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x564c77722b60 0x564c7772ffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:24.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.884+0000 7fdac1fa5640 1 -- 172.21.15.22:0/4146894578 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564c7771dc70 msgr2=0x564c7772faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:37:24.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.884+0000 7fdac17a4640 1 --2- 172.21.15.22:0/4146894578 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564c7771dc70 0x564c7772faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:24.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.884+0000 7fdac1fa5640 1 --2- 172.21.15.22:0/4146894578 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564c7771dc70 0x564c7772faa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:24.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.884+0000 7fdac1fa5640 1 -- 172.21.15.22:0/4146894578 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c77576260 con 0x564c7771d350 2024-05-21T13:37:24.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.884+0000 7fdac17a4640 1 --2- 172.21.15.22:0/4146894578 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564c7771dc70 0x564c7772faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:37:24.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.884+0000 7fdac1fa5640 1 --2- 172.21.15.22:0/4146894578 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564c7771d350 0x564c776e6920 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fdab80f5140 tx=0x7fdab80af690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12ce365ff56f2cb1 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:37:24.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.884+0000 7fda9cff9640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-05-21T13:37:24.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.884+0000 7fda9cff9640 1 -- 172.21.15.22:0/4146894578 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdab8101c00 con 0x564c7771d350 2024-05-21T13:37:24.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.884+0000 7fda9cff9640 1 -- 172.21.15.22:0/4146894578 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7fdab80f8320 con 0x564c7771d350 2024-05-21T13:37:24.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.884+0000 7fdac7394000 1 -- 172.21.15.22:0/4146894578 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdaac019040 con 0x564c7771d350 2024-05-21T13:37:24.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.884+0000 7fda9cff9640 1 -- 172.21.15.22:0/4146894578 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7fdab8128050 con 0x564c7771d350 2024-05-21T13:37:24.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.884+0000 7fdac7394000 10 client.4890 fetch_fsmap learned FSMap version 14 2024-05-21T13:37:24.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.884+0000 7fdac7394000 1 -- 172.21.15.22:0/4146894578 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x564c774d36e0 con 0x564c7771d350 2024-05-21T13:37:24.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.884+0000 7fda9cff9640 1 -- 172.21.15.22:0/4146894578 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdaac019040 con 0x564c7771d350 2024-05-21T13:37:24.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.884+0000 7fda9cff9640 1 -- 172.21.15.22:0/4146894578 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7fdab80b8050 con 0x564c7771d350 2024-05-21T13:37:24.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.884+0000 7fdac7394000 10 client.4890 fetch_fsmap finished waiting for FSMap version 14 2024-05-21T13:37:24.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.884+0000 7fdac7394000 10 client.4890 resolve_mds: validated gid 4300 aka daemon mds.f 2024-05-21T13:37:24.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.884+0000 7fdac7394000 20 client.4890 populate_metadata read hostname 'smithi022' 2024-05-21T13:37:24.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.884+0000 7fdac7394000 1 --2- 172.21.15.22:0/4146894578 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x564c7771c810 0x564c7771cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:24.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.884+0000 7fdac7394000 4 client.4890 mds_command: new command op to 4300 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-21T13:37:24.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.884+0000 7fdac7394000 1 -- 172.21.15.22:0/4146894578 --> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564c774c8060 con 0x564c7771c810 2024-05-21T13:37:24.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.884+0000 7fdac17a4640 1 --2- 172.21.15.22:0/4146894578 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x564c7771c810 0x564c7771cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:24.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.888+0000 7fda9cff9640 10 client.4890 ms_handle_connect on v2:172.21.15.115:6838/1525097577 2024-05-21T13:37:24.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.888+0000 7fdac17a4640 1 --2- 172.21.15.22:0/4146894578 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x564c7771c810 0x564c7771cbf0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a805a28e73d2a23b server_cookie=5a6e68b3a37fc364 in_seq=0 out_seq=0 2024-05-21T13:37:24.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.888+0000 7fda9cff9640 1 -- 172.21.15.22:0/4146894578 <== mds.0 v2:172.21.15.115:6838/1525097577 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x564c774c8060 con 0x564c7771c810 2024-05-21T13:37:24.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.888+0000 7fda9cff9640 10 client.4890 handle_command_reply: tid=0 2024-05-21T13:37:24.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.888+0000 7fdac7394000 1 client.4890 shutdown 2024-05-21T13:37:24.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.888+0000 7fdac7394000 1 -- 172.21.15.22:0/4146894578 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564c7771d350 msgr2=0x564c776e6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:37:24.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.888+0000 7fdac7394000 1 --2- 172.21.15.22:0/4146894578 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564c7771d350 0x564c776e6920 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fdab80f5140 tx=0x7fdab80af690 comp rx=0 tx=0).stop 2024-05-21T13:37:24.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.888+0000 7fdac7394000 1 -- 172.21.15.22:0/4146894578 shutdown_connections 2024-05-21T13:37:24.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.888+0000 7fdac7394000 1 --2- 172.21.15.22:0/4146894578 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x564c77722b60 0x564c7772ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:24.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.888+0000 7fdac7394000 1 --2- 172.21.15.22:0/4146894578 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x564c7771c810 0x564c7771cbf0 crc :-1 s=READY pgs=28 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:24.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.888+0000 7fdac7394000 1 --2- 172.21.15.22:0/4146894578 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564c7771dc70 0x564c7772faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:24.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.888+0000 7fdac7394000 1 --2- 172.21.15.22:0/4146894578 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564c7771d350 0x564c776e6920 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:24.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.888+0000 7fda9cff9640 0 client.4890 ms_handle_reset on v2:172.21.15.115:6838/1525097577 2024-05-21T13:37:24.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.888+0000 7fdac7394000 1 -- 172.21.15.22:0/4146894578 >> 172.21.15.22:0/4146894578 conn(0x564c775c9f90 msgr2=0x564c77720060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:37:24.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.888+0000 7fdac7394000 1 -- 172.21.15.22:0/4146894578 shutdown_connections 2024-05-21T13:37:24.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.888+0000 7fdac7394000 1 -- 172.21.15.22:0/4146894578 wait complete. 2024-05-21T13:37:24.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.888+0000 7fdac7394000 20 client.4890 trim_cache size 0 max 16384 2024-05-21T13:37:24.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.904+0000 7fdac7394000 1 Processor -- start 2024-05-21T13:37:24.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.904+0000 7fdac7394000 1 -- start start 2024-05-21T13:37:24.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.908+0000 7fdac7394000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564c7771d350 0x564c777426a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:24.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.908+0000 7fdac7394000 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564c7771dc70 0x564c776e6740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:24.887 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.908+0000 7fdac7394000 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x564c77722b60 0x564c776e6c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:24.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.908+0000 7fdac7394000 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fdabc1f9fb0 con 0x564c7771dc70 2024-05-21T13:37:24.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.908+0000 7fdac7394000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fdabc0742c0 con 0x564c7771d350 2024-05-21T13:37:24.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.908+0000 7fdac7394000 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7fdabc1f3670 con 0x564c77722b60 2024-05-21T13:37:24.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.908+0000 7fdac17a4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564c7771dc70 0x564c776e6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:24.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.908+0000 7fdac17a4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564c7771dc70 0x564c776e6740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35596/0 (socket says 172.21.15.22:35596) 2024-05-21T13:37:24.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.908+0000 7fdac17a4640 1 -- 172.21.15.22:0/3069374968 learned_addr learned my addr 172.21.15.22:0/3069374968 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:37:24.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.908+0000 7fdac17a4640 1 -- 172.21.15.22:0/3069374968 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x564c77722b60 msgr2=0x564c776e6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:37:24.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.908+0000 7fdac17a4640 1 --2- 172.21.15.22:0/3069374968 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x564c77722b60 0x564c776e6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:24.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.908+0000 7fdac17a4640 1 -- 172.21.15.22:0/3069374968 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564c7771d350 msgr2=0x564c777426a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:37:24.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.908+0000 7fdac17a4640 1 --2- 172.21.15.22:0/3069374968 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564c7771d350 0x564c777426a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:24.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.908+0000 7fdac17a4640 1 -- 172.21.15.22:0/3069374968 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c775b1cf0 con 0x564c7771dc70 2024-05-21T13:37:24.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.908+0000 7fdac17a4640 1 --2- 172.21.15.22:0/3069374968 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564c7771dc70 0x564c776e6740 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fdabc0c9d90 tx=0x7fdaac00e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e6b64477f5c567e server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:37:24.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.908+0000 7fda9effd640 1 -- 172.21.15.22:0/3069374968 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaac039070 con 0x564c7771dc70 2024-05-21T13:37:24.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.908+0000 7fda9effd640 1 -- 172.21.15.22:0/3069374968 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdaac019040 con 0x564c7771dc70 2024-05-21T13:37:24.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.908+0000 7fda9effd640 1 -- 172.21.15.22:0/3069374968 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaac022040 con 0x564c7771dc70 2024-05-21T13:37:24.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.908+0000 7fdac7394000 1 -- 172.21.15.22:0/3069374968 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564c7771dc70 msgr2=0x564c776e6740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:37:24.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.908+0000 7fdac7394000 1 --2- 172.21.15.22:0/3069374968 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564c7771dc70 0x564c776e6740 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fdabc0c9d90 tx=0x7fdaac00e000 comp rx=0 tx=0).stop 2024-05-21T13:37:24.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.908+0000 7fdac7394000 1 -- 172.21.15.22:0/3069374968 shutdown_connections 2024-05-21T13:37:24.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.908+0000 7fdac7394000 1 --2- 172.21.15.22:0/3069374968 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x564c77722b60 0x564c776e6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:24.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.908+0000 7fdac7394000 1 --2- 172.21.15.22:0/3069374968 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564c7771dc70 0x564c776e6740 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:24.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.908+0000 7fdac7394000 1 --2- 172.21.15.22:0/3069374968 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564c7771d350 0x564c777426a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:24.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.908+0000 7fdac7394000 1 -- 172.21.15.22:0/3069374968 >> 172.21.15.22:0/3069374968 conn(0x564c775c9f90 msgr2=0x564c776e7800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:37:24.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.908+0000 7fdac7394000 1 -- 172.21.15.22:0/3069374968 shutdown_connections 2024-05-21T13:37:24.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.908+0000 7fdac7394000 1 -- 172.21.15.22:0/3069374968 wait complete. 2024-05-21T13:37:24.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.908+0000 7fdac7394000 1 -- start start 2024-05-21T13:37:24.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.908+0000 7fdac7394000 1 Processor -- start 2024-05-21T13:37:24.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.908+0000 7fdac7394000 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564c7771d350 0x564c77740880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:24.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.908+0000 7fdac7394000 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x564c7771dc70 0x564c77740dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:24.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.908+0000 7fdac7394000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564c77722b60 0x564c77760d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:24.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.908+0000 7fdac7394000 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x564c775285f0 con 0x564c7771d350 2024-05-21T13:37:24.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.908+0000 7fdac7394000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x564c775b1860 con 0x564c77722b60 2024-05-21T13:37:24.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.908+0000 7fdac7394000 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x564c774c4c50 con 0x564c7771dc70 2024-05-21T13:37:24.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.908+0000 7fdac7394000 10 client.0 _ll_register_callbacks cb 0x7fdab80b0f10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-21T13:37:24.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.908+0000 7fdac1fa5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564c7771d350 0x564c77740880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:24.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.908+0000 7fdac1fa5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564c7771d350 0x564c77740880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35602/0 (socket says 172.21.15.22:35602) 2024-05-21T13:37:24.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.908+0000 7fdac1fa5640 1 -- 172.21.15.22:0/117113647 learned_addr learned my addr 172.21.15.22:0/117113647 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:37:24.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.908+0000 7fdac1fa5640 1 -- 172.21.15.22:0/117113647 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x564c7771dc70 msgr2=0x564c77740dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:37:24.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.908+0000 7fdac1fa5640 1 --2- 172.21.15.22:0/117113647 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x564c7771dc70 0x564c77740dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:24.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.908+0000 7fdac1fa5640 1 -- 172.21.15.22:0/117113647 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564c77722b60 msgr2=0x564c77760d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:37:24.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.908+0000 7fdac1fa5640 1 --2- 172.21.15.22:0/117113647 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564c77722b60 0x564c77760d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:24.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.908+0000 7fdac1fa5640 1 -- 172.21.15.22:0/117113647 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c774deca0 con 0x564c7771d350 2024-05-21T13:37:24.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.908+0000 7fdac1fa5640 1 --2- 172.21.15.22:0/117113647 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564c7771d350 0x564c77740880 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fdab80f9050 tx=0x7fdab80b6fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23c9c61718b1afa8 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:37:24.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.908+0000 7fda9cff9640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-05-21T13:37:24.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.908+0000 7fda9cff9640 1 -- 172.21.15.22:0/117113647 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdab80f8a10 con 0x564c7771d350 2024-05-21T13:37:24.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.908+0000 7fda9cff9640 1 -- 172.21.15.22:0/117113647 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7fdab80f4a30 con 0x564c7771d350 2024-05-21T13:37:24.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.908+0000 7fdac7394000 1 -- 172.21.15.22:0/117113647 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdaac019040 con 0x564c7771d350 2024-05-21T13:37:24.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.908+0000 7fda9cff9640 1 -- 172.21.15.22:0/117113647 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7fdab80fd240 con 0x564c7771d350 2024-05-21T13:37:24.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.908+0000 7fdac7394000 10 client.4896 fetch_fsmap learned FSMap version 14 2024-05-21T13:37:24.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.908+0000 7fdac7394000 1 -- 172.21.15.22:0/117113647 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x564c774c39c0 con 0x564c7771d350 2024-05-21T13:37:24.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.912+0000 7fda9cff9640 1 -- 172.21.15.22:0/117113647 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdaac019040 con 0x564c7771d350 2024-05-21T13:37:24.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.912+0000 7fda9cff9640 1 -- 172.21.15.22:0/117113647 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7fdab80b8070 con 0x564c7771d350 2024-05-21T13:37:24.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.912+0000 7fdac7394000 10 client.4896 fetch_fsmap finished waiting for FSMap version 14 2024-05-21T13:37:24.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.912+0000 7fdac7394000 10 client.4896 resolve_mds: validated gid 4300 aka daemon mds.f 2024-05-21T13:37:24.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.912+0000 7fdac7394000 20 client.4896 populate_metadata read hostname 'smithi022' 2024-05-21T13:37:24.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.912+0000 7fdac7394000 1 --2- 172.21.15.22:0/117113647 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x564c77761240 0x564c77761650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:24.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.912+0000 7fdac7394000 4 client.4896 mds_command: new command op to 4300 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "1c6f8938", "release": true, "await": true}] 2024-05-21T13:37:24.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.912+0000 7fdac7394000 1 -- 172.21.15.22:0/117113647 --> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] -- command(tid 0: {"prefix": "quiesce db", "set_id": "1c6f8938", "release": true, "await": true}) -- 0x564c7753e7f0 con 0x564c77761240 2024-05-21T13:37:24.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.912+0000 7fdac17a4640 1 --2- 172.21.15.22:0/117113647 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x564c77761240 0x564c77761650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:24.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.912+0000 7fdac17a4640 1 --2- 172.21.15.22:0/117113647 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x564c77761240 0x564c77761650 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=279712b8c0407ebd server_cookie=b45f9cc110dcd8ff in_seq=0 out_seq=0 2024-05-21T13:37:24.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.912+0000 7fda9cff9640 10 client.4896 ms_handle_connect on v2:172.21.15.115:6838/1525097577 2024-05-21T13:37:24.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.912+0000 7fda9cff9640 1 -- 172.21.15.22:0/117113647 <== mds.0 v2:172.21.15.115:6838/1525097577 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x564c7753e7f0 con 0x564c77761240 2024-05-21T13:37:24.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.912+0000 7fda9cff9640 10 client.4896 handle_command_reply: tid=0 2024-05-21T13:37:24.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.912+0000 7fdac7394000 1 client.4896 shutdown 2024-05-21T13:37:24.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.912+0000 7fdac7394000 1 -- 172.21.15.22:0/117113647 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564c7771d350 msgr2=0x564c77740880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:37:24.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.912+0000 7fdac7394000 1 --2- 172.21.15.22:0/117113647 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564c7771d350 0x564c77740880 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fdab80f9050 tx=0x7fdab80b6fc0 comp rx=0 tx=0).stop 2024-05-21T13:37:24.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.912+0000 7fdac7394000 1 -- 172.21.15.22:0/117113647 shutdown_connections 2024-05-21T13:37:24.896 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.912+0000 7fdac7394000 1 --2- 172.21.15.22:0/117113647 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x564c77761240 0x564c77761650 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:24.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.912+0000 7fdac7394000 1 --2- 172.21.15.22:0/117113647 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x564c77722b60 0x564c77760d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:24.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.912+0000 7fdac7394000 1 --2- 172.21.15.22:0/117113647 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x564c7771dc70 0x564c77740dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:24.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.912+0000 7fdac7394000 1 --2- 172.21.15.22:0/117113647 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x564c7771d350 0x564c77740880 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:24.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.912+0000 7fdac7394000 1 -- 172.21.15.22:0/117113647 >> 172.21.15.22:0/117113647 conn(0x564c775c9f90 msgr2=0x564c77742290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:37:24.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.912+0000 7fda9cff9640 0 client.4896 ms_handle_reset on v2:172.21.15.115:6838/1525097577 2024-05-21T13:37:24.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.912+0000 7fdac7394000 1 -- 172.21.15.22:0/117113647 shutdown_connections 2024-05-21T13:37:24.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.912+0000 7fdac7394000 1 -- 172.21.15.22:0/117113647 wait complete. 2024-05-21T13:37:24.897 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.912+0000 7fdac7394000 20 client.4896 trim_cache size 0 max 16384 2024-05-21T13:37:24.897 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-05-21T13:37:24.897 INFO:teuthology.orchestra.run.smithi022.stdout: "epoch": 14, 2024-05-21T13:37:24.898 INFO:teuthology.orchestra.run.smithi022.stdout: "leader": 4300, 2024-05-21T13:37:24.898 INFO:teuthology.orchestra.run.smithi022.stdout: "set_version": 4, 2024-05-21T13:37:24.898 INFO:teuthology.orchestra.run.smithi022.stdout: "sets": { 2024-05-21T13:37:24.898 INFO:teuthology.orchestra.run.smithi022.stdout: "1c6f8938": { 2024-05-21T13:37:24.898 INFO:teuthology.orchestra.run.smithi022.stdout: "version": 4, 2024-05-21T13:37:24.898 INFO:teuthology.orchestra.run.smithi022.stdout: "age_ref": 0.0, 2024-05-21T13:37:24.898 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-05-21T13:37:24.898 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RELEASED", 2024-05-21T13:37:24.898 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-05-21T13:37:24.898 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-05-21T13:37:24.898 INFO:teuthology.orchestra.run.smithi022.stdout: "timeout": 90.0, 2024-05-21T13:37:24.898 INFO:teuthology.orchestra.run.smithi022.stdout: "expiration": 144.2, 2024-05-21T13:37:24.898 INFO:teuthology.orchestra.run.smithi022.stdout: "members": { 2024-05-21T13:37:24.899 INFO:teuthology.orchestra.run.smithi022.stdout: "file:/": { 2024-05-21T13:37:24.899 INFO:teuthology.orchestra.run.smithi022.stdout: "excluded": false, 2024-05-21T13:37:24.899 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-05-21T13:37:24.899 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RELEASED", 2024-05-21T13:37:24.899 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-05-21T13:37:24.899 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-05-21T13:37:24.899 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-05-21T13:37:24.899 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-05-21T13:37:24.899 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-05-21T13:37:24.899 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-05-21T13:37:24.899 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-05-21T13:37:24.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.916+0000 7fdac4209640 1 -- 172.21.15.22:0/203857813 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fdaa006f430 msgr2=0x7fdaa00718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:37:24.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.916+0000 7fdac4209640 1 --2- 172.21.15.22:0/203857813 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fdaa006f430 0x7fdaa00718f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fdabc069b10 tx=0x7fdaac006ca0 comp rx=0 tx=0).stop 2024-05-21T13:37:24.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.916+0000 7fdac4209640 1 -- 172.21.15.22:0/203857813 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdabc0c7440 msgr2=0x7fdabc0cc3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:37:24.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.916+0000 7fdac4209640 1 --2- 172.21.15.22:0/203857813 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdabc0c7440 0x7fdabc0cc3a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fdab80b3040 tx=0x7fdab801ba30 comp rx=0 tx=0).stop 2024-05-21T13:37:24.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.916+0000 7fdac4209640 1 -- 172.21.15.22:0/203857813 shutdown_connections 2024-05-21T13:37:24.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.916+0000 7fdac4209640 1 --2- 172.21.15.22:0/203857813 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fdaa006f430 0x7fdaa00718f0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:24.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.916+0000 7fdac4209640 1 --2- 172.21.15.22:0/203857813 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdabc150400 0x7fdabc141160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:24.900 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.916+0000 7fdac4209640 1 --2- 172.21.15.22:0/203857813 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdabc0c9990 0x7fdabc140c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:24.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.916+0000 7fdac4209640 1 --2- 172.21.15.22:0/203857813 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdabc0c7440 0x7fdabc0cc3a0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:24.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.916+0000 7fdac4209640 1 -- 172.21.15.22:0/203857813 >> 172.21.15.22:0/203857813 conn(0x7fdabc06cc50 msgr2=0x7fdabc158c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:37:24.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.916+0000 7fdac4209640 1 -- 172.21.15.22:0/203857813 shutdown_connections 2024-05-21T13:37:24.901 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:24.916+0000 7fdac4209640 1 -- 172.21.15.22:0/203857813 wait complete. 2024-05-21T13:37:24.910 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '1c6f8938', total seconds elapsed: 24.7 2024-05-21T13:37:24.910 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 24.2 2024-05-21T13:37:24.910 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-21T13:37:25.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.044+0000 7f60ecd34640 1 Processor -- start 2024-05-21T13:37:25.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.044+0000 7f60ecd34640 1 -- start start 2024-05-21T13:37:25.025 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.044+0000 7f60ecd34640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f60e8155d80 0x7f60e815b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:25.025 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.044+0000 7f60ecd34640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f60e80cd1c0 0x7f60e80d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:25.025 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.044+0000 7f60ecd34640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f60e8156160 con 0x7f60e815bf30 2024-05-21T13:37:25.025 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.044+0000 7f60ecd34640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f60e80ccfc0 con 0x7f60e80cd1c0 2024-05-21T13:37:25.025 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.044+0000 7f60ecd34640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f60e80c6560 con 0x7f60e8155d80 2024-05-21T13:37:25.025 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.044+0000 7f60e6d9d640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f60e80cd1c0 0x7f60e80d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:25.025 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.044+0000 7f60e6d9d640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f60e80cd1c0 0x7f60e80d1420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35616/0 (socket says 172.21.15.22:35616) 2024-05-21T13:37:25.025 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.044+0000 7f60e6d9d640 1 -- 172.21.15.22:0/1529262882 learned_addr learned my addr 172.21.15.22:0/1529262882 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:37:25.025 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.044+0000 7f60e659c640 1 --2- 172.21.15.22:0/1529262882 >> v2:172.21.15.115:3300/0 conn(0x7f60e8155d80 0x7f60e815b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:25.026 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.044+0000 7f60e6d9d640 1 -- 172.21.15.22:0/1529262882 >> v2:172.21.15.115:3300/0 conn(0x7f60e8155d80 msgr2=0x7f60e815b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:37:25.026 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.044+0000 7f60e6d9d640 1 --2- 172.21.15.22:0/1529262882 >> v2:172.21.15.115:3300/0 conn(0x7f60e8155d80 0x7f60e815b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:25.026 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.044+0000 7f60e6d9d640 1 -- 172.21.15.22:0/1529262882 >> v1:172.21.15.115:6789/0 conn(0x7f60e815bf30 legacy=0x7f60e80ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:37:25.026 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.044+0000 7f60e6d9d640 1 -- 172.21.15.22:0/1529262882 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60e815c4a0 con 0x7f60e80cd1c0 2024-05-21T13:37:25.026 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.044+0000 7f60e659c640 1 --2- 172.21.15.22:0/1529262882 >> v2:172.21.15.115:3300/0 conn(0x7f60e8155d80 0x7f60e815b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:37:25.027 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.048+0000 7f60e6d9d640 1 --2- 172.21.15.22:0/1529262882 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f60e80cd1c0 0x7f60e80d1420 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f60e806de20 tx=0x7f60e001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44f9e47cd0290ed6 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:37:25.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.048+0000 7f60e559a640 1 -- 172.21.15.22:0/1529262882 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60e00a56c0 con 0x7f60e80cd1c0 2024-05-21T13:37:25.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.048+0000 7f60e559a640 1 -- 172.21.15.22:0/1529262882 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60e00a5860 con 0x7f60e80cd1c0 2024-05-21T13:37:25.028 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.048+0000 7f60e559a640 1 -- 172.21.15.22:0/1529262882 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60e00a5c30 con 0x7f60e80cd1c0 2024-05-21T13:37:25.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.048+0000 7f60ecd34640 1 -- 172.21.15.22:0/1529262882 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f60e80cd1c0 msgr2=0x7f60e80d1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:37:25.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.048+0000 7f60ecd34640 1 --2- 172.21.15.22:0/1529262882 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f60e80cd1c0 0x7f60e80d1420 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f60e806de20 tx=0x7f60e001c930 comp rx=0 tx=0).stop 2024-05-21T13:37:25.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.048+0000 7f60ecd34640 1 -- 172.21.15.22:0/1529262882 shutdown_connections 2024-05-21T13:37:25.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.048+0000 7f60ecd34640 1 --2- 172.21.15.22:0/1529262882 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f60e80cd1c0 0x7f60e80d1420 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:25.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.048+0000 7f60ecd34640 1 --2- 172.21.15.22:0/1529262882 >> v2:172.21.15.115:3300/0 conn(0x7f60e8155d80 0x7f60e815b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:25.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.048+0000 7f60ecd34640 1 -- 172.21.15.22:0/1529262882 >> 172.21.15.22:0/1529262882 conn(0x7f60e806f3b0 msgr2=0x7f60e806d430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:37:25.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.048+0000 7f60ecd34640 1 -- 172.21.15.22:0/1529262882 shutdown_connections 2024-05-21T13:37:25.029 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.048+0000 7f60ecd34640 1 -- 172.21.15.22:0/1529262882 wait complete. 2024-05-21T13:37:25.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.048+0000 7f60ecd34640 1 Processor -- start 2024-05-21T13:37:25.030 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.052+0000 7f60ecd34640 1 -- start start 2024-05-21T13:37:25.032 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.052+0000 7f60ecd34640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f60e80cd1c0 0x7f60e815d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:25.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.052+0000 7f60ecd34640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f60e8155d80 0x7f60e80cab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:25.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.052+0000 7f60ecd34640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f60e815bf30 0x7f60e80c9d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:25.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.052+0000 7f60ecd34640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f60e80cec20 con 0x7f60e80cd1c0 2024-05-21T13:37:25.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.052+0000 7f60ecd34640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f60e80cdff0 con 0x7f60e815bf30 2024-05-21T13:37:25.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.052+0000 7f60ecd34640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f60e80ceda0 con 0x7f60e8155d80 2024-05-21T13:37:25.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.052+0000 7f60e659c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f60e80cd1c0 0x7f60e815d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:25.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.052+0000 7f60e659c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f60e80cd1c0 0x7f60e815d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35626/0 (socket says 172.21.15.22:35626) 2024-05-21T13:37:25.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.052+0000 7f60e659c640 1 -- 172.21.15.22:0/2498177261 learned_addr learned my addr 172.21.15.22:0/2498177261 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:37:25.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.052+0000 7f60e6d9d640 1 --2- 172.21.15.22:0/2498177261 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f60e815bf30 0x7f60e80c9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:25.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.052+0000 7f60e5d9b640 1 --2- 172.21.15.22:0/2498177261 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f60e8155d80 0x7f60e80cab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:25.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.052+0000 7f60e659c640 1 -- 172.21.15.22:0/2498177261 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f60e8155d80 msgr2=0x7f60e80cab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:37:25.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.052+0000 7f60e659c640 1 --2- 172.21.15.22:0/2498177261 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f60e8155d80 0x7f60e80cab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:25.033 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.052+0000 7f60e659c640 1 -- 172.21.15.22:0/2498177261 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f60e815bf30 msgr2=0x7f60e80c9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:37:25.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.052+0000 7f60e659c640 1 --2- 172.21.15.22:0/2498177261 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f60e815bf30 0x7f60e80c9d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:25.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.052+0000 7f60e659c640 1 -- 172.21.15.22:0/2498177261 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60e815dc30 con 0x7f60e80cd1c0 2024-05-21T13:37:25.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.052+0000 7f60e6d9d640 1 --2- 172.21.15.22:0/2498177261 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f60e815bf30 0x7f60e80c9d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:37:25.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.052+0000 7f60e659c640 1 --2- 172.21.15.22:0/2498177261 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f60e80cd1c0 0x7f60e815d5a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f60d800c7f0 tx=0x7f60d800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:37:25.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.052+0000 7f60d6ffd640 1 -- 172.21.15.22:0/2498177261 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60d8007a30 con 0x7f60e80cd1c0 2024-05-21T13:37:25.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.052+0000 7f60d6ffd640 1 -- 172.21.15.22:0/2498177261 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f60d8007bd0 con 0x7f60e80cd1c0 2024-05-21T13:37:25.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.052+0000 7f60d6ffd640 1 -- 172.21.15.22:0/2498177261 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60d80113f0 con 0x7f60e80cd1c0 2024-05-21T13:37:25.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.052+0000 7f60ecd34640 1 -- 172.21.15.22:0/2498177261 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60e80c8930 con 0x7f60e80cd1c0 2024-05-21T13:37:25.034 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.052+0000 7f60ecd34640 1 -- 172.21.15.22:0/2498177261 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60e80c8ef0 con 0x7f60e80cd1c0 2024-05-21T13:37:25.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.052+0000 7f60ecd34640 1 -- 172.21.15.22:0/2498177261 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60e8077bb0 con 0x7f60e80cd1c0 2024-05-21T13:37:25.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.056+0000 7f60d6ffd640 1 -- 172.21.15.22:0/2498177261 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f60d8011590 con 0x7f60e80cd1c0 2024-05-21T13:37:25.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.056+0000 7f60d6ffd640 1 --2- 172.21.15.22:0/2498177261 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f60c806f430 0x7f60c80718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:25.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.056+0000 7f60d6ffd640 1 -- 172.21.15.22:0/2498177261 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f60d808f760 con 0x7f60e80cd1c0 2024-05-21T13:37:25.035 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.056+0000 7f60e5d9b640 1 --2- 172.21.15.22:0/2498177261 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f60c806f430 0x7f60c80718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:25.036 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.056+0000 7f60e5d9b640 1 --2- 172.21.15.22:0/2498177261 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f60c806f430 0x7f60c80718f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f60e814b130 tx=0x7f60dc008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:37:25.039 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.060+0000 7f60d6ffd640 1 -- 172.21.15.22:0/2498177261 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f60d8015020 con 0x7f60e80cd1c0 2024-05-21T13:37:25.235 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.256+0000 7f60ecd34640 1 -- 172.21.15.22:0/2498177261 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f60e806d4c0 con 0x7f60e80cd1c0 2024-05-21T13:37:25.236 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.256+0000 7f60d6ffd640 1 -- 172.21.15.22:0/2498177261 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6875 (secure 0 0 0) 0x7f60d805c400 con 0x7f60e80cd1c0 2024-05-21T13:37:25.237 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-21T13:37:25.237 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4224,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/355756580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":355756580},{"type":"v1","addr":"172.21.15.22:6833","nonce":355756580}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4230,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3277017116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":3277017116},{"type":"v1","addr":"172.21.15.22:6835","nonce":3277017116}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4233,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3840772609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3840772609},{"type":"v1","addr":"172.21.15.22:6837","nonce":3840772609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-21T13:35:57.106892+0000","modified":"2024-05-21T13:36:32.396351+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4300,"mds_1":4294,"mds_2":4248},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4248":{"gid":4248,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":12,"addr":"172.21.15.115:6837/2009761279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":2009761279},{"type":"v1","addr":"172.21.15.115:6837","nonce":2009761279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4294":{"gid":4294,"name":"b","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.115:6835/3894678097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3894678097},{"type":"v1","addr":"172.21.15.115:6835","nonce":3894678097}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4300":{"gid":4300,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.115:6839/1525097577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6838","nonce":1525097577},{"type":"v1","addr":"172.21.15.115:6839","nonce":1525097577}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4300,"qdb_cluster":[4248,4300,4294]},"id":1}]} 2024-05-21T13:37:25.237 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 14 2024-05-21T13:37:25.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.260+0000 7f60ecd34640 1 -- 172.21.15.22:0/2498177261 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f60c806f430 msgr2=0x7f60c80718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:37:25.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.260+0000 7f60ecd34640 1 --2- 172.21.15.22:0/2498177261 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f60c806f430 0x7f60c80718f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f60e814b130 tx=0x7f60dc008040 comp rx=0 tx=0).stop 2024-05-21T13:37:25.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.260+0000 7f60ecd34640 1 -- 172.21.15.22:0/2498177261 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f60e80cd1c0 msgr2=0x7f60e815d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:37:25.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.260+0000 7f60ecd34640 1 --2- 172.21.15.22:0/2498177261 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f60e80cd1c0 0x7f60e815d5a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f60d800c7f0 tx=0x7f60d800ccb0 comp rx=0 tx=0).stop 2024-05-21T13:37:25.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.260+0000 7f60ecd34640 1 -- 172.21.15.22:0/2498177261 shutdown_connections 2024-05-21T13:37:25.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.260+0000 7f60ecd34640 1 --2- 172.21.15.22:0/2498177261 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f60c806f430 0x7f60c80718f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:25.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.260+0000 7f60ecd34640 1 --2- 172.21.15.22:0/2498177261 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f60e815bf30 0x7f60e80c9d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:25.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.260+0000 7f60ecd34640 1 --2- 172.21.15.22:0/2498177261 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f60e8155d80 0x7f60e80cab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:25.239 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.260+0000 7f60ecd34640 1 --2- 172.21.15.22:0/2498177261 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f60e80cd1c0 0x7f60e815d5a0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:25.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.260+0000 7f60ecd34640 1 -- 172.21.15.22:0/2498177261 >> 172.21.15.22:0/2498177261 conn(0x7f60e806f3b0 msgr2=0x7f60e80cfc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:37:25.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.260+0000 7f60ecd34640 1 -- 172.21.15.22:0/2498177261 shutdown_connections 2024-05-21T13:37:25.240 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.260+0000 7f60ecd34640 1 -- 172.21.15.22:0/2498177261 wait complete. 2024-05-21T13:37:25.254 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4300 quiesce db / --timeout 90 --expiration 144.2 --await-for 45.0' 2024-05-21T13:37:25.254 DEBUG:teuthology.orchestra.run.smithi022:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4300 quiesce db / --timeout 90 --expiration 144.2 --await-for 45.0 2024-05-21T13:37:25.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.400+0000 7f2278cf5640 1 Processor -- start 2024-05-21T13:37:25.379 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.400+0000 7f2278cf5640 1 -- start start 2024-05-21T13:37:25.380 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.400+0000 7f2278cf5640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f22740741a0 0x7f227406fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:25.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.400+0000 7f2278cf5640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22740c8ea0 con 0x7f22740746f0 2024-05-21T13:37:25.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.400+0000 7f2278cf5640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22740c9180 con 0x7f22741537f0 2024-05-21T13:37:25.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.400+0000 7f2278cf5640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f22740736c0 con 0x7f22740741a0 2024-05-21T13:37:25.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.400+0000 7f2271d9b640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f22740741a0 0x7f227406fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:25.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.400+0000 7f2271d9b640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f22740741a0 0x7f227406fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35630/0 (socket says 172.21.15.22:35630) 2024-05-21T13:37:25.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.400+0000 7f2272d9d640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f22740746f0 0x7f22740c7b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:46900/0 (socket says 172.21.15.22:46900) 2024-05-21T13:37:25.381 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.400+0000 7f2271d9b640 1 -- 172.21.15.22:0/1536663332 learned_addr learned my addr 172.21.15.22:0/1536663332 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:37:25.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.400+0000 7f2271d9b640 1 -- 172.21.15.22:0/1536663332 >> v1:172.21.15.115:6789/0 conn(0x7f22741537f0 legacy=0x7f22741598d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:37:25.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.400+0000 7f2271d9b640 1 -- 172.21.15.22:0/1536663332 >> v1:172.21.15.22:6789/0 conn(0x7f22740746f0 legacy=0x7f22740c7b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:37:25.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.400+0000 7f2271d9b640 1 -- 172.21.15.22:0/1536663332 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22740739a0 con 0x7f22740741a0 2024-05-21T13:37:25.382 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.400+0000 7f227159a640 1 -- 172.21.15.22:0/1536663332 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3201175434 0 0) 0x7f22740c8ea0 con 0x7f22740746f0 2024-05-21T13:37:25.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.404+0000 7f2271d9b640 1 --2- 172.21.15.22:0/1536663332 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f22740741a0 0x7f227406fb80 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f2268009870 tx=0x7f226801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96e4a72a9fa67ec server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:37:25.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.404+0000 7f227159a640 1 -- 172.21.15.22:0/1536663332 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22680a7070 con 0x7f22740741a0 2024-05-21T13:37:25.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.404+0000 7f227159a640 1 -- 172.21.15.22:0/1536663332 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22680b0070 con 0x7f22740741a0 2024-05-21T13:37:25.383 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.404+0000 7f227159a640 1 -- 172.21.15.22:0/1536663332 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22680ab890 con 0x7f22740741a0 2024-05-21T13:37:25.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.404+0000 7f2278cf5640 1 -- 172.21.15.22:0/1536663332 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f22740741a0 msgr2=0x7f227406fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:37:25.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.404+0000 7f2278cf5640 1 --2- 172.21.15.22:0/1536663332 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f22740741a0 0x7f227406fb80 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f2268009870 tx=0x7f226801c560 comp rx=0 tx=0).stop 2024-05-21T13:37:25.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.404+0000 7f2278cf5640 1 -- 172.21.15.22:0/1536663332 shutdown_connections 2024-05-21T13:37:25.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.404+0000 7f2278cf5640 1 --2- 172.21.15.22:0/1536663332 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f22740741a0 0x7f227406fb80 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:25.384 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.404+0000 7f2278cf5640 1 -- 172.21.15.22:0/1536663332 >> 172.21.15.22:0/1536663332 conn(0x7f22740ce400 msgr2=0x7f22740ce810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:37:25.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.404+0000 7f2278cf5640 1 -- 172.21.15.22:0/1536663332 shutdown_connections 2024-05-21T13:37:25.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.404+0000 7f2278cf5640 1 -- 172.21.15.22:0/1536663332 wait complete. 2024-05-21T13:37:25.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.404+0000 7f2278cf5640 1 Processor -- start 2024-05-21T13:37:25.385 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.404+0000 7f2278cf5640 1 -- start start 2024-05-21T13:37:25.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.404+0000 7f2278cf5640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22740741a0 0x7f22741f39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:25.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.404+0000 7f2278cf5640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22740746f0 0x7f22741f3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:25.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.404+0000 7f2278cf5640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f22741537f0 0x7f227415d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:25.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.404+0000 7f2278cf5640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f2274071d30 con 0x7f22741537f0 2024-05-21T13:37:25.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.404+0000 7f2278cf5640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f2274153de0 con 0x7f22740741a0 2024-05-21T13:37:25.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.404+0000 7f2278cf5640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f2274071eb0 con 0x7f22740746f0 2024-05-21T13:37:25.387 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.404+0000 7f2272d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f22741537f0 0x7f227415d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:25.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.404+0000 7f2272d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f22741537f0 0x7f227415d3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35642/0 (socket says 172.21.15.22:35642) 2024-05-21T13:37:25.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.404+0000 7f2272d9d640 1 -- 172.21.15.22:0/3896259788 learned_addr learned my addr 172.21.15.22:0/3896259788 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:37:25.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.408+0000 7f227259c640 1 --2- 172.21.15.22:0/3896259788 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22740741a0 0x7f22741f39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:25.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.408+0000 7f2271d9b640 1 --2- 172.21.15.22:0/3896259788 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22740746f0 0x7f22741f3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:25.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.408+0000 7f2272d9d640 1 -- 172.21.15.22:0/3896259788 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22740746f0 msgr2=0x7f22741f3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:37:25.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.408+0000 7f2272d9d640 1 --2- 172.21.15.22:0/3896259788 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22740746f0 0x7f22741f3f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:25.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.408+0000 7f2272d9d640 1 -- 172.21.15.22:0/3896259788 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22740741a0 msgr2=0x7f22741f39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:37:25.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.408+0000 7f2272d9d640 1 --2- 172.21.15.22:0/3896259788 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22740741a0 0x7f22741f39c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:25.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.408+0000 7f2272d9d640 1 -- 172.21.15.22:0/3896259788 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f227406a0f0 con 0x7f22741537f0 2024-05-21T13:37:25.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.408+0000 7f2271d9b640 1 --2- 172.21.15.22:0/3896259788 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22740746f0 0x7f22741f3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:37:25.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.408+0000 7f227259c640 1 --2- 172.21.15.22:0/3896259788 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22740741a0 0x7f22741f39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:37:25.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.408+0000 7f2272d9d640 1 --2- 172.21.15.22:0/3896259788 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f22741537f0 0x7f227415d3b0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f226c00c410 tx=0x7f226c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:37:25.388 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.408+0000 7f2262ffd640 1 -- 172.21.15.22:0/3896259788 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f226c0074e0 con 0x7f22741537f0 2024-05-21T13:37:25.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.408+0000 7f2262ffd640 1 -- 172.21.15.22:0/3896259788 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f226c0047f0 con 0x7f22741537f0 2024-05-21T13:37:25.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.408+0000 7f2262ffd640 1 -- 172.21.15.22:0/3896259788 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f226c007680 con 0x7f22741537f0 2024-05-21T13:37:25.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.408+0000 7f2278cf5640 1 -- 172.21.15.22:0/3896259788 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f227414aa70 con 0x7f22741537f0 2024-05-21T13:37:25.389 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.408+0000 7f2278cf5640 1 -- 172.21.15.22:0/3896259788 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f227414b030 con 0x7f22741537f0 2024-05-21T13:37:25.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.408+0000 7f2262ffd640 1 -- 172.21.15.22:0/3896259788 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f226c011070 con 0x7f22741537f0 2024-05-21T13:37:25.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.408+0000 7f2262ffd640 1 --2- 172.21.15.22:0/3896259788 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f225406f430 0x7f22540718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:25.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.408+0000 7f2262ffd640 1 -- 172.21.15.22:0/3896259788 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f226c08f270 con 0x7f22741537f0 2024-05-21T13:37:25.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.408+0000 7f227259c640 1 --2- 172.21.15.22:0/3896259788 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f225406f430 0x7f22540718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:25.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.408+0000 7f227be80000 1 Processor -- start 2024-05-21T13:37:25.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.408+0000 7f227be80000 1 -- start start 2024-05-21T13:37:25.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.408+0000 7f227259c640 1 --2- 172.21.15.22:0/3896259788 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f225406f430 0x7f22540718f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2264007fd0 tx=0x7f2264009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:37:25.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.408+0000 7f227be80000 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55f555bce5b0 0x55f555c0cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:25.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.408+0000 7f227be80000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f555c0d4e0 0x55f555c0d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:25.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.408+0000 7f227be80000 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f555c0de00 0x55f555c0e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:25.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.408+0000 7f227be80000 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55f555a24740 con 0x55f555c0de00 2024-05-21T13:37:25.392 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.408+0000 7f227be80000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55f555a142e0 con 0x55f555c0d4e0 2024-05-21T13:37:25.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.408+0000 7f227be80000 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x55f555a18320 con 0x55f555bce5b0 2024-05-21T13:37:25.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.408+0000 7f2272d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f555c0de00 0x55f555c0e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:25.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.412+0000 7f2272d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f555c0de00 0x55f555c0e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35654/0 (socket says 172.21.15.22:35654) 2024-05-21T13:37:25.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.412+0000 7f2272d9d640 1 -- 172.21.15.22:0/3269093756 learned_addr learned my addr 172.21.15.22:0/3269093756 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:37:25.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.412+0000 7f227259c640 1 --2- 172.21.15.22:0/3269093756 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55f555bce5b0 0x55f555c0cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:25.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.412+0000 7f2271d9b640 1 --2- 172.21.15.22:0/3269093756 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f555c0d4e0 0x55f555c0d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:25.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.412+0000 7f2272d9d640 1 -- 172.21.15.22:0/3269093756 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55f555bce5b0 msgr2=0x55f555c0cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:37:25.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.412+0000 7f2272d9d640 1 --2- 172.21.15.22:0/3269093756 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55f555bce5b0 0x55f555c0cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:25.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.412+0000 7f2272d9d640 1 -- 172.21.15.22:0/3269093756 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f555c0d4e0 msgr2=0x55f555c0d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:37:25.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.412+0000 7f2272d9d640 1 --2- 172.21.15.22:0/3269093756 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f555c0d4e0 0x55f555c0d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:25.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.412+0000 7f2272d9d640 1 -- 172.21.15.22:0/3269093756 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5559b6490 con 0x55f555c0de00 2024-05-21T13:37:25.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.412+0000 7f2271d9b640 1 --2- 172.21.15.22:0/3269093756 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f555c0d4e0 0x55f555c0d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:37:25.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.412+0000 7f2272d9d640 1 --2- 172.21.15.22:0/3269093756 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f555c0de00 0x55f555c0e1e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f226c057c40 tx=0x7f226c0575c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78f048a6eaa43992 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:37:25.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.412+0000 7f2253fff640 1 -- 172.21.15.22:0/3269093756 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f226c05b650 con 0x55f555c0de00 2024-05-21T13:37:25.393 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.412+0000 7f2253fff640 1 -- 172.21.15.22:0/3269093756 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f226c05fa00 con 0x55f555c0de00 2024-05-21T13:37:25.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.412+0000 7f2253fff640 1 -- 172.21.15.22:0/3269093756 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f226c064240 con 0x55f555c0de00 2024-05-21T13:37:25.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.412+0000 7f227be80000 1 -- 172.21.15.22:0/3269093756 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f555c0de00 msgr2=0x55f555c0e1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:37:25.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.412+0000 7f227be80000 1 --2- 172.21.15.22:0/3269093756 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f555c0de00 0x55f555c0e1e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f226c057c40 tx=0x7f226c0575c0 comp rx=0 tx=0).stop 2024-05-21T13:37:25.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.412+0000 7f227be80000 1 -- 172.21.15.22:0/3269093756 shutdown_connections 2024-05-21T13:37:25.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.412+0000 7f227be80000 1 --2- 172.21.15.22:0/3269093756 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f555c0de00 0x55f555c0e1e0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:25.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.412+0000 7f227be80000 1 --2- 172.21.15.22:0/3269093756 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f555c0d4e0 0x55f555c0d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:25.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.412+0000 7f227be80000 1 --2- 172.21.15.22:0/3269093756 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55f555bce5b0 0x55f555c0cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:25.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.412+0000 7f227be80000 1 -- 172.21.15.22:0/3269093756 >> 172.21.15.22:0/3269093756 conn(0x55f555ab0d80 msgr2=0x55f555bcea10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:37:25.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.412+0000 7f227be80000 1 -- 172.21.15.22:0/3269093756 shutdown_connections 2024-05-21T13:37:25.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.412+0000 7f227be80000 1 -- 172.21.15.22:0/3269093756 wait complete. 2024-05-21T13:37:25.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.412+0000 7f227be80000 1 -- start start 2024-05-21T13:37:25.394 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.412+0000 7f227be80000 1 Processor -- start 2024-05-21T13:37:25.397 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.412+0000 7f227be80000 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55f555bce5b0 0x55f555bd7620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:25.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.412+0000 7f227be80000 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f555c0d4e0 0x55f555bd7b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:25.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.412+0000 7f227be80000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f555c0de00 0x55f555bd80a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:25.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.412+0000 7f227be80000 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55f5556dfb10 con 0x55f555c0d4e0 2024-05-21T13:37:25.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.412+0000 7f227be80000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55f5559d0670 con 0x55f555c0de00 2024-05-21T13:37:25.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.412+0000 7f227be80000 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x55f555a1c950 con 0x55f555bce5b0 2024-05-21T13:37:25.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.412+0000 7f227be80000 10 client.0 _ll_register_callbacks cb 0x55f555bb4540 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-21T13:37:25.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.412+0000 7f2271d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f555c0d4e0 0x55f555bd7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:25.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.412+0000 7f2271d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f555c0d4e0 0x55f555bd7b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35662/0 (socket says 172.21.15.22:35662) 2024-05-21T13:37:25.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.412+0000 7f2271d9b640 1 -- 172.21.15.22:0/3037666537 learned_addr learned my addr 172.21.15.22:0/3037666537 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:37:25.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.412+0000 7f2272d9d640 1 --2- 172.21.15.22:0/3037666537 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f555c0de00 0x55f555bd80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:25.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.412+0000 7f227259c640 1 --2- 172.21.15.22:0/3037666537 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55f555bce5b0 0x55f555bd7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:25.398 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.412+0000 7f2271d9b640 1 -- 172.21.15.22:0/3037666537 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55f555bce5b0 msgr2=0x55f555bd7620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:37:25.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.412+0000 7f2271d9b640 1 --2- 172.21.15.22:0/3037666537 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55f555bce5b0 0x55f555bd7620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:25.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.412+0000 7f2271d9b640 1 -- 172.21.15.22:0/3037666537 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f555c0de00 msgr2=0x55f555bd80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:37:25.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.412+0000 7f2271d9b640 1 --2- 172.21.15.22:0/3037666537 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f555c0de00 0x55f555bd80a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:25.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.412+0000 7f2271d9b640 1 -- 172.21.15.22:0/3037666537 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5559c9e40 con 0x55f555c0d4e0 2024-05-21T13:37:25.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.412+0000 7f2272d9d640 1 --2- 172.21.15.22:0/3037666537 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f555c0de00 0x55f555bd80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:37:25.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.412+0000 7f227259c640 1 --2- 172.21.15.22:0/3037666537 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55f555bce5b0 0x55f555bd7620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:37:25.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.412+0000 7f2271d9b640 1 --2- 172.21.15.22:0/3037666537 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f555c0d4e0 0x55f555bd7b60 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f22680ad040 tx=0x7f22680046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de52b96418cb7917 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:37:25.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.412+0000 7f22517fa640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-05-21T13:37:25.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.412+0000 7f22517fa640 1 -- 172.21.15.22:0/3037666537 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22680ba070 con 0x55f555c0d4e0 2024-05-21T13:37:25.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.412+0000 7f22517fa640 1 -- 172.21.15.22:0/3037666537 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f22680bfe20 con 0x55f555c0d4e0 2024-05-21T13:37:25.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.412+0000 7f227be80000 1 -- 172.21.15.22:0/3037666537 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f226c05fa00 con 0x55f555c0d4e0 2024-05-21T13:37:25.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.412+0000 7f22517fa640 1 -- 172.21.15.22:0/3037666537 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f22680abd70 con 0x55f555c0d4e0 2024-05-21T13:37:25.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.412+0000 7f227be80000 10 client.4917 fetch_fsmap learned FSMap version 14 2024-05-21T13:37:25.399 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.412+0000 7f227be80000 1 -- 172.21.15.22:0/3037666537 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x55f555a99890 con 0x55f555c0d4e0 2024-05-21T13:37:25.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.412+0000 7f22517fa640 1 -- 172.21.15.22:0/3037666537 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f226c05fa00 con 0x55f555c0d4e0 2024-05-21T13:37:25.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.412+0000 7f22517fa640 1 -- 172.21.15.22:0/3037666537 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7f22680be400 con 0x55f555c0d4e0 2024-05-21T13:37:25.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.412+0000 7f227be80000 10 client.4917 fetch_fsmap finished waiting for FSMap version 14 2024-05-21T13:37:25.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.412+0000 7f227be80000 10 client.4917 resolve_mds: validated gid 4300 aka daemon mds.f 2024-05-21T13:37:25.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.412+0000 7f227be80000 20 client.4917 populate_metadata read hostname 'smithi022' 2024-05-21T13:37:25.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.412+0000 7f227be80000 1 --2- 172.21.15.22:0/3037666537 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x55f555bc6aa0 0x55f555bc8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:25.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.412+0000 7f227be80000 4 client.4917 mds_command: new command op to 4300 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-21T13:37:25.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.412+0000 7f227be80000 1 -- 172.21.15.22:0/3037666537 --> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f5559b07f0 con 0x55f555bc6aa0 2024-05-21T13:37:25.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.416+0000 7f227259c640 1 --2- 172.21.15.22:0/3037666537 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x55f555bc6aa0 0x55f555bc8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:25.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.416+0000 7f227259c640 1 --2- 172.21.15.22:0/3037666537 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x55f555bc6aa0 0x55f555bc8ec0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=72b3ef3d3b715e2e server_cookie=db7dc8cf5021ac1d in_seq=0 out_seq=0 2024-05-21T13:37:25.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.416+0000 7f22517fa640 10 client.4917 ms_handle_connect on v2:172.21.15.115:6838/1525097577 2024-05-21T13:37:25.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.416+0000 7f22517fa640 1 -- 172.21.15.22:0/3037666537 <== mds.0 v2:172.21.15.115:6838/1525097577 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x55f5559b07f0 con 0x55f555bc6aa0 2024-05-21T13:37:25.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.416+0000 7f22517fa640 10 client.4917 handle_command_reply: tid=0 2024-05-21T13:37:25.400 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.416+0000 7f227be80000 1 client.4917 shutdown 2024-05-21T13:37:25.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.416+0000 7f227be80000 1 -- 172.21.15.22:0/3037666537 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f555c0d4e0 msgr2=0x55f555bd7b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:37:25.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.416+0000 7f227be80000 1 --2- 172.21.15.22:0/3037666537 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f555c0d4e0 0x55f555bd7b60 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f22680ad040 tx=0x7f22680046d0 comp rx=0 tx=0).stop 2024-05-21T13:37:25.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.416+0000 7f227be80000 1 -- 172.21.15.22:0/3037666537 shutdown_connections 2024-05-21T13:37:25.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.416+0000 7f227be80000 1 --2- 172.21.15.22:0/3037666537 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x55f555bc6aa0 0x55f555bc8ec0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:25.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.416+0000 7f227be80000 1 --2- 172.21.15.22:0/3037666537 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f555c0de00 0x55f555bd80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:25.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.416+0000 7f227be80000 1 --2- 172.21.15.22:0/3037666537 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f555c0d4e0 0x55f555bd7b60 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:25.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.416+0000 7f22517fa640 0 client.4917 ms_handle_reset on v2:172.21.15.115:6838/1525097577 2024-05-21T13:37:25.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.416+0000 7f227be80000 1 --2- 172.21.15.22:0/3037666537 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55f555bce5b0 0x55f555bd7620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:25.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.416+0000 7f227be80000 1 -- 172.21.15.22:0/3037666537 >> 172.21.15.22:0/3037666537 conn(0x55f555ab0d80 msgr2=0x55f555bcbd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:37:25.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.416+0000 7f227be80000 1 -- 172.21.15.22:0/3037666537 shutdown_connections 2024-05-21T13:37:25.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.416+0000 7f227be80000 1 -- 172.21.15.22:0/3037666537 wait complete. 2024-05-21T13:37:25.401 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.416+0000 7f227be80000 20 client.4917 trim_cache size 0 max 16384 2024-05-21T13:37:25.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.432+0000 7f227be80000 1 Processor -- start 2024-05-21T13:37:25.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.432+0000 7f227be80000 1 -- start start 2024-05-21T13:37:25.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.432+0000 7f227be80000 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f555ab0d80 0x55f555bcc310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:25.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.432+0000 7f227be80000 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55f555bce5b0 0x55f555bd37f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:25.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.432+0000 7f227be80000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f555c0d4e0 0x55f555bd3d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:25.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.436+0000 7f227be80000 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f22741fcef0 con 0x55f555ab0d80 2024-05-21T13:37:25.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.436+0000 7f227be80000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f22740c75c0 con 0x55f555c0d4e0 2024-05-21T13:37:25.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.436+0000 7f227be80000 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f22741fc9c0 con 0x55f555bce5b0 2024-05-21T13:37:25.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.436+0000 7f227259c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f555ab0d80 0x55f555bcc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:25.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.436+0000 7f227259c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f555ab0d80 0x55f555bcc310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35676/0 (socket says 172.21.15.22:35676) 2024-05-21T13:37:25.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.436+0000 7f227259c640 1 -- 172.21.15.22:0/1933331205 learned_addr learned my addr 172.21.15.22:0/1933331205 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:37:25.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.436+0000 7f227259c640 1 -- 172.21.15.22:0/1933331205 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55f555bce5b0 msgr2=0x55f555bd37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:37:25.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.436+0000 7f227259c640 1 --2- 172.21.15.22:0/1933331205 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55f555bce5b0 0x55f555bd37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:25.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.436+0000 7f227259c640 1 -- 172.21.15.22:0/1933331205 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f555c0d4e0 msgr2=0x55f555bd3d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:37:25.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.436+0000 7f227259c640 1 --2- 172.21.15.22:0/1933331205 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f555c0d4e0 0x55f555bd3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:25.416 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.436+0000 7f227259c640 1 -- 172.21.15.22:0/1933331205 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f555a70da0 con 0x55f555ab0d80 2024-05-21T13:37:25.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.436+0000 7f227259c640 1 --2- 172.21.15.22:0/1933331205 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f555ab0d80 0x55f555bcc310 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2264001c40 tx=0x7f2264013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caeceacc64a5e541 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:37:25.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.436+0000 7f22537fe640 1 -- 172.21.15.22:0/1933331205 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f226401d040 con 0x55f555ab0d80 2024-05-21T13:37:25.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.436+0000 7f22537fe640 1 -- 172.21.15.22:0/1933331205 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f226400dcd0 con 0x55f555ab0d80 2024-05-21T13:37:25.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.436+0000 7f22537fe640 1 -- 172.21.15.22:0/1933331205 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2264006d60 con 0x55f555ab0d80 2024-05-21T13:37:25.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.436+0000 7f227be80000 1 -- 172.21.15.22:0/1933331205 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f555ab0d80 msgr2=0x55f555bcc310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:37:25.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.436+0000 7f227be80000 1 --2- 172.21.15.22:0/1933331205 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f555ab0d80 0x55f555bcc310 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f2264001c40 tx=0x7f2264013000 comp rx=0 tx=0).stop 2024-05-21T13:37:25.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.436+0000 7f227be80000 1 -- 172.21.15.22:0/1933331205 shutdown_connections 2024-05-21T13:37:25.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.436+0000 7f227be80000 1 --2- 172.21.15.22:0/1933331205 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f555c0d4e0 0x55f555bd3d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:25.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.436+0000 7f227be80000 1 --2- 172.21.15.22:0/1933331205 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55f555bce5b0 0x55f555bd37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:25.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.436+0000 7f227be80000 1 --2- 172.21.15.22:0/1933331205 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f555ab0d80 0x55f555bcc310 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:25.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.436+0000 7f227be80000 1 -- 172.21.15.22:0/1933331205 >> 172.21.15.22:0/1933331205 conn(0x55f555c1e940 msgr2=0x55f555c2e780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:37:25.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.436+0000 7f227be80000 1 -- 172.21.15.22:0/1933331205 shutdown_connections 2024-05-21T13:37:25.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.436+0000 7f227be80000 1 -- 172.21.15.22:0/1933331205 wait complete. 2024-05-21T13:37:25.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.436+0000 7f227be80000 1 -- start start 2024-05-21T13:37:25.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.436+0000 7f227be80000 1 Processor -- start 2024-05-21T13:37:25.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.436+0000 7f227be80000 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55f555ab0d80 0x55f555c85570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:25.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.436+0000 7f227be80000 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f555bce5b0 0x55f555c85ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:25.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.436+0000 7f227be80000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f555c0d4e0 0x55f555bcb1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:25.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.436+0000 7f227be80000 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55f555a100e0 con 0x55f555bce5b0 2024-05-21T13:37:25.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.436+0000 7f227be80000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55f555a99400 con 0x55f555c0d4e0 2024-05-21T13:37:25.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.436+0000 7f227be80000 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x55f5559ad3e0 con 0x55f555ab0d80 2024-05-21T13:37:25.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.436+0000 7f227be80000 10 client.0 _ll_register_callbacks cb 0x7f22680096f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-21T13:37:25.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.436+0000 7f2271d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f555bce5b0 0x55f555c85ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:25.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.436+0000 7f2271d9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f555bce5b0 0x55f555c85ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:35690/0 (socket says 172.21.15.22:35690) 2024-05-21T13:37:25.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.436+0000 7f2271d9b640 1 -- 172.21.15.22:0/1090242264 learned_addr learned my addr 172.21.15.22:0/1090242264 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:37:25.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.436+0000 7f2271d9b640 1 -- 172.21.15.22:0/1090242264 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55f555ab0d80 msgr2=0x55f555c85570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:37:25.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.436+0000 7f2272d9d640 1 --2- 172.21.15.22:0/1090242264 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f555c0d4e0 0x55f555bcb1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:25.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.436+0000 7f2271d9b640 1 --2- 172.21.15.22:0/1090242264 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55f555ab0d80 0x55f555c85570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:25.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.436+0000 7f2271d9b640 1 -- 172.21.15.22:0/1090242264 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f555c0d4e0 msgr2=0x55f555bcb1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:37:25.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.436+0000 7f2271d9b640 1 --2- 172.21.15.22:0/1090242264 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f555c0d4e0 0x55f555bcb1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:25.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.436+0000 7f2271d9b640 1 -- 172.21.15.22:0/1090242264 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5559a8f40 con 0x55f555bce5b0 2024-05-21T13:37:25.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.436+0000 7f2271d9b640 1 --2- 172.21.15.22:0/1090242264 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f555bce5b0 0x55f555c85ab0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2268019170 tx=0x7f2268019300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a80ba8da8ae0ae4 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:37:25.421 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.436+0000 7f22517fa640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-05-21T13:37:25.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.436+0000 7f22517fa640 1 -- 172.21.15.22:0/1090242264 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22680ba040 con 0x55f555bce5b0 2024-05-21T13:37:25.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.436+0000 7f22517fa640 1 -- 172.21.15.22:0/1090242264 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f22680bea30 con 0x55f555bce5b0 2024-05-21T13:37:25.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.436+0000 7f227be80000 1 -- 172.21.15.22:0/1090242264 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f226400dcd0 con 0x55f555bce5b0 2024-05-21T13:37:25.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.436+0000 7f22517fa640 1 -- 172.21.15.22:0/1090242264 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f22680d8050 con 0x55f555bce5b0 2024-05-21T13:37:25.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.436+0000 7f227be80000 10 client.4923 fetch_fsmap learned FSMap version 14 2024-05-21T13:37:25.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.436+0000 7f227be80000 1 -- 172.21.15.22:0/1090242264 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x55f5559bbf80 con 0x55f555bce5b0 2024-05-21T13:37:25.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.436+0000 7f22517fa640 1 -- 172.21.15.22:0/1090242264 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f226400dcd0 con 0x55f555bce5b0 2024-05-21T13:37:25.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.436+0000 7f22517fa640 1 -- 172.21.15.22:0/1090242264 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7f22680db020 con 0x55f555bce5b0 2024-05-21T13:37:25.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.436+0000 7f227be80000 10 client.4923 fetch_fsmap finished waiting for FSMap version 14 2024-05-21T13:37:25.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.436+0000 7f227be80000 10 client.4923 resolve_mds: validated gid 4300 aka daemon mds.f 2024-05-21T13:37:25.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.436+0000 7f227be80000 20 client.4923 populate_metadata read hostname 'smithi022' 2024-05-21T13:37:25.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.436+0000 7f227be80000 1 --2- 172.21.15.22:0/1090242264 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x55f555c0de00 0x55f555bcbeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:25.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.436+0000 7f227be80000 4 client.4923 mds_command: new command op to 4300 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 144.2, "await_for": 45.0}] 2024-05-21T13:37:25.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.436+0000 7f227be80000 1 -- 172.21.15.22:0/1090242264 --> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 144.2, "await_for": 45.0}) -- 0x55f5559f1e60 con 0x55f555c0de00 2024-05-21T13:37:25.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.440+0000 7f227259c640 1 --2- 172.21.15.22:0/1090242264 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x55f555c0de00 0x55f555bcbeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:25.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.440+0000 7f22517fa640 10 client.4923 ms_handle_connect on v2:172.21.15.115:6838/1525097577 2024-05-21T13:37:25.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.440+0000 7f227259c640 1 --2- 172.21.15.22:0/1090242264 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x55f555c0de00 0x55f555bcbeb0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c612f408f465af7 server_cookie=f64ecef406b27d51 in_seq=0 out_seq=0 2024-05-21T13:37:25.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.444+0000 7f22517fa640 1 -- 172.21.15.22:0/1090242264 <== mds.0 v2:172.21.15.115:6838/1525097577 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x55f5559f1e60 con 0x55f555c0de00 2024-05-21T13:37:25.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.444+0000 7f22517fa640 10 client.4923 handle_command_reply: tid=0 2024-05-21T13:37:25.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.444+0000 7f227be80000 1 client.4923 shutdown 2024-05-21T13:37:25.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.444+0000 7f227be80000 1 -- 172.21.15.22:0/1090242264 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f555bce5b0 msgr2=0x55f555c85ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:37:25.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.444+0000 7f227be80000 1 --2- 172.21.15.22:0/1090242264 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f555bce5b0 0x55f555c85ab0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2268019170 tx=0x7f2268019300 comp rx=0 tx=0).stop 2024-05-21T13:37:25.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.444+0000 7f227be80000 1 -- 172.21.15.22:0/1090242264 shutdown_connections 2024-05-21T13:37:25.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.444+0000 7f227be80000 1 --2- 172.21.15.22:0/1090242264 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x55f555c0de00 0x55f555bcbeb0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:25.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.444+0000 7f227be80000 1 --2- 172.21.15.22:0/1090242264 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f555c0d4e0 0x55f555bcb1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:25.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.444+0000 7f227be80000 1 --2- 172.21.15.22:0/1090242264 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f555bce5b0 0x55f555c85ab0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:25.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.444+0000 7f22517fa640 0 client.4923 ms_handle_reset on v2:172.21.15.115:6838/1525097577 2024-05-21T13:37:25.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.444+0000 7f227be80000 1 --2- 172.21.15.22:0/1090242264 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55f555ab0d80 0x55f555c85570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:25.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.444+0000 7f227be80000 1 -- 172.21.15.22:0/1090242264 >> 172.21.15.22:0/1090242264 conn(0x55f555c1e940 msgr2=0x55f555c2d140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:37:25.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.444+0000 7f227be80000 1 -- 172.21.15.22:0/1090242264 shutdown_connections 2024-05-21T13:37:25.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.444+0000 7f227be80000 1 -- 172.21.15.22:0/1090242264 wait complete. 2024-05-21T13:37:25.426 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.444+0000 7f227be80000 20 client.4923 trim_cache size 0 max 16384 2024-05-21T13:37:25.426 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-05-21T13:37:25.426 INFO:teuthology.orchestra.run.smithi022.stdout: "epoch": 14, 2024-05-21T13:37:25.426 INFO:teuthology.orchestra.run.smithi022.stdout: "leader": 4300, 2024-05-21T13:37:25.426 INFO:teuthology.orchestra.run.smithi022.stdout: "set_version": 6, 2024-05-21T13:37:25.426 INFO:teuthology.orchestra.run.smithi022.stdout: "sets": { 2024-05-21T13:37:25.426 INFO:teuthology.orchestra.run.smithi022.stdout: "47970f0f": { 2024-05-21T13:37:25.426 INFO:teuthology.orchestra.run.smithi022.stdout: "version": 6, 2024-05-21T13:37:25.427 INFO:teuthology.orchestra.run.smithi022.stdout: "age_ref": 0.0, 2024-05-21T13:37:25.427 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-05-21T13:37:25.427 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "QUIESCED", 2024-05-21T13:37:25.427 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-05-21T13:37:25.427 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-05-21T13:37:25.427 INFO:teuthology.orchestra.run.smithi022.stdout: "timeout": 90.0, 2024-05-21T13:37:25.427 INFO:teuthology.orchestra.run.smithi022.stdout: "expiration": 144.2, 2024-05-21T13:37:25.427 INFO:teuthology.orchestra.run.smithi022.stdout: "members": { 2024-05-21T13:37:25.427 INFO:teuthology.orchestra.run.smithi022.stdout: "file:/": { 2024-05-21T13:37:25.427 INFO:teuthology.orchestra.run.smithi022.stdout: "excluded": false, 2024-05-21T13:37:25.427 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-05-21T13:37:25.427 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "QUIESCED", 2024-05-21T13:37:25.427 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-05-21T13:37:25.427 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-05-21T13:37:25.428 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-05-21T13:37:25.428 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-05-21T13:37:25.428 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-05-21T13:37:25.428 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-05-21T13:37:25.428 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-05-21T13:37:25.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.444+0000 7f2278cf5640 1 -- 172.21.15.22:0/3896259788 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f225406f430 msgr2=0x7f22540718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:37:25.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.444+0000 7f2278cf5640 1 --2- 172.21.15.22:0/3896259788 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f225406f430 0x7f22540718f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2264007fd0 tx=0x7f2264009040 comp rx=0 tx=0).stop 2024-05-21T13:37:25.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.444+0000 7f2278cf5640 1 -- 172.21.15.22:0/3896259788 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f22741537f0 msgr2=0x7f227415d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:37:25.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.444+0000 7f2278cf5640 1 --2- 172.21.15.22:0/3896259788 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f22741537f0 0x7f227415d3b0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f226c00c410 tx=0x7f226c00c8d0 comp rx=0 tx=0).stop 2024-05-21T13:37:25.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.444+0000 7f2278cf5640 1 -- 172.21.15.22:0/3896259788 shutdown_connections 2024-05-21T13:37:25.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.444+0000 7f2278cf5640 1 --2- 172.21.15.22:0/3896259788 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f225406f430 0x7f22540718f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:25.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.444+0000 7f2278cf5640 1 --2- 172.21.15.22:0/3896259788 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f22741537f0 0x7f227415d3b0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:25.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.444+0000 7f2278cf5640 1 --2- 172.21.15.22:0/3896259788 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f22740746f0 0x7f22741f3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:25.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.444+0000 7f2278cf5640 1 --2- 172.21.15.22:0/3896259788 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f22740741a0 0x7f22741f39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:25.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.444+0000 7f2278cf5640 1 -- 172.21.15.22:0/3896259788 >> 172.21.15.22:0/3896259788 conn(0x7f22740ce400 msgr2=0x7f2274151a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:37:25.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.444+0000 7f2278cf5640 1 -- 172.21.15.22:0/3896259788 shutdown_connections 2024-05-21T13:37:25.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:25.444+0000 7f2278cf5640 1 -- 172.21.15.22:0/3896259788 wait complete. 2024-05-21T13:37:25.440 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '47970f0f', quiesce took 0.5 seconds. Will release after: 23.7 2024-05-21T13:37:29.344 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-21T13:37:29.347 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-21T13:37:49.142 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-21T13:37:49.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.320+0000 7febb1c0c640 1 Processor -- start 2024-05-21T13:37:49.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.320+0000 7febb1c0c640 1 -- start start 2024-05-21T13:37:49.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.320+0000 7febb1c0c640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7febac152df0 0x7febac15c030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:49.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.320+0000 7febb1c0c640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7febac0c54e0 0x7febac0ce4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:49.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.320+0000 7febb1c0c640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7febac0cea20 0x7febac0ca370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:49.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.320+0000 7febb1c0c640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7febac073f10 con 0x7febac0cea20 2024-05-21T13:37:49.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.320+0000 7febb1c0c640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7febac0741f0 con 0x7febac152df0 2024-05-21T13:37:49.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.320+0000 7febb1c0c640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7febac0744d0 con 0x7febac0c54e0 2024-05-21T13:37:49.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.320+0000 7febabfff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7febac0cea20 0x7febac0ca370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:49.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.320+0000 7febabfff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7febac0cea20 0x7febac0ca370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33846/0 (socket says 172.21.15.22:33846) 2024-05-21T13:37:49.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.320+0000 7febabfff640 1 -- 172.21.15.22:0/908866325 learned_addr learned my addr 172.21.15.22:0/908866325 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:37:49.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.320+0000 7febaaffd640 1 --2- 172.21.15.22:0/908866325 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7febac0c54e0 0x7febac0ce4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:49.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.320+0000 7febab7fe640 1 --2- 172.21.15.22:0/908866325 >> v2:172.21.15.115:3300/0 conn(0x7febac152df0 0x7febac15c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:49.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.324+0000 7febabfff640 1 -- 172.21.15.22:0/908866325 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7febac0c54e0 msgr2=0x7febac0ce4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:37:49.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.324+0000 7febabfff640 1 --2- 172.21.15.22:0/908866325 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7febac0c54e0 0x7febac0ce4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:49.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.324+0000 7febabfff640 1 -- 172.21.15.22:0/908866325 >> v2:172.21.15.115:3300/0 conn(0x7febac152df0 msgr2=0x7febac15c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:37:49.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.324+0000 7febabfff640 1 --2- 172.21.15.22:0/908866325 >> v2:172.21.15.115:3300/0 conn(0x7febac152df0 0x7febac15c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:49.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.324+0000 7febabfff640 1 -- 172.21.15.22:0/908866325 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febac0c9890 con 0x7febac0cea20 2024-05-21T13:37:49.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.324+0000 7febabfff640 1 --2- 172.21.15.22:0/908866325 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7febac0cea20 0x7febac0ca370 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7febac0cc080 tx=0x7feba401f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad3825754d68b356 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:37:49.306 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.324+0000 7febaa7fc640 1 -- 172.21.15.22:0/908866325 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba40b4070 con 0x7febac0cea20 2024-05-21T13:37:49.306 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.324+0000 7febaa7fc640 1 -- 172.21.15.22:0/908866325 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feba40af400 con 0x7febac0cea20 2024-05-21T13:37:49.306 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.324+0000 7febaa7fc640 1 -- 172.21.15.22:0/908866325 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feba40af7d0 con 0x7febac0cea20 2024-05-21T13:37:49.307 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.328+0000 7febb1c0c640 1 -- 172.21.15.22:0/908866325 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7febac0cea20 msgr2=0x7febac0ca370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:37:49.307 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.328+0000 7febb1c0c640 1 --2- 172.21.15.22:0/908866325 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7febac0cea20 0x7febac0ca370 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7febac0cc080 tx=0x7feba401f1e0 comp rx=0 tx=0).stop 2024-05-21T13:37:49.307 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.328+0000 7febb1c0c640 1 -- 172.21.15.22:0/908866325 shutdown_connections 2024-05-21T13:37:49.307 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.328+0000 7febb1c0c640 1 --2- 172.21.15.22:0/908866325 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7febac0c54e0 0x7febac0ce4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:49.307 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.328+0000 7febb1c0c640 1 --2- 172.21.15.22:0/908866325 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7febac0cea20 0x7febac0ca370 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:49.307 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.328+0000 7febb1c0c640 1 --2- 172.21.15.22:0/908866325 >> v2:172.21.15.115:3300/0 conn(0x7febac152df0 0x7febac15c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:49.307 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.328+0000 7febb1c0c640 1 -- 172.21.15.22:0/908866325 >> 172.21.15.22:0/908866325 conn(0x7febac06fd30 msgr2=0x7febac06d600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:37:49.307 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.328+0000 7febb1c0c640 1 -- 172.21.15.22:0/908866325 shutdown_connections 2024-05-21T13:37:49.307 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.328+0000 7febb1c0c640 1 -- 172.21.15.22:0/908866325 wait complete. 2024-05-21T13:37:49.308 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.328+0000 7febb1c0c640 1 Processor -- start 2024-05-21T13:37:49.308 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.328+0000 7febb1c0c640 1 -- start start 2024-05-21T13:37:49.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.328+0000 7febb1c0c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7febac0c54e0 0x7febac1edc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:49.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.328+0000 7febb1c0c640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7febac0cea20 0x7febac0ce140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:49.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.328+0000 7febb1c0c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7febac152df0 0x7febac157580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:49.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.328+0000 7febab7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7febac0c54e0 0x7febac1edc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:49.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.328+0000 7febab7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7febac0c54e0 0x7febac1edc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33862/0 (socket says 172.21.15.22:33862) 2024-05-21T13:37:49.310 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.328+0000 7febab7fe640 1 -- 172.21.15.22:0/1038017500 learned_addr learned my addr 172.21.15.22:0/1038017500 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:37:49.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.328+0000 7febb1c0c640 1 -- 172.21.15.22:0/1038017500 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7febac1531d0 con 0x7febac0c54e0 2024-05-21T13:37:49.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.328+0000 7febb1c0c640 1 -- 172.21.15.22:0/1038017500 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7febac0c9e50 con 0x7febac152df0 2024-05-21T13:37:49.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.328+0000 7febb1c0c640 1 -- 172.21.15.22:0/1038017500 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7febac073bb0 con 0x7febac0cea20 2024-05-21T13:37:49.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.328+0000 7febaaffd640 1 --2- 172.21.15.22:0/1038017500 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7febac0cea20 0x7febac0ce140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:49.311 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.332+0000 7febabfff640 1 --2- 172.21.15.22:0/1038017500 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7febac152df0 0x7febac157580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:49.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.332+0000 7febab7fe640 1 -- 172.21.15.22:0/1038017500 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7febac0cea20 msgr2=0x7febac0ce140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:37:49.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.332+0000 7febab7fe640 1 --2- 172.21.15.22:0/1038017500 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7febac0cea20 0x7febac0ce140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:49.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.332+0000 7febab7fe640 1 -- 172.21.15.22:0/1038017500 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7febac152df0 msgr2=0x7febac157580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:37:49.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.332+0000 7febab7fe640 1 --2- 172.21.15.22:0/1038017500 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7febac152df0 0x7febac157580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:49.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.332+0000 7febab7fe640 1 -- 172.21.15.22:0/1038017500 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febac1591b0 con 0x7febac0c54e0 2024-05-21T13:37:49.312 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.332+0000 7febabfff640 1 --2- 172.21.15.22:0/1038017500 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7febac152df0 0x7febac157580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T13:37:49.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.332+0000 7febab7fe640 1 --2- 172.21.15.22:0/1038017500 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7febac0c54e0 0x7febac1edc60 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7feb9c00d620 tx=0x7feb9c00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:37:49.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.332+0000 7feb93fff640 1 -- 172.21.15.22:0/1038017500 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb9c00b620 con 0x7febac0c54e0 2024-05-21T13:37:49.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.332+0000 7feb93fff640 1 -- 172.21.15.22:0/1038017500 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb9c019070 con 0x7febac0c54e0 2024-05-21T13:37:49.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.332+0000 7febb1c0c640 1 -- 172.21.15.22:0/1038017500 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febac1ee1a0 con 0x7febac0c54e0 2024-05-21T13:37:49.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.332+0000 7feb93fff640 1 -- 172.21.15.22:0/1038017500 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb9c00b9e0 con 0x7febac0c54e0 2024-05-21T13:37:49.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.332+0000 7febb1c0c640 1 -- 172.21.15.22:0/1038017500 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febac159420 con 0x7febac0c54e0 2024-05-21T13:37:49.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.332+0000 7febb1c0c640 1 -- 172.21.15.22:0/1038017500 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febac0697d0 con 0x7febac0c54e0 2024-05-21T13:37:49.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.332+0000 7feb93fff640 1 -- 172.21.15.22:0/1038017500 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7feb9c00bb80 con 0x7febac0c54e0 2024-05-21T13:37:49.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.336+0000 7feb93fff640 1 --2- 172.21.15.22:0/1038017500 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7feb9806f450 0x7feb98071910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:49.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.336+0000 7febaaffd640 1 --2- 172.21.15.22:0/1038017500 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7feb9806f450 0x7feb98071910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:49.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.336+0000 7febaaffd640 1 --2- 172.21.15.22:0/1038017500 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7feb9806f450 0x7feb98071910 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7febac156650 tx=0x7feba0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:37:49.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.340+0000 7feb93fff640 1 -- 172.21.15.22:0/1038017500 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7feb9c08d3d0 con 0x7febac0c54e0 2024-05-21T13:37:49.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.344+0000 7feb93fff640 1 -- 172.21.15.22:0/1038017500 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7feb9c05bd10 con 0x7febac0c54e0 2024-05-21T13:37:49.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.732+0000 7febb1c0c640 1 -- 172.21.15.22:0/1038017500 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7febac074760 con 0x7febac0c54e0 2024-05-21T13:37:49.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.732+0000 7feb93fff640 1 -- 172.21.15.22:0/1038017500 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6875 (secure 0 0 0) 0x7feb9c05b610 con 0x7febac0c54e0 2024-05-21T13:37:49.714 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-21T13:37:49.714 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4224,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/355756580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":355756580},{"type":"v1","addr":"172.21.15.22:6833","nonce":355756580}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4230,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3277017116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":3277017116},{"type":"v1","addr":"172.21.15.22:6835","nonce":3277017116}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4233,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3840772609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3840772609},{"type":"v1","addr":"172.21.15.22:6837","nonce":3840772609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-21T13:35:57.106892+0000","modified":"2024-05-21T13:36:32.396351+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4300,"mds_1":4294,"mds_2":4248},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4248":{"gid":4248,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":12,"addr":"172.21.15.115:6837/2009761279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":2009761279},{"type":"v1","addr":"172.21.15.115:6837","nonce":2009761279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4294":{"gid":4294,"name":"b","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.115:6835/3894678097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3894678097},{"type":"v1","addr":"172.21.15.115:6835","nonce":3894678097}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4300":{"gid":4300,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.115:6839/1525097577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6838","nonce":1525097577},{"type":"v1","addr":"172.21.15.115:6839","nonce":1525097577}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4300,"qdb_cluster":[4248,4300,4294]},"id":1}]} 2024-05-21T13:37:49.714 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 14 2024-05-21T13:37:49.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.736+0000 7febb1c0c640 1 -- 172.21.15.22:0/1038017500 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7feb9806f450 msgr2=0x7feb98071910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:37:49.716 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.736+0000 7febb1c0c640 1 --2- 172.21.15.22:0/1038017500 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7feb9806f450 0x7feb98071910 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7febac156650 tx=0x7feba0008040 comp rx=0 tx=0).stop 2024-05-21T13:37:49.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.736+0000 7febb1c0c640 1 -- 172.21.15.22:0/1038017500 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7febac0c54e0 msgr2=0x7febac1edc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:37:49.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.736+0000 7febb1c0c640 1 --2- 172.21.15.22:0/1038017500 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7febac0c54e0 0x7febac1edc60 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7feb9c00d620 tx=0x7feb9c00dae0 comp rx=0 tx=0).stop 2024-05-21T13:37:49.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.736+0000 7febb1c0c640 1 -- 172.21.15.22:0/1038017500 shutdown_connections 2024-05-21T13:37:49.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.736+0000 7febb1c0c640 1 --2- 172.21.15.22:0/1038017500 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7feb9806f450 0x7feb98071910 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:49.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.736+0000 7febb1c0c640 1 --2- 172.21.15.22:0/1038017500 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7febac152df0 0x7febac157580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:49.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.736+0000 7febb1c0c640 1 --2- 172.21.15.22:0/1038017500 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7febac0cea20 0x7febac0ce140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:49.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.736+0000 7febb1c0c640 1 --2- 172.21.15.22:0/1038017500 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7febac0c54e0 0x7febac1edc60 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:49.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.736+0000 7febb1c0c640 1 -- 172.21.15.22:0/1038017500 >> 172.21.15.22:0/1038017500 conn(0x7febac06fd30 msgr2=0x7febac06d230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:37:49.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.736+0000 7febb1c0c640 1 -- 172.21.15.22:0/1038017500 shutdown_connections 2024-05-21T13:37:49.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.736+0000 7febb1c0c640 1 -- 172.21.15.22:0/1038017500 wait complete. 2024-05-21T13:37:49.736 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4300 quiesce db --set-id 47970f0f --release --await' 2024-05-21T13:37:49.737 DEBUG:teuthology.orchestra.run.smithi022:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4300 quiesce db --set-id 47970f0f --release --await 2024-05-21T13:37:49.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.932+0000 7fb0e8e5c640 1 Processor -- start 2024-05-21T13:37:49.911 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.932+0000 7fb0e8e5c640 1 -- start start 2024-05-21T13:37:49.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.932+0000 7fb0e8e5c640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb0e4071770 0x7fb0e4153730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:49.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.932+0000 7fb0e8e5c640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0e40c4630 con 0x7fb0e40c5020 2024-05-21T13:37:49.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.932+0000 7fb0e8e5c640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0e40c4910 con 0x7fb0e40c5400 2024-05-21T13:37:49.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.932+0000 7fb0e8e5c640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fb0e40702d0 con 0x7fb0e4071770 2024-05-21T13:37:49.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.932+0000 7fb0e2d9d640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb0e4071770 0x7fb0e4153730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:49.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.932+0000 7fb0e259c640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fb0e40c5020 0x7fb0e415a390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:37902/0 (socket says 172.21.15.22:37902) 2024-05-21T13:37:49.912 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.932+0000 7fb0e259c640 1 -- 172.21.15.22:0/623298794 learned_addr learned my addr 172.21.15.22:0/623298794 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-21T13:37:49.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.932+0000 7fb0e1d9b640 1 -- 172.21.15.22:0/623298794 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4140725224 0 0) 0x7fb0e40c4630 con 0x7fb0e40c5020 2024-05-21T13:37:49.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.932+0000 7fb0e1d9b640 1 -- 172.21.15.22:0/623298794 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb0d0003530 con 0x7fb0e40c5020 2024-05-21T13:37:49.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.932+0000 7fb0e2d9d640 1 -- 172.21.15.22:0/623298794 >> v1:172.21.15.115:6789/0 conn(0x7fb0e40c5400 legacy=0x7fb0e40cb240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:37:49.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.932+0000 7fb0e2d9d640 1 -- 172.21.15.22:0/623298794 >> v1:172.21.15.22:6789/0 conn(0x7fb0e40c5020 legacy=0x7fb0e415a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:37:49.914 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.932+0000 7fb0e2d9d640 1 -- 172.21.15.22:0/623298794 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0e40705b0 con 0x7fb0e4071770 2024-05-21T13:37:49.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.936+0000 7fb0e2d9d640 1 --2- 172.21.15.22:0/623298794 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb0e4071770 0x7fb0e4153730 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc009d90 tx=0x7fb0dc01f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=806e83822d3fd8dc server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:37:49.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.936+0000 7fb0e1d9b640 1 -- 172.21.15.22:0/623298794 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0dc0b4070 con 0x7fb0e4071770 2024-05-21T13:37:49.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.936+0000 7fb0e1d9b640 1 -- 172.21.15.22:0/623298794 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0dc0af600 con 0x7fb0e4071770 2024-05-21T13:37:49.916 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.936+0000 7fb0e1d9b640 1 -- 172.21.15.22:0/623298794 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0dc0af9b0 con 0x7fb0e4071770 2024-05-21T13:37:49.917 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.936+0000 7fb0e8e5c640 1 -- 172.21.15.22:0/623298794 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb0e4071770 msgr2=0x7fb0e4153730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:37:49.917 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.936+0000 7fb0e8e5c640 1 --2- 172.21.15.22:0/623298794 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb0e4071770 0x7fb0e4153730 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc009d90 tx=0x7fb0dc01f150 comp rx=0 tx=0).stop 2024-05-21T13:37:49.917 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.936+0000 7fb0e8e5c640 1 -- 172.21.15.22:0/623298794 shutdown_connections 2024-05-21T13:37:49.917 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.936+0000 7fb0e8e5c640 1 --2- 172.21.15.22:0/623298794 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb0e4071770 0x7fb0e4153730 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:49.917 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.936+0000 7fb0e8e5c640 1 -- 172.21.15.22:0/623298794 >> 172.21.15.22:0/623298794 conn(0x7fb0e4072090 msgr2=0x7fb0e40724a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:37:49.917 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.936+0000 7fb0e8e5c640 1 -- 172.21.15.22:0/623298794 shutdown_connections 2024-05-21T13:37:49.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.936+0000 7fb0e8e5c640 1 -- 172.21.15.22:0/623298794 wait complete. 2024-05-21T13:37:49.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.940+0000 7fb0e8e5c640 1 Processor -- start 2024-05-21T13:37:49.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.940+0000 7fb0e8e5c640 1 -- start start 2024-05-21T13:37:49.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.940+0000 7fb0e8e5c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb0e4071770 0x7fb0e40ca700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:49.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.940+0000 7fb0e8e5c640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb0e40c5020 0x7fb0e41f3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:49.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.940+0000 7fb0e8e5c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb0e40c5400 0x7fb0e41512b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:49.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.940+0000 7fb0e8e5c640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb0e4071090 con 0x7fb0e4071770 2024-05-21T13:37:49.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.940+0000 7fb0e8e5c640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fb0e4070b70 con 0x7fb0e40c5400 2024-05-21T13:37:49.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.940+0000 7fb0e8e5c640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7fb0e41f33a0 con 0x7fb0e40c5020 2024-05-21T13:37:49.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.940+0000 7fb0e259c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb0e4071770 0x7fb0e40ca700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:49.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.940+0000 7fb0e259c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb0e4071770 0x7fb0e40ca700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33874/0 (socket says 172.21.15.22:33874) 2024-05-21T13:37:49.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.940+0000 7fb0e259c640 1 -- 172.21.15.22:0/1187418870 learned_addr learned my addr 172.21.15.22:0/1187418870 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:37:49.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.940+0000 7fb0e2d9d640 1 --2- 172.21.15.22:0/1187418870 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb0e40c5400 0x7fb0e41512b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:49.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.940+0000 7fb0e259c640 1 -- 172.21.15.22:0/1187418870 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb0e40c5020 msgr2=0x7fb0e41f3830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:37:49.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.940+0000 7fb0e259c640 1 --2- 172.21.15.22:0/1187418870 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb0e40c5020 0x7fb0e41f3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:49.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.940+0000 7fb0e259c640 1 -- 172.21.15.22:0/1187418870 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb0e40c5400 msgr2=0x7fb0e41512b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:37:49.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.940+0000 7fb0e259c640 1 --2- 172.21.15.22:0/1187418870 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb0e40c5400 0x7fb0e41512b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:49.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.940+0000 7fb0e259c640 1 -- 172.21.15.22:0/1187418870 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0e4149590 con 0x7fb0e4071770 2024-05-21T13:37:49.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.940+0000 7fb0e259c640 1 --2- 172.21.15.22:0/1187418870 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb0e4071770 0x7fb0e40ca700 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fb0d400c4d0 tx=0x7fb0d400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:37:49.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.940+0000 7fb0daffd640 1 -- 172.21.15.22:0/1187418870 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0d4017070 con 0x7fb0e4071770 2024-05-21T13:37:49.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.940+0000 7fb0daffd640 1 -- 172.21.15.22:0/1187418870 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0d4005cf0 con 0x7fb0e4071770 2024-05-21T13:37:49.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.940+0000 7fb0e8e5c640 1 -- 172.21.15.22:0/1187418870 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0e4148cc0 con 0x7fb0e4071770 2024-05-21T13:37:49.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.940+0000 7fb0daffd640 1 -- 172.21.15.22:0/1187418870 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0d4007270 con 0x7fb0e4071770 2024-05-21T13:37:49.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.944+0000 7fb0daffd640 1 -- 172.21.15.22:0/1187418870 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fb0d401a070 con 0x7fb0e4071770 2024-05-21T13:37:49.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.944+0000 7fb0e8e5c640 1 -- 172.21.15.22:0/1187418870 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0e4147d20 con 0x7fb0e4071770 2024-05-21T13:37:49.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.944+0000 7fb0daffd640 1 --2- 172.21.15.22:0/1187418870 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fb0c406f430 0x7fb0c40718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:49.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.944+0000 7fb0daffd640 1 -- 172.21.15.22:0/1187418870 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7fb0d4093060 con 0x7fb0e4071770 2024-05-21T13:37:49.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.944+0000 7fb0dbfff640 1 --2- 172.21.15.22:0/1187418870 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fb0c406f430 0x7fb0c40718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:49.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.948+0000 7fb0dbfff640 1 --2- 172.21.15.22:0/1187418870 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fb0c406f430 0x7fb0c40718f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc006fd0 tx=0x7fb0cc006bc0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:37:49.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.948+0000 7fb0ebfe7000 1 Processor -- start 2024-05-21T13:37:49.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.948+0000 7fb0ebfe7000 1 -- start start 2024-05-21T13:37:49.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.948+0000 7fb0ebfe7000 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x556569feb900 0x556569febce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:49.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.948+0000 7fb0ebfe7000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55656a022350 0x55656a022730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:49.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.948+0000 7fb0ebfe7000 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55656a022c70 0x55656a027620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:49.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.948+0000 7fb0e2d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55656a022c70 0x55656a027620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:49.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.948+0000 7fb0e2d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55656a022c70 0x55656a027620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33882/0 (socket says 172.21.15.22:33882) 2024-05-21T13:37:49.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.948+0000 7fb0dbfff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55656a022350 0x55656a022730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:49.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.948+0000 7fb0e2d9d640 1 -- 172.21.15.22:0/1037516320 learned_addr learned my addr 172.21.15.22:0/1037516320 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:37:49.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.948+0000 7fb0e259c640 1 --2- 172.21.15.22:0/1037516320 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x556569feb900 0x556569febce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:49.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.948+0000 7fb0ebfe7000 1 -- 172.21.15.22:0/1037516320 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x556569e418a0 con 0x55656a022c70 2024-05-21T13:37:49.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.948+0000 7fb0ebfe7000 1 -- 172.21.15.22:0/1037516320 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x556569e31440 con 0x55656a022350 2024-05-21T13:37:49.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.948+0000 7fb0ebfe7000 1 -- 172.21.15.22:0/1037516320 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x556569e35480 con 0x556569feb900 2024-05-21T13:37:49.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.948+0000 7fb0e2d9d640 1 -- 172.21.15.22:0/1037516320 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x556569feb900 msgr2=0x556569febce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:37:49.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.948+0000 7fb0e2d9d640 1 --2- 172.21.15.22:0/1037516320 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x556569feb900 0x556569febce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:49.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.948+0000 7fb0e2d9d640 1 -- 172.21.15.22:0/1037516320 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55656a022350 msgr2=0x55656a022730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:37:49.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.948+0000 7fb0e2d9d640 1 --2- 172.21.15.22:0/1037516320 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55656a022350 0x55656a022730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:49.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.948+0000 7fb0e2d9d640 1 -- 172.21.15.22:0/1037516320 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556569edd370 con 0x55656a022c70 2024-05-21T13:37:49.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.948+0000 7fb0e2d9d640 1 --2- 172.21.15.22:0/1037516320 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55656a022c70 0x55656a027620 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc009e80 tx=0x7fb0dc004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd967cbecf589bdf server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:37:49.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.948+0000 7fb0c3fff640 1 -- 172.21.15.22:0/1037516320 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0dc0be030 con 0x55656a022c70 2024-05-21T13:37:49.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.952+0000 7fb0c3fff640 1 -- 172.21.15.22:0/1037516320 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0dc003ba0 con 0x55656a022c70 2024-05-21T13:37:49.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.952+0000 7fb0c3fff640 1 -- 172.21.15.22:0/1037516320 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0dc0b4040 con 0x55656a022c70 2024-05-21T13:37:49.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.952+0000 7fb0ebfe7000 1 -- 172.21.15.22:0/1037516320 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55656a022c70 msgr2=0x55656a027620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:37:49.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.952+0000 7fb0ebfe7000 1 --2- 172.21.15.22:0/1037516320 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55656a022c70 0x55656a027620 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb0dc009e80 tx=0x7fb0dc004ac0 comp rx=0 tx=0).stop 2024-05-21T13:37:49.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.952+0000 7fb0ebfe7000 1 -- 172.21.15.22:0/1037516320 shutdown_connections 2024-05-21T13:37:49.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.952+0000 7fb0ebfe7000 1 --2- 172.21.15.22:0/1037516320 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55656a022c70 0x55656a027620 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:49.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.952+0000 7fb0ebfe7000 1 --2- 172.21.15.22:0/1037516320 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55656a022350 0x55656a022730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:49.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.952+0000 7fb0ebfe7000 1 --2- 172.21.15.22:0/1037516320 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x556569feb900 0x556569febce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:49.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.952+0000 7fb0ebfe7000 1 -- 172.21.15.22:0/1037516320 >> 172.21.15.22:0/1037516320 conn(0x556569ecef90 msgr2=0x55656a0253e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:37:49.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.952+0000 7fb0ebfe7000 1 -- 172.21.15.22:0/1037516320 shutdown_connections 2024-05-21T13:37:49.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.952+0000 7fb0ebfe7000 1 -- 172.21.15.22:0/1037516320 wait complete. 2024-05-21T13:37:49.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.952+0000 7fb0ebfe7000 1 -- start start 2024-05-21T13:37:49.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.952+0000 7fb0ebfe7000 1 Processor -- start 2024-05-21T13:37:49.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.952+0000 7fb0ebfe7000 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x556569feb900 0x55656a021690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:49.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.952+0000 7fb0ebfe7000 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55656a022350 0x55656a021bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:49.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.952+0000 7fb0ebfe7000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55656a022c70 0x55656a035d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:49.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.952+0000 7fb0ebfe7000 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x556569dd84d0 con 0x55656a022350 2024-05-21T13:37:49.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.952+0000 7fb0ebfe7000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x556569e39ab0 con 0x55656a022c70 2024-05-21T13:37:49.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.952+0000 7fb0ebfe7000 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x556569fecde0 con 0x556569feb900 2024-05-21T13:37:49.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.952+0000 7fb0ebfe7000 10 client.0 _ll_register_callbacks cb 0x556569dd3ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-21T13:37:49.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.952+0000 7fb0dbfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55656a022350 0x55656a021bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:49.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.952+0000 7fb0dbfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55656a022350 0x55656a021bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33884/0 (socket says 172.21.15.22:33884) 2024-05-21T13:37:49.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.952+0000 7fb0dbfff640 1 -- 172.21.15.22:0/1599863623 learned_addr learned my addr 172.21.15.22:0/1599863623 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:37:49.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.952+0000 7fb0e259c640 1 --2- 172.21.15.22:0/1599863623 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x556569feb900 0x55656a021690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:49.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.952+0000 7fb0e2d9d640 1 --2- 172.21.15.22:0/1599863623 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55656a022c70 0x55656a035d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:49.937 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.956+0000 7fb0dbfff640 1 -- 172.21.15.22:0/1599863623 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x556569feb900 msgr2=0x55656a021690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:37:49.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.956+0000 7fb0dbfff640 1 --2- 172.21.15.22:0/1599863623 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x556569feb900 0x55656a021690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:49.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.956+0000 7fb0dbfff640 1 -- 172.21.15.22:0/1599863623 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55656a022c70 msgr2=0x55656a035d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:37:49.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.956+0000 7fb0dbfff640 1 --2- 172.21.15.22:0/1599863623 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55656a022c70 0x55656a035d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:49.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.956+0000 7fb0dbfff640 1 -- 172.21.15.22:0/1599863623 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556569e7b260 con 0x55656a022350 2024-05-21T13:37:49.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.956+0000 7fb0dbfff640 1 --2- 172.21.15.22:0/1599863623 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55656a022350 0x55656a021bd0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc0069b0 tx=0x7fb0cc004750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17b065a61d0272f server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:37:49.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.956+0000 7fb0c17fa640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-05-21T13:37:49.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.956+0000 7fb0c17fa640 1 -- 172.21.15.22:0/1599863623 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0cc005de0 con 0x55656a022350 2024-05-21T13:37:49.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.956+0000 7fb0c17fa640 1 -- 172.21.15.22:0/1599863623 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7fb0cc004020 con 0x55656a022350 2024-05-21T13:37:49.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.956+0000 7fb0ebfe7000 1 -- 172.21.15.22:0/1599863623 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb0dc003ba0 con 0x55656a022350 2024-05-21T13:37:49.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.956+0000 7fb0c17fa640 1 -- 172.21.15.22:0/1599863623 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7fb0cc02b050 con 0x55656a022350 2024-05-21T13:37:49.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.956+0000 7fb0ebfe7000 10 client.4944 fetch_fsmap learned FSMap version 14 2024-05-21T13:37:49.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.956+0000 7fb0ebfe7000 1 -- 172.21.15.22:0/1599863623 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x556569dd86e0 con 0x55656a022350 2024-05-21T13:37:49.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.956+0000 7fb0c17fa640 1 -- 172.21.15.22:0/1599863623 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0dc003ba0 con 0x55656a022350 2024-05-21T13:37:49.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.956+0000 7fb0c17fa640 1 -- 172.21.15.22:0/1599863623 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7fb0cc02e020 con 0x55656a022350 2024-05-21T13:37:49.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.956+0000 7fb0ebfe7000 10 client.4944 fetch_fsmap finished waiting for FSMap version 14 2024-05-21T13:37:49.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.956+0000 7fb0ebfe7000 10 client.4944 resolve_mds: validated gid 4300 aka daemon mds.f 2024-05-21T13:37:49.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.956+0000 7fb0ebfe7000 20 client.4944 populate_metadata read hostname 'smithi022' 2024-05-21T13:37:49.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.956+0000 7fb0ebfe7000 1 --2- 172.21.15.22:0/1599863623 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x55656a036aa0 0x55656a036eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:49.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.956+0000 7fb0ebfe7000 4 client.4944 mds_command: new command op to 4300 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-21T13:37:49.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.956+0000 7fb0ebfe7000 1 -- 172.21.15.22:0/1599863623 --> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556569dcd060 con 0x55656a036aa0 2024-05-21T13:37:49.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.956+0000 7fb0e259c640 1 --2- 172.21.15.22:0/1599863623 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x55656a036aa0 0x55656a036eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:49.941 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.956+0000 7fb0e259c640 1 --2- 172.21.15.22:0/1599863623 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x55656a036aa0 0x55656a036eb0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d7f040905c92c1a server_cookie=667197b0bd76dbd8 in_seq=0 out_seq=0 2024-05-21T13:37:49.941 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.956+0000 7fb0c17fa640 10 client.4944 ms_handle_connect on v2:172.21.15.115:6838/1525097577 2024-05-21T13:37:49.941 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.960+0000 7fb0c17fa640 1 -- 172.21.15.22:0/1599863623 <== mds.0 v2:172.21.15.115:6838/1525097577 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x556569dcd060 con 0x55656a036aa0 2024-05-21T13:37:49.941 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.960+0000 7fb0c17fa640 10 client.4944 handle_command_reply: tid=0 2024-05-21T13:37:49.941 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.960+0000 7fb0ebfe7000 1 client.4944 shutdown 2024-05-21T13:37:49.941 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.960+0000 7fb0ebfe7000 1 -- 172.21.15.22:0/1599863623 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55656a022350 msgr2=0x55656a021bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:37:49.941 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.960+0000 7fb0ebfe7000 1 --2- 172.21.15.22:0/1599863623 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55656a022350 0x55656a021bd0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc0069b0 tx=0x7fb0cc004750 comp rx=0 tx=0).stop 2024-05-21T13:37:49.941 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.960+0000 7fb0ebfe7000 1 -- 172.21.15.22:0/1599863623 shutdown_connections 2024-05-21T13:37:49.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.960+0000 7fb0ebfe7000 1 --2- 172.21.15.22:0/1599863623 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x55656a036aa0 0x55656a036eb0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:49.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.960+0000 7fb0ebfe7000 1 --2- 172.21.15.22:0/1599863623 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55656a022c70 0x55656a035d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:49.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.960+0000 7fb0ebfe7000 1 --2- 172.21.15.22:0/1599863623 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55656a022350 0x55656a021bd0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:49.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.960+0000 7fb0ebfe7000 1 --2- 172.21.15.22:0/1599863623 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x556569feb900 0x55656a021690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:49.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.960+0000 7fb0ebfe7000 1 -- 172.21.15.22:0/1599863623 >> 172.21.15.22:0/1599863623 conn(0x556569ecef90 msgr2=0x55656a025060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:37:49.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.960+0000 7fb0c17fa640 0 client.4944 ms_handle_reset on v2:172.21.15.115:6838/1525097577 2024-05-21T13:37:49.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.960+0000 7fb0ebfe7000 1 -- 172.21.15.22:0/1599863623 shutdown_connections 2024-05-21T13:37:49.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.960+0000 7fb0ebfe7000 1 -- 172.21.15.22:0/1599863623 wait complete. 2024-05-21T13:37:49.942 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.960+0000 7fb0ebfe7000 20 client.4944 trim_cache size 0 max 16384 2024-05-21T13:37:49.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.992+0000 7fb0ebfe7000 1 Processor -- start 2024-05-21T13:37:49.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.992+0000 7fb0ebfe7000 1 -- start start 2024-05-21T13:37:49.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.992+0000 7fb0ebfe7000 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x556569feb900 0x55656a0352a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:49.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.992+0000 7fb0ebfe7000 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55656a022350 0x55656a0357e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:49.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.992+0000 7fb0ebfe7000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55656a022c70 0x55656a0464f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:49.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.992+0000 7fb0dbfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55656a022350 0x55656a0357e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:49.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.992+0000 7fb0dbfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55656a022350 0x55656a0357e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33896/0 (socket says 172.21.15.22:33896) 2024-05-21T13:37:49.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.996+0000 7fb0dbfff640 1 -- 172.21.15.22:0/3846994131 learned_addr learned my addr 172.21.15.22:0/3846994131 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:37:49.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.996+0000 7fb0ebfe7000 1 -- 172.21.15.22:0/3846994131 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb0e41fa360 con 0x55656a022350 2024-05-21T13:37:49.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.996+0000 7fb0ebfe7000 1 -- 172.21.15.22:0/3846994131 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fb0e406f120 con 0x55656a022c70 2024-05-21T13:37:49.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.996+0000 7fb0ebfe7000 1 -- 172.21.15.22:0/3846994131 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7fb0e4146540 con 0x556569feb900 2024-05-21T13:37:49.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.996+0000 7fb0e259c640 1 --2- 172.21.15.22:0/3846994131 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x556569feb900 0x55656a0352a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:49.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.996+0000 7fb0e2d9d640 1 --2- 172.21.15.22:0/3846994131 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55656a022c70 0x55656a0464f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:49.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.996+0000 7fb0dbfff640 1 -- 172.21.15.22:0/3846994131 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x556569feb900 msgr2=0x55656a0352a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:37:49.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.996+0000 7fb0dbfff640 1 --2- 172.21.15.22:0/3846994131 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x556569feb900 0x55656a0352a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:49.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.996+0000 7fb0dbfff640 1 -- 172.21.15.22:0/3846994131 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55656a022c70 msgr2=0x55656a0464f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:37:49.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.996+0000 7fb0dbfff640 1 --2- 172.21.15.22:0/3846994131 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55656a022c70 0x55656a0464f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:49.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.996+0000 7fb0dbfff640 1 -- 172.21.15.22:0/3846994131 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556569eb6cf0 con 0x55656a022350 2024-05-21T13:37:49.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.996+0000 7fb0dbfff640 1 --2- 172.21.15.22:0/3846994131 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55656a022350 0x55656a0357e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc009450 tx=0x7fb0cc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2f698c70b7956ff server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:37:49.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.996+0000 7fb0c37fe640 1 -- 172.21.15.22:0/3846994131 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0cc006610 con 0x55656a022350 2024-05-21T13:37:49.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.996+0000 7fb0c37fe640 1 -- 172.21.15.22:0/3846994131 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0cc026300 con 0x55656a022350 2024-05-21T13:37:49.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.996+0000 7fb0c37fe640 1 -- 172.21.15.22:0/3846994131 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0cc0266d0 con 0x55656a022350 2024-05-21T13:37:49.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.996+0000 7fb0ebfe7000 1 -- 172.21.15.22:0/3846994131 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55656a022350 msgr2=0x55656a0357e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:37:49.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.996+0000 7fb0ebfe7000 1 --2- 172.21.15.22:0/3846994131 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55656a022350 0x55656a0357e0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc009450 tx=0x7fb0cc017000 comp rx=0 tx=0).stop 2024-05-21T13:37:49.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.996+0000 7fb0ebfe7000 1 -- 172.21.15.22:0/3846994131 shutdown_connections 2024-05-21T13:37:49.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.996+0000 7fb0ebfe7000 1 --2- 172.21.15.22:0/3846994131 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55656a022c70 0x55656a0464f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:49.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.996+0000 7fb0ebfe7000 1 --2- 172.21.15.22:0/3846994131 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55656a022350 0x55656a0357e0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:49.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.996+0000 7fb0ebfe7000 1 --2- 172.21.15.22:0/3846994131 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x556569feb900 0x55656a0352a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:49.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.996+0000 7fb0ebfe7000 1 -- 172.21.15.22:0/3846994131 >> 172.21.15.22:0/3846994131 conn(0x556569ecef90 msgr2=0x55656a04b970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:37:49.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.996+0000 7fb0ebfe7000 1 -- 172.21.15.22:0/3846994131 shutdown_connections 2024-05-21T13:37:49.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.996+0000 7fb0ebfe7000 1 -- 172.21.15.22:0/3846994131 wait complete. 2024-05-21T13:37:49.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.996+0000 7fb0ebfe7000 1 -- start start 2024-05-21T13:37:49.983 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:49.996+0000 7fb0ebfe7000 1 Processor -- start 2024-05-21T13:37:49.983 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:50.000+0000 7fb0ebfe7000 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556569feb900 0x55656a049770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:49.983 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:50.000+0000 7fb0ebfe7000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55656a022350 0x55656a049cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:49.983 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:50.000+0000 7fb0ebfe7000 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55656a022c70 0x55656a04a1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:49.983 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:50.000+0000 7fb0ebfe7000 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x556569e2d5f0 con 0x556569feb900 2024-05-21T13:37:49.983 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:50.000+0000 7fb0ebfe7000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x556569eb6860 con 0x55656a022350 2024-05-21T13:37:49.983 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:50.000+0000 7fb0ebfe7000 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x556569dc9c50 con 0x55656a022c70 2024-05-21T13:37:49.983 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:50.000+0000 7fb0dbfff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55656a022350 0x55656a049cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:49.983 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:50.000+0000 7fb0ebfe7000 10 client.0 _ll_register_callbacks cb 0x7fb0cc005b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-21T13:37:49.983 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:50.000+0000 7fb0e2d9d640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55656a022c70 0x55656a04a1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:49.983 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:50.000+0000 7fb0dbfff640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55656a022350 0x55656a049cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3300/0 says I am v2:172.21.15.22:52198/0 (socket says 172.21.15.22:52198) 2024-05-21T13:37:49.983 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:50.000+0000 7fb0dbfff640 1 -- 172.21.15.22:0/1748557582 learned_addr learned my addr 172.21.15.22:0/1748557582 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:37:49.983 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:50.000+0000 7fb0e2d9d640 1 -- 172.21.15.22:0/1748557582 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55656a022350 msgr2=0x55656a049cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:37:49.983 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:50.000+0000 7fb0e2d9d640 1 --2- 172.21.15.22:0/1748557582 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55656a022350 0x55656a049cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:49.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:50.000+0000 7fb0e2d9d640 1 -- 172.21.15.22:0/1748557582 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556569feb900 msgr2=0x55656a049770 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-05-21T13:37:49.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:50.000+0000 7fb0e2d9d640 1 --2- 172.21.15.22:0/1748557582 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556569feb900 0x55656a049770 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:49.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:50.000+0000 7fb0e2d9d640 1 -- 172.21.15.22:0/1748557582 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) -- 0x556569de3ca0 con 0x55656a022c70 2024-05-21T13:37:49.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:50.000+0000 7fb0e2d9d640 1 --2- 172.21.15.22:0/1748557582 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55656a022c70 0x55656a04a1f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x556569df8b70 tx=0x7fb0dc01d990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f2cc18d09fbcd72 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:37:49.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:50.000+0000 7fb0c17fa640 10 client.0 ms_handle_connect on v2:172.21.15.115:3301/0 2024-05-21T13:37:49.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:50.000+0000 7fb0c17fa640 1 -- 172.21.15.22:0/1748557582 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0dc0be070 con 0x55656a022c70 2024-05-21T13:37:49.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:50.000+0000 7fb0c17fa640 1 -- 172.21.15.22:0/1748557582 <== mon.2 v2:172.21.15.115:3301/0 2 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7fb0dc0bbe10 con 0x55656a022c70 2024-05-21T13:37:49.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:50.000+0000 7fb0ebfe7000 1 -- 172.21.15.22:0/1748557582 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb0cc026300 con 0x55656a022c70 2024-05-21T13:37:49.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:50.000+0000 7fb0c17fa640 1 -- 172.21.15.22:0/1748557582 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7fb0dc0d1050 con 0x55656a022c70 2024-05-21T13:37:49.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:50.000+0000 7fb0ebfe7000 10 client.4643 fetch_fsmap learned FSMap version 14 2024-05-21T13:37:49.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:50.000+0000 7fb0ebfe7000 1 -- 172.21.15.22:0/1748557582 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x556569dc89c0 con 0x55656a022c70 2024-05-21T13:37:49.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:50.000+0000 7fb0c17fa640 1 -- 172.21.15.22:0/1748557582 <== mon.2 v2:172.21.15.115:3301/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0dc0c3460 con 0x55656a022c70 2024-05-21T13:37:49.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:50.000+0000 7fb0c17fa640 1 -- 172.21.15.22:0/1748557582 <== mon.2 v2:172.21.15.115:3301/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7fb0dc0d4020 con 0x55656a022c70 2024-05-21T13:37:49.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:50.000+0000 7fb0ebfe7000 10 client.4643 fetch_fsmap finished waiting for FSMap version 14 2024-05-21T13:37:49.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:50.000+0000 7fb0ebfe7000 10 client.4643 resolve_mds: validated gid 4300 aka daemon mds.f 2024-05-21T13:37:49.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:50.000+0000 7fb0ebfe7000 20 client.4643 populate_metadata read hostname 'smithi022' 2024-05-21T13:37:49.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:50.000+0000 7fb0ebfe7000 1 --2- 172.21.15.22:0/1748557582 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x55656a0ae5e0 0x55656a0b09d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:37:49.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:50.000+0000 7fb0ebfe7000 4 client.4643 mds_command: new command op to 4300 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "47970f0f", "release": true, "await": true}] 2024-05-21T13:37:49.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:50.000+0000 7fb0ebfe7000 1 -- 172.21.15.22:0/1748557582 --> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] -- command(tid 0: {"prefix": "quiesce db", "set_id": "47970f0f", "release": true, "await": true}) -- 0x7fb0cc026300 con 0x55656a0ae5e0 2024-05-21T13:37:49.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:50.008+0000 7fb0e259c640 1 --2- 172.21.15.22:0/1748557582 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x55656a0ae5e0 0x55656a0b09d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:37:49.988 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:50.008+0000 7fb0e259c640 1 --2- 172.21.15.22:0/1748557582 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x55656a0ae5e0 0x55656a0b09d0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e1e43e2d97cefb7f server_cookie=84f720d3e53e0b91 in_seq=0 out_seq=0 2024-05-21T13:37:49.988 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:50.008+0000 7fb0c17fa640 10 client.4643 ms_handle_connect on v2:172.21.15.115:6838/1525097577 2024-05-21T13:37:49.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:50.008+0000 7fb0c17fa640 1 -- 172.21.15.22:0/1748557582 <== mds.0 v2:172.21.15.115:6838/1525097577 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x7fb0cc026300 con 0x55656a0ae5e0 2024-05-21T13:37:49.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:50.008+0000 7fb0c17fa640 10 client.4643 handle_command_reply: tid=0 2024-05-21T13:37:49.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:50.008+0000 7fb0ebfe7000 1 client.4643 shutdown 2024-05-21T13:37:49.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:50.008+0000 7fb0ebfe7000 1 -- 172.21.15.22:0/1748557582 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55656a022c70 msgr2=0x55656a04a1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:37:49.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:50.012+0000 7fb0ebfe7000 1 --2- 172.21.15.22:0/1748557582 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55656a022c70 0x55656a04a1f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x556569df8b70 tx=0x7fb0dc01d990 comp rx=0 tx=0).stop 2024-05-21T13:37:49.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:50.012+0000 7fb0ebfe7000 1 -- 172.21.15.22:0/1748557582 shutdown_connections 2024-05-21T13:37:49.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:50.012+0000 7fb0ebfe7000 1 --2- 172.21.15.22:0/1748557582 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55656a022c70 0x55656a04a1f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:49.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:50.012+0000 7fb0ebfe7000 1 --2- 172.21.15.22:0/1748557582 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x55656a0ae5e0 0x55656a0b09d0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:49.991 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:50.012+0000 7fb0ebfe7000 1 --2- 172.21.15.22:0/1748557582 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55656a022350 0x55656a049cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:49.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:50.012+0000 7fb0c17fa640 0 client.4643 ms_handle_reset on v2:172.21.15.115:6838/1525097577 2024-05-21T13:37:49.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:50.012+0000 7fb0ebfe7000 1 --2- 172.21.15.22:0/1748557582 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556569feb900 0x55656a049770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:49.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:50.012+0000 7fb0ebfe7000 1 -- 172.21.15.22:0/1748557582 >> 172.21.15.22:0/1748557582 conn(0x556569ecef90 msgr2=0x55656a034290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:37:49.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:50.012+0000 7fb0ebfe7000 1 -- 172.21.15.22:0/1748557582 shutdown_connections 2024-05-21T13:37:49.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:50.012+0000 7fb0ebfe7000 1 -- 172.21.15.22:0/1748557582 wait complete. 2024-05-21T13:37:49.992 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:50.012+0000 7fb0ebfe7000 20 client.4643 trim_cache size 0 max 16384 2024-05-21T13:37:49.992 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-05-21T13:37:49.992 INFO:teuthology.orchestra.run.smithi022.stdout: "epoch": 14, 2024-05-21T13:37:49.992 INFO:teuthology.orchestra.run.smithi022.stdout: "leader": 4300, 2024-05-21T13:37:49.992 INFO:teuthology.orchestra.run.smithi022.stdout: "set_version": 8, 2024-05-21T13:37:49.993 INFO:teuthology.orchestra.run.smithi022.stdout: "sets": { 2024-05-21T13:37:49.993 INFO:teuthology.orchestra.run.smithi022.stdout: "47970f0f": { 2024-05-21T13:37:49.993 INFO:teuthology.orchestra.run.smithi022.stdout: "version": 8, 2024-05-21T13:37:49.993 INFO:teuthology.orchestra.run.smithi022.stdout: "age_ref": 0.0, 2024-05-21T13:37:49.993 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-05-21T13:37:49.993 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RELEASED", 2024-05-21T13:37:49.993 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-05-21T13:37:49.993 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-05-21T13:37:49.993 INFO:teuthology.orchestra.run.smithi022.stdout: "timeout": 90.0, 2024-05-21T13:37:49.993 INFO:teuthology.orchestra.run.smithi022.stdout: "expiration": 144.2, 2024-05-21T13:37:49.993 INFO:teuthology.orchestra.run.smithi022.stdout: "members": { 2024-05-21T13:37:49.993 INFO:teuthology.orchestra.run.smithi022.stdout: "file:/": { 2024-05-21T13:37:49.993 INFO:teuthology.orchestra.run.smithi022.stdout: "excluded": false, 2024-05-21T13:37:49.994 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-05-21T13:37:49.994 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RELEASED", 2024-05-21T13:37:49.994 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-05-21T13:37:49.994 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-05-21T13:37:49.994 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-05-21T13:37:49.994 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-05-21T13:37:49.994 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-05-21T13:37:49.994 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-05-21T13:37:49.994 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-05-21T13:37:49.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:50.012+0000 7fb0e8e5c640 1 -- 172.21.15.22:0/1187418870 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fb0c406f430 msgr2=0x7fb0c40718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:37:49.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:50.012+0000 7fb0e8e5c640 1 --2- 172.21.15.22:0/1187418870 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fb0c406f430 0x7fb0c40718f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb0cc006fd0 tx=0x7fb0cc006bc0 comp rx=0 tx=0).stop 2024-05-21T13:37:49.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:50.012+0000 7fb0e8e5c640 1 -- 172.21.15.22:0/1187418870 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb0e4071770 msgr2=0x7fb0e40ca700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:37:49.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:50.012+0000 7fb0e8e5c640 1 --2- 172.21.15.22:0/1187418870 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb0e4071770 0x7fb0e40ca700 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fb0d400c4d0 tx=0x7fb0d400c990 comp rx=0 tx=0).stop 2024-05-21T13:37:49.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:50.012+0000 7fb0e8e5c640 1 -- 172.21.15.22:0/1187418870 shutdown_connections 2024-05-21T13:37:49.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:50.012+0000 7fb0e8e5c640 1 --2- 172.21.15.22:0/1187418870 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fb0c406f430 0x7fb0c40718f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:49.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:50.012+0000 7fb0e8e5c640 1 --2- 172.21.15.22:0/1187418870 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb0e40c5400 0x7fb0e41512b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:49.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:50.012+0000 7fb0e8e5c640 1 --2- 172.21.15.22:0/1187418870 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb0e40c5020 0x7fb0e41f3830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:49.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:50.012+0000 7fb0e8e5c640 1 --2- 172.21.15.22:0/1187418870 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb0e4071770 0x7fb0e40ca700 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:37:49.995 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:50.012+0000 7fb0e8e5c640 1 -- 172.21.15.22:0/1187418870 >> 172.21.15.22:0/1187418870 conn(0x7fb0e4072090 msgr2=0x7fb0e415a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:37:49.996 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:50.012+0000 7fb0e8e5c640 1 -- 172.21.15.22:0/1187418870 shutdown_connections 2024-05-21T13:37:49.996 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:37:50.012+0000 7fb0e8e5c640 1 -- 172.21.15.22:0/1187418870 wait complete. 2024-05-21T13:37:50.014 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '47970f0f', total seconds elapsed: 25.1 2024-05-21T13:37:59.388 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-21T13:37:59.391 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-21T13:38:09.413 INFO:tasks.workunit.client.0.smithi022.stderr:Updating files: 96% (11829/12271) Updating files: 97% (11903/12271) Updating files: 98% (12026/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-05-21T13:38:10.162 INFO:tasks.workunit.client.0.smithi022.stderr:Note: switching to '7956b5e965f6ee5669688b5643c11d881b72442c'. 2024-05-21T13:38:10.163 INFO:tasks.workunit.client.0.smithi022.stderr: 2024-05-21T13:38:10.163 INFO:tasks.workunit.client.0.smithi022.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-05-21T13:38:10.163 INFO:tasks.workunit.client.0.smithi022.stderr:changes and commit them, and you can discard any commits you make in this 2024-05-21T13:38:10.163 INFO:tasks.workunit.client.0.smithi022.stderr:state without impacting any branches by switching back to a branch. 2024-05-21T13:38:10.163 INFO:tasks.workunit.client.0.smithi022.stderr: 2024-05-21T13:38:10.163 INFO:tasks.workunit.client.0.smithi022.stderr:If you want to create a new branch to retain commits you create, you may 2024-05-21T13:38:10.163 INFO:tasks.workunit.client.0.smithi022.stderr:do so (now or later) by using -c with the switch command. Example: 2024-05-21T13:38:10.163 INFO:tasks.workunit.client.0.smithi022.stderr: 2024-05-21T13:38:10.163 INFO:tasks.workunit.client.0.smithi022.stderr: git switch -c 2024-05-21T13:38:10.163 INFO:tasks.workunit.client.0.smithi022.stderr: 2024-05-21T13:38:10.163 INFO:tasks.workunit.client.0.smithi022.stderr:Or undo this operation with: 2024-05-21T13:38:10.163 INFO:tasks.workunit.client.0.smithi022.stderr: 2024-05-21T13:38:10.163 INFO:tasks.workunit.client.0.smithi022.stderr: git switch - 2024-05-21T13:38:10.164 INFO:tasks.workunit.client.0.smithi022.stderr: 2024-05-21T13:38:10.164 INFO:tasks.workunit.client.0.smithi022.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-05-21T13:38:10.164 INFO:tasks.workunit.client.0.smithi022.stderr: 2024-05-21T13:38:10.164 INFO:tasks.workunit.client.0.smithi022.stderr:HEAD is now at 7956b5e965f mds/quiesce: overdrive an export if it hasn't frozen the tree yet 2024-05-21T13:38:10.169 DEBUG:teuthology.orchestra.run.smithi022:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-05-21T13:38:10.176 INFO:tasks.workunit.client.0.smithi022.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-05-21T13:38:10.180 INFO:tasks.workunit.client.0.smithi022.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-21T13:38:10.180 INFO:tasks.workunit.client.0.smithi022.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-05-21T13:38:10.932 INFO:tasks.workunit.client.0.smithi022.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-05-21T13:38:11.017 INFO:tasks.workunit.client.0.smithi022.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-05-21T13:38:11.074 INFO:tasks.workunit.client.0.smithi022.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-05-21T13:38:11.075 INFO:tasks.workunit.client.0.smithi022.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-21T13:38:11.075 INFO:tasks.workunit.client.0.smithi022.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-05-21T13:38:11.122 INFO:tasks.workunit.client.0.smithi022.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-05-21T13:38:11.127 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-05-21T13:38:11.127 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-05-21T13:38:11.175 INFO:tasks.workunit:Running workunits matching suites/iozone.sh on client.0... 2024-05-21T13:38:11.176 INFO:tasks.workunit:Running workunit suites/iozone.sh... 2024-05-21T13:38:11.177 DEBUG:teuthology.orchestra.run.smithi022:workunit test suites/iozone.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7956b5e965f6ee5669688b5643c11d881b72442c TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/iozone.sh 2024-05-21T13:38:11.238 INFO:tasks.workunit.client.0.smithi022.stderr:+ iozone -c -e -s 1024M -r 16K -t 1 -F f1 -i 0 -i 1 2024-05-21T13:38:11.346 INFO:tasks.workunit.client.0.smithi022.stdout: Iozone: Performance Test of File I/O 2024-05-21T13:38:11.346 INFO:tasks.workunit.client.0.smithi022.stdout: Version $Revision: 3.489 $ 2024-05-21T13:38:11.347 INFO:tasks.workunit.client.0.smithi022.stdout: Compiled for 64 bit mode. 2024-05-21T13:38:11.347 INFO:tasks.workunit.client.0.smithi022.stdout: Build: linux-AMD64 2024-05-21T13:38:11.347 INFO:tasks.workunit.client.0.smithi022.stdout: 2024-05-21T13:38:11.347 INFO:tasks.workunit.client.0.smithi022.stdout: Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins 2024-05-21T13:38:11.347 INFO:tasks.workunit.client.0.smithi022.stdout: Al Slater, Scott Rhine, Mike Wisner, Ken Goss 2024-05-21T13:38:11.347 INFO:tasks.workunit.client.0.smithi022.stdout: Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, 2024-05-21T13:38:11.347 INFO:tasks.workunit.client.0.smithi022.stdout: Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, 2024-05-21T13:38:11.347 INFO:tasks.workunit.client.0.smithi022.stdout: Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, 2024-05-21T13:38:11.347 INFO:tasks.workunit.client.0.smithi022.stdout: Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, 2024-05-21T13:38:11.347 INFO:tasks.workunit.client.0.smithi022.stdout: Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, 2024-05-21T13:38:11.347 INFO:tasks.workunit.client.0.smithi022.stdout: Vangel Bojaxhi, Ben England, Vikentsi Lapa, 2024-05-21T13:38:11.347 INFO:tasks.workunit.client.0.smithi022.stdout: Alexey Skidanov, Sudhir Kumar. 2024-05-21T13:38:11.347 INFO:tasks.workunit.client.0.smithi022.stdout: 2024-05-21T13:38:11.347 INFO:tasks.workunit.client.0.smithi022.stdout: Run began: Tue May 21 13:38:11 2024 2024-05-21T13:38:11.348 INFO:tasks.workunit.client.0.smithi022.stdout: 2024-05-21T13:38:11.348 INFO:tasks.workunit.client.0.smithi022.stdout: Include close in write timing 2024-05-21T13:38:11.348 INFO:tasks.workunit.client.0.smithi022.stdout: Include fsync in write timing 2024-05-21T13:38:11.348 INFO:tasks.workunit.client.0.smithi022.stdout: File size set to 1048576 kB 2024-05-21T13:38:11.348 INFO:tasks.workunit.client.0.smithi022.stdout: Record Size 16 kB 2024-05-21T13:38:11.348 INFO:tasks.workunit.client.0.smithi022.stdout: Command line used: iozone -c -e -s 1024M -r 16K -t 1 -F f1 -i 0 -i 1 2024-05-21T13:38:11.348 INFO:tasks.workunit.client.0.smithi022.stdout: Output is in kBytes/sec 2024-05-21T13:38:11.348 INFO:tasks.workunit.client.0.smithi022.stdout: Time Resolution = 0.000001 seconds. 2024-05-21T13:38:11.348 INFO:tasks.workunit.client.0.smithi022.stdout: Processor cache size set to 1024 kBytes. 2024-05-21T13:38:11.348 INFO:tasks.workunit.client.0.smithi022.stdout: Processor cache line size set to 32 bytes. 2024-05-21T13:38:11.348 INFO:tasks.workunit.client.0.smithi022.stdout: File stride size set to 17 * record size. 2024-05-21T13:38:11.348 INFO:tasks.workunit.client.0.smithi022.stdout: Throughput test with 1 process 2024-05-21T13:38:11.348 INFO:tasks.workunit.client.0.smithi022.stdout: Each process writes a 1048576 kByte file in 16 kByte records 2024-05-21T13:38:28.950 INFO:tasks.workunit.client.0.smithi022.stdout: 2024-05-21T13:38:28.951 INFO:tasks.workunit.client.0.smithi022.stdout: Children see throughput for 1 initial writers = 59582.51 kB/sec 2024-05-21T13:38:28.951 INFO:tasks.workunit.client.0.smithi022.stdout: Parent sees throughput for 1 initial writers = 59580.32 kB/sec 2024-05-21T13:38:28.951 INFO:tasks.workunit.client.0.smithi022.stdout: Min throughput per process = 59582.51 kB/sec 2024-05-21T13:38:28.951 INFO:tasks.workunit.client.0.smithi022.stdout: Max throughput per process = 59582.51 kB/sec 2024-05-21T13:38:28.951 INFO:tasks.workunit.client.0.smithi022.stdout: Avg throughput per process = 59582.51 kB/sec 2024-05-21T13:38:28.951 INFO:tasks.workunit.client.0.smithi022.stdout: Min xfer = 1048576.00 kB 2024-05-21T13:38:29.517 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-21T13:38:29.520 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-21T13:38:45.671 INFO:tasks.workunit.client.0.smithi022.stdout: 2024-05-21T13:38:45.671 INFO:tasks.workunit.client.0.smithi022.stdout: Children see throughput for 1 rewriters = 100256.72 kB/sec 2024-05-21T13:38:45.671 INFO:tasks.workunit.client.0.smithi022.stdout: Parent sees throughput for 1 rewriters = 100250.51 kB/sec 2024-05-21T13:38:45.672 INFO:tasks.workunit.client.0.smithi022.stdout: Min throughput per process = 100256.72 kB/sec 2024-05-21T13:38:45.672 INFO:tasks.workunit.client.0.smithi022.stdout: Max throughput per process = 100256.72 kB/sec 2024-05-21T13:38:45.672 INFO:tasks.workunit.client.0.smithi022.stdout: Avg throughput per process = 100256.72 kB/sec 2024-05-21T13:38:45.672 INFO:tasks.workunit.client.0.smithi022.stdout: Min xfer = 1048576.00 kB 2024-05-21T13:38:50.241 INFO:tasks.workunit.client.0.smithi022.stdout: 2024-05-21T13:38:50.242 INFO:tasks.workunit.client.0.smithi022.stdout: Children see throughput for 1 readers = 6712261.00 kB/sec 2024-05-21T13:38:50.242 INFO:tasks.workunit.client.0.smithi022.stdout: Parent sees throughput for 1 readers = 6687012.03 kB/sec 2024-05-21T13:38:50.242 INFO:tasks.workunit.client.0.smithi022.stdout: Min throughput per process = 6712261.00 kB/sec 2024-05-21T13:38:50.242 INFO:tasks.workunit.client.0.smithi022.stdout: Max throughput per process = 6712261.00 kB/sec 2024-05-21T13:38:50.242 INFO:tasks.workunit.client.0.smithi022.stdout: Avg throughput per process = 6712261.00 kB/sec 2024-05-21T13:38:50.242 INFO:tasks.workunit.client.0.smithi022.stdout: Min xfer = 1048576.00 kB 2024-05-21T13:38:52.526 INFO:tasks.workunit.client.0.smithi022.stdout: 2024-05-21T13:38:52.526 INFO:tasks.workunit.client.0.smithi022.stdout: Children see throughput for 1 re-readers = 5491045.50 kB/sec 2024-05-21T13:38:52.526 INFO:tasks.workunit.client.0.smithi022.stdout: Parent sees throughput for 1 re-readers = 5472992.57 kB/sec 2024-05-21T13:38:52.526 INFO:tasks.workunit.client.0.smithi022.stdout: Min throughput per process = 5491045.50 kB/sec 2024-05-21T13:38:52.526 INFO:tasks.workunit.client.0.smithi022.stdout: Max throughput per process = 5491045.50 kB/sec 2024-05-21T13:38:52.526 INFO:tasks.workunit.client.0.smithi022.stdout: Avg throughput per process = 5491045.50 kB/sec 2024-05-21T13:38:52.526 INFO:tasks.workunit.client.0.smithi022.stdout: Min xfer = 1048576.00 kB 2024-05-21T13:38:58.882 INFO:tasks.workunit.client.0.smithi022.stdout: 2024-05-21T13:38:58.882 INFO:tasks.workunit.client.0.smithi022.stdout: 2024-05-21T13:38:58.882 INFO:tasks.workunit.client.0.smithi022.stdout: 2024-05-21T13:38:58.882 INFO:tasks.workunit.client.0.smithi022.stdout:iozone test complete. 2024-05-21T13:38:58.884 INFO:tasks.workunit.client.0.smithi022.stderr:+ iozone -c -e -s 1024M -r 1M -t 1 -F f2 -i 0 -i 1 2024-05-21T13:38:58.962 INFO:tasks.workunit.client.0.smithi022.stdout: Iozone: Performance Test of File I/O 2024-05-21T13:38:58.963 INFO:tasks.workunit.client.0.smithi022.stdout: Version $Revision: 3.489 $ 2024-05-21T13:38:58.963 INFO:tasks.workunit.client.0.smithi022.stdout: Compiled for 64 bit mode. 2024-05-21T13:38:58.963 INFO:tasks.workunit.client.0.smithi022.stdout: Build: linux-AMD64 2024-05-21T13:38:58.963 INFO:tasks.workunit.client.0.smithi022.stdout: 2024-05-21T13:38:58.963 INFO:tasks.workunit.client.0.smithi022.stdout: Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins 2024-05-21T13:38:58.963 INFO:tasks.workunit.client.0.smithi022.stdout: Al Slater, Scott Rhine, Mike Wisner, Ken Goss 2024-05-21T13:38:58.963 INFO:tasks.workunit.client.0.smithi022.stdout: Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, 2024-05-21T13:38:58.963 INFO:tasks.workunit.client.0.smithi022.stdout: Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, 2024-05-21T13:38:58.963 INFO:tasks.workunit.client.0.smithi022.stdout: Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, 2024-05-21T13:38:58.963 INFO:tasks.workunit.client.0.smithi022.stdout: Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, 2024-05-21T13:38:58.964 INFO:tasks.workunit.client.0.smithi022.stdout: Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, 2024-05-21T13:38:58.964 INFO:tasks.workunit.client.0.smithi022.stdout: Vangel Bojaxhi, Ben England, Vikentsi Lapa, 2024-05-21T13:38:58.964 INFO:tasks.workunit.client.0.smithi022.stdout: Alexey Skidanov, Sudhir Kumar. 2024-05-21T13:38:58.964 INFO:tasks.workunit.client.0.smithi022.stdout: 2024-05-21T13:38:58.964 INFO:tasks.workunit.client.0.smithi022.stdout: Run began: Tue May 21 13:38:58 2024 2024-05-21T13:38:58.964 INFO:tasks.workunit.client.0.smithi022.stdout: 2024-05-21T13:38:58.964 INFO:tasks.workunit.client.0.smithi022.stdout: Include close in write timing 2024-05-21T13:38:58.964 INFO:tasks.workunit.client.0.smithi022.stdout: Include fsync in write timing 2024-05-21T13:38:58.964 INFO:tasks.workunit.client.0.smithi022.stdout: File size set to 1048576 kB 2024-05-21T13:38:58.964 INFO:tasks.workunit.client.0.smithi022.stdout: Record Size 1024 kB 2024-05-21T13:38:58.964 INFO:tasks.workunit.client.0.smithi022.stdout: Command line used: iozone -c -e -s 1024M -r 1M -t 1 -F f2 -i 0 -i 1 2024-05-21T13:38:58.964 INFO:tasks.workunit.client.0.smithi022.stdout: Output is in kBytes/sec 2024-05-21T13:38:58.964 INFO:tasks.workunit.client.0.smithi022.stdout: Time Resolution = 0.000001 seconds. 2024-05-21T13:38:58.964 INFO:tasks.workunit.client.0.smithi022.stdout: Processor cache size set to 1024 kBytes. 2024-05-21T13:38:58.965 INFO:tasks.workunit.client.0.smithi022.stdout: Processor cache line size set to 32 bytes. 2024-05-21T13:38:58.965 INFO:tasks.workunit.client.0.smithi022.stdout: File stride size set to 17 * record size. 2024-05-21T13:38:58.965 INFO:tasks.workunit.client.0.smithi022.stdout: Throughput test with 1 process 2024-05-21T13:38:58.965 INFO:tasks.workunit.client.0.smithi022.stdout: Each process writes a 1048576 kByte file in 1024 kByte records 2024-05-21T13:39:00.115 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-21T13:39:00.119 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-21T13:39:01.317 INFO:tasks.workunit.client.0.smithi022.stdout: 2024-05-21T13:39:01.318 INFO:tasks.workunit.client.0.smithi022.stdout: Children see throughput for 1 initial writers = 454046.94 kB/sec 2024-05-21T13:39:01.318 INFO:tasks.workunit.client.0.smithi022.stdout: Parent sees throughput for 1 initial writers = 453877.92 kB/sec 2024-05-21T13:39:01.318 INFO:tasks.workunit.client.0.smithi022.stdout: Min throughput per process = 454046.94 kB/sec 2024-05-21T13:39:01.318 INFO:tasks.workunit.client.0.smithi022.stdout: Max throughput per process = 454046.94 kB/sec 2024-05-21T13:39:01.318 INFO:tasks.workunit.client.0.smithi022.stdout: Avg throughput per process = 454046.94 kB/sec 2024-05-21T13:39:01.318 INFO:tasks.workunit.client.0.smithi022.stdout: Min xfer = 1048576.00 kB 2024-05-21T13:39:06.337 INFO:tasks.workunit.client.0.smithi022.stdout: 2024-05-21T13:39:06.337 INFO:tasks.workunit.client.0.smithi022.stdout: Children see throughput for 1 rewriters = 502140.81 kB/sec 2024-05-21T13:39:06.337 INFO:tasks.workunit.client.0.smithi022.stdout: Parent sees throughput for 1 rewriters = 501905.99 kB/sec 2024-05-21T13:39:06.337 INFO:tasks.workunit.client.0.smithi022.stdout: Min throughput per process = 502140.81 kB/sec 2024-05-21T13:39:06.337 INFO:tasks.workunit.client.0.smithi022.stdout: Max throughput per process = 502140.81 kB/sec 2024-05-21T13:39:06.337 INFO:tasks.workunit.client.0.smithi022.stdout: Avg throughput per process = 502140.81 kB/sec 2024-05-21T13:39:06.337 INFO:tasks.workunit.client.0.smithi022.stdout: Min xfer = 1048576.00 kB 2024-05-21T13:39:09.800 INFO:tasks.workunit.client.0.smithi022.stdout: 2024-05-21T13:39:09.800 INFO:tasks.workunit.client.0.smithi022.stdout: Children see throughput for 1 readers = 7020600.00 kB/sec 2024-05-21T13:39:09.800 INFO:tasks.workunit.client.0.smithi022.stdout: Parent sees throughput for 1 readers = 6996153.38 kB/sec 2024-05-21T13:39:09.800 INFO:tasks.workunit.client.0.smithi022.stdout: Min throughput per process = 7020600.00 kB/sec 2024-05-21T13:39:09.801 INFO:tasks.workunit.client.0.smithi022.stdout: Max throughput per process = 7020600.00 kB/sec 2024-05-21T13:39:09.801 INFO:tasks.workunit.client.0.smithi022.stdout: Avg throughput per process = 7020600.00 kB/sec 2024-05-21T13:39:09.801 INFO:tasks.workunit.client.0.smithi022.stdout: Min xfer = 1048576.00 kB 2024-05-21T13:39:12.080 INFO:tasks.workunit.client.0.smithi022.stdout: 2024-05-21T13:39:12.080 INFO:tasks.workunit.client.0.smithi022.stdout: Children see throughput for 1 re-readers = 5599427.00 kB/sec 2024-05-21T13:39:12.080 INFO:tasks.workunit.client.0.smithi022.stdout: Parent sees throughput for 1 re-readers = 5582759.38 kB/sec 2024-05-21T13:39:12.080 INFO:tasks.workunit.client.0.smithi022.stdout: Min throughput per process = 5599427.00 kB/sec 2024-05-21T13:39:12.080 INFO:tasks.workunit.client.0.smithi022.stdout: Max throughput per process = 5599427.00 kB/sec 2024-05-21T13:39:12.080 INFO:tasks.workunit.client.0.smithi022.stdout: Avg throughput per process = 5599427.00 kB/sec 2024-05-21T13:39:12.080 INFO:tasks.workunit.client.0.smithi022.stdout: Min xfer = 1048576.00 kB 2024-05-21T13:39:18.448 INFO:tasks.workunit.client.0.smithi022.stdout: 2024-05-21T13:39:18.448 INFO:tasks.workunit.client.0.smithi022.stdout: 2024-05-21T13:39:18.448 INFO:tasks.workunit.client.0.smithi022.stdout: 2024-05-21T13:39:18.448 INFO:tasks.workunit.client.0.smithi022.stdout:iozone test complete. 2024-05-21T13:39:18.449 INFO:tasks.workunit.client.0.smithi022.stderr:+ iozone -c -e -s 10240M -r 1M -t 1 -F f3 -i 0 -i 1 2024-05-21T13:39:18.529 INFO:tasks.workunit.client.0.smithi022.stdout: Iozone: Performance Test of File I/O 2024-05-21T13:39:18.530 INFO:tasks.workunit.client.0.smithi022.stdout: Version $Revision: 3.489 $ 2024-05-21T13:39:18.530 INFO:tasks.workunit.client.0.smithi022.stdout: Compiled for 64 bit mode. 2024-05-21T13:39:18.530 INFO:tasks.workunit.client.0.smithi022.stdout: Build: linux-AMD64 2024-05-21T13:39:18.530 INFO:tasks.workunit.client.0.smithi022.stdout: 2024-05-21T13:39:18.530 INFO:tasks.workunit.client.0.smithi022.stdout: Contributors:William Norcott, Don Capps, Isom Crawford, Kirby Collins 2024-05-21T13:39:18.530 INFO:tasks.workunit.client.0.smithi022.stdout: Al Slater, Scott Rhine, Mike Wisner, Ken Goss 2024-05-21T13:39:18.530 INFO:tasks.workunit.client.0.smithi022.stdout: Steve Landherr, Brad Smith, Mark Kelly, Dr. Alain CYR, 2024-05-21T13:39:18.530 INFO:tasks.workunit.client.0.smithi022.stdout: Randy Dunlap, Mark Montague, Dan Million, Gavin Brebner, 2024-05-21T13:39:18.530 INFO:tasks.workunit.client.0.smithi022.stdout: Jean-Marc Zucconi, Jeff Blomberg, Benny Halevy, Dave Boone, 2024-05-21T13:39:18.530 INFO:tasks.workunit.client.0.smithi022.stdout: Erik Habbinga, Kris Strecker, Walter Wong, Joshua Root, 2024-05-21T13:39:18.530 INFO:tasks.workunit.client.0.smithi022.stdout: Fabrice Bacchella, Zhenghua Xue, Qin Li, Darren Sawyer, 2024-05-21T13:39:18.531 INFO:tasks.workunit.client.0.smithi022.stdout: Vangel Bojaxhi, Ben England, Vikentsi Lapa, 2024-05-21T13:39:18.531 INFO:tasks.workunit.client.0.smithi022.stdout: Alexey Skidanov, Sudhir Kumar. 2024-05-21T13:39:18.531 INFO:tasks.workunit.client.0.smithi022.stdout: 2024-05-21T13:39:18.531 INFO:tasks.workunit.client.0.smithi022.stdout: Run began: Tue May 21 13:39:18 2024 2024-05-21T13:39:18.531 INFO:tasks.workunit.client.0.smithi022.stdout: 2024-05-21T13:39:18.531 INFO:tasks.workunit.client.0.smithi022.stdout: Include close in write timing 2024-05-21T13:39:18.531 INFO:tasks.workunit.client.0.smithi022.stdout: Include fsync in write timing 2024-05-21T13:39:18.531 INFO:tasks.workunit.client.0.smithi022.stdout: File size set to 10485760 kB 2024-05-21T13:39:18.531 INFO:tasks.workunit.client.0.smithi022.stdout: Record Size 1024 kB 2024-05-21T13:39:18.531 INFO:tasks.workunit.client.0.smithi022.stdout: Command line used: iozone -c -e -s 10240M -r 1M -t 1 -F f3 -i 0 -i 1 2024-05-21T13:39:18.531 INFO:tasks.workunit.client.0.smithi022.stdout: Output is in kBytes/sec 2024-05-21T13:39:18.531 INFO:tasks.workunit.client.0.smithi022.stdout: Time Resolution = 0.000001 seconds. 2024-05-21T13:39:18.531 INFO:tasks.workunit.client.0.smithi022.stdout: Processor cache size set to 1024 kBytes. 2024-05-21T13:39:18.532 INFO:tasks.workunit.client.0.smithi022.stdout: Processor cache line size set to 32 bytes. 2024-05-21T13:39:18.532 INFO:tasks.workunit.client.0.smithi022.stdout: File stride size set to 17 * record size. 2024-05-21T13:39:18.532 INFO:tasks.workunit.client.0.smithi022.stdout: Throughput test with 1 process 2024-05-21T13:39:18.532 INFO:tasks.workunit.client.0.smithi022.stdout: Each process writes a 10485760 kByte file in 1024 kByte records 2024-05-21T13:39:19.901 INFO:tasks.quiescer.fs.[cephfs]:Total duration (40.9) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-05-21T13:39:19.901 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 20.45 2024-05-21T13:39:19.902 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-21T13:39:20.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.123+0000 7faf08664640 1 Processor -- start 2024-05-21T13:39:20.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.123+0000 7faf08664640 1 -- start start 2024-05-21T13:39:20.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.123+0000 7faf08664640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7faf000c4530 0x7faf000c7440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:39:20.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.123+0000 7faf08664640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7faf000c4910 0x7faf000c4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:39:20.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.123+0000 7faf08664640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf000cd440 con 0x7faf000c8480 2024-05-21T13:39:20.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.123+0000 7faf08664640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7faf000cd720 con 0x7faf000c4910 2024-05-21T13:39:20.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.123+0000 7faf08664640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7faf00159130 con 0x7faf000c4530 2024-05-21T13:39:20.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.123+0000 7faf06c01640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7faf000c4910 0x7faf000c4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:39:20.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.123+0000 7faf06c01640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7faf000c4910 0x7faf000c4ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59780/0 (socket says 172.21.15.22:59780) 2024-05-21T13:39:20.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.123+0000 7faf06c01640 1 -- 172.21.15.22:0/422694891 learned_addr learned my addr 172.21.15.22:0/422694891 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:39:20.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.123+0000 7faf06400640 1 --2- 172.21.15.22:0/422694891 >> v2:172.21.15.115:3300/0 conn(0x7faf000c4530 0x7faf000c7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:39:20.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.123+0000 7faf06c01640 1 -- 172.21.15.22:0/422694891 >> v2:172.21.15.115:3300/0 conn(0x7faf000c4530 msgr2=0x7faf000c7440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:39:20.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.123+0000 7faf06c01640 1 --2- 172.21.15.22:0/422694891 >> v2:172.21.15.115:3300/0 conn(0x7faf000c4530 0x7faf000c7440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:20.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.123+0000 7faf06c01640 1 -- 172.21.15.22:0/422694891 >> v1:172.21.15.115:6789/0 conn(0x7faf000c8480 legacy=0x7faf000cb7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:39:20.105 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.123+0000 7faf06c01640 1 -- 172.21.15.22:0/422694891 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf00158ae0 con 0x7faf000c4910 2024-05-21T13:39:20.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.127+0000 7faf06c01640 1 --2- 172.21.15.22:0/422694891 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf000c4910 0x7faf000c4ea0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7faf00072630 tx=0x7faef801f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec56a1b1a5cc565e server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:39:20.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.127+0000 7faf053fe640 1 -- 172.21.15.22:0/422694891 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faef80b4070 con 0x7faf000c4910 2024-05-21T13:39:20.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.127+0000 7faf053fe640 1 -- 172.21.15.22:0/422694891 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faef80af400 con 0x7faf000c4910 2024-05-21T13:39:20.107 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.127+0000 7faf053fe640 1 -- 172.21.15.22:0/422694891 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faef80af7d0 con 0x7faf000c4910 2024-05-21T13:39:20.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.127+0000 7faf08664640 1 -- 172.21.15.22:0/422694891 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf000c4910 msgr2=0x7faf000c4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:39:20.108 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.127+0000 7faf08664640 1 --2- 172.21.15.22:0/422694891 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf000c4910 0x7faf000c4ea0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7faf00072630 tx=0x7faef801f1e0 comp rx=0 tx=0).stop 2024-05-21T13:39:20.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.127+0000 7faf08664640 1 -- 172.21.15.22:0/422694891 shutdown_connections 2024-05-21T13:39:20.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.127+0000 7faf08664640 1 --2- 172.21.15.22:0/422694891 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf000c4910 0x7faf000c4ea0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:20.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.127+0000 7faf08664640 1 --2- 172.21.15.22:0/422694891 >> v2:172.21.15.115:3300/0 conn(0x7faf000c4530 0x7faf000c7440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:20.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.127+0000 7faf08664640 1 -- 172.21.15.22:0/422694891 >> 172.21.15.22:0/422694891 conn(0x7faf0006c4f0 msgr2=0x7faf0006c900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:39:20.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.127+0000 7faf08664640 1 -- 172.21.15.22:0/422694891 shutdown_connections 2024-05-21T13:39:20.109 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.127+0000 7faf08664640 1 -- 172.21.15.22:0/422694891 wait complete. 2024-05-21T13:39:20.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.131+0000 7faf08664640 1 Processor -- start 2024-05-21T13:39:20.110 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.131+0000 7faf08664640 1 -- start start 2024-05-21T13:39:20.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.131+0000 7faf08664640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf000c4530 0x7faf0014ec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:39:20.111 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.131+0000 7faf08664640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf000c4910 0x7faf00151930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:39:20.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.131+0000 7faf08664640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faf000c8480 0x7faf00151e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:39:20.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.131+0000 7faf08664640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7faf001595c0 con 0x7faf000c4530 2024-05-21T13:39:20.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.131+0000 7faf08664640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7faf000cd140 con 0x7faf000c4910 2024-05-21T13:39:20.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.131+0000 7faf08664640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7faf00159740 con 0x7faf000c8480 2024-05-21T13:39:20.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.131+0000 7faf06400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf000c4530 0x7faf0014ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:39:20.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.131+0000 7faf06400640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf000c4530 0x7faf0014ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59790/0 (socket says 172.21.15.22:59790) 2024-05-21T13:39:20.112 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.131+0000 7faf06400640 1 -- 172.21.15.22:0/1558589824 learned_addr learned my addr 172.21.15.22:0/1558589824 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:39:20.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.131+0000 7faf05bff640 1 --2- 172.21.15.22:0/1558589824 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf000c4910 0x7faf00151930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:39:20.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.131+0000 7faf06400640 1 -- 172.21.15.22:0/1558589824 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faf000c8480 msgr2=0x7faf00151e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:39:20.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.131+0000 7faf06400640 1 --2- 172.21.15.22:0/1558589824 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faf000c8480 0x7faf00151e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:20.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.131+0000 7faf06400640 1 -- 172.21.15.22:0/1558589824 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf000c4910 msgr2=0x7faf00151930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:39:20.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.131+0000 7faf06400640 1 --2- 172.21.15.22:0/1558589824 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf000c4910 0x7faf00151930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:20.113 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.131+0000 7faf06400640 1 -- 172.21.15.22:0/1558589824 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf001f5680 con 0x7faf000c4530 2024-05-21T13:39:20.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.135+0000 7faf06400640 1 --2- 172.21.15.22:0/1558589824 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf000c4530 0x7faf0014ec10 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7faefc00d830 tx=0x7faefc00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:39:20.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.135+0000 7faef6ffd640 1 -- 172.21.15.22:0/1558589824 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faefc00b6c0 con 0x7faf000c4530 2024-05-21T13:39:20.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.135+0000 7faef6ffd640 1 -- 172.21.15.22:0/1558589824 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faefc019070 con 0x7faf000c4530 2024-05-21T13:39:20.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.135+0000 7faef6ffd640 1 -- 172.21.15.22:0/1558589824 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faefc00ba60 con 0x7faf000c4530 2024-05-21T13:39:20.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.139+0000 7faf08664640 1 -- 172.21.15.22:0/1558589824 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf001f5920 con 0x7faf000c4530 2024-05-21T13:39:20.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.139+0000 7faf08664640 1 -- 172.21.15.22:0/1558589824 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf0014d330 con 0x7faf000c4530 2024-05-21T13:39:20.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.139+0000 7faef6ffd640 1 -- 172.21.15.22:0/1558589824 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7faefc00bc00 con 0x7faf000c4530 2024-05-21T13:39:20.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.139+0000 7faef6ffd640 1 --2- 172.21.15.22:0/1558589824 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7faee406f4d0 0x7faee4071990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:39:20.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.143+0000 7faef6ffd640 1 -- 172.21.15.22:0/1558589824 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7faefc08f3f0 con 0x7faf000c4530 2024-05-21T13:39:20.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.143+0000 7faf05bff640 1 --2- 172.21.15.22:0/1558589824 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7faee406f4d0 0x7faee4071990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:39:20.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.143+0000 7faf08664640 1 -- 172.21.15.22:0/1558589824 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf000697d0 con 0x7faf000c4530 2024-05-21T13:39:20.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.143+0000 7faf05bff640 1 --2- 172.21.15.22:0/1558589824 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7faee406f4d0 0x7faee4071990 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7faf000c6ca0 tx=0x7faef0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:39:20.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.147+0000 7faef6ffd640 1 -- 172.21.15.22:0/1558589824 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7faefc05be70 con 0x7faf000c4530 2024-05-21T13:39:20.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.487+0000 7faf08664640 1 -- 172.21.15.22:0/1558589824 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faf0006cc80 con 0x7faf000c4530 2024-05-21T13:39:20.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.487+0000 7faef6ffd640 1 -- 172.21.15.22:0/1558589824 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6875 (secure 0 0 0) 0x7faefc05b770 con 0x7faf000c4530 2024-05-21T13:39:20.467 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-21T13:39:20.467 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4224,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/355756580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":355756580},{"type":"v1","addr":"172.21.15.22:6833","nonce":355756580}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4230,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3277017116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":3277017116},{"type":"v1","addr":"172.21.15.22:6835","nonce":3277017116}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4233,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3840772609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3840772609},{"type":"v1","addr":"172.21.15.22:6837","nonce":3840772609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-21T13:35:57.106892+0000","modified":"2024-05-21T13:36:32.396351+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4300,"mds_1":4294,"mds_2":4248},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4248":{"gid":4248,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":12,"addr":"172.21.15.115:6837/2009761279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":2009761279},{"type":"v1","addr":"172.21.15.115:6837","nonce":2009761279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4294":{"gid":4294,"name":"b","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.115:6835/3894678097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3894678097},{"type":"v1","addr":"172.21.15.115:6835","nonce":3894678097}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4300":{"gid":4300,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.115:6839/1525097577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6838","nonce":1525097577},{"type":"v1","addr":"172.21.15.115:6839","nonce":1525097577}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4300,"qdb_cluster":[4248,4300,4294]},"id":1}]} 2024-05-21T13:39:20.468 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 14 2024-05-21T13:39:20.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.491+0000 7faf08664640 1 -- 172.21.15.22:0/1558589824 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7faee406f4d0 msgr2=0x7faee4071990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:39:20.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.491+0000 7faf08664640 1 --2- 172.21.15.22:0/1558589824 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7faee406f4d0 0x7faee4071990 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7faf000c6ca0 tx=0x7faef0008040 comp rx=0 tx=0).stop 2024-05-21T13:39:20.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.491+0000 7faf08664640 1 -- 172.21.15.22:0/1558589824 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf000c4530 msgr2=0x7faf0014ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:39:20.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.491+0000 7faf08664640 1 --2- 172.21.15.22:0/1558589824 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf000c4530 0x7faf0014ec10 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7faefc00d830 tx=0x7faefc00dcf0 comp rx=0 tx=0).stop 2024-05-21T13:39:20.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.491+0000 7faf08664640 1 -- 172.21.15.22:0/1558589824 shutdown_connections 2024-05-21T13:39:20.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.491+0000 7faf08664640 1 --2- 172.21.15.22:0/1558589824 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7faee406f4d0 0x7faee4071990 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:20.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.491+0000 7faf08664640 1 --2- 172.21.15.22:0/1558589824 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7faf000c8480 0x7faf00151e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:20.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.491+0000 7faf08664640 1 --2- 172.21.15.22:0/1558589824 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7faf000c4910 0x7faf00151930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:20.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.491+0000 7faf08664640 1 --2- 172.21.15.22:0/1558589824 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7faf000c4530 0x7faf0014ec10 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:20.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.491+0000 7faf08664640 1 -- 172.21.15.22:0/1558589824 >> 172.21.15.22:0/1558589824 conn(0x7faf0006c4f0 msgr2=0x7faf0014b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:39:20.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.491+0000 7faf08664640 1 -- 172.21.15.22:0/1558589824 shutdown_connections 2024-05-21T13:39:20.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.491+0000 7faf08664640 1 -- 172.21.15.22:0/1558589824 wait complete. 2024-05-21T13:39:20.507 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4300 quiesce db / --timeout 90 --expiration 140.45 --await-for 45.0' 2024-05-21T13:39:20.508 DEBUG:teuthology.orchestra.run.smithi022:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4300 quiesce db / --timeout 90 --expiration 140.45 --await-for 45.0 2024-05-21T13:39:20.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.707+0000 7fe2cc24d640 1 Processor -- start 2024-05-21T13:39:20.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.707+0000 7fe2cc24d640 1 -- start start 2024-05-21T13:39:20.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.707+0000 7fe2cc24d640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe2c40c8580 0x7fe2c415be90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:39:20.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.707+0000 7fe2cc24d640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2c4073850 con 0x7fe2c4159590 2024-05-21T13:39:20.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.707+0000 7fe2cc24d640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2c4073b30 con 0x7fe2c4152ca0 2024-05-21T13:39:20.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.707+0000 7fe2cc24d640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7fe2c415c3d0 con 0x7fe2c40c8580 2024-05-21T13:39:20.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.707+0000 7fe2c97e8640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fe2c4159590 0x7fe2c4070e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:42228/0 (socket says 172.21.15.22:42228) 2024-05-21T13:39:20.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.707+0000 7fe2c97e8640 1 -- 172.21.15.22:0/3493371218 learned_addr learned my addr 172.21.15.22:0/3493371218 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-21T13:39:20.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.707+0000 7fe2ca7ea640 1 --2- 172.21.15.22:0/3493371218 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe2c40c8580 0x7fe2c415be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:39:20.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.707+0000 7fe2c8fe7640 1 -- 172.21.15.22:0/3493371218 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3281270458 0 0) 0x7fe2c4073850 con 0x7fe2c4159590 2024-05-21T13:39:20.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.707+0000 7fe2c8fe7640 1 -- 172.21.15.22:0/3493371218 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe2b0003530 con 0x7fe2c4159590 2024-05-21T13:39:20.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.707+0000 7fe2c8fe7640 1 -- 172.21.15.22:0/3493371218 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1298502924 0 0) 0x7fe2c4073b30 con 0x7fe2c4152ca0 2024-05-21T13:39:20.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.707+0000 7fe2ca7ea640 1 -- 172.21.15.22:0/3493371218 >> v1:172.21.15.115:6789/0 conn(0x7fe2c4152ca0 legacy=0x7fe2c40c5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:39:20.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.707+0000 7fe2ca7ea640 1 -- 172.21.15.22:0/3493371218 >> v1:172.21.15.22:6789/0 conn(0x7fe2c4159590 legacy=0x7fe2c4070e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:39:20.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.707+0000 7fe2ca7ea640 1 -- 172.21.15.22:0/3493371218 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2c4158ab0 con 0x7fe2c40c8580 2024-05-21T13:39:20.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.711+0000 7fe2ca7ea640 1 --2- 172.21.15.22:0/3493371218 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe2c40c8580 0x7fe2c415be90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc009dc0 tx=0x7fe2bc01c9b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3000c798469308b server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:39:20.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.711+0000 7fe2c8fe7640 1 -- 172.21.15.22:0/3493371218 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2bc0b2070 con 0x7fe2c40c8580 2024-05-21T13:39:20.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.711+0000 7fe2c8fe7640 1 -- 172.21.15.22:0/3493371218 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2bc0a5870 con 0x7fe2c40c8580 2024-05-21T13:39:20.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.711+0000 7fe2c8fe7640 1 -- 172.21.15.22:0/3493371218 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2bc0a5c20 con 0x7fe2c40c8580 2024-05-21T13:39:20.692 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.711+0000 7fe2cc24d640 1 -- 172.21.15.22:0/3493371218 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe2c40c8580 msgr2=0x7fe2c415be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:39:20.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.711+0000 7fe2cc24d640 1 --2- 172.21.15.22:0/3493371218 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe2c40c8580 0x7fe2c415be90 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc009dc0 tx=0x7fe2bc01c9b0 comp rx=0 tx=0).stop 2024-05-21T13:39:20.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.711+0000 7fe2cc24d640 1 -- 172.21.15.22:0/3493371218 shutdown_connections 2024-05-21T13:39:20.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.711+0000 7fe2cc24d640 1 --2- 172.21.15.22:0/3493371218 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe2c40c8580 0x7fe2c415be90 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:20.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.711+0000 7fe2cc24d640 1 -- 172.21.15.22:0/3493371218 >> 172.21.15.22:0/3493371218 conn(0x7fe2c40ce640 msgr2=0x7fe2c40cea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:39:20.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.711+0000 7fe2cc24d640 1 -- 172.21.15.22:0/3493371218 shutdown_connections 2024-05-21T13:39:20.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.711+0000 7fe2cc24d640 1 -- 172.21.15.22:0/3493371218 wait complete. 2024-05-21T13:39:20.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.715+0000 7fe2cc24d640 1 Processor -- start 2024-05-21T13:39:20.695 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.715+0000 7fe2cc24d640 1 -- start start 2024-05-21T13:39:20.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.715+0000 7fe2cc24d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2c40c8580 0x7fe2c41f7e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:39:20.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.715+0000 7fe2cc24d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2c4152ca0 0x7fe2c414ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:39:20.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.715+0000 7fe2cc24d640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe2c4159590 0x7fe2c415aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:39:20.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.715+0000 7fe2cc24d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe2c4071710 con 0x7fe2c4152ca0 2024-05-21T13:39:20.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.715+0000 7fe2cc24d640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fe2c4071590 con 0x7fe2c40c8580 2024-05-21T13:39:20.698 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.715+0000 7fe2cc24d640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7fe2c406c4f0 con 0x7fe2c4159590 2024-05-21T13:39:20.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.715+0000 7fe2c97e8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2c4152ca0 0x7fe2c414ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:39:20.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.715+0000 7fe2c97e8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2c4152ca0 0x7fe2c414ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59804/0 (socket says 172.21.15.22:59804) 2024-05-21T13:39:20.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.715+0000 7fe2c97e8640 1 -- 172.21.15.22:0/360116771 learned_addr learned my addr 172.21.15.22:0/360116771 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:39:20.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.715+0000 7fe2c9fe9640 1 --2- 172.21.15.22:0/360116771 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2c40c8580 0x7fe2c41f7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:39:20.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.715+0000 7fe2c97e8640 1 -- 172.21.15.22:0/360116771 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe2c4159590 msgr2=0x7fe2c415aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:39:20.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.715+0000 7fe2c97e8640 1 --2- 172.21.15.22:0/360116771 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe2c4159590 0x7fe2c415aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:20.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.715+0000 7fe2c97e8640 1 -- 172.21.15.22:0/360116771 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2c40c8580 msgr2=0x7fe2c41f7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:39:20.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.715+0000 7fe2c97e8640 1 --2- 172.21.15.22:0/360116771 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2c40c8580 0x7fe2c41f7e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:20.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.715+0000 7fe2c97e8640 1 -- 172.21.15.22:0/360116771 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2c41f3ec0 con 0x7fe2c4152ca0 2024-05-21T13:39:20.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.715+0000 7fe2c9fe9640 1 --2- 172.21.15.22:0/360116771 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2c40c8580 0x7fe2c41f7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T13:39:20.699 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.719+0000 7fe2c97e8640 1 --2- 172.21.15.22:0/360116771 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2c4152ca0 0x7fe2c414ef50 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fe2b400c460 tx=0x7fe2b400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:39:20.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.719+0000 7fe2ba7fc640 1 -- 172.21.15.22:0/360116771 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2b4017070 con 0x7fe2c4152ca0 2024-05-21T13:39:20.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.719+0000 7fe2ba7fc640 1 -- 172.21.15.22:0/360116771 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2b4005cf0 con 0x7fe2c4152ca0 2024-05-21T13:39:20.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.719+0000 7fe2cc24d640 1 -- 172.21.15.22:0/360116771 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2c41588c0 con 0x7fe2c4152ca0 2024-05-21T13:39:20.700 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.719+0000 7fe2cc24d640 1 -- 172.21.15.22:0/360116771 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2c414fa90 con 0x7fe2c4152ca0 2024-05-21T13:39:20.701 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.719+0000 7fe2ba7fc640 1 -- 172.21.15.22:0/360116771 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2b4007270 con 0x7fe2c4152ca0 2024-05-21T13:39:20.701 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.723+0000 7fe2cf3d8000 1 Processor -- start 2024-05-21T13:39:20.702 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.723+0000 7fe2cf3d8000 1 -- start start 2024-05-21T13:39:20.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.723+0000 7fe2ba7fc640 1 -- 172.21.15.22:0/360116771 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fe2b401a070 con 0x7fe2c4152ca0 2024-05-21T13:39:20.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.723+0000 7fe2cf3d8000 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55f5b08df900 0x55f5b08ab920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:39:20.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.723+0000 7fe2cf3d8000 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f5b08abe60 0x55f5b08e4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:39:20.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.723+0000 7fe2cf3d8000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f5b08e46c0 0x55f5b08e4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:39:20.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.723+0000 7fe2c9fe9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f5b08abe60 0x55f5b08e4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:39:20.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.723+0000 7fe2c9fe9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f5b08abe60 0x55f5b08e4180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59820/0 (socket says 172.21.15.22:59820) 2024-05-21T13:39:20.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.723+0000 7fe2c9fe9640 1 -- 172.21.15.22:0/2987765613 learned_addr learned my addr 172.21.15.22:0/2987765613 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:39:20.704 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.723+0000 7fe2cf3d8000 1 -- 172.21.15.22:0/2987765613 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55f5b06ff730 con 0x55f5b08abe60 2024-05-21T13:39:20.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.723+0000 7fe2cf3d8000 1 -- 172.21.15.22:0/2987765613 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55f5b06ef2d0 con 0x55f5b08e46c0 2024-05-21T13:39:20.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.723+0000 7fe2cf3d8000 1 -- 172.21.15.22:0/2987765613 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x55f5b06f3310 con 0x55f5b08df900 2024-05-21T13:39:20.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.723+0000 7fe2ca7ea640 1 --2- 172.21.15.22:0/2987765613 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55f5b08df900 0x55f5b08ab920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:39:20.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.723+0000 7fe2c97e8640 1 --2- 172.21.15.22:0/2987765613 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f5b08e46c0 0x55f5b08e4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:39:20.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.723+0000 7fe2ba7fc640 1 --2- 172.21.15.22:0/360116771 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fe2a806f4d0 0x7fe2a8071990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:39:20.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.723+0000 7fe2c9fe9640 1 -- 172.21.15.22:0/2987765613 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55f5b08df900 msgr2=0x55f5b08ab920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:39:20.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.723+0000 7fe2c9fe9640 1 --2- 172.21.15.22:0/2987765613 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55f5b08df900 0x55f5b08ab920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:20.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.723+0000 7fe2c9fe9640 1 -- 172.21.15.22:0/2987765613 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f5b08e46c0 msgr2=0x55f5b08e4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:39:20.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.723+0000 7fe2c9fe9640 1 --2- 172.21.15.22:0/2987765613 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f5b08e46c0 0x55f5b08e4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:20.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.723+0000 7fe2c9fe9640 1 -- 172.21.15.22:0/2987765613 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5b0738a30 con 0x55f5b08abe60 2024-05-21T13:39:20.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.723+0000 7fe2ba7fc640 1 -- 172.21.15.22:0/360116771 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7fe2b408e900 con 0x7fe2c4152ca0 2024-05-21T13:39:20.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.723+0000 7fe2ca7ea640 1 --2- 172.21.15.22:0/360116771 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fe2a806f4d0 0x7fe2a8071990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:39:20.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.723+0000 7fe2c9fe9640 1 --2- 172.21.15.22:0/2987765613 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f5b08abe60 0x55f5b08e4180 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe2c00016a0 tx=0x7fe2c0001b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56f1f9b674bbf209 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:39:20.705 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.723+0000 7fe2cc24d640 1 -- 172.21.15.22:0/2987765613 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2c0019070 con 0x55f5b08abe60 2024-05-21T13:39:20.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.723+0000 7fe2cc24d640 1 -- 172.21.15.22:0/2987765613 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2c00052e0 con 0x55f5b08abe60 2024-05-21T13:39:20.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.723+0000 7fe2cc24d640 1 -- 172.21.15.22:0/2987765613 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2c000e940 con 0x55f5b08abe60 2024-05-21T13:39:20.706 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.723+0000 7fe2cf3d8000 1 -- 172.21.15.22:0/2987765613 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f5b08abe60 msgr2=0x55f5b08e4180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:39:20.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.723+0000 7fe2ca7ea640 1 --2- 172.21.15.22:0/360116771 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fe2a806f4d0 0x7fe2a8071990 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc0af000 tx=0x7fe2bc0a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:39:20.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.723+0000 7fe2cf3d8000 1 --2- 172.21.15.22:0/2987765613 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f5b08abe60 0x55f5b08e4180 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe2c00016a0 tx=0x7fe2c0001b60 comp rx=0 tx=0).stop 2024-05-21T13:39:20.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.723+0000 7fe2cf3d8000 1 -- 172.21.15.22:0/2987765613 shutdown_connections 2024-05-21T13:39:20.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.723+0000 7fe2cf3d8000 1 --2- 172.21.15.22:0/2987765613 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f5b08e46c0 0x55f5b08e4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:20.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.723+0000 7fe2cf3d8000 1 --2- 172.21.15.22:0/2987765613 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f5b08abe60 0x55f5b08e4180 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:20.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.723+0000 7fe2cf3d8000 1 --2- 172.21.15.22:0/2987765613 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55f5b08df900 0x55f5b08ab920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:20.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.723+0000 7fe2cf3d8000 1 -- 172.21.15.22:0/2987765613 >> 172.21.15.22:0/2987765613 conn(0x55f5b08ac5c0 msgr2=0x55f5b08e1f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:39:20.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.727+0000 7fe2cf3d8000 1 -- 172.21.15.22:0/2987765613 shutdown_connections 2024-05-21T13:39:20.707 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.727+0000 7fe2cf3d8000 1 -- 172.21.15.22:0/2987765613 wait complete. 2024-05-21T13:39:20.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.727+0000 7fe2cf3d8000 1 -- start start 2024-05-21T13:39:20.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.727+0000 7fe2cf3d8000 1 Processor -- start 2024-05-21T13:39:20.708 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.727+0000 7fe2cf3d8000 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f5b08abe60 0x55f5b08ab210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:39:20.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.727+0000 7fe2c9fe9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f5b08abe60 0x55f5b08ab210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:39:20.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.727+0000 7fe2c9fe9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f5b08abe60 0x55f5b08ab210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59834/0 (socket says 172.21.15.22:59834) 2024-05-21T13:39:20.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.727+0000 7fe2c9fe9640 1 -- 172.21.15.22:0/735400227 learned_addr learned my addr 172.21.15.22:0/735400227 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:39:20.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.727+0000 7fe2cf3d8000 1 --2- 172.21.15.22:0/735400227 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55f5b08df900 0x55f5b08ab750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:39:20.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.727+0000 7fe2cf3d8000 1 --2- 172.21.15.22:0/735400227 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f5b08e46c0 0x55f5b08ead10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:39:20.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.731+0000 7fe2cf3d8000 1 -- 172.21.15.22:0/735400227 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55f5b03bab70 con 0x55f5b08abe60 2024-05-21T13:39:20.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.731+0000 7fe2c97e8640 1 --2- 172.21.15.22:0/735400227 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55f5b08df900 0x55f5b08ab750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:39:20.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.731+0000 7fe2cf3d8000 1 -- 172.21.15.22:0/735400227 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55f5b06ab490 con 0x55f5b08e46c0 2024-05-21T13:39:20.710 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.731+0000 7fe2cf3d8000 1 -- 172.21.15.22:0/735400227 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x55f5b06f7940 con 0x55f5b08df900 2024-05-21T13:39:20.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.731+0000 7fe2ca7ea640 1 --2- 172.21.15.22:0/735400227 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f5b08e46c0 0x55f5b08ead10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:39:20.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.731+0000 7fe2c9fe9640 1 -- 172.21.15.22:0/735400227 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55f5b08df900 msgr2=0x55f5b08ab750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:39:20.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.731+0000 7fe2c9fe9640 1 --2- 172.21.15.22:0/735400227 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55f5b08df900 0x55f5b08ab750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:20.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.731+0000 7fe2c9fe9640 1 -- 172.21.15.22:0/735400227 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f5b08e46c0 msgr2=0x55f5b08ead10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:39:20.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.731+0000 7fe2c9fe9640 1 --2- 172.21.15.22:0/735400227 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f5b08e46c0 0x55f5b08ead10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:20.711 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.731+0000 7fe2c9fe9640 1 -- 172.21.15.22:0/735400227 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5b072e710 con 0x55f5b08abe60 2024-05-21T13:39:20.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.731+0000 7fe2c9fe9640 1 --2- 172.21.15.22:0/735400227 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f5b08abe60 0x55f5b08ab210 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe2c0007a40 tx=0x7fe2c00079d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=970ecbb33c8622e1 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:39:20.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.731+0000 7fe2a4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-05-21T13:39:20.712 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.731+0000 7fe2a4ff9640 1 -- 172.21.15.22:0/735400227 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2c0024060 con 0x55f5b08abe60 2024-05-21T13:39:20.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.731+0000 7fe2a4ff9640 1 -- 172.21.15.22:0/735400227 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7fe2c000ec60 con 0x55f5b08abe60 2024-05-21T13:39:20.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.731+0000 7fe2cf3d8000 10 client.0 _ll_register_callbacks cb 0x55f5b088f350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-21T13:39:20.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.731+0000 7fe2cf3d8000 1 -- 172.21.15.22:0/735400227 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe2c00052e0 con 0x55f5b08abe60 2024-05-21T13:39:20.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.731+0000 7fe2a4ff9640 1 -- 172.21.15.22:0/735400227 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7fe2c0019070 con 0x55f5b08abe60 2024-05-21T13:39:20.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.731+0000 7fe2cf3d8000 10 client.4965 fetch_fsmap learned FSMap version 14 2024-05-21T13:39:20.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.731+0000 7fe2cf3d8000 1 -- 172.21.15.22:0/735400227 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({fsmap=14}) -- 0x55f5b06912b0 con 0x55f5b08abe60 2024-05-21T13:39:20.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.731+0000 7fe2a4ff9640 1 -- 172.21.15.22:0/735400227 <== mon.0 v2:172.21.15.22:3300/0 4 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7fe2c002a710 con 0x55f5b08abe60 2024-05-21T13:39:20.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.731+0000 7fe2cf3d8000 10 client.4965 fetch_fsmap finished waiting for FSMap version 14 2024-05-21T13:39:20.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.731+0000 7fe2cf3d8000 10 client.4965 resolve_mds: validated gid 4300 aka daemon mds.f 2024-05-21T13:39:20.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.735+0000 7fe2cf3d8000 20 client.4965 populate_metadata read hostname 'smithi022' 2024-05-21T13:39:20.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.735+0000 7fe2cf3d8000 1 --2- 172.21.15.22:0/735400227 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x55f5b08eba80 0x55f5b08ebe60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:39:20.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.735+0000 7fe2cf3d8000 4 client.4965 mds_command: new command op to 4300 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-21T13:39:20.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.735+0000 7fe2cf3d8000 1 -- 172.21.15.22:0/735400227 --> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fe2c00052e0 con 0x55f5b08eba80 2024-05-21T13:39:20.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.735+0000 7fe2c97e8640 1 --2- 172.21.15.22:0/735400227 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x55f5b08eba80 0x55f5b08ebe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:39:20.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.735+0000 7fe2c97e8640 1 --2- 172.21.15.22:0/735400227 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x55f5b08eba80 0x55f5b08ebe60 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a7dd20ec2dc70198 server_cookie=bdb46fb9ab57498c in_seq=0 out_seq=0 2024-05-21T13:39:20.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.735+0000 7fe2a4ff9640 10 client.4965 ms_handle_connect on v2:172.21.15.115:6838/1525097577 2024-05-21T13:39:20.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.735+0000 7fe2a4ff9640 1 -- 172.21.15.22:0/735400227 <== mds.0 v2:172.21.15.115:6838/1525097577 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x7fe2c00052e0 con 0x55f5b08eba80 2024-05-21T13:39:20.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.735+0000 7fe2a4ff9640 10 client.4965 handle_command_reply: tid=0 2024-05-21T13:39:20.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.735+0000 7fe2cf3d8000 1 client.4965 shutdown 2024-05-21T13:39:20.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.735+0000 7fe2cf3d8000 1 -- 172.21.15.22:0/735400227 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f5b08abe60 msgr2=0x55f5b08ab210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:39:20.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.735+0000 7fe2cf3d8000 1 --2- 172.21.15.22:0/735400227 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f5b08abe60 0x55f5b08ab210 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe2c0007a40 tx=0x7fe2c00079d0 comp rx=0 tx=0).stop 2024-05-21T13:39:20.717 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.735+0000 7fe2cf3d8000 1 -- 172.21.15.22:0/735400227 shutdown_connections 2024-05-21T13:39:20.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.735+0000 7fe2cf3d8000 1 --2- 172.21.15.22:0/735400227 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x55f5b08eba80 0x55f5b08ebe60 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:20.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.735+0000 7fe2a4ff9640 0 client.4965 ms_handle_reset on v2:172.21.15.115:6838/1525097577 2024-05-21T13:39:20.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.735+0000 7fe2cf3d8000 1 --2- 172.21.15.22:0/735400227 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f5b08e46c0 0x55f5b08ead10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:20.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.735+0000 7fe2cf3d8000 1 --2- 172.21.15.22:0/735400227 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55f5b08df900 0x55f5b08ab750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:20.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.735+0000 7fe2cf3d8000 1 --2- 172.21.15.22:0/735400227 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f5b08abe60 0x55f5b08ab210 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:20.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.735+0000 7fe2cf3d8000 1 -- 172.21.15.22:0/735400227 >> 172.21.15.22:0/735400227 conn(0x55f5b08ac5c0 msgr2=0x55f5b08e1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:39:20.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.735+0000 7fe2cf3d8000 1 -- 172.21.15.22:0/735400227 shutdown_connections 2024-05-21T13:39:20.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.735+0000 7fe2cf3d8000 1 -- 172.21.15.22:0/735400227 wait complete. 2024-05-21T13:39:20.718 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.735+0000 7fe2cf3d8000 20 client.4965 trim_cache size 0 max 16384 2024-05-21T13:39:20.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.767+0000 7fe2cf3d8000 1 Processor -- start 2024-05-21T13:39:20.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.767+0000 7fe2cf3d8000 1 -- start start 2024-05-21T13:39:20.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.771+0000 7fe2cf3d8000 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55f5b08abe60 0x55f5b08e9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:39:20.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.771+0000 7fe2cf3d8000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f5b08df900 0x55f5b08ea020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:39:20.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.771+0000 7fe2cf3d8000 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f5b08e46c0 0x55f5b08ff4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:39:20.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.771+0000 7fe2cf3d8000 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe2c4202740 con 0x55f5b08e46c0 2024-05-21T13:39:20.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.771+0000 7fe2cf3d8000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fe2c4200f20 con 0x55f5b08df900 2024-05-21T13:39:20.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.771+0000 7fe2cf3d8000 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7fe2c4200280 con 0x55f5b08abe60 2024-05-21T13:39:20.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.771+0000 7fe2ca7ea640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f5b08e46c0 0x55f5b08ff4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:39:20.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.771+0000 7fe2ca7ea640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f5b08e46c0 0x55f5b08ff4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:59850/0 (socket says 172.21.15.22:59850) 2024-05-21T13:39:20.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.771+0000 7fe2ca7ea640 1 -- 172.21.15.22:0/328515682 learned_addr learned my addr 172.21.15.22:0/328515682 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:39:20.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.771+0000 7fe2c9fe9640 1 --2- 172.21.15.22:0/328515682 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55f5b08abe60 0x55f5b08e9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:39:20.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.771+0000 7fe2ca7ea640 1 -- 172.21.15.22:0/328515682 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55f5b08abe60 msgr2=0x55f5b08e9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:39:20.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.771+0000 7fe2ca7ea640 1 --2- 172.21.15.22:0/328515682 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55f5b08abe60 0x55f5b08e9ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:20.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.771+0000 7fe2ca7ea640 1 -- 172.21.15.22:0/328515682 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f5b08df900 msgr2=0x55f5b08ea020 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-05-21T13:39:20.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.771+0000 7fe2ca7ea640 1 --2- 172.21.15.22:0/328515682 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f5b08df900 0x55f5b08ea020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:20.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.771+0000 7fe2ca7ea640 1 -- 172.21.15.22:0/328515682 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5b06a4c60 con 0x55f5b08e46c0 2024-05-21T13:39:20.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.771+0000 7fe2ca7ea640 1 --2- 172.21.15.22:0/328515682 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f5b08e46c0 0x55f5b08ff4f0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc098390 tx=0x7fe2bc004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65b6e6fe7f14b1a5 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:39:20.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.771+0000 7fe2a6ffd640 1 -- 172.21.15.22:0/328515682 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2bc0b2040 con 0x55f5b08e46c0 2024-05-21T13:39:20.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.771+0000 7fe2a6ffd640 1 -- 172.21.15.22:0/328515682 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2bc0cb070 con 0x55f5b08e46c0 2024-05-21T13:39:20.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.771+0000 7fe2a6ffd640 1 -- 172.21.15.22:0/328515682 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2bc0a6dd0 con 0x55f5b08e46c0 2024-05-21T13:39:20.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.771+0000 7fe2cf3d8000 1 -- 172.21.15.22:0/328515682 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f5b08e46c0 msgr2=0x55f5b08ff4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:39:20.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.771+0000 7fe2cf3d8000 1 --2- 172.21.15.22:0/328515682 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f5b08e46c0 0x55f5b08ff4f0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc098390 tx=0x7fe2bc004ac0 comp rx=0 tx=0).stop 2024-05-21T13:39:20.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.771+0000 7fe2cf3d8000 1 -- 172.21.15.22:0/328515682 shutdown_connections 2024-05-21T13:39:20.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.771+0000 7fe2cf3d8000 1 --2- 172.21.15.22:0/328515682 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f5b08e46c0 0x55f5b08ff4f0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:20.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.771+0000 7fe2cf3d8000 1 --2- 172.21.15.22:0/328515682 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f5b08df900 0x55f5b08ea020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:20.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.771+0000 7fe2cf3d8000 1 --2- 172.21.15.22:0/328515682 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55f5b08abe60 0x55f5b08e9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:20.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.771+0000 7fe2cf3d8000 1 -- 172.21.15.22:0/328515682 >> 172.21.15.22:0/328515682 conn(0x55f5b08ac5c0 msgr2=0x55f5b08f5eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:39:20.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.775+0000 7fe2cf3d8000 1 -- 172.21.15.22:0/328515682 shutdown_connections 2024-05-21T13:39:20.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.775+0000 7fe2cf3d8000 1 -- 172.21.15.22:0/328515682 wait complete. 2024-05-21T13:39:20.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.779+0000 7fe2cf3d8000 1 -- start start 2024-05-21T13:39:20.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.779+0000 7fe2cf3d8000 1 Processor -- start 2024-05-21T13:39:20.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.779+0000 7fe2cf3d8000 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55f5b08abe60 0x55f5b091f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:39:20.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.779+0000 7fe2cf3d8000 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f5b08e46c0 0x55f5b091fae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:39:20.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.779+0000 7fe2cf3d8000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f5b08eba80 0x55f5b08e8470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:39:20.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.779+0000 7fe2cf3d8000 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55f5b06a9040 con 0x55f5b08e46c0 2024-05-21T13:39:20.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.779+0000 7fe2cf3d8000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fe2c42008d0 con 0x55f5b08eba80 2024-05-21T13:39:20.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.779+0000 7fe2cf3d8000 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x55f5b0688200 con 0x55f5b08abe60 2024-05-21T13:39:20.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.779+0000 7fe2cf3d8000 10 client.0 _ll_register_callbacks cb 0x7fe2c0017070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-21T13:39:20.759 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.779+0000 7fe2c9fe9640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55f5b08abe60 0x55f5b091f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:39:20.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.779+0000 7fe2c9fe9640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55f5b08abe60 0x55f5b091f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.22:46416/0 (socket says 172.21.15.22:46416) 2024-05-21T13:39:20.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.779+0000 7fe2c9fe9640 1 -- 172.21.15.22:0/901386076 learned_addr learned my addr 172.21.15.22:0/901386076 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:39:20.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.779+0000 7fe2c9fe9640 1 -- 172.21.15.22:0/901386076 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f5b08eba80 msgr2=0x55f5b08e8470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:39:20.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.779+0000 7fe2c9fe9640 1 --2- 172.21.15.22:0/901386076 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f5b08eba80 0x55f5b08e8470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:20.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.779+0000 7fe2c9fe9640 1 -- 172.21.15.22:0/901386076 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f5b08e46c0 msgr2=0x55f5b091fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:39:20.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.779+0000 7fe2c9fe9640 1 --2- 172.21.15.22:0/901386076 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f5b08e46c0 0x55f5b091fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:20.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.779+0000 7fe2c9fe9640 1 -- 172.21.15.22:0/901386076 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) -- 0x55f5b0683f20 con 0x55f5b08abe60 2024-05-21T13:39:20.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.779+0000 7fe2c9fe9640 1 --2- 172.21.15.22:0/901386076 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55f5b08abe60 0x55f5b091f5a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe2c00015f0 tx=0x7fe2c0001b60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5c252deba977d37 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:39:20.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.779+0000 7fe2a4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.115:3301/0 2024-05-21T13:39:20.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.779+0000 7fe2a4ff9640 1 -- 172.21.15.22:0/901386076 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2c0037060 con 0x55f5b08abe60 2024-05-21T13:39:20.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.779+0000 7fe2a4ff9640 1 -- 172.21.15.22:0/901386076 <== mon.2 v2:172.21.15.115:3301/0 2 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7fe2c00052e0 con 0x55f5b08abe60 2024-05-21T13:39:20.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.779+0000 7fe2cf3d8000 1 -- 172.21.15.22:0/901386076 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe2bc0cb070 con 0x55f5b08abe60 2024-05-21T13:39:20.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.779+0000 7fe2a4ff9640 1 -- 172.21.15.22:0/901386076 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7fe2c003d050 con 0x55f5b08abe60 2024-05-21T13:39:20.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.779+0000 7fe2cf3d8000 10 client.4658 fetch_fsmap learned FSMap version 14 2024-05-21T13:39:20.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.779+0000 7fe2cf3d8000 1 -- 172.21.15.22:0/901386076 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x55f5b0696da0 con 0x55f5b08abe60 2024-05-21T13:39:20.762 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.779+0000 7fe2a4ff9640 1 -- 172.21.15.22:0/901386076 <== mon.2 v2:172.21.15.115:3301/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2bc0cb070 con 0x55f5b08abe60 2024-05-21T13:39:20.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.783+0000 7fe2a4ff9640 1 -- 172.21.15.22:0/901386076 <== mon.2 v2:172.21.15.115:3301/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7fe2c0040020 con 0x55f5b08abe60 2024-05-21T13:39:20.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.783+0000 7fe2cf3d8000 10 client.4658 fetch_fsmap finished waiting for FSMap version 14 2024-05-21T13:39:20.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.783+0000 7fe2cf3d8000 10 client.4658 resolve_mds: validated gid 4300 aka daemon mds.f 2024-05-21T13:39:20.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.783+0000 7fe2cf3d8000 20 client.4658 populate_metadata read hostname 'smithi022' 2024-05-21T13:39:20.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.783+0000 7fe2cf3d8000 1 --2- 172.21.15.22:0/901386076 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x55f5b08e9110 0x55f5b08e9520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:39:20.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.783+0000 7fe2cf3d8000 4 client.4658 mds_command: new command op to 4300 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.45, "await_for": 45.0}] 2024-05-21T13:39:20.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.783+0000 7fe2cf3d8000 1 -- 172.21.15.22:0/901386076 --> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.45, "await_for": 45.0}) -- 0x55f5b068b610 con 0x55f5b08e9110 2024-05-21T13:39:20.763 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.783+0000 7fe2c97e8640 1 --2- 172.21.15.22:0/901386076 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x55f5b08e9110 0x55f5b08e9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:39:20.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.783+0000 7fe2a4ff9640 10 client.4658 ms_handle_connect on v2:172.21.15.115:6838/1525097577 2024-05-21T13:39:20.764 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.783+0000 7fe2c97e8640 1 --2- 172.21.15.22:0/901386076 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x55f5b08e9110 0x55f5b08e9520 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b834f6a9d98b1548 server_cookie=b92febfc0d9ef5fd in_seq=0 out_seq=0 2024-05-21T13:39:20.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.795+0000 7fe2a4ff9640 1 -- 172.21.15.22:0/901386076 <== mds.0 v2:172.21.15.115:6838/1525097577 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x55f5b068b610 con 0x55f5b08e9110 2024-05-21T13:39:20.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.795+0000 7fe2a4ff9640 10 client.4658 handle_command_reply: tid=0 2024-05-21T13:39:20.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.795+0000 7fe2cf3d8000 1 client.4658 shutdown 2024-05-21T13:39:20.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.795+0000 7fe2cf3d8000 1 -- 172.21.15.22:0/901386076 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55f5b08abe60 msgr2=0x55f5b091f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:39:20.775 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.795+0000 7fe2cf3d8000 1 --2- 172.21.15.22:0/901386076 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55f5b08abe60 0x55f5b091f5a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fe2c00015f0 tx=0x7fe2c0001b60 comp rx=0 tx=0).stop 2024-05-21T13:39:20.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.795+0000 7fe2cf3d8000 1 -- 172.21.15.22:0/901386076 shutdown_connections 2024-05-21T13:39:20.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.795+0000 7fe2cf3d8000 1 --2- 172.21.15.22:0/901386076 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x55f5b08e9110 0x55f5b08e9520 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:20.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.795+0000 7fe2cf3d8000 1 --2- 172.21.15.22:0/901386076 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55f5b08eba80 0x55f5b08e8470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:20.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.795+0000 7fe2a4ff9640 0 client.4658 ms_handle_reset on v2:172.21.15.115:6838/1525097577 2024-05-21T13:39:20.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.795+0000 7fe2cf3d8000 1 --2- 172.21.15.22:0/901386076 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55f5b08e46c0 0x55f5b091fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:20.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.795+0000 7fe2cf3d8000 1 --2- 172.21.15.22:0/901386076 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55f5b08abe60 0x55f5b091f5a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:20.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.795+0000 7fe2cf3d8000 1 -- 172.21.15.22:0/901386076 >> 172.21.15.22:0/901386076 conn(0x55f5b08ac5c0 msgr2=0x55f5b08f5eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:39:20.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.795+0000 7fe2cf3d8000 1 -- 172.21.15.22:0/901386076 shutdown_connections 2024-05-21T13:39:20.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.795+0000 7fe2cf3d8000 1 -- 172.21.15.22:0/901386076 wait complete. 2024-05-21T13:39:20.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.795+0000 7fe2cf3d8000 20 client.4658 trim_cache size 0 max 16384 2024-05-21T13:39:20.776 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-05-21T13:39:20.777 INFO:teuthology.orchestra.run.smithi022.stdout: "epoch": 14, 2024-05-21T13:39:20.777 INFO:teuthology.orchestra.run.smithi022.stdout: "leader": 4300, 2024-05-21T13:39:20.777 INFO:teuthology.orchestra.run.smithi022.stdout: "set_version": 10, 2024-05-21T13:39:20.777 INFO:teuthology.orchestra.run.smithi022.stdout: "sets": { 2024-05-21T13:39:20.777 INFO:teuthology.orchestra.run.smithi022.stdout: "121f7211": { 2024-05-21T13:39:20.777 INFO:teuthology.orchestra.run.smithi022.stdout: "version": 10, 2024-05-21T13:39:20.777 INFO:teuthology.orchestra.run.smithi022.stdout: "age_ref": 0.0, 2024-05-21T13:39:20.777 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-05-21T13:39:20.777 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "QUIESCED", 2024-05-21T13:39:20.777 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-05-21T13:39:20.777 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-05-21T13:39:20.777 INFO:teuthology.orchestra.run.smithi022.stdout: "timeout": 90.0, 2024-05-21T13:39:20.778 INFO:teuthology.orchestra.run.smithi022.stdout: "expiration": 140.4, 2024-05-21T13:39:20.778 INFO:teuthology.orchestra.run.smithi022.stdout: "members": { 2024-05-21T13:39:20.778 INFO:teuthology.orchestra.run.smithi022.stdout: "file:/": { 2024-05-21T13:39:20.778 INFO:teuthology.orchestra.run.smithi022.stdout: "excluded": false, 2024-05-21T13:39:20.778 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-05-21T13:39:20.778 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "QUIESCED", 2024-05-21T13:39:20.778 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-05-21T13:39:20.778 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-05-21T13:39:20.778 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-05-21T13:39:20.778 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-05-21T13:39:20.778 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-05-21T13:39:20.778 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-05-21T13:39:20.778 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-05-21T13:39:20.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.795+0000 7fe2a7fff640 1 -- 172.21.15.22:0/360116771 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fe2a806f4d0 msgr2=0x7fe2a8071990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:39:20.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.795+0000 7fe2a7fff640 1 --2- 172.21.15.22:0/360116771 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fe2a806f4d0 0x7fe2a8071990 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc0af000 tx=0x7fe2bc0a7000 comp rx=0 tx=0).stop 2024-05-21T13:39:20.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.795+0000 7fe2a7fff640 1 -- 172.21.15.22:0/360116771 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2c4152ca0 msgr2=0x7fe2c414ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:39:20.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.795+0000 7fe2a7fff640 1 --2- 172.21.15.22:0/360116771 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2c4152ca0 0x7fe2c414ef50 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7fe2b400c460 tx=0x7fe2b400c920 comp rx=0 tx=0).stop 2024-05-21T13:39:20.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.795+0000 7fe2a7fff640 1 -- 172.21.15.22:0/360116771 shutdown_connections 2024-05-21T13:39:20.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.795+0000 7fe2a7fff640 1 --2- 172.21.15.22:0/360116771 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fe2a806f4d0 0x7fe2a8071990 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:20.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.795+0000 7fe2a7fff640 1 --2- 172.21.15.22:0/360116771 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe2c4159590 0x7fe2c415aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:20.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.795+0000 7fe2a7fff640 1 --2- 172.21.15.22:0/360116771 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe2c4152ca0 0x7fe2c414ef50 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:20.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.795+0000 7fe2a7fff640 1 --2- 172.21.15.22:0/360116771 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe2c40c8580 0x7fe2c41f7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:20.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.795+0000 7fe2a7fff640 1 -- 172.21.15.22:0/360116771 >> 172.21.15.22:0/360116771 conn(0x7fe2c40ce640 msgr2=0x7fe2c4150c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:39:20.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.795+0000 7fe2a7fff640 1 -- 172.21.15.22:0/360116771 shutdown_connections 2024-05-21T13:39:20.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:20.795+0000 7fe2a7fff640 1 -- 172.21.15.22:0/360116771 wait complete. 2024-05-21T13:39:20.790 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '121f7211', quiesce took 0.9 seconds. Will release after: 19.55 2024-05-21T13:39:30.164 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-21T13:39:30.167 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-21T13:39:40.341 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-21T13:39:40.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.499+0000 7fb860414640 1 Processor -- start 2024-05-21T13:39:40.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.499+0000 7fb860414640 1 -- start start 2024-05-21T13:39:40.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.499+0000 7fb860414640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb858155d80 0x7fb85815b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:39:40.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.499+0000 7fb860414640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb8580cd1c0 0x7fb8580d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:39:40.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.499+0000 7fb860414640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb858156160 con 0x7fb85815bf30 2024-05-21T13:39:40.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.499+0000 7fb860414640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fb8580ccfc0 con 0x7fb8580cd1c0 2024-05-21T13:39:40.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.499+0000 7fb860414640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7fb8580c6560 con 0x7fb858155d80 2024-05-21T13:39:40.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.499+0000 7fb85e9b1640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb8580cd1c0 0x7fb8580d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:39:40.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.499+0000 7fb85d9af640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fb85815bf30 0x7fb8580ce510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:47064/0 (socket says 172.21.15.22:47064) 2024-05-21T13:39:40.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.499+0000 7fb85d9af640 1 -- 172.21.15.22:0/738135040 learned_addr learned my addr 172.21.15.22:0/738135040 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-21T13:39:40.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.499+0000 7fb85e1b0640 1 --2- 172.21.15.22:0/738135040 >> v2:172.21.15.115:3300/0 conn(0x7fb858155d80 0x7fb85815b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:39:40.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.499+0000 7fb85e9b1640 1 -- 172.21.15.22:0/738135040 >> v2:172.21.15.115:3300/0 conn(0x7fb858155d80 msgr2=0x7fb85815b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:39:40.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.499+0000 7fb85e9b1640 1 --2- 172.21.15.22:0/738135040 >> v2:172.21.15.115:3300/0 conn(0x7fb858155d80 0x7fb85815b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:40.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.499+0000 7fb85e9b1640 1 -- 172.21.15.22:0/738135040 >> v1:172.21.15.22:6789/0 conn(0x7fb85815bf30 legacy=0x7fb8580ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:39:40.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.499+0000 7fb85e9b1640 1 -- 172.21.15.22:0/738135040 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb85815c4a0 con 0x7fb8580cd1c0 2024-05-21T13:39:40.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.499+0000 7fb85d1ae640 1 -- 172.21.15.22:0/738135040 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2495830039 0 0) 0x7fb858156160 con 0x7fb85815bf30 2024-05-21T13:39:40.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.503+0000 7fb85e9b1640 1 --2- 172.21.15.22:0/738135040 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8580cd1c0 0x7fb8580d1420 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fb85806de20 tx=0x7fb85001c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b8cabf772abc724 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:39:40.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.503+0000 7fb85d1ae640 1 -- 172.21.15.22:0/738135040 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8500b0070 con 0x7fb8580cd1c0 2024-05-21T13:39:40.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.503+0000 7fb85d1ae640 1 -- 172.21.15.22:0/738135040 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8500ab600 con 0x7fb8580cd1c0 2024-05-21T13:39:40.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.503+0000 7fb85d1ae640 1 -- 172.21.15.22:0/738135040 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8500ab9d0 con 0x7fb8580cd1c0 2024-05-21T13:39:40.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.503+0000 7fb860414640 1 -- 172.21.15.22:0/738135040 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8580cd1c0 msgr2=0x7fb8580d1420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:39:40.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.503+0000 7fb860414640 1 --2- 172.21.15.22:0/738135040 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8580cd1c0 0x7fb8580d1420 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fb85806de20 tx=0x7fb85001c3c0 comp rx=0 tx=0).stop 2024-05-21T13:39:40.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.503+0000 7fb860414640 1 -- 172.21.15.22:0/738135040 shutdown_connections 2024-05-21T13:39:40.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.503+0000 7fb860414640 1 --2- 172.21.15.22:0/738135040 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb8580cd1c0 0x7fb8580d1420 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:40.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.503+0000 7fb860414640 1 --2- 172.21.15.22:0/738135040 >> v2:172.21.15.115:3300/0 conn(0x7fb858155d80 0x7fb85815b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:40.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.503+0000 7fb860414640 1 -- 172.21.15.22:0/738135040 >> 172.21.15.22:0/738135040 conn(0x7fb85806f3b0 msgr2=0x7fb85806d430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:39:40.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.503+0000 7fb860414640 1 -- 172.21.15.22:0/738135040 shutdown_connections 2024-05-21T13:39:40.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.503+0000 7fb860414640 1 -- 172.21.15.22:0/738135040 wait complete. 2024-05-21T13:39:40.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.503+0000 7fb860414640 1 Processor -- start 2024-05-21T13:39:40.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.503+0000 7fb860414640 1 -- start start 2024-05-21T13:39:40.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.503+0000 7fb860414640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb8580cd1c0 0x7fb858151280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:39:40.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.503+0000 7fb860414640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb858155d80 0x7fb85815a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:39:40.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.503+0000 7fb860414640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb85815bf30 0x7fb858145800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:39:40.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.503+0000 7fb860414640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb8580cec20 con 0x7fb858155d80 2024-05-21T13:39:40.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.503+0000 7fb860414640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fb8580cdff0 con 0x7fb8580cd1c0 2024-05-21T13:39:40.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.503+0000 7fb860414640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7fb8580ceda0 con 0x7fb85815bf30 2024-05-21T13:39:40.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.503+0000 7fb85d9af640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb858155d80 0x7fb85815a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:39:40.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.503+0000 7fb85d9af640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb858155d80 0x7fb85815a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55730/0 (socket says 172.21.15.22:55730) 2024-05-21T13:39:40.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.503+0000 7fb85d9af640 1 -- 172.21.15.22:0/4083048464 learned_addr learned my addr 172.21.15.22:0/4083048464 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:39:40.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.503+0000 7fb85e1b0640 1 --2- 172.21.15.22:0/4083048464 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb8580cd1c0 0x7fb858151280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:39:40.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.503+0000 7fb85e9b1640 1 --2- 172.21.15.22:0/4083048464 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb85815bf30 0x7fb858145800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:39:40.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.503+0000 7fb85d9af640 1 -- 172.21.15.22:0/4083048464 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb85815bf30 msgr2=0x7fb858145800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:39:40.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.503+0000 7fb85d9af640 1 --2- 172.21.15.22:0/4083048464 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb85815bf30 0x7fb858145800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:40.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.503+0000 7fb85d9af640 1 -- 172.21.15.22:0/4083048464 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb8580cd1c0 msgr2=0x7fb858151280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:39:40.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.503+0000 7fb85d9af640 1 --2- 172.21.15.22:0/4083048464 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb8580cd1c0 0x7fb858151280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:40.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.503+0000 7fb85d9af640 1 -- 172.21.15.22:0/4083048464 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb858148220 con 0x7fb858155d80 2024-05-21T13:39:40.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.503+0000 7fb85d9af640 1 --2- 172.21.15.22:0/4083048464 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb858155d80 0x7fb85815a190 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb84800c3c0 tx=0x7fb84800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:39:40.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.503+0000 7fb84effd640 1 -- 172.21.15.22:0/4083048464 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8480074e0 con 0x7fb858155d80 2024-05-21T13:39:40.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.503+0000 7fb84effd640 1 -- 172.21.15.22:0/4083048464 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8480047f0 con 0x7fb858155d80 2024-05-21T13:39:40.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.503+0000 7fb860414640 1 -- 172.21.15.22:0/4083048464 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb858146d50 con 0x7fb858155d80 2024-05-21T13:39:40.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.503+0000 7fb84effd640 1 -- 172.21.15.22:0/4083048464 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb848007680 con 0x7fb858155d80 2024-05-21T13:39:40.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.503+0000 7fb860414640 1 -- 172.21.15.22:0/4083048464 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8581f8210 con 0x7fb858155d80 2024-05-21T13:39:40.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.507+0000 7fb860414640 1 -- 172.21.15.22:0/4083048464 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb858077bb0 con 0x7fb858155d80 2024-05-21T13:39:40.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.507+0000 7fb84effd640 1 -- 172.21.15.22:0/4083048464 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fb848011070 con 0x7fb858155d80 2024-05-21T13:39:40.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.507+0000 7fb84effd640 1 --2- 172.21.15.22:0/4083048464 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fb83c06f400 0x7fb83c0718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:39:40.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.507+0000 7fb84effd640 1 -- 172.21.15.22:0/4083048464 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7fb84808f0a0 con 0x7fb858155d80 2024-05-21T13:39:40.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.507+0000 7fb85e1b0640 1 --2- 172.21.15.22:0/4083048464 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fb83c06f400 0x7fb83c0718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:39:40.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.507+0000 7fb85e1b0640 1 --2- 172.21.15.22:0/4083048464 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fb83c06f400 0x7fb83c0718c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb854007330 tx=0x7fb85400b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:39:40.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.511+0000 7fb84effd640 1 -- 172.21.15.22:0/4083048464 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fb84805bd40 con 0x7fb858155d80 2024-05-21T13:39:40.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.707+0000 7fb860414640 1 -- 172.21.15.22:0/4083048464 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb8580ce7f0 con 0x7fb858155d80 2024-05-21T13:39:40.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.707+0000 7fb84effd640 1 -- 172.21.15.22:0/4083048464 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6875 (secure 0 0 0) 0x7fb84805b640 con 0x7fb858155d80 2024-05-21T13:39:40.688 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-21T13:39:40.688 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4224,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/355756580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":355756580},{"type":"v1","addr":"172.21.15.22:6833","nonce":355756580}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4230,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3277017116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":3277017116},{"type":"v1","addr":"172.21.15.22:6835","nonce":3277017116}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4233,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3840772609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3840772609},{"type":"v1","addr":"172.21.15.22:6837","nonce":3840772609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-21T13:35:57.106892+0000","modified":"2024-05-21T13:36:32.396351+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4300,"mds_1":4294,"mds_2":4248},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4248":{"gid":4248,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":12,"addr":"172.21.15.115:6837/2009761279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":2009761279},{"type":"v1","addr":"172.21.15.115:6837","nonce":2009761279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4294":{"gid":4294,"name":"b","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.115:6835/3894678097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3894678097},{"type":"v1","addr":"172.21.15.115:6835","nonce":3894678097}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4300":{"gid":4300,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.115:6839/1525097577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6838","nonce":1525097577},{"type":"v1","addr":"172.21.15.115:6839","nonce":1525097577}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4300,"qdb_cluster":[4248,4300,4294]},"id":1}]} 2024-05-21T13:39:40.689 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 14 2024-05-21T13:39:40.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.711+0000 7fb860414640 1 -- 172.21.15.22:0/4083048464 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fb83c06f400 msgr2=0x7fb83c0718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:39:40.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.711+0000 7fb860414640 1 --2- 172.21.15.22:0/4083048464 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fb83c06f400 0x7fb83c0718c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb854007330 tx=0x7fb85400b040 comp rx=0 tx=0).stop 2024-05-21T13:39:40.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.711+0000 7fb860414640 1 -- 172.21.15.22:0/4083048464 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb858155d80 msgr2=0x7fb85815a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:39:40.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.711+0000 7fb860414640 1 --2- 172.21.15.22:0/4083048464 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb858155d80 0x7fb85815a190 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb84800c3c0 tx=0x7fb84800c880 comp rx=0 tx=0).stop 2024-05-21T13:39:40.690 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.711+0000 7fb860414640 1 -- 172.21.15.22:0/4083048464 shutdown_connections 2024-05-21T13:39:40.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.711+0000 7fb860414640 1 --2- 172.21.15.22:0/4083048464 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fb83c06f400 0x7fb83c0718c0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:40.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.711+0000 7fb860414640 1 --2- 172.21.15.22:0/4083048464 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb85815bf30 0x7fb858145800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:40.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.711+0000 7fb860414640 1 --2- 172.21.15.22:0/4083048464 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb858155d80 0x7fb85815a190 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:40.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.711+0000 7fb860414640 1 --2- 172.21.15.22:0/4083048464 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb8580cd1c0 0x7fb858151280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:40.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.711+0000 7fb860414640 1 -- 172.21.15.22:0/4083048464 >> 172.21.15.22:0/4083048464 conn(0x7fb85806f3b0 msgr2=0x7fb85806d430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:39:40.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.711+0000 7fb860414640 1 -- 172.21.15.22:0/4083048464 shutdown_connections 2024-05-21T13:39:40.691 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.711+0000 7fb860414640 1 -- 172.21.15.22:0/4083048464 wait complete. 2024-05-21T13:39:40.706 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4300 quiesce db --set-id 121f7211 --release --await' 2024-05-21T13:39:40.707 DEBUG:teuthology.orchestra.run.smithi022:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4300 quiesce db --set-id 121f7211 --release --await 2024-05-21T13:39:40.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.847+0000 7fae877fb640 1 Processor -- start 2024-05-21T13:39:40.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.851+0000 7fae877fb640 1 -- start start 2024-05-21T13:39:40.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.851+0000 7fae877fb640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fae80150400 0x7fae800c47f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:39:40.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.851+0000 7fae877fb640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae800c7ed0 con 0x7fae800c9990 2024-05-21T13:39:40.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.851+0000 7fae877fb640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae800c81b0 con 0x7fae800c7440 2024-05-21T13:39:40.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.851+0000 7fae877fb640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fae800c52a0 con 0x7fae80150400 2024-05-21T13:39:40.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.851+0000 7fae85597640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fae80150400 0x7fae800c47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:39:40.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.851+0000 7fae84d96640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fae800c9990 0x7fae8006df50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:47078/0 (socket says 172.21.15.22:47078) 2024-05-21T13:39:40.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.851+0000 7fae84d96640 1 -- 172.21.15.22:0/2270367582 learned_addr learned my addr 172.21.15.22:0/2270367582 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-21T13:39:40.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.851+0000 7fae85597640 1 -- 172.21.15.22:0/2270367582 >> v1:172.21.15.115:6789/0 conn(0x7fae800c7440 legacy=0x7fae801641b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:39:40.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.851+0000 7fae85597640 1 -- 172.21.15.22:0/2270367582 >> v1:172.21.15.22:6789/0 conn(0x7fae800c9990 legacy=0x7fae8006df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:39:40.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.851+0000 7fae77fff640 1 -- 172.21.15.22:0/2270367582 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2130736766 0 0) 0x7fae800c7ed0 con 0x7fae800c9990 2024-05-21T13:39:40.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.851+0000 7fae85597640 1 -- 172.21.15.22:0/2270367582 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae800c5580 con 0x7fae80150400 2024-05-21T13:39:40.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.855+0000 7fae85597640 1 --2- 172.21.15.22:0/2270367582 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fae80150400 0x7fae800c47f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fae7c0097c0 tx=0x7fae7c01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51123e27c515c952 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:39:40.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.855+0000 7fae77fff640 1 -- 172.21.15.22:0/2270367582 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae7c0b0070 con 0x7fae80150400 2024-05-21T13:39:40.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.855+0000 7fae77fff640 1 -- 172.21.15.22:0/2270367582 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae7c0ab600 con 0x7fae80150400 2024-05-21T13:39:40.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.855+0000 7fae77fff640 1 -- 172.21.15.22:0/2270367582 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae7c0ab9d0 con 0x7fae80150400 2024-05-21T13:39:40.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.855+0000 7fae877fb640 1 -- 172.21.15.22:0/2270367582 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fae80150400 msgr2=0x7fae800c47f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:39:40.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.855+0000 7fae877fb640 1 --2- 172.21.15.22:0/2270367582 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fae80150400 0x7fae800c47f0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fae7c0097c0 tx=0x7fae7c01c4a0 comp rx=0 tx=0).stop 2024-05-21T13:39:40.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.855+0000 7fae877fb640 1 -- 172.21.15.22:0/2270367582 shutdown_connections 2024-05-21T13:39:40.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.855+0000 7fae877fb640 1 --2- 172.21.15.22:0/2270367582 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fae80150400 0x7fae800c47f0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:40.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.855+0000 7fae877fb640 1 -- 172.21.15.22:0/2270367582 >> 172.21.15.22:0/2270367582 conn(0x7fae8006cc50 msgr2=0x7fae800cd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:39:40.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.855+0000 7fae877fb640 1 -- 172.21.15.22:0/2270367582 shutdown_connections 2024-05-21T13:39:40.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.855+0000 7fae877fb640 1 -- 172.21.15.22:0/2270367582 wait complete. 2024-05-21T13:39:40.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.855+0000 7fae877fb640 1 Processor -- start 2024-05-21T13:39:40.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.855+0000 7fae877fb640 1 -- start start 2024-05-21T13:39:40.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.855+0000 7fae877fb640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fae800c7440 0x7fae8015d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:39:40.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.855+0000 7fae877fb640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae800c9990 0x7fae80152800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:39:40.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.855+0000 7fae877fb640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fae80150400 0x7fae80152d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:39:40.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.855+0000 7fae877fb640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fae80168270 con 0x7fae800c7440 2024-05-21T13:39:40.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.855+0000 7fae877fb640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fae801680f0 con 0x7fae800c9990 2024-05-21T13:39:40.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.855+0000 7fae877fb640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7fae801683f0 con 0x7fae80150400 2024-05-21T13:39:40.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.855+0000 7fae85597640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fae800c7440 0x7fae8015d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:39:40.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.855+0000 7fae85597640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fae800c7440 0x7fae8015d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55750/0 (socket says 172.21.15.22:55750) 2024-05-21T13:39:40.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.855+0000 7fae85597640 1 -- 172.21.15.22:0/1642044581 learned_addr learned my addr 172.21.15.22:0/1642044581 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:39:40.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.855+0000 7fae84d96640 1 --2- 172.21.15.22:0/1642044581 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae800c9990 0x7fae80152800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:39:40.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.855+0000 7fae85d98640 1 --2- 172.21.15.22:0/1642044581 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fae80150400 0x7fae80152d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:39:40.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.855+0000 7fae85597640 1 -- 172.21.15.22:0/1642044581 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fae80150400 msgr2=0x7fae80152d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:39:40.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.855+0000 7fae85597640 1 --2- 172.21.15.22:0/1642044581 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fae80150400 0x7fae80152d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:40.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.855+0000 7fae85597640 1 -- 172.21.15.22:0/1642044581 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae800c9990 msgr2=0x7fae80152800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:39:40.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.855+0000 7fae85597640 1 --2- 172.21.15.22:0/1642044581 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae800c9990 0x7fae80152800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:40.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.855+0000 7fae85597640 1 -- 172.21.15.22:0/1642044581 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae80147450 con 0x7fae800c7440 2024-05-21T13:39:40.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.855+0000 7fae85597640 1 --2- 172.21.15.22:0/1642044581 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fae800c7440 0x7fae8015d330 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fae7c0ae040 tx=0x7fae7c01ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:39:40.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.855+0000 7fae75ffb640 1 -- 172.21.15.22:0/1642044581 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae7c0bd070 con 0x7fae800c7440 2024-05-21T13:39:40.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.855+0000 7fae75ffb640 1 -- 172.21.15.22:0/1642044581 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae7c004030 con 0x7fae800c7440 2024-05-21T13:39:40.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.855+0000 7fae75ffb640 1 -- 172.21.15.22:0/1642044581 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae7c0b0040 con 0x7fae800c7440 2024-05-21T13:39:40.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.855+0000 7fae877fb640 1 -- 172.21.15.22:0/1642044581 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae80073d70 con 0x7fae800c7440 2024-05-21T13:39:40.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.855+0000 7fae877fb640 1 -- 172.21.15.22:0/1642044581 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae80074010 con 0x7fae800c7440 2024-05-21T13:39:40.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.859+0000 7fae75ffb640 1 -- 172.21.15.22:0/1642044581 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fae7c003620 con 0x7fae800c7440 2024-05-21T13:39:40.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.859+0000 7fae75ffb640 1 --2- 172.21.15.22:0/1642044581 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fae6406f400 0x7fae640718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:39:40.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.859+0000 7fae75ffb640 1 -- 172.21.15.22:0/1642044581 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7fae7c1292f0 con 0x7fae800c7440 2024-05-21T13:39:40.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.859+0000 7fae84d96640 1 --2- 172.21.15.22:0/1642044581 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fae6406f400 0x7fae640718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:39:40.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.859+0000 7fae8a986000 1 Processor -- start 2024-05-21T13:39:40.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.859+0000 7fae8a986000 1 -- start start 2024-05-21T13:39:40.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.859+0000 7fae84d96640 1 --2- 172.21.15.22:0/1642044581 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fae6406f400 0x7fae640718c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fae70007fd0 tx=0x7fae70007b20 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:39:40.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.859+0000 7fae8a986000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ee6fa04b90 0x55ee6f9ce390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:39:40.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.859+0000 7fae8a986000 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee6f9ce8d0 0x55ee6fa09620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:39:40.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.859+0000 7fae8a986000 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55ee6fa09b60 0x55ee6fa09f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:39:40.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.859+0000 7fae8a986000 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55ee6f8238a0 con 0x55ee6f9ce8d0 2024-05-21T13:39:40.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.859+0000 7fae8a986000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55ee6f813440 con 0x55ee6fa04b90 2024-05-21T13:39:40.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.859+0000 7fae8a986000 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x55ee6f817480 con 0x55ee6fa09b60 2024-05-21T13:39:40.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.859+0000 7fae84d96640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee6f9ce8d0 0x55ee6fa09620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:39:40.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.859+0000 7fae84d96640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee6f9ce8d0 0x55ee6fa09620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55758/0 (socket says 172.21.15.22:55758) 2024-05-21T13:39:40.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.859+0000 7fae84d96640 1 -- 172.21.15.22:0/2115865190 learned_addr learned my addr 172.21.15.22:0/2115865190 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:39:40.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.859+0000 7fae85597640 1 --2- 172.21.15.22:0/2115865190 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ee6fa04b90 0x55ee6f9ce390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:39:40.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.859+0000 7fae85d98640 1 --2- 172.21.15.22:0/2115865190 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55ee6fa09b60 0x55ee6fa09f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:39:40.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.859+0000 7fae84d96640 1 -- 172.21.15.22:0/2115865190 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55ee6fa09b60 msgr2=0x55ee6fa09f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:39:40.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.859+0000 7fae84d96640 1 --2- 172.21.15.22:0/2115865190 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55ee6fa09b60 0x55ee6fa09f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:40.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.859+0000 7fae84d96640 1 -- 172.21.15.22:0/2115865190 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ee6fa04b90 msgr2=0x55ee6f9ce390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:39:40.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.859+0000 7fae84d96640 1 --2- 172.21.15.22:0/2115865190 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ee6fa04b90 0x55ee6f9ce390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:40.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.859+0000 7fae84d96640 1 -- 172.21.15.22:0/2115865190 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee6f8bf370 con 0x55ee6f9ce8d0 2024-05-21T13:39:40.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.859+0000 7fae85597640 1 --2- 172.21.15.22:0/2115865190 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ee6fa04b90 0x55ee6f9ce390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:39:40.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.859+0000 7fae84d96640 1 --2- 172.21.15.22:0/2115865190 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee6f9ce8d0 0x55ee6fa09620 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fae800c9d90 tx=0x7fae70012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f8c302c1b2e7d71 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:39:40.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.863+0000 7fae62ffd640 1 -- 172.21.15.22:0/2115865190 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae70005c90 con 0x55ee6f9ce8d0 2024-05-21T13:39:40.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.863+0000 7fae62ffd640 1 -- 172.21.15.22:0/2115865190 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae70005e30 con 0x55ee6f9ce8d0 2024-05-21T13:39:40.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.863+0000 7fae62ffd640 1 -- 172.21.15.22:0/2115865190 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae70015bc0 con 0x55ee6f9ce8d0 2024-05-21T13:39:40.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.863+0000 7fae8a986000 1 -- 172.21.15.22:0/2115865190 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee6f9ce8d0 msgr2=0x55ee6fa09620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:39:40.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.863+0000 7fae8a986000 1 --2- 172.21.15.22:0/2115865190 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee6f9ce8d0 0x55ee6fa09620 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fae800c9d90 tx=0x7fae70012000 comp rx=0 tx=0).stop 2024-05-21T13:39:40.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.863+0000 7fae8a986000 1 -- 172.21.15.22:0/2115865190 shutdown_connections 2024-05-21T13:39:40.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.863+0000 7fae8a986000 1 --2- 172.21.15.22:0/2115865190 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55ee6fa09b60 0x55ee6fa09f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:40.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.863+0000 7fae8a986000 1 --2- 172.21.15.22:0/2115865190 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee6f9ce8d0 0x55ee6fa09620 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:40.844 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.863+0000 7fae8a986000 1 --2- 172.21.15.22:0/2115865190 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ee6fa04b90 0x55ee6f9ce390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:40.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.863+0000 7fae8a986000 1 -- 172.21.15.22:0/2115865190 >> 172.21.15.22:0/2115865190 conn(0x55ee6f8b0f90 msgr2=0x55ee6fa073e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:39:40.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.863+0000 7fae8a986000 1 -- 172.21.15.22:0/2115865190 shutdown_connections 2024-05-21T13:39:40.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.863+0000 7fae8a986000 1 -- 172.21.15.22:0/2115865190 wait complete. 2024-05-21T13:39:40.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.863+0000 7fae8a986000 1 -- start start 2024-05-21T13:39:40.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.863+0000 7fae8a986000 1 Processor -- start 2024-05-21T13:39:40.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.863+0000 7fae8a986000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ee6f9ce8d0 0x55ee6fa03730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:39:40.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.863+0000 7fae8a986000 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee6fa04b90 0x55ee6fa03c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:39:40.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.863+0000 7fae8a986000 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55ee6fa09b60 0x55ee6fa0f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:39:40.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.863+0000 7fae8a986000 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55ee6f7bc170 con 0x55ee6fa04b90 2024-05-21T13:39:40.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.863+0000 7fae8a986000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55ee6f7ba4d0 con 0x55ee6f9ce8d0 2024-05-21T13:39:40.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.863+0000 7fae8a986000 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x55ee6f81bab0 con 0x55ee6fa09b60 2024-05-21T13:39:40.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.863+0000 7fae8a986000 10 client.0 _ll_register_callbacks cb 0x55ee6f7b5ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-21T13:39:40.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.863+0000 7fae84d96640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee6fa04b90 0x55ee6fa03c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:39:40.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.863+0000 7fae84d96640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee6fa04b90 0x55ee6fa03c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55762/0 (socket says 172.21.15.22:55762) 2024-05-21T13:39:40.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.863+0000 7fae84d96640 1 -- 172.21.15.22:0/595122195 learned_addr learned my addr 172.21.15.22:0/595122195 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:39:40.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.863+0000 7fae85597640 1 --2- 172.21.15.22:0/595122195 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ee6f9ce8d0 0x55ee6fa03730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:39:40.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.863+0000 7fae84d96640 1 -- 172.21.15.22:0/595122195 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55ee6fa09b60 msgr2=0x55ee6fa0f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:39:40.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.863+0000 7fae85d98640 1 --2- 172.21.15.22:0/595122195 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55ee6fa09b60 0x55ee6fa0f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:39:40.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.863+0000 7fae84d96640 1 --2- 172.21.15.22:0/595122195 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55ee6fa09b60 0x55ee6fa0f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:40.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.863+0000 7fae84d96640 1 -- 172.21.15.22:0/595122195 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ee6f9ce8d0 msgr2=0x55ee6fa03730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:39:40.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.863+0000 7fae84d96640 1 --2- 172.21.15.22:0/595122195 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ee6f9ce8d0 0x55ee6fa03730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:40.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.863+0000 7fae84d96640 1 -- 172.21.15.22:0/595122195 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee6f85d260 con 0x55ee6fa04b90 2024-05-21T13:39:40.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.863+0000 7fae85597640 1 --2- 172.21.15.22:0/595122195 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ee6f9ce8d0 0x55ee6fa03730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:39:40.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.863+0000 7fae84d96640 1 --2- 172.21.15.22:0/595122195 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee6fa04b90 0x55ee6fa03c70 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fae70000f70 tx=0x7fae70000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f56ae0be21e9fecb server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:39:40.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.863+0000 7fae5bfff640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-05-21T13:39:40.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.863+0000 7fae5bfff640 1 -- 172.21.15.22:0/595122195 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae70021450 con 0x55ee6fa04b90 2024-05-21T13:39:40.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.863+0000 7fae5bfff640 1 -- 172.21.15.22:0/595122195 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7fae70010040 con 0x55ee6fa04b90 2024-05-21T13:39:40.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.863+0000 7fae8a986000 1 -- 172.21.15.22:0/595122195 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fae70005e30 con 0x55ee6fa04b90 2024-05-21T13:39:40.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.863+0000 7fae5bfff640 1 -- 172.21.15.22:0/595122195 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7fae70033050 con 0x55ee6fa04b90 2024-05-21T13:39:40.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.863+0000 7fae8a986000 10 client.4992 fetch_fsmap learned FSMap version 14 2024-05-21T13:39:40.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.863+0000 7fae8a986000 1 -- 172.21.15.22:0/595122195 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x55ee6f7ba6e0 con 0x55ee6fa04b90 2024-05-21T13:39:40.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.863+0000 7fae5bfff640 1 -- 172.21.15.22:0/595122195 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae70005e30 con 0x55ee6fa04b90 2024-05-21T13:39:40.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.863+0000 7fae5bfff640 1 -- 172.21.15.22:0/595122195 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7fae70036020 con 0x55ee6fa04b90 2024-05-21T13:39:40.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.863+0000 7fae8a986000 10 client.4992 fetch_fsmap finished waiting for FSMap version 14 2024-05-21T13:39:40.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.863+0000 7fae8a986000 10 client.4992 resolve_mds: validated gid 4300 aka daemon mds.f 2024-05-21T13:39:40.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.863+0000 7fae8a986000 20 client.4992 populate_metadata read hostname 'smithi022' 2024-05-21T13:39:40.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.863+0000 7fae8a986000 1 --2- 172.21.15.22:0/595122195 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x55ee6fa10150 0x55ee6fa10560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:39:40.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.863+0000 7fae8a986000 4 client.4992 mds_command: new command op to 4300 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-21T13:39:40.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.863+0000 7fae8a986000 1 -- 172.21.15.22:0/595122195 --> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ee6f7af060 con 0x55ee6fa10150 2024-05-21T13:39:40.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.863+0000 7fae85597640 1 --2- 172.21.15.22:0/595122195 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x55ee6fa10150 0x55ee6fa10560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:39:40.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.867+0000 7fae85597640 1 --2- 172.21.15.22:0/595122195 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x55ee6fa10150 0x55ee6fa10560 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fdeca9ce815197ca server_cookie=6c1cb9937345d647 in_seq=0 out_seq=0 2024-05-21T13:39:40.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.867+0000 7fae5bfff640 10 client.4992 ms_handle_connect on v2:172.21.15.115:6838/1525097577 2024-05-21T13:39:40.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.867+0000 7fae5bfff640 1 -- 172.21.15.22:0/595122195 <== mds.0 v2:172.21.15.115:6838/1525097577 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x55ee6f7af060 con 0x55ee6fa10150 2024-05-21T13:39:40.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.867+0000 7fae5bfff640 10 client.4992 handle_command_reply: tid=0 2024-05-21T13:39:40.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.867+0000 7fae8a986000 1 client.4992 shutdown 2024-05-21T13:39:40.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.867+0000 7fae8a986000 1 -- 172.21.15.22:0/595122195 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee6fa04b90 msgr2=0x55ee6fa03c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:39:40.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.867+0000 7fae8a986000 1 --2- 172.21.15.22:0/595122195 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee6fa04b90 0x55ee6fa03c70 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fae70000f70 tx=0x7fae70000ee0 comp rx=0 tx=0).stop 2024-05-21T13:39:40.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.867+0000 7fae8a986000 1 -- 172.21.15.22:0/595122195 shutdown_connections 2024-05-21T13:39:40.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.867+0000 7fae8a986000 1 --2- 172.21.15.22:0/595122195 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55ee6fa09b60 0x55ee6fa0f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:40.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.867+0000 7fae8a986000 1 --2- 172.21.15.22:0/595122195 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee6fa04b90 0x55ee6fa03c70 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:40.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.867+0000 7fae8a986000 1 --2- 172.21.15.22:0/595122195 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x55ee6fa10150 0x55ee6fa10560 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:40.851 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.867+0000 7fae8a986000 1 --2- 172.21.15.22:0/595122195 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ee6f9ce8d0 0x55ee6fa03730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:40.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.867+0000 7fae5bfff640 0 client.4992 ms_handle_reset on v2:172.21.15.115:6838/1525097577 2024-05-21T13:39:40.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.867+0000 7fae8a986000 1 -- 172.21.15.22:0/595122195 >> 172.21.15.22:0/595122195 conn(0x55ee6f8b0f90 msgr2=0x55ee6f9cdb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:39:40.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.867+0000 7fae8a986000 1 -- 172.21.15.22:0/595122195 shutdown_connections 2024-05-21T13:39:40.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.867+0000 7fae8a986000 1 -- 172.21.15.22:0/595122195 wait complete. 2024-05-21T13:39:40.852 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.867+0000 7fae8a986000 20 client.4992 trim_cache size 0 max 16384 2024-05-21T13:39:40.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.883+0000 7fae8a986000 1 Processor -- start 2024-05-21T13:39:40.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.883+0000 7fae8a986000 1 -- start start 2024-05-21T13:39:40.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.887+0000 7fae8a986000 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee6f9ce8d0 0x55ee6fa251d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:39:40.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.887+0000 7fae8a986000 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55ee6fa04b90 0x55ee6fa23da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:39:40.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.887+0000 7fae8a986000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ee6fa09b60 0x55ee6fa242e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:39:40.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.887+0000 7fae8a986000 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fae80201a80 con 0x55ee6f9ce8d0 2024-05-21T13:39:40.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.887+0000 7fae8a986000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fae80072c50 con 0x55ee6fa09b60 2024-05-21T13:39:40.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.887+0000 7fae8a986000 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7fae802015a0 con 0x55ee6fa04b90 2024-05-21T13:39:40.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.887+0000 7fae85597640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee6f9ce8d0 0x55ee6fa251d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:39:40.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.887+0000 7fae85597640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee6f9ce8d0 0x55ee6fa251d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55768/0 (socket says 172.21.15.22:55768) 2024-05-21T13:39:40.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.887+0000 7fae85597640 1 -- 172.21.15.22:0/2357813550 learned_addr learned my addr 172.21.15.22:0/2357813550 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:39:40.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.887+0000 7fae85597640 1 -- 172.21.15.22:0/2357813550 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55ee6fa04b90 msgr2=0x55ee6fa23da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:39:40.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.887+0000 7fae85597640 1 --2- 172.21.15.22:0/2357813550 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55ee6fa04b90 0x55ee6fa23da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:40.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.887+0000 7fae85597640 1 -- 172.21.15.22:0/2357813550 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ee6fa09b60 msgr2=0x55ee6fa242e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:39:40.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.887+0000 7fae85597640 1 --2- 172.21.15.22:0/2357813550 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ee6fa09b60 0x55ee6fa242e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:40.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.887+0000 7fae85597640 1 -- 172.21.15.22:0/2357813550 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee6f898cf0 con 0x55ee6f9ce8d0 2024-05-21T13:39:40.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.887+0000 7fae85597640 1 --2- 172.21.15.22:0/2357813550 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee6f9ce8d0 0x55ee6fa251d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fae7c0f5700 tx=0x7fae7c116040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91ce53a93a764c9a server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:39:40.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.887+0000 7fae627fc640 1 -- 172.21.15.22:0/2357813550 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae7c0f5770 con 0x55ee6f9ce8d0 2024-05-21T13:39:40.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.887+0000 7fae627fc640 1 -- 172.21.15.22:0/2357813550 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae7c0f9b20 con 0x55ee6f9ce8d0 2024-05-21T13:39:40.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.887+0000 7fae627fc640 1 -- 172.21.15.22:0/2357813550 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae7c0fe5d0 con 0x55ee6f9ce8d0 2024-05-21T13:39:40.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.887+0000 7fae8a986000 1 -- 172.21.15.22:0/2357813550 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee6f9ce8d0 msgr2=0x55ee6fa251d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:39:40.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.887+0000 7fae8a986000 1 --2- 172.21.15.22:0/2357813550 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee6f9ce8d0 0x55ee6fa251d0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fae7c0f5700 tx=0x7fae7c116040 comp rx=0 tx=0).stop 2024-05-21T13:39:40.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.887+0000 7fae8a986000 1 -- 172.21.15.22:0/2357813550 shutdown_connections 2024-05-21T13:39:40.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.887+0000 7fae8a986000 1 --2- 172.21.15.22:0/2357813550 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ee6fa09b60 0x55ee6fa242e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:40.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.887+0000 7fae8a986000 1 --2- 172.21.15.22:0/2357813550 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55ee6fa04b90 0x55ee6fa23da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:40.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.887+0000 7fae8a986000 1 --2- 172.21.15.22:0/2357813550 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee6f9ce8d0 0x55ee6fa251d0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:40.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.887+0000 7fae8a986000 1 -- 172.21.15.22:0/2357813550 >> 172.21.15.22:0/2357813550 conn(0x55ee6f8b0f90 msgr2=0x55ee6f9c50f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:39:40.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.887+0000 7fae8a986000 1 -- 172.21.15.22:0/2357813550 shutdown_connections 2024-05-21T13:39:40.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.887+0000 7fae8a986000 1 -- 172.21.15.22:0/2357813550 wait complete. 2024-05-21T13:39:40.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.887+0000 7fae8a986000 1 -- start start 2024-05-21T13:39:40.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.887+0000 7fae8a986000 1 Processor -- start 2024-05-21T13:39:40.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.887+0000 7fae8a986000 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55ee6f9ce8d0 0x55ee6fa0e670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:39:40.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.887+0000 7fae8a986000 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee6fa04b90 0x55ee6fa0ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:39:40.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.887+0000 7fae8a986000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ee6fa09b60 0x55ee6f9c95a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:39:40.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.887+0000 7fae8a986000 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55ee6f80f5f0 con 0x55ee6fa04b90 2024-05-21T13:39:40.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.887+0000 7fae8a986000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55ee6f898860 con 0x55ee6fa09b60 2024-05-21T13:39:40.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.887+0000 7fae8a986000 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x55ee6f7abc50 con 0x55ee6f9ce8d0 2024-05-21T13:39:40.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.887+0000 7fae8a986000 10 client.0 _ll_register_callbacks cb 0x7fae70007630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-21T13:39:40.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.887+0000 7fae84d96640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee6fa04b90 0x55ee6fa0ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:39:40.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.887+0000 7fae84d96640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee6fa04b90 0x55ee6fa0ebb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55774/0 (socket says 172.21.15.22:55774) 2024-05-21T13:39:40.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.887+0000 7fae84d96640 1 -- 172.21.15.22:0/1315021163 learned_addr learned my addr 172.21.15.22:0/1315021163 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:39:40.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.887+0000 7fae85d98640 1 --2- 172.21.15.22:0/1315021163 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ee6fa09b60 0x55ee6f9c95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:39:40.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.887+0000 7fae84d96640 1 -- 172.21.15.22:0/1315021163 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55ee6f9ce8d0 msgr2=0x55ee6fa0e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:39:40.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.887+0000 7fae84d96640 1 --2- 172.21.15.22:0/1315021163 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55ee6f9ce8d0 0x55ee6fa0e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:40.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.887+0000 7fae84d96640 1 -- 172.21.15.22:0/1315021163 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ee6fa09b60 msgr2=0x55ee6f9c95a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:39:40.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.887+0000 7fae84d96640 1 --2- 172.21.15.22:0/1315021163 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ee6fa09b60 0x55ee6f9c95a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:40.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.887+0000 7fae84d96640 1 -- 172.21.15.22:0/1315021163 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee6f7c5ca0 con 0x55ee6fa04b90 2024-05-21T13:39:40.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.887+0000 7fae84d96640 1 --2- 172.21.15.22:0/1315021163 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee6fa04b90 0x55ee6fa0ebb0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fae70000f20 tx=0x7fae70001090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a46e54d6fd514101 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:39:40.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.887+0000 7fae5bfff640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-05-21T13:39:40.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.887+0000 7fae5bfff640 1 -- 172.21.15.22:0/1315021163 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae7003c060 con 0x55ee6fa04b90 2024-05-21T13:39:40.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.887+0000 7fae5bfff640 1 -- 172.21.15.22:0/1315021163 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7fae70010040 con 0x55ee6fa04b90 2024-05-21T13:39:40.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.887+0000 7fae8a986000 1 -- 172.21.15.22:0/1315021163 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fae7c0f9b20 con 0x55ee6fa04b90 2024-05-21T13:39:40.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.887+0000 7fae5bfff640 1 -- 172.21.15.22:0/1315021163 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7fae70042050 con 0x55ee6fa04b90 2024-05-21T13:39:40.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.887+0000 7fae8a986000 10 client.4998 fetch_fsmap learned FSMap version 14 2024-05-21T13:39:40.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.887+0000 7fae8a986000 1 -- 172.21.15.22:0/1315021163 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x55ee6f7aa9c0 con 0x55ee6fa04b90 2024-05-21T13:39:40.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.891+0000 7fae5bfff640 1 -- 172.21.15.22:0/1315021163 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae7c0f9b20 con 0x55ee6fa04b90 2024-05-21T13:39:40.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.891+0000 7fae5bfff640 1 -- 172.21.15.22:0/1315021163 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7fae70045020 con 0x55ee6fa04b90 2024-05-21T13:39:40.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.891+0000 7fae8a986000 10 client.4998 fetch_fsmap finished waiting for FSMap version 14 2024-05-21T13:39:40.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.891+0000 7fae8a986000 10 client.4998 resolve_mds: validated gid 4300 aka daemon mds.f 2024-05-21T13:39:40.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.891+0000 7fae8a986000 20 client.4998 populate_metadata read hostname 'smithi022' 2024-05-21T13:39:40.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.891+0000 7fae8a986000 1 --2- 172.21.15.22:0/1315021163 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x55ee6f9c9ae0 0x55ee6f9c9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:39:40.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.891+0000 7fae8a986000 4 client.4998 mds_command: new command op to 4300 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "121f7211", "release": true, "await": true}] 2024-05-21T13:39:40.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.891+0000 7fae8a986000 1 -- 172.21.15.22:0/1315021163 --> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] -- command(tid 0: {"prefix": "quiesce db", "set_id": "121f7211", "release": true, "await": true}) -- 0x55ee6f8257f0 con 0x55ee6f9c9ae0 2024-05-21T13:39:40.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.891+0000 7fae85597640 1 --2- 172.21.15.22:0/1315021163 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x55ee6f9c9ae0 0x55ee6f9c9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:39:40.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.891+0000 7fae5bfff640 10 client.4998 ms_handle_connect on v2:172.21.15.115:6838/1525097577 2024-05-21T13:39:40.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.891+0000 7fae85597640 1 --2- 172.21.15.22:0/1315021163 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x55ee6f9c9ae0 0x55ee6f9c9ef0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=56f42245101c96bc server_cookie=acf4c6614047b9a3 in_seq=0 out_seq=0 2024-05-21T13:39:40.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.891+0000 7fae5bfff640 1 -- 172.21.15.22:0/1315021163 <== mds.0 v2:172.21.15.115:6838/1525097577 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x55ee6f8257f0 con 0x55ee6f9c9ae0 2024-05-21T13:39:40.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.891+0000 7fae5bfff640 10 client.4998 handle_command_reply: tid=0 2024-05-21T13:39:40.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.891+0000 7fae8a986000 1 client.4998 shutdown 2024-05-21T13:39:40.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.895+0000 7fae8a986000 1 -- 172.21.15.22:0/1315021163 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee6fa04b90 msgr2=0x55ee6fa0ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:39:40.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.895+0000 7fae8a986000 1 --2- 172.21.15.22:0/1315021163 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee6fa04b90 0x55ee6fa0ebb0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fae70000f20 tx=0x7fae70001090 comp rx=0 tx=0).stop 2024-05-21T13:39:40.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.895+0000 7fae8a986000 1 -- 172.21.15.22:0/1315021163 shutdown_connections 2024-05-21T13:39:40.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.895+0000 7fae8a986000 1 --2- 172.21.15.22:0/1315021163 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x55ee6f9c9ae0 0x55ee6f9c9ef0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:40.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.895+0000 7fae8a986000 1 --2- 172.21.15.22:0/1315021163 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ee6fa09b60 0x55ee6f9c95a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:40.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.895+0000 7fae8a986000 1 --2- 172.21.15.22:0/1315021163 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ee6fa04b90 0x55ee6fa0ebb0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:40.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.895+0000 7fae8a986000 1 --2- 172.21.15.22:0/1315021163 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55ee6f9ce8d0 0x55ee6fa0e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:40.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.895+0000 7fae5bfff640 0 client.4998 ms_handle_reset on v2:172.21.15.115:6838/1525097577 2024-05-21T13:39:40.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.895+0000 7fae8a986000 1 -- 172.21.15.22:0/1315021163 >> 172.21.15.22:0/1315021163 conn(0x55ee6f8b0f90 msgr2=0x55ee6fa0df60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:39:40.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.895+0000 7fae8a986000 1 -- 172.21.15.22:0/1315021163 shutdown_connections 2024-05-21T13:39:40.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.895+0000 7fae8a986000 1 -- 172.21.15.22:0/1315021163 wait complete. 2024-05-21T13:39:40.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.895+0000 7fae8a986000 20 client.4998 trim_cache size 0 max 16384 2024-05-21T13:39:40.876 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-05-21T13:39:40.876 INFO:teuthology.orchestra.run.smithi022.stdout: "epoch": 14, 2024-05-21T13:39:40.876 INFO:teuthology.orchestra.run.smithi022.stdout: "leader": 4300, 2024-05-21T13:39:40.876 INFO:teuthology.orchestra.run.smithi022.stdout: "set_version": 12, 2024-05-21T13:39:40.876 INFO:teuthology.orchestra.run.smithi022.stdout: "sets": { 2024-05-21T13:39:40.876 INFO:teuthology.orchestra.run.smithi022.stdout: "121f7211": { 2024-05-21T13:39:40.876 INFO:teuthology.orchestra.run.smithi022.stdout: "version": 12, 2024-05-21T13:39:40.877 INFO:teuthology.orchestra.run.smithi022.stdout: "age_ref": 0.0, 2024-05-21T13:39:40.877 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-05-21T13:39:40.877 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RELEASED", 2024-05-21T13:39:40.877 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-05-21T13:39:40.877 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-05-21T13:39:40.877 INFO:teuthology.orchestra.run.smithi022.stdout: "timeout": 90.0, 2024-05-21T13:39:40.877 INFO:teuthology.orchestra.run.smithi022.stdout: "expiration": 140.4, 2024-05-21T13:39:40.877 INFO:teuthology.orchestra.run.smithi022.stdout: "members": { 2024-05-21T13:39:40.877 INFO:teuthology.orchestra.run.smithi022.stdout: "file:/": { 2024-05-21T13:39:40.877 INFO:teuthology.orchestra.run.smithi022.stdout: "excluded": false, 2024-05-21T13:39:40.877 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-05-21T13:39:40.877 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RELEASED", 2024-05-21T13:39:40.877 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-05-21T13:39:40.878 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-05-21T13:39:40.878 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-05-21T13:39:40.878 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-05-21T13:39:40.878 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-05-21T13:39:40.878 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-05-21T13:39:40.878 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-05-21T13:39:40.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.895+0000 7fae877fb640 1 -- 172.21.15.22:0/1642044581 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fae6406f400 msgr2=0x7fae640718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:39:40.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.895+0000 7fae877fb640 1 --2- 172.21.15.22:0/1642044581 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fae6406f400 0x7fae640718c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fae70007fd0 tx=0x7fae70007b20 comp rx=0 tx=0).stop 2024-05-21T13:39:40.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.895+0000 7fae877fb640 1 -- 172.21.15.22:0/1642044581 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fae800c7440 msgr2=0x7fae8015d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:39:40.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.895+0000 7fae877fb640 1 --2- 172.21.15.22:0/1642044581 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fae800c7440 0x7fae8015d330 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fae7c0ae040 tx=0x7fae7c01ace0 comp rx=0 tx=0).stop 2024-05-21T13:39:40.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.895+0000 7fae877fb640 1 -- 172.21.15.22:0/1642044581 shutdown_connections 2024-05-21T13:39:40.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.895+0000 7fae877fb640 1 --2- 172.21.15.22:0/1642044581 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fae6406f400 0x7fae640718c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:40.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.895+0000 7fae877fb640 1 --2- 172.21.15.22:0/1642044581 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fae80150400 0x7fae80152d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:40.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.895+0000 7fae877fb640 1 --2- 172.21.15.22:0/1642044581 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fae800c9990 0x7fae80152800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:40.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.895+0000 7fae877fb640 1 --2- 172.21.15.22:0/1642044581 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fae800c7440 0x7fae8015d330 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:40.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.895+0000 7fae877fb640 1 -- 172.21.15.22:0/1642044581 >> 172.21.15.22:0/1642044581 conn(0x7fae8006cc50 msgr2=0x7fae8014e110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:39:40.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.895+0000 7fae877fb640 1 -- 172.21.15.22:0/1642044581 shutdown_connections 2024-05-21T13:39:40.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:40.895+0000 7fae877fb640 1 -- 172.21.15.22:0/1642044581 wait complete. 2024-05-21T13:39:40.898 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '121f7211', total seconds elapsed: 21.0 2024-05-21T13:39:40.898 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 20.45 2024-05-21T13:39:40.898 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-21T13:39:41.082 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.103+0000 7ff32a3ac640 1 Processor -- start 2024-05-21T13:39:41.082 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.103+0000 7ff32a3ac640 1 -- start start 2024-05-21T13:39:41.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.103+0000 7ff32a3ac640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff3240c9510 0x7ff324159f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:39:41.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.103+0000 7ff32a3ac640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff3240c8150 0x7ff32415a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:39:41.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.103+0000 7ff32a3ac640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff324159a70 con 0x7ff3240c7d70 2024-05-21T13:39:41.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.103+0000 7ff32a3ac640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7ff324074a00 con 0x7ff3240c9510 2024-05-21T13:39:41.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.103+0000 7ff32a3ac640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7ff32406d2c0 con 0x7ff3240c8150 2024-05-21T13:39:41.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.103+0000 7ff3237fe640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff3240c9510 0x7ff324159f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:39:41.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.103+0000 7ff3237fe640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff3240c9510 0x7ff324159f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55788/0 (socket says 172.21.15.22:55788) 2024-05-21T13:39:41.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.103+0000 7ff3237fe640 1 -- 172.21.15.22:0/2069845595 learned_addr learned my addr 172.21.15.22:0/2069845595 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:39:41.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.103+0000 7ff328949640 1 --2- 172.21.15.22:0/2069845595 >> v2:172.21.15.115:3300/0 conn(0x7ff3240c8150 0x7ff32415a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:39:41.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.103+0000 7ff3237fe640 1 -- 172.21.15.22:0/2069845595 >> v2:172.21.15.115:3300/0 conn(0x7ff3240c8150 msgr2=0x7ff32415a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:39:41.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.103+0000 7ff3237fe640 1 --2- 172.21.15.22:0/2069845595 >> v2:172.21.15.115:3300/0 conn(0x7ff3240c8150 0x7ff32415a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:41.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.103+0000 7ff3237fe640 1 -- 172.21.15.22:0/2069845595 >> v1:172.21.15.115:6789/0 conn(0x7ff3240c7d70 legacy=0x7ff3240c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:39:41.084 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.103+0000 7ff3237fe640 1 -- 172.21.15.22:0/2069845595 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff32406c740 con 0x7ff3240c9510 2024-05-21T13:39:41.086 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.107+0000 7ff3237fe640 1 --2- 172.21.15.22:0/2069845595 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff3240c9510 0x7ff324159f70 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ff324073450 tx=0x7ff31801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37ed4da019520cea server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:39:41.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.107+0000 7ff322ffd640 1 -- 172.21.15.22:0/2069845595 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3180ab430 con 0x7ff3240c9510 2024-05-21T13:39:41.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.107+0000 7ff322ffd640 1 -- 172.21.15.22:0/2069845595 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3180b0070 con 0x7ff3240c9510 2024-05-21T13:39:41.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.107+0000 7ff322ffd640 1 -- 172.21.15.22:0/2069845595 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3180ab7f0 con 0x7ff3240c9510 2024-05-21T13:39:41.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.107+0000 7ff32a3ac640 1 -- 172.21.15.22:0/2069845595 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff3240c9510 msgr2=0x7ff324159f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:39:41.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.107+0000 7ff32a3ac640 1 --2- 172.21.15.22:0/2069845595 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff3240c9510 0x7ff324159f70 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7ff324073450 tx=0x7ff31801c520 comp rx=0 tx=0).stop 2024-05-21T13:39:41.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.111+0000 7ff32a3ac640 1 -- 172.21.15.22:0/2069845595 shutdown_connections 2024-05-21T13:39:41.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.111+0000 7ff32a3ac640 1 --2- 172.21.15.22:0/2069845595 >> v2:172.21.15.115:3300/0 conn(0x7ff3240c8150 0x7ff32415a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:41.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.111+0000 7ff32a3ac640 1 --2- 172.21.15.22:0/2069845595 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff3240c9510 0x7ff324159f70 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:41.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.111+0000 7ff32a3ac640 1 -- 172.21.15.22:0/2069845595 >> 172.21.15.22:0/2069845595 conn(0x7ff324070fd0 msgr2=0x7ff3240713e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:39:41.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.111+0000 7ff32a3ac640 1 -- 172.21.15.22:0/2069845595 shutdown_connections 2024-05-21T13:39:41.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.111+0000 7ff32a3ac640 1 -- 172.21.15.22:0/2069845595 wait complete. 2024-05-21T13:39:41.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.115+0000 7ff32a3ac640 1 Processor -- start 2024-05-21T13:39:41.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.115+0000 7ff32a3ac640 1 -- start start 2024-05-21T13:39:41.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.115+0000 7ff32a3ac640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff3240c7d70 0x7ff32414d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:39:41.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.115+0000 7ff32a3ac640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff3240c8150 0x7ff32415cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:39:41.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.115+0000 7ff32a3ac640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff3240c9510 0x7ff32415d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:39:41.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.115+0000 7ff32a3ac640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff324073640 con 0x7ff3240c8150 2024-05-21T13:39:41.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.115+0000 7ff32a3ac640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7ff3240734c0 con 0x7ff3240c9510 2024-05-21T13:39:41.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.115+0000 7ff32a3ac640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7ff324153d10 con 0x7ff3240c7d70 2024-05-21T13:39:41.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.115+0000 7ff3237fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff3240c8150 0x7ff32415cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:39:41.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.115+0000 7ff3237fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff3240c8150 0x7ff32415cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55798/0 (socket says 172.21.15.22:55798) 2024-05-21T13:39:41.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.115+0000 7ff3237fe640 1 -- 172.21.15.22:0/269446383 learned_addr learned my addr 172.21.15.22:0/269446383 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:39:41.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.115+0000 7ff328949640 1 --2- 172.21.15.22:0/269446383 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff3240c9510 0x7ff32415d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:39:41.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.115+0000 7ff3237fe640 1 -- 172.21.15.22:0/269446383 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff3240c7d70 msgr2=0x7ff32414d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:39:41.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.115+0000 7ff3237fe640 1 --2- 172.21.15.22:0/269446383 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff3240c7d70 0x7ff32414d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:41.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.115+0000 7ff3237fe640 1 -- 172.21.15.22:0/269446383 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff3240c9510 msgr2=0x7ff32415d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:39:41.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.115+0000 7ff3237fe640 1 --2- 172.21.15.22:0/269446383 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff3240c9510 0x7ff32415d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:41.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.115+0000 7ff3237fe640 1 -- 172.21.15.22:0/269446383 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff32415bef0 con 0x7ff3240c8150 2024-05-21T13:39:41.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.115+0000 7ff3237fe640 1 --2- 172.21.15.22:0/269446383 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff3240c8150 0x7ff32415cee0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ff31801a150 tx=0x7ff3180192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:39:41.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.119+0000 7ff320ff9640 1 -- 172.21.15.22:0/269446383 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3180c0680 con 0x7ff3240c8150 2024-05-21T13:39:41.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.119+0000 7ff320ff9640 1 -- 172.21.15.22:0/269446383 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3180c0820 con 0x7ff3240c8150 2024-05-21T13:39:41.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.119+0000 7ff320ff9640 1 -- 172.21.15.22:0/269446383 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3180c0c10 con 0x7ff3240c8150 2024-05-21T13:39:41.098 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.119+0000 7ff32a3ac640 1 -- 172.21.15.22:0/269446383 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff324166fb0 con 0x7ff3240c8150 2024-05-21T13:39:41.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.119+0000 7ff32a3ac640 1 -- 172.21.15.22:0/269446383 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff324167250 con 0x7ff3240c8150 2024-05-21T13:39:41.099 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.119+0000 7ff32a3ac640 1 -- 172.21.15.22:0/269446383 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff32415bc40 con 0x7ff3240c8150 2024-05-21T13:39:41.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.119+0000 7ff320ff9640 1 -- 172.21.15.22:0/269446383 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ff3180b5400 con 0x7ff3240c8150 2024-05-21T13:39:41.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.119+0000 7ff320ff9640 1 --2- 172.21.15.22:0/269446383 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7ff31006f400 0x7ff3100718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:39:41.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.119+0000 7ff320ff9640 1 -- 172.21.15.22:0/269446383 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7ff31812a490 con 0x7ff3240c8150 2024-05-21T13:39:41.102 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.123+0000 7ff323fff640 1 --2- 172.21.15.22:0/269446383 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7ff31006f400 0x7ff3100718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:39:41.104 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.123+0000 7ff323fff640 1 --2- 172.21.15.22:0/269446383 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7ff31006f400 0x7ff3100718c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff314000f70 tx=0x7ff3140079c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:39:41.106 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.127+0000 7ff320ff9640 1 -- 172.21.15.22:0/269446383 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7ff318016110 con 0x7ff3240c8150 2024-05-21T13:39:41.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.431+0000 7ff32a3ac640 1 -- 172.21.15.22:0/269446383 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff3240697d0 con 0x7ff3240c8150 2024-05-21T13:39:41.411 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-21T13:39:41.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.431+0000 7ff320ff9640 1 -- 172.21.15.22:0/269446383 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6875 (secure 0 0 0) 0x7ff3180abe20 con 0x7ff3240c8150 2024-05-21T13:39:41.411 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4224,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/355756580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":355756580},{"type":"v1","addr":"172.21.15.22:6833","nonce":355756580}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4230,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3277017116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":3277017116},{"type":"v1","addr":"172.21.15.22:6835","nonce":3277017116}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4233,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3840772609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3840772609},{"type":"v1","addr":"172.21.15.22:6837","nonce":3840772609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-21T13:35:57.106892+0000","modified":"2024-05-21T13:36:32.396351+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4300,"mds_1":4294,"mds_2":4248},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4248":{"gid":4248,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":12,"addr":"172.21.15.115:6837/2009761279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":2009761279},{"type":"v1","addr":"172.21.15.115:6837","nonce":2009761279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4294":{"gid":4294,"name":"b","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.115:6835/3894678097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3894678097},{"type":"v1","addr":"172.21.15.115:6835","nonce":3894678097}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4300":{"gid":4300,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.115:6839/1525097577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6838","nonce":1525097577},{"type":"v1","addr":"172.21.15.115:6839","nonce":1525097577}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4300,"qdb_cluster":[4248,4300,4294]},"id":1}]} 2024-05-21T13:39:41.412 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 14 2024-05-21T13:39:41.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.435+0000 7ff32a3ac640 1 -- 172.21.15.22:0/269446383 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7ff31006f400 msgr2=0x7ff3100718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:39:41.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.435+0000 7ff32a3ac640 1 --2- 172.21.15.22:0/269446383 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7ff31006f400 0x7ff3100718c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7ff314000f70 tx=0x7ff3140079c0 comp rx=0 tx=0).stop 2024-05-21T13:39:41.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.435+0000 7ff32a3ac640 1 -- 172.21.15.22:0/269446383 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff3240c8150 msgr2=0x7ff32415cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:39:41.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.435+0000 7ff32a3ac640 1 --2- 172.21.15.22:0/269446383 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff3240c8150 0x7ff32415cee0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7ff31801a150 tx=0x7ff3180192c0 comp rx=0 tx=0).stop 2024-05-21T13:39:41.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.435+0000 7ff32a3ac640 1 -- 172.21.15.22:0/269446383 shutdown_connections 2024-05-21T13:39:41.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.435+0000 7ff32a3ac640 1 --2- 172.21.15.22:0/269446383 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7ff31006f400 0x7ff3100718c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:41.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.435+0000 7ff32a3ac640 1 --2- 172.21.15.22:0/269446383 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff3240c9510 0x7ff32415d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:41.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.435+0000 7ff32a3ac640 1 --2- 172.21.15.22:0/269446383 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff3240c8150 0x7ff32415cee0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:41.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.435+0000 7ff32a3ac640 1 --2- 172.21.15.22:0/269446383 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff3240c7d70 0x7ff32414d7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:41.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.435+0000 7ff32a3ac640 1 -- 172.21.15.22:0/269446383 >> 172.21.15.22:0/269446383 conn(0x7ff324070fd0 msgr2=0x7ff3240c7300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:39:41.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.435+0000 7ff32a3ac640 1 -- 172.21.15.22:0/269446383 shutdown_connections 2024-05-21T13:39:41.415 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.435+0000 7ff32a3ac640 1 -- 172.21.15.22:0/269446383 wait complete. 2024-05-21T13:39:41.451 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4300 quiesce db / --timeout 90 --expiration 140.45 --await-for 45.0' 2024-05-21T13:39:41.451 DEBUG:teuthology.orchestra.run.smithi022:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4300 quiesce db / --timeout 90 --expiration 140.45 --await-for 45.0 2024-05-21T13:39:41.641 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.663+0000 7efc26c25640 1 Processor -- start 2024-05-21T13:39:41.642 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.663+0000 7efc26c25640 1 -- start start 2024-05-21T13:39:41.643 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.663+0000 7efc26c25640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7efc20155f60 0x7efc200cdad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:39:41.643 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.663+0000 7efc26c25640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc2015fba0 0x7efc200ce010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:39:41.643 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.663+0000 7efc26c25640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc200c3830 con 0x7efc20068660 2024-05-21T13:39:41.643 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.663+0000 7efc26c25640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7efc200735a0 con 0x7efc20155f60 2024-05-21T13:39:41.643 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.663+0000 7efc26c25640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7efc20160090 con 0x7efc2015fba0 2024-05-21T13:39:41.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.663+0000 7efc251c2640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc2015fba0 0x7efc200ce010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:39:41.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.663+0000 7efc249c1640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7efc20155f60 0x7efc200cdad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:39:41.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.663+0000 7efc251c2640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc2015fba0 0x7efc200ce010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.22:55556/0 (socket says 172.21.15.22:55556) 2024-05-21T13:39:41.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.663+0000 7efc251c2640 1 -- 172.21.15.22:0/1313812614 learned_addr learned my addr 172.21.15.22:0/1313812614 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:39:41.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.663+0000 7efc251c2640 1 -- 172.21.15.22:0/1313812614 >> v2:172.21.15.115:3300/0 conn(0x7efc20155f60 msgr2=0x7efc200cdad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:39:41.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.663+0000 7efc251c2640 1 --2- 172.21.15.22:0/1313812614 >> v2:172.21.15.115:3300/0 conn(0x7efc20155f60 0x7efc200cdad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:41.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.663+0000 7efc251c2640 1 -- 172.21.15.22:0/1313812614 >> v1:172.21.15.22:6789/0 conn(0x7efc20068660 legacy=0x7efc20073a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:39:41.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.663+0000 7efc1f7fe640 1 -- 172.21.15.22:0/1313812614 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2415770232 0 0) 0x7efc200c3830 con 0x7efc20068660 2024-05-21T13:39:41.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.663+0000 7efc251c2640 1 -- 172.21.15.22:0/1313812614 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc200c3b10 con 0x7efc2015fba0 2024-05-21T13:39:41.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.667+0000 7efc251c2640 1 --2- 172.21.15.22:0/1313812614 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc2015fba0 0x7efc200ce010 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7efc10009870 tx=0x7efc1001ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d396fa676bcac1f2 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:39:41.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.667+0000 7efc1f7fe640 1 -- 172.21.15.22:0/1313812614 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc100b5070 con 0x7efc2015fba0 2024-05-21T13:39:41.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.667+0000 7efc1f7fe640 1 -- 172.21.15.22:0/1313812614 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc100a8a50 con 0x7efc2015fba0 2024-05-21T13:39:41.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.667+0000 7efc1f7fe640 1 -- 172.21.15.22:0/1313812614 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc100a8e20 con 0x7efc2015fba0 2024-05-21T13:39:41.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.671+0000 7efc26c25640 1 -- 172.21.15.22:0/1313812614 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc2015fba0 msgr2=0x7efc200ce010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:39:41.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.671+0000 7efc26c25640 1 --2- 172.21.15.22:0/1313812614 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc2015fba0 0x7efc200ce010 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7efc10009870 tx=0x7efc1001ed50 comp rx=0 tx=0).stop 2024-05-21T13:39:41.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.671+0000 7efc26c25640 1 -- 172.21.15.22:0/1313812614 shutdown_connections 2024-05-21T13:39:41.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.671+0000 7efc26c25640 1 --2- 172.21.15.22:0/1313812614 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc2015fba0 0x7efc200ce010 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:41.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.671+0000 7efc26c25640 1 --2- 172.21.15.22:0/1313812614 >> v2:172.21.15.115:3300/0 conn(0x7efc20155f60 0x7efc200cdad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:41.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.671+0000 7efc26c25640 1 -- 172.21.15.22:0/1313812614 >> 172.21.15.22:0/1313812614 conn(0x7efc2006f6b0 msgr2=0x7efc200707b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:39:41.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.671+0000 7efc26c25640 1 -- 172.21.15.22:0/1313812614 shutdown_connections 2024-05-21T13:39:41.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.671+0000 7efc26c25640 1 -- 172.21.15.22:0/1313812614 wait complete. 2024-05-21T13:39:41.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.671+0000 7efc26c25640 1 Processor -- start 2024-05-21T13:39:41.651 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.671+0000 7efc26c25640 1 -- start start 2024-05-21T13:39:41.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.671+0000 7efc26c25640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc20068660 0x7efc2015e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:39:41.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.671+0000 7efc26c25640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc20155f60 0x7efc2014f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:39:41.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.671+0000 7efc26c25640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc2015fba0 0x7efc2014f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:39:41.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.671+0000 7efc26c25640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7efc20156340 con 0x7efc20068660 2024-05-21T13:39:41.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.671+0000 7efc26c25640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7efc200c40d0 con 0x7efc20155f60 2024-05-21T13:39:41.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.671+0000 7efc26c25640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7efc200710f0 con 0x7efc2015fba0 2024-05-21T13:39:41.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.671+0000 7efc249c1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc20068660 0x7efc2015e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:39:41.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.671+0000 7efc249c1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc20068660 0x7efc2015e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55806/0 (socket says 172.21.15.22:55806) 2024-05-21T13:39:41.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.671+0000 7efc249c1640 1 -- 172.21.15.22:0/2086789093 learned_addr learned my addr 172.21.15.22:0/2086789093 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:39:41.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.671+0000 7efc1ffff640 1 --2- 172.21.15.22:0/2086789093 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc20155f60 0x7efc2014f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:39:41.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.671+0000 7efc249c1640 1 -- 172.21.15.22:0/2086789093 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc2015fba0 msgr2=0x7efc2014f9d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-05-21T13:39:41.653 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.671+0000 7efc249c1640 1 --2- 172.21.15.22:0/2086789093 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc2015fba0 0x7efc2014f9d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:41.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.671+0000 7efc249c1640 1 -- 172.21.15.22:0/2086789093 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc20155f60 msgr2=0x7efc2014f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:39:41.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.671+0000 7efc249c1640 1 --2- 172.21.15.22:0/2086789093 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc20155f60 0x7efc2014f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:41.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.671+0000 7efc249c1640 1 -- 172.21.15.22:0/2086789093 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc200b3c80 con 0x7efc20068660 2024-05-21T13:39:41.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.675+0000 7efc249c1640 1 --2- 172.21.15.22:0/2086789093 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc20068660 0x7efc2015e240 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7efc18007ef0 tx=0x7efc1800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:39:41.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.675+0000 7efc1d7fa640 1 -- 172.21.15.22:0/2086789093 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc18014620 con 0x7efc20068660 2024-05-21T13:39:41.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.675+0000 7efc1d7fa640 1 -- 172.21.15.22:0/2086789093 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc18019070 con 0x7efc20068660 2024-05-21T13:39:41.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.675+0000 7efc26c25640 1 -- 172.21.15.22:0/2086789093 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc201f22f0 con 0x7efc20068660 2024-05-21T13:39:41.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.675+0000 7efc1d7fa640 1 -- 172.21.15.22:0/2086789093 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc180149e0 con 0x7efc20068660 2024-05-21T13:39:41.655 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.675+0000 7efc26c25640 1 -- 172.21.15.22:0/2086789093 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc201f2590 con 0x7efc20068660 2024-05-21T13:39:41.656 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.675+0000 7efc1d7fa640 1 -- 172.21.15.22:0/2086789093 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7efc18014b80 con 0x7efc20068660 2024-05-21T13:39:41.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.679+0000 7efc1d7fa640 1 --2- 172.21.15.22:0/2086789093 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7efc0c06f430 0x7efc0c0718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:39:41.657 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.679+0000 7efc29db0000 1 Processor -- start 2024-05-21T13:39:41.659 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.679+0000 7efc29db0000 1 -- start start 2024-05-21T13:39:41.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.679+0000 7efc1d7fa640 1 -- 172.21.15.22:0/2086789093 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7efc1808fdf0 con 0x7efc20068660 2024-05-21T13:39:41.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.679+0000 7efc29db0000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556560329650 0x5565602f20a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:39:41.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.679+0000 7efc29db0000 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x556560329a30 0x5565602f25e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:39:41.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.679+0000 7efc29db0000 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55656032b180 0x55656032b560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:39:41.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.679+0000 7efc29db0000 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x556560146730 con 0x55656032b180 2024-05-21T13:39:41.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.679+0000 7efc29db0000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5565601362d0 con 0x556560329650 2024-05-21T13:39:41.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.679+0000 7efc29db0000 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x55656013a310 con 0x556560329a30 2024-05-21T13:39:41.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.679+0000 7efc1ffff640 1 --2- 172.21.15.22:0/2086789093 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7efc0c06f430 0x7efc0c0718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:39:41.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.679+0000 7efc251c2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55656032b180 0x55656032b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:39:41.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.679+0000 7efc251c2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55656032b180 0x55656032b560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55810/0 (socket says 172.21.15.22:55810) 2024-05-21T13:39:41.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.679+0000 7efc251c2640 1 -- 172.21.15.22:0/4245027910 learned_addr learned my addr 172.21.15.22:0/4245027910 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:39:41.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.679+0000 7efc1ffff640 1 --2- 172.21.15.22:0/4245027910 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x556560329a30 0x5565602f25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:39:41.660 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.679+0000 7efc251c2640 1 -- 172.21.15.22:0/4245027910 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x556560329a30 msgr2=0x5565602f25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:39:41.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.679+0000 7efc251c2640 1 --2- 172.21.15.22:0/4245027910 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x556560329a30 0x5565602f25e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:41.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.679+0000 7efc251c2640 1 -- 172.21.15.22:0/4245027910 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556560329650 msgr2=0x5565602f20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:39:41.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.679+0000 7efc249c1640 1 --2- 172.21.15.22:0/4245027910 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556560329650 0x5565602f20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:39:41.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.679+0000 7efc251c2640 1 --2- 172.21.15.22:0/4245027910 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556560329650 0x5565602f20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:41.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.679+0000 7efc251c2640 1 -- 172.21.15.22:0/4245027910 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55656017fa30 con 0x55656032b180 2024-05-21T13:39:41.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.679+0000 7efc249c1640 1 --2- 172.21.15.22:0/4245027910 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556560329650 0x5565602f20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:39:41.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.679+0000 7efc251c2640 1 --2- 172.21.15.22:0/4245027910 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55656032b180 0x55656032b560 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7efc100b3040 tx=0x7efc10004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a136545566ee786 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:39:41.661 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.683+0000 7efc067fc640 1 -- 172.21.15.22:0/4245027910 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc100c0070 con 0x55656032b180 2024-05-21T13:39:41.662 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.683+0000 7efc067fc640 1 -- 172.21.15.22:0/4245027910 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc100a8a50 con 0x55656032b180 2024-05-21T13:39:41.662 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.683+0000 7efc067fc640 1 -- 172.21.15.22:0/4245027910 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc100b5070 con 0x55656032b180 2024-05-21T13:39:41.662 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.683+0000 7efc1ffff640 1 --2- 172.21.15.22:0/2086789093 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7efc0c06f430 0x7efc0c0718f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7efc201f5ea0 tx=0x7efc140166d0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:39:41.663 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.683+0000 7efc29db0000 1 -- 172.21.15.22:0/4245027910 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55656032b180 msgr2=0x55656032b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:39:41.663 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.683+0000 7efc29db0000 1 --2- 172.21.15.22:0/4245027910 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55656032b180 0x55656032b560 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7efc100b3040 tx=0x7efc10004740 comp rx=0 tx=0).stop 2024-05-21T13:39:41.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.683+0000 7efc29db0000 1 -- 172.21.15.22:0/4245027910 shutdown_connections 2024-05-21T13:39:41.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.683+0000 7efc29db0000 1 --2- 172.21.15.22:0/4245027910 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55656032b180 0x55656032b560 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:41.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.683+0000 7efc29db0000 1 --2- 172.21.15.22:0/4245027910 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x556560329a30 0x5565602f25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:41.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.683+0000 7efc29db0000 1 --2- 172.21.15.22:0/4245027910 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556560329650 0x5565602f20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:41.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.683+0000 7efc29db0000 1 -- 172.21.15.22:0/4245027910 >> 172.21.15.22:0/4245027910 conn(0x5565602f35c0 msgr2=0x556560328f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:39:41.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.687+0000 7efc29db0000 1 -- 172.21.15.22:0/4245027910 shutdown_connections 2024-05-21T13:39:41.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.687+0000 7efc29db0000 1 -- 172.21.15.22:0/4245027910 wait complete. 2024-05-21T13:39:41.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.687+0000 7efc29db0000 1 -- start start 2024-05-21T13:39:41.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.687+0000 7efc29db0000 1 Processor -- start 2024-05-21T13:39:41.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.687+0000 7efc29db0000 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x556560329650 0x55656033e690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:39:41.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.687+0000 7efc29db0000 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556560329a30 0x55656033ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:39:41.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.687+0000 7efc29db0000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55656032b180 0x556560328b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:39:41.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.687+0000 7efc29db0000 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55655fe01b70 con 0x556560329a30 2024-05-21T13:39:41.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.687+0000 7efc29db0000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x5565600f2490 con 0x55656032b180 2024-05-21T13:39:41.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.687+0000 7efc29db0000 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x55656013e940 con 0x556560329650 2024-05-21T13:39:41.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.687+0000 7efc29db0000 10 client.0 _ll_register_callbacks cb 0x5565602d6350 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-21T13:39:41.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.687+0000 7efc249c1640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x556560329650 0x55656033e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:39:41.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.687+0000 7efc249c1640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x556560329650 0x55656033e690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.22:55584/0 (socket says 172.21.15.22:55584) 2024-05-21T13:39:41.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.687+0000 7efc249c1640 1 -- 172.21.15.22:0/2050949248 learned_addr learned my addr 172.21.15.22:0/2050949248 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:39:41.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.687+0000 7efc1ffff640 1 --2- 172.21.15.22:0/2050949248 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556560329a30 0x55656033ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:39:41.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.691+0000 7efc249c1640 1 -- 172.21.15.22:0/2050949248 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55656032b180 msgr2=0x556560328b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:39:41.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.691+0000 7efc251c2640 1 --2- 172.21.15.22:0/2050949248 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55656032b180 0x556560328b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:39:41.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.691+0000 7efc249c1640 1 --2- 172.21.15.22:0/2050949248 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55656032b180 0x556560328b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:41.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.691+0000 7efc249c1640 1 -- 172.21.15.22:0/2050949248 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556560329a30 msgr2=0x55656033ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:39:41.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.691+0000 7efc249c1640 1 --2- 172.21.15.22:0/2050949248 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556560329a30 0x55656033ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:41.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.691+0000 7efc249c1640 1 -- 172.21.15.22:0/2050949248 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({osdmap=0}) -- 0x556560175710 con 0x556560329650 2024-05-21T13:39:41.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.691+0000 7efc1ffff640 1 --2- 172.21.15.22:0/2050949248 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556560329a30 0x55656033ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-21T13:39:41.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.691+0000 7efc251c2640 1 --2- 172.21.15.22:0/2050949248 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55656032b180 0x556560328b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:39:41.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.695+0000 7efc249c1640 1 --2- 172.21.15.22:0/2050949248 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x556560329650 0x55656033e690 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7efc1800e9b0 tx=0x7efc1805bb30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78718ae3eae695b2 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:39:41.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.695+0000 7efbff7fe640 10 client.0 ms_handle_connect on v2:172.21.15.115:3301/0 2024-05-21T13:39:41.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.695+0000 7efbff7fe640 1 -- 172.21.15.22:0/2050949248 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc18064e40 con 0x556560329650 2024-05-21T13:39:41.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.695+0000 7efbff7fe640 1 -- 172.21.15.22:0/2050949248 <== mon.2 v2:172.21.15.115:3301/0 2 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7efc1805b560 con 0x556560329650 2024-05-21T13:39:41.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.695+0000 7efc29db0000 1 -- 172.21.15.22:0/2050949248 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efc100a8a50 con 0x556560329650 2024-05-21T13:39:41.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.695+0000 7efbff7fe640 1 -- 172.21.15.22:0/2050949248 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7efc1805c300 con 0x556560329650 2024-05-21T13:39:41.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.695+0000 7efc29db0000 10 client.4670 fetch_fsmap learned FSMap version 14 2024-05-21T13:39:41.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.695+0000 7efc29db0000 1 -- 172.21.15.22:0/2050949248 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x5565600d82b0 con 0x556560329650 2024-05-21T13:39:41.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.695+0000 7efbff7fe640 1 -- 172.21.15.22:0/2050949248 <== mon.2 v2:172.21.15.115:3301/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc100a8a50 con 0x556560329650 2024-05-21T13:39:41.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.695+0000 7efbff7fe640 1 -- 172.21.15.22:0/2050949248 <== mon.2 v2:172.21.15.115:3301/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7efc18060170 con 0x556560329650 2024-05-21T13:39:41.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.695+0000 7efc29db0000 10 client.4670 fetch_fsmap finished waiting for FSMap version 14 2024-05-21T13:39:41.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.695+0000 7efc29db0000 10 client.4670 resolve_mds: validated gid 4300 aka daemon mds.f 2024-05-21T13:39:41.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.695+0000 7efc29db0000 20 client.4670 populate_metadata read hostname 'smithi022' 2024-05-21T13:39:41.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.695+0000 7efc29db0000 1 --2- 172.21.15.22:0/2050949248 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x556560320ee0 0x556560353640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:39:41.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.695+0000 7efc29db0000 4 client.4670 mds_command: new command op to 4300 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-21T13:39:41.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.695+0000 7efc29db0000 1 -- 172.21.15.22:0/2050949248 --> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5565600d2610 con 0x556560320ee0 2024-05-21T13:39:41.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.695+0000 7efc1ffff640 1 --2- 172.21.15.22:0/2050949248 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x556560320ee0 0x556560353640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:39:41.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.695+0000 7efbff7fe640 10 client.4670 ms_handle_connect on v2:172.21.15.115:6838/1525097577 2024-05-21T13:39:41.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.695+0000 7efc1ffff640 1 --2- 172.21.15.22:0/2050949248 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x556560320ee0 0x556560353640 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5740d080636f66be server_cookie=5aacbeb09b87a65 in_seq=0 out_seq=0 2024-05-21T13:39:41.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.703+0000 7efbff7fe640 1 -- 172.21.15.22:0/2050949248 <== mds.0 v2:172.21.15.115:6838/1525097577 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x5565600d2610 con 0x556560320ee0 2024-05-21T13:39:41.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.703+0000 7efbff7fe640 10 client.4670 handle_command_reply: tid=0 2024-05-21T13:39:41.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.703+0000 7efc29db0000 1 client.4670 shutdown 2024-05-21T13:39:41.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.703+0000 7efc29db0000 1 -- 172.21.15.22:0/2050949248 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x556560329650 msgr2=0x55656033e690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:39:41.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.703+0000 7efc29db0000 1 --2- 172.21.15.22:0/2050949248 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x556560329650 0x55656033e690 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7efc1800e9b0 tx=0x7efc1805bb30 comp rx=0 tx=0).stop 2024-05-21T13:39:41.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.703+0000 7efc29db0000 1 -- 172.21.15.22:0/2050949248 shutdown_connections 2024-05-21T13:39:41.685 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.703+0000 7efc29db0000 1 --2- 172.21.15.22:0/2050949248 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x556560320ee0 0x556560353640 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:41.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.703+0000 7efc29db0000 1 --2- 172.21.15.22:0/2050949248 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55656032b180 0x556560328b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:41.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.703+0000 7efc29db0000 1 --2- 172.21.15.22:0/2050949248 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556560329a30 0x55656033ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:41.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.703+0000 7efc29db0000 1 --2- 172.21.15.22:0/2050949248 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x556560329650 0x55656033e690 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:41.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.703+0000 7efc29db0000 1 -- 172.21.15.22:0/2050949248 >> 172.21.15.22:0/2050949248 conn(0x5565602f35c0 msgr2=0x5565602eb010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:39:41.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.703+0000 7efbff7fe640 0 client.4670 ms_handle_reset on v2:172.21.15.115:6838/1525097577 2024-05-21T13:39:41.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.703+0000 7efc29db0000 1 -- 172.21.15.22:0/2050949248 shutdown_connections 2024-05-21T13:39:41.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.703+0000 7efc29db0000 1 -- 172.21.15.22:0/2050949248 wait complete. 2024-05-21T13:39:41.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.703+0000 7efc29db0000 20 client.4670 trim_cache size 0 max 16384 2024-05-21T13:39:41.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.751+0000 7efc29db0000 1 Processor -- start 2024-05-21T13:39:41.730 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.751+0000 7efc29db0000 1 -- start start 2024-05-21T13:39:41.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.751+0000 7efc29db0000 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x556560329650 0x5565602f1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:39:41.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.751+0000 7efc29db0000 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556560329a30 0x5565602f2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:39:41.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.751+0000 7efc29db0000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55656032b180 0x55656033d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:39:41.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.751+0000 7efc29db0000 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7efc200aeff0 con 0x556560329a30 2024-05-21T13:39:41.731 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.751+0000 7efc29db0000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7efc200ad8c0 con 0x55656032b180 2024-05-21T13:39:41.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.751+0000 7efc29db0000 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7efc201f5a60 con 0x556560329650 2024-05-21T13:39:41.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.751+0000 7efc1ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556560329a30 0x5565602f2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:39:41.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.751+0000 7efc1ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556560329a30 0x5565602f2530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55842/0 (socket says 172.21.15.22:55842) 2024-05-21T13:39:41.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.751+0000 7efc1ffff640 1 -- 172.21.15.22:0/2306150792 learned_addr learned my addr 172.21.15.22:0/2306150792 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:39:41.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.751+0000 7efc249c1640 1 --2- 172.21.15.22:0/2306150792 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x556560329650 0x5565602f1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:39:41.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.751+0000 7efc251c2640 1 --2- 172.21.15.22:0/2306150792 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55656032b180 0x55656033d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:39:41.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.751+0000 7efc1ffff640 1 -- 172.21.15.22:0/2306150792 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x556560329650 msgr2=0x5565602f1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:39:41.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.751+0000 7efc1ffff640 1 --2- 172.21.15.22:0/2306150792 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x556560329650 0x5565602f1ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:41.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.751+0000 7efc1ffff640 1 -- 172.21.15.22:0/2306150792 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55656032b180 msgr2=0x55656033d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:39:41.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.751+0000 7efc1ffff640 1 --2- 172.21.15.22:0/2306150792 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55656032b180 0x55656033d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:41.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.751+0000 7efc1ffff640 1 -- 172.21.15.22:0/2306150792 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565600ebc60 con 0x556560329a30 2024-05-21T13:39:41.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.751+0000 7efc251c2640 1 --2- 172.21.15.22:0/2306150792 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55656032b180 0x55656033d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T13:39:41.732 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.751+0000 7efc1ffff640 1 --2- 172.21.15.22:0/2306150792 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556560329a30 0x5565602f2530 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7efc14000f70 tx=0x7efc1400a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=985be0b88e8fc6a8 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:39:41.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.751+0000 7efc05ffb640 1 -- 172.21.15.22:0/2306150792 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc1401ccc0 con 0x556560329a30 2024-05-21T13:39:41.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.751+0000 7efc05ffb640 1 -- 172.21.15.22:0/2306150792 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc1402c030 con 0x556560329a30 2024-05-21T13:39:41.733 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.751+0000 7efc05ffb640 1 -- 172.21.15.22:0/2306150792 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc1401ce60 con 0x556560329a30 2024-05-21T13:39:41.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.751+0000 7efc29db0000 1 -- 172.21.15.22:0/2306150792 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556560329a30 msgr2=0x5565602f2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:39:41.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.751+0000 7efc29db0000 1 --2- 172.21.15.22:0/2306150792 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556560329a30 0x5565602f2530 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7efc14000f70 tx=0x7efc1400a000 comp rx=0 tx=0).stop 2024-05-21T13:39:41.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.751+0000 7efc29db0000 1 -- 172.21.15.22:0/2306150792 shutdown_connections 2024-05-21T13:39:41.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.751+0000 7efc29db0000 1 --2- 172.21.15.22:0/2306150792 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55656032b180 0x55656033d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:41.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.751+0000 7efc29db0000 1 --2- 172.21.15.22:0/2306150792 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556560329a30 0x5565602f2530 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:41.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.751+0000 7efc29db0000 1 --2- 172.21.15.22:0/2306150792 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x556560329650 0x5565602f1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:41.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.751+0000 7efc29db0000 1 -- 172.21.15.22:0/2306150792 >> 172.21.15.22:0/2306150792 conn(0x5565602f35c0 msgr2=0x5565602ed8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:39:41.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.755+0000 7efc29db0000 1 -- 172.21.15.22:0/2306150792 shutdown_connections 2024-05-21T13:39:41.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.755+0000 7efc29db0000 1 -- 172.21.15.22:0/2306150792 wait complete. 2024-05-21T13:39:41.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.755+0000 7efc29db0000 1 -- start start 2024-05-21T13:39:41.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.755+0000 7efc29db0000 1 Processor -- start 2024-05-21T13:39:41.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.755+0000 7efc29db0000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556560329650 0x5565603257d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:39:41.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.755+0000 7efc29db0000 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556560329a30 0x556560325d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:39:41.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.755+0000 7efc29db0000 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55656032b180 0x556560326250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:39:41.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.755+0000 7efc29db0000 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x5565600f0040 con 0x556560329a30 2024-05-21T13:39:41.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.755+0000 7efc29db0000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7efc200ad270 con 0x556560329650 2024-05-21T13:39:41.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.755+0000 7efc29db0000 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x5565600cf200 con 0x55656032b180 2024-05-21T13:39:41.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.755+0000 7efc29db0000 10 client.0 _ll_register_callbacks cb 0x7efc1800eae0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-21T13:39:41.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.755+0000 7efc1ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556560329a30 0x556560325d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:39:41.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.755+0000 7efc1ffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556560329a30 0x556560325d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:55852/0 (socket says 172.21.15.22:55852) 2024-05-21T13:39:41.737 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.755+0000 7efc1ffff640 1 -- 172.21.15.22:0/2655801575 learned_addr learned my addr 172.21.15.22:0/2655801575 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:39:41.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.755+0000 7efc251c2640 1 --2- 172.21.15.22:0/2655801575 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55656032b180 0x556560326250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:39:41.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.755+0000 7efc249c1640 1 --2- 172.21.15.22:0/2655801575 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556560329650 0x5565603257d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:39:41.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.755+0000 7efc1ffff640 1 -- 172.21.15.22:0/2655801575 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55656032b180 msgr2=0x556560326250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:39:41.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.755+0000 7efc1ffff640 1 --2- 172.21.15.22:0/2655801575 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55656032b180 0x556560326250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:41.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.755+0000 7efc1ffff640 1 -- 172.21.15.22:0/2655801575 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556560329650 msgr2=0x5565603257d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:39:41.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.755+0000 7efc1ffff640 1 --2- 172.21.15.22:0/2655801575 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556560329650 0x5565603257d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:41.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.755+0000 7efc1ffff640 1 -- 172.21.15.22:0/2655801575 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565600caf20 con 0x556560329a30 2024-05-21T13:39:41.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.755+0000 7efc1ffff640 1 --2- 172.21.15.22:0/2655801575 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556560329a30 0x556560325d10 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7efc14000f70 tx=0x7efc14007cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aebecbec259f28b server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:39:41.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.755+0000 7efbff7fe640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-05-21T13:39:41.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.755+0000 7efbff7fe640 1 -- 172.21.15.22:0/2655801575 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc14019890 con 0x556560329a30 2024-05-21T13:39:41.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.755+0000 7efbff7fe640 1 -- 172.21.15.22:0/2655801575 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7efc14019a30 con 0x556560329a30 2024-05-21T13:39:41.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.755+0000 7efc29db0000 1 -- 172.21.15.22:0/2655801575 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efc1402c030 con 0x556560329a30 2024-05-21T13:39:41.738 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.755+0000 7efbff7fe640 1 -- 172.21.15.22:0/2655801575 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7efc14044050 con 0x556560329a30 2024-05-21T13:39:41.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.755+0000 7efc29db0000 10 client.5022 fetch_fsmap learned FSMap version 14 2024-05-21T13:39:41.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.755+0000 7efc29db0000 1 -- 172.21.15.22:0/2655801575 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x5565600ddda0 con 0x556560329a30 2024-05-21T13:39:41.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.755+0000 7efbff7fe640 1 -- 172.21.15.22:0/2655801575 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc1402c030 con 0x556560329a30 2024-05-21T13:39:41.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.755+0000 7efbff7fe640 1 -- 172.21.15.22:0/2655801575 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7efc14047020 con 0x556560329a30 2024-05-21T13:39:41.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.755+0000 7efc29db0000 10 client.5022 fetch_fsmap finished waiting for FSMap version 14 2024-05-21T13:39:41.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.755+0000 7efc29db0000 10 client.5022 resolve_mds: validated gid 4300 aka daemon mds.f 2024-05-21T13:39:41.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.755+0000 7efc29db0000 20 client.5022 populate_metadata read hostname 'smithi022' 2024-05-21T13:39:41.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.755+0000 7efc29db0000 1 --2- 172.21.15.22:0/2655801575 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x5565603bac60 0x5565603bd050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:39:41.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.755+0000 7efc29db0000 4 client.5022 mds_command: new command op to 4300 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.45, "await_for": 45.0}] 2024-05-21T13:39:41.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.755+0000 7efc29db0000 1 -- 172.21.15.22:0/2655801575 --> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 140.45, "await_for": 45.0}) -- 0x556560148680 con 0x5565603bac60 2024-05-21T13:39:41.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.755+0000 7efc249c1640 1 --2- 172.21.15.22:0/2655801575 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x5565603bac60 0x5565603bd050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:39:41.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.759+0000 7efbff7fe640 10 client.5022 ms_handle_connect on v2:172.21.15.115:6838/1525097577 2024-05-21T13:39:41.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.759+0000 7efc249c1640 1 --2- 172.21.15.22:0/2655801575 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x5565603bac60 0x5565603bd050 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6a630f1ef160f155 server_cookie=c616703bbdee3f60 in_seq=0 out_seq=0 2024-05-21T13:39:41.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.771+0000 7efbff7fe640 1 -- 172.21.15.22:0/2655801575 <== mds.0 v2:172.21.15.115:6838/1525097577 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x556560148680 con 0x5565603bac60 2024-05-21T13:39:41.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.771+0000 7efbff7fe640 10 client.5022 handle_command_reply: tid=0 2024-05-21T13:39:41.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.771+0000 7efc29db0000 1 client.5022 shutdown 2024-05-21T13:39:41.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.771+0000 7efc29db0000 1 -- 172.21.15.22:0/2655801575 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556560329a30 msgr2=0x556560325d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:39:41.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.771+0000 7efc29db0000 1 --2- 172.21.15.22:0/2655801575 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556560329a30 0x556560325d10 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7efc14000f70 tx=0x7efc14007cd0 comp rx=0 tx=0).stop 2024-05-21T13:39:41.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.771+0000 7efc29db0000 1 -- 172.21.15.22:0/2655801575 shutdown_connections 2024-05-21T13:39:41.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.771+0000 7efc29db0000 1 --2- 172.21.15.22:0/2655801575 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55656032b180 0x556560326250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:41.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.771+0000 7efc29db0000 1 --2- 172.21.15.22:0/2655801575 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x556560329a30 0x556560325d10 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:41.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.771+0000 7efc29db0000 1 --2- 172.21.15.22:0/2655801575 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x5565603bac60 0x5565603bd050 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:41.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.771+0000 7efc29db0000 1 --2- 172.21.15.22:0/2655801575 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x556560329650 0x5565603257d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:41.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.771+0000 7efbff7fe640 0 client.5022 ms_handle_reset on v2:172.21.15.115:6838/1525097577 2024-05-21T13:39:41.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.771+0000 7efc29db0000 1 -- 172.21.15.22:0/2655801575 >> 172.21.15.22:0/2655801575 conn(0x5565602f35c0 msgr2=0x55656033d5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:39:41.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.771+0000 7efc29db0000 1 -- 172.21.15.22:0/2655801575 shutdown_connections 2024-05-21T13:39:41.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.771+0000 7efc29db0000 1 -- 172.21.15.22:0/2655801575 wait complete. 2024-05-21T13:39:41.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.771+0000 7efc29db0000 20 client.5022 trim_cache size 0 max 16384 2024-05-21T13:39:41.751 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-05-21T13:39:41.751 INFO:teuthology.orchestra.run.smithi022.stdout: "epoch": 14, 2024-05-21T13:39:41.751 INFO:teuthology.orchestra.run.smithi022.stdout: "leader": 4300, 2024-05-21T13:39:41.751 INFO:teuthology.orchestra.run.smithi022.stdout: "set_version": 14, 2024-05-21T13:39:41.752 INFO:teuthology.orchestra.run.smithi022.stdout: "sets": { 2024-05-21T13:39:41.752 INFO:teuthology.orchestra.run.smithi022.stdout: "b76c2ead": { 2024-05-21T13:39:41.752 INFO:teuthology.orchestra.run.smithi022.stdout: "version": 14, 2024-05-21T13:39:41.752 INFO:teuthology.orchestra.run.smithi022.stdout: "age_ref": 0.0, 2024-05-21T13:39:41.752 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-05-21T13:39:41.752 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "QUIESCED", 2024-05-21T13:39:41.752 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-05-21T13:39:41.752 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-05-21T13:39:41.752 INFO:teuthology.orchestra.run.smithi022.stdout: "timeout": 90.0, 2024-05-21T13:39:41.752 INFO:teuthology.orchestra.run.smithi022.stdout: "expiration": 140.4, 2024-05-21T13:39:41.752 INFO:teuthology.orchestra.run.smithi022.stdout: "members": { 2024-05-21T13:39:41.752 INFO:teuthology.orchestra.run.smithi022.stdout: "file:/": { 2024-05-21T13:39:41.752 INFO:teuthology.orchestra.run.smithi022.stdout: "excluded": false, 2024-05-21T13:39:41.752 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-05-21T13:39:41.753 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "QUIESCED", 2024-05-21T13:39:41.753 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-05-21T13:39:41.753 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-05-21T13:39:41.753 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-05-21T13:39:41.753 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-05-21T13:39:41.753 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-05-21T13:39:41.753 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-05-21T13:39:41.753 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-05-21T13:39:41.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.771+0000 7efc26c25640 1 -- 172.21.15.22:0/2086789093 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7efc0c06f430 msgr2=0x7efc0c0718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:39:41.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.771+0000 7efc26c25640 1 --2- 172.21.15.22:0/2086789093 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7efc0c06f430 0x7efc0c0718f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7efc201f5ea0 tx=0x7efc140166d0 comp rx=0 tx=0).stop 2024-05-21T13:39:41.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.771+0000 7efc26c25640 1 -- 172.21.15.22:0/2086789093 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc20068660 msgr2=0x7efc2015e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:39:41.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.771+0000 7efc26c25640 1 --2- 172.21.15.22:0/2086789093 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc20068660 0x7efc2015e240 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7efc18007ef0 tx=0x7efc1800e4b0 comp rx=0 tx=0).stop 2024-05-21T13:39:41.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.771+0000 7efc26c25640 1 -- 172.21.15.22:0/2086789093 shutdown_connections 2024-05-21T13:39:41.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.771+0000 7efc26c25640 1 --2- 172.21.15.22:0/2086789093 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7efc0c06f430 0x7efc0c0718f0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:41.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.771+0000 7efc26c25640 1 --2- 172.21.15.22:0/2086789093 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc2015fba0 0x7efc2014f9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:41.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.771+0000 7efc26c25640 1 --2- 172.21.15.22:0/2086789093 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc20155f60 0x7efc2014f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:41.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.771+0000 7efc26c25640 1 --2- 172.21.15.22:0/2086789093 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc20068660 0x7efc2015e240 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:39:41.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.771+0000 7efc26c25640 1 -- 172.21.15.22:0/2086789093 >> 172.21.15.22:0/2086789093 conn(0x7efc2006f6b0 msgr2=0x7efc20153be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:39:41.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.771+0000 7efc26c25640 1 -- 172.21.15.22:0/2086789093 shutdown_connections 2024-05-21T13:39:41.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:39:41.771+0000 7efc26c25640 1 -- 172.21.15.22:0/2086789093 wait complete. 2024-05-21T13:39:41.766 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'b76c2ead', quiesce took 0.9 seconds. Will release after: 19.55 2024-05-21T13:40:00.310 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-21T13:40:00.313 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-21T13:40:01.317 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-21T13:40:01.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.474+0000 7f04f5a1a640 1 Processor -- start 2024-05-21T13:40:01.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.474+0000 7f04f5a1a640 1 -- start start 2024-05-21T13:40:01.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.474+0000 7f04f5a1a640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f04f00cba20 0x7f04f00c9ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:40:01.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.474+0000 7f04f5a1a640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f04f00c7890 0x7f04f015a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:40:01.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.474+0000 7f04f5a1a640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04f0159af0 con 0x7f04f00c74b0 2024-05-21T13:40:01.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.474+0000 7f04f5a1a640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f04f015d810 con 0x7f04f00cba20 2024-05-21T13:40:01.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.474+0000 7f04f5a1a640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f04f015daf0 con 0x7f04f00c7890 2024-05-21T13:40:01.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.474+0000 7f04ee7fc640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f04f00cba20 0x7f04f00c9ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:40:01.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.474+0000 7f04eeffd640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f04f00c74b0 0x7f04f015d060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:56140/0 (socket says 172.21.15.22:56140) 2024-05-21T13:40:01.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.474+0000 7f04eeffd640 1 -- 172.21.15.22:0/4072790094 learned_addr learned my addr 172.21.15.22:0/4072790094 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-21T13:40:01.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.474+0000 7f04ef7fe640 1 --2- 172.21.15.22:0/4072790094 >> v2:172.21.15.115:3300/0 conn(0x7f04f00c7890 0x7f04f015a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:40:01.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.474+0000 7f04ee7fc640 1 -- 172.21.15.22:0/4072790094 >> v2:172.21.15.115:3300/0 conn(0x7f04f00c7890 msgr2=0x7f04f015a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:40:01.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.474+0000 7f04ee7fc640 1 --2- 172.21.15.22:0/4072790094 >> v2:172.21.15.115:3300/0 conn(0x7f04f00c7890 0x7f04f015a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:40:01.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.474+0000 7f04ee7fc640 1 -- 172.21.15.22:0/4072790094 >> v1:172.21.15.22:6789/0 conn(0x7f04f00c74b0 legacy=0x7f04f015d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:40:01.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.474+0000 7f04ee7fc640 1 -- 172.21.15.22:0/4072790094 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04f015ddd0 con 0x7f04f00cba20 2024-05-21T13:40:01.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.474+0000 7f04edffb640 1 -- 172.21.15.22:0/4072790094 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 324338496 0 0) 0x7f04f0159af0 con 0x7f04f00c74b0 2024-05-21T13:40:01.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.478+0000 7f04ee7fc640 1 --2- 172.21.15.22:0/4072790094 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f04f00cba20 0x7f04f00c9ef0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f04f00cda20 tx=0x7f04e401ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54d78594cfa939b2 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:40:01.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.478+0000 7f04edffb640 1 -- 172.21.15.22:0/4072790094 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e40b5070 con 0x7f04f00cba20 2024-05-21T13:40:01.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.478+0000 7f04edffb640 1 -- 172.21.15.22:0/4072790094 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04e40a8970 con 0x7f04f00cba20 2024-05-21T13:40:01.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.478+0000 7f04edffb640 1 -- 172.21.15.22:0/4072790094 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e40a8d40 con 0x7f04f00cba20 2024-05-21T13:40:01.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.478+0000 7f04f5a1a640 1 -- 172.21.15.22:0/4072790094 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f04f00cba20 msgr2=0x7f04f00c9ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:40:01.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.478+0000 7f04f5a1a640 1 --2- 172.21.15.22:0/4072790094 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f04f00cba20 0x7f04f00c9ef0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f04f00cda20 tx=0x7f04e401ec70 comp rx=0 tx=0).stop 2024-05-21T13:40:01.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.478+0000 7f04f5a1a640 1 -- 172.21.15.22:0/4072790094 shutdown_connections 2024-05-21T13:40:01.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.478+0000 7f04f5a1a640 1 --2- 172.21.15.22:0/4072790094 >> v2:172.21.15.115:3300/0 conn(0x7f04f00c7890 0x7f04f015a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:40:01.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.478+0000 7f04f5a1a640 1 --2- 172.21.15.22:0/4072790094 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f04f00cba20 0x7f04f00c9ef0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:40:01.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.478+0000 7f04f5a1a640 1 -- 172.21.15.22:0/4072790094 >> 172.21.15.22:0/4072790094 conn(0x7f04f006f1c0 msgr2=0x7f04f00707f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:40:01.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.478+0000 7f04f5a1a640 1 -- 172.21.15.22:0/4072790094 shutdown_connections 2024-05-21T13:40:01.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.478+0000 7f04f5a1a640 1 -- 172.21.15.22:0/4072790094 wait complete. 2024-05-21T13:40:01.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.478+0000 7f04f5a1a640 1 Processor -- start 2024-05-21T13:40:01.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.478+0000 7f04f5a1a640 1 -- start start 2024-05-21T13:40:01.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.478+0000 7f04f5a1a640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f04f00c74b0 0x7f04f015b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:40:01.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.478+0000 7f04f5a1a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04f00c7890 0x7f04f014f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:40:01.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.478+0000 7f04f5a1a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f04f00cba20 0x7f04f0074320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:40:01.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.478+0000 7f04f5a1a640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f04f00c86c0 con 0x7f04f00cba20 2024-05-21T13:40:01.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.478+0000 7f04f5a1a640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f04f00c8540 con 0x7f04f00c7890 2024-05-21T13:40:01.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.478+0000 7f04f5a1a640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f04f00c8840 con 0x7f04f00c74b0 2024-05-21T13:40:01.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.478+0000 7f04ef7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f04f00cba20 0x7f04f0074320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:40:01.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.478+0000 7f04ef7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f04f00cba20 0x7f04f0074320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50374/0 (socket says 172.21.15.22:50374) 2024-05-21T13:40:01.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.478+0000 7f04ef7fe640 1 -- 172.21.15.22:0/4123968347 learned_addr learned my addr 172.21.15.22:0/4123968347 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:40:01.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.482+0000 7f04ee7fc640 1 --2- 172.21.15.22:0/4123968347 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04f00c7890 0x7f04f014f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:40:01.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.482+0000 7f04ef7fe640 1 -- 172.21.15.22:0/4123968347 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f04f00c74b0 msgr2=0x7f04f015b660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:40:01.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.482+0000 7f04ef7fe640 1 --2- 172.21.15.22:0/4123968347 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f04f00c74b0 0x7f04f015b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:40:01.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.482+0000 7f04ef7fe640 1 -- 172.21.15.22:0/4123968347 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04f00c7890 msgr2=0x7f04f014f860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:40:01.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.482+0000 7f04ef7fe640 1 --2- 172.21.15.22:0/4123968347 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04f00c7890 0x7f04f014f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:40:01.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.482+0000 7f04ef7fe640 1 -- 172.21.15.22:0/4123968347 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04f015bba0 con 0x7f04f00cba20 2024-05-21T13:40:01.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.482+0000 7f04ef7fe640 1 --2- 172.21.15.22:0/4123968347 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f04f00cba20 0x7f04f0074320 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f04e800d800 tx=0x7f04e800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:40:01.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.482+0000 7f04d7fff640 1 -- 172.21.15.22:0/4123968347 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e800b6c0 con 0x7f04f00cba20 2024-05-21T13:40:01.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.482+0000 7f04d7fff640 1 -- 172.21.15.22:0/4123968347 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04e8019070 con 0x7f04f00cba20 2024-05-21T13:40:01.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.482+0000 7f04d7fff640 1 -- 172.21.15.22:0/4123968347 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04e800baa0 con 0x7f04f00cba20 2024-05-21T13:40:01.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.482+0000 7f04f5a1a640 1 -- 172.21.15.22:0/4123968347 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04f014fda0 con 0x7f04f00cba20 2024-05-21T13:40:01.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.482+0000 7f04f5a1a640 1 -- 172.21.15.22:0/4123968347 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04f01f95d0 con 0x7f04f00cba20 2024-05-21T13:40:01.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.482+0000 7f04f5a1a640 1 -- 172.21.15.22:0/4123968347 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04f00697d0 con 0x7f04f00cba20 2024-05-21T13:40:01.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.482+0000 7f04d7fff640 1 -- 172.21.15.22:0/4123968347 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f04e800bc40 con 0x7f04f00cba20 2024-05-21T13:40:01.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.482+0000 7f04d7fff640 1 --2- 172.21.15.22:0/4123968347 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f04dc06f430 0x7f04dc0718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:40:01.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.482+0000 7f04d7fff640 1 -- 172.21.15.22:0/4123968347 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f04e808fa90 con 0x7f04f00cba20 2024-05-21T13:40:01.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.482+0000 7f04eeffd640 1 --2- 172.21.15.22:0/4123968347 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f04dc06f430 0x7f04dc0718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:40:01.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.482+0000 7f04eeffd640 1 --2- 172.21.15.22:0/4123968347 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f04dc06f430 0x7f04dc0718f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f04e0001d00 tx=0x7f04e0007c60 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:40:01.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.486+0000 7f04d7fff640 1 -- 172.21.15.22:0/4123968347 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f04e805c6a0 con 0x7f04f00cba20 2024-05-21T13:40:01.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.686+0000 7f04f5a1a640 1 -- 172.21.15.22:0/4123968347 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f04f00c2ea0 con 0x7f04f00cba20 2024-05-21T13:40:01.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.686+0000 7f04d7fff640 1 -- 172.21.15.22:0/4123968347 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6875 (secure 0 0 0) 0x7f04e805bfa0 con 0x7f04f00cba20 2024-05-21T13:40:01.667 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-21T13:40:01.668 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4224,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/355756580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":355756580},{"type":"v1","addr":"172.21.15.22:6833","nonce":355756580}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4230,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3277017116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":3277017116},{"type":"v1","addr":"172.21.15.22:6835","nonce":3277017116}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4233,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3840772609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3840772609},{"type":"v1","addr":"172.21.15.22:6837","nonce":3840772609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-21T13:35:57.106892+0000","modified":"2024-05-21T13:36:32.396351+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4300,"mds_1":4294,"mds_2":4248},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4248":{"gid":4248,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":12,"addr":"172.21.15.115:6837/2009761279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":2009761279},{"type":"v1","addr":"172.21.15.115:6837","nonce":2009761279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4294":{"gid":4294,"name":"b","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.115:6835/3894678097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3894678097},{"type":"v1","addr":"172.21.15.115:6835","nonce":3894678097}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4300":{"gid":4300,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.115:6839/1525097577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6838","nonce":1525097577},{"type":"v1","addr":"172.21.15.115:6839","nonce":1525097577}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4300,"qdb_cluster":[4248,4300,4294]},"id":1}]} 2024-05-21T13:40:01.668 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 14 2024-05-21T13:40:01.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.690+0000 7f04f5a1a640 1 -- 172.21.15.22:0/4123968347 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f04dc06f430 msgr2=0x7f04dc0718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:40:01.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.690+0000 7f04f5a1a640 1 --2- 172.21.15.22:0/4123968347 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f04dc06f430 0x7f04dc0718f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f04e0001d00 tx=0x7f04e0007c60 comp rx=0 tx=0).stop 2024-05-21T13:40:01.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.690+0000 7f04f5a1a640 1 -- 172.21.15.22:0/4123968347 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f04f00cba20 msgr2=0x7f04f0074320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:40:01.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.690+0000 7f04f5a1a640 1 --2- 172.21.15.22:0/4123968347 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f04f00cba20 0x7f04f0074320 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f04e800d800 tx=0x7f04e800dcc0 comp rx=0 tx=0).stop 2024-05-21T13:40:01.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.690+0000 7f04f5a1a640 1 -- 172.21.15.22:0/4123968347 shutdown_connections 2024-05-21T13:40:01.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.690+0000 7f04f5a1a640 1 --2- 172.21.15.22:0/4123968347 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f04dc06f430 0x7f04dc0718f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:40:01.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.690+0000 7f04f5a1a640 1 --2- 172.21.15.22:0/4123968347 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f04f00cba20 0x7f04f0074320 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:40:01.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.690+0000 7f04f5a1a640 1 --2- 172.21.15.22:0/4123968347 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f04f00c7890 0x7f04f014f860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:40:01.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.690+0000 7f04f5a1a640 1 --2- 172.21.15.22:0/4123968347 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f04f00c74b0 0x7f04f015b660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:40:01.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.690+0000 7f04f5a1a640 1 -- 172.21.15.22:0/4123968347 >> 172.21.15.22:0/4123968347 conn(0x7f04f006f1c0 msgr2=0x7f04f00c3650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:40:01.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.690+0000 7f04f5a1a640 1 -- 172.21.15.22:0/4123968347 shutdown_connections 2024-05-21T13:40:01.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.690+0000 7f04f5a1a640 1 -- 172.21.15.22:0/4123968347 wait complete. 2024-05-21T13:40:01.687 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4300 quiesce db --set-id b76c2ead --release --await' 2024-05-21T13:40:01.688 DEBUG:teuthology.orchestra.run.smithi022:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4300 quiesce db --set-id b76c2ead --release --await 2024-05-21T13:40:01.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.846+0000 7f6ddfaf7640 1 Processor -- start 2024-05-21T13:40:01.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.846+0000 7f6ddfaf7640 1 -- start start 2024-05-21T13:40:01.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.846+0000 7f6ddfaf7640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f6dd8152aa0 0x7f6dd80c8d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:40:01.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.846+0000 7f6ddfaf7640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6dd80c5800 0x7f6dd80c7350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:40:01.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.846+0000 7f6ddfaf7640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6dd80c7890 0x7f6dd815c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:40:01.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.846+0000 7f6ddfaf7640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f6dd8071690 con 0x7f6dd80c7890 2024-05-21T13:40:01.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.846+0000 7f6ddfaf7640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f6dd80c8700 con 0x7f6dd8152aa0 2024-05-21T13:40:01.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.846+0000 7f6ddfaf7640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f6dd8070e30 con 0x7f6dd80c5800 2024-05-21T13:40:01.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.846+0000 7f6dde094640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6dd80c7890 0x7f6dd815c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:40:01.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.846+0000 7f6dde094640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f6dd80c7890 0x7f6dd815c3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50376/0 (socket says 172.21.15.22:50376) 2024-05-21T13:40:01.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.846+0000 7f6dde094640 1 -- 172.21.15.22:0/1683868112 learned_addr learned my addr 172.21.15.22:0/1683868112 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:40:01.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.846+0000 7f6ddd893640 1 --2- 172.21.15.22:0/1683868112 >> v2:172.21.15.115:3300/0 conn(0x7f6dd8152aa0 0x7f6dd80c8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:40:01.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.846+0000 7f6ddd092640 1 --2- 172.21.15.22:0/1683868112 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6dd80c5800 0x7f6dd80c7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:40:01.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.846+0000 7f6dde094640 1 -- 172.21.15.22:0/1683868112 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6dd80c5800 msgr2=0x7f6dd80c7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:40:01.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.846+0000 7f6dde094640 1 --2- 172.21.15.22:0/1683868112 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6dd80c5800 0x7f6dd80c7350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:40:01.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.846+0000 7f6dde094640 1 -- 172.21.15.22:0/1683868112 >> v2:172.21.15.115:3300/0 conn(0x7f6dd8152aa0 msgr2=0x7f6dd80c8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:40:01.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.846+0000 7f6dde094640 1 --2- 172.21.15.22:0/1683868112 >> v2:172.21.15.115:3300/0 conn(0x7f6dd8152aa0 0x7f6dd80c8d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:40:01.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.846+0000 7f6dde094640 1 -- 172.21.15.22:0/1683868112 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dd80710d0 con 0x7f6dd80c7890 2024-05-21T13:40:01.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.846+0000 7f6ddd893640 1 --2- 172.21.15.22:0/1683868112 >> v2:172.21.15.115:3300/0 conn(0x7f6dd8152aa0 0x7f6dd80c8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:40:01.828 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.846+0000 7f6ddd092640 1 --2- 172.21.15.22:0/1683868112 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6dd80c5800 0x7f6dd80c7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:40:01.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.850+0000 7f6dde094640 1 --2- 172.21.15.22:0/1683868112 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6dd80c7890 0x7f6dd815c3a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f6dd8070bf0 tx=0x7f6dd001eb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cfbefe04c95a4f7 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:40:01.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.850+0000 7f6ddc891640 1 -- 172.21.15.22:0/1683868112 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dd000b2d0 con 0x7f6dd80c7890 2024-05-21T13:40:01.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.850+0000 7f6ddc891640 1 -- 172.21.15.22:0/1683868112 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dd000b470 con 0x7f6dd80c7890 2024-05-21T13:40:01.829 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.850+0000 7f6ddc891640 1 -- 172.21.15.22:0/1683868112 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dd00a7900 con 0x7f6dd80c7890 2024-05-21T13:40:01.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.850+0000 7f6ddfaf7640 1 -- 172.21.15.22:0/1683868112 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6dd80c7890 msgr2=0x7f6dd815c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:40:01.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.850+0000 7f6ddfaf7640 1 --2- 172.21.15.22:0/1683868112 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6dd80c7890 0x7f6dd815c3a0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f6dd8070bf0 tx=0x7f6dd001eb60 comp rx=0 tx=0).stop 2024-05-21T13:40:01.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.850+0000 7f6ddfaf7640 1 -- 172.21.15.22:0/1683868112 shutdown_connections 2024-05-21T13:40:01.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.850+0000 7f6ddfaf7640 1 --2- 172.21.15.22:0/1683868112 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6dd80c5800 0x7f6dd80c7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:40:01.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.850+0000 7f6ddfaf7640 1 --2- 172.21.15.22:0/1683868112 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6dd80c7890 0x7f6dd815c3a0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:40:01.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.850+0000 7f6ddfaf7640 1 --2- 172.21.15.22:0/1683868112 >> v2:172.21.15.115:3300/0 conn(0x7f6dd8152aa0 0x7f6dd80c8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:40:01.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.850+0000 7f6ddfaf7640 1 -- 172.21.15.22:0/1683868112 >> 172.21.15.22:0/1683868112 conn(0x7f6dd806f260 msgr2=0x7f6dd806f670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:40:01.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.850+0000 7f6ddfaf7640 1 -- 172.21.15.22:0/1683868112 shutdown_connections 2024-05-21T13:40:01.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.850+0000 7f6ddfaf7640 1 -- 172.21.15.22:0/1683868112 wait complete. 2024-05-21T13:40:01.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.850+0000 7f6ddfaf7640 1 Processor -- start 2024-05-21T13:40:01.832 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.850+0000 7f6ddfaf7640 1 -- start start 2024-05-21T13:40:01.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.854+0000 7f6ddfaf7640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6dd80c5800 0x7f6dd81f0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:40:01.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.854+0000 7f6ddfaf7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6dd80c7890 0x7f6dd8146b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:40:01.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.854+0000 7f6ddfaf7640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6dd8152aa0 0x7f6dd8142260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:40:01.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.854+0000 7f6ddfaf7640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6dd8163a70 con 0x7f6dd80c7890 2024-05-21T13:40:01.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.854+0000 7f6ddfaf7640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f6dd81638f0 con 0x7f6dd8152aa0 2024-05-21T13:40:01.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.854+0000 7f6ddfaf7640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f6dd8163bf0 con 0x7f6dd80c5800 2024-05-21T13:40:01.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.854+0000 7f6ddd092640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6dd80c7890 0x7f6dd8146b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:40:01.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.854+0000 7f6ddd092640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6dd80c7890 0x7f6dd8146b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50380/0 (socket says 172.21.15.22:50380) 2024-05-21T13:40:01.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.854+0000 7f6ddd092640 1 -- 172.21.15.22:0/26768485 learned_addr learned my addr 172.21.15.22:0/26768485 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:40:01.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.854+0000 7f6ddd893640 1 --2- 172.21.15.22:0/26768485 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6dd80c5800 0x7f6dd81f0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:40:01.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.854+0000 7f6dde094640 1 --2- 172.21.15.22:0/26768485 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6dd8152aa0 0x7f6dd8142260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:40:01.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.854+0000 7f6ddd092640 1 -- 172.21.15.22:0/26768485 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6dd80c5800 msgr2=0x7f6dd81f0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:40:01.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.854+0000 7f6ddd092640 1 --2- 172.21.15.22:0/26768485 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6dd80c5800 0x7f6dd81f0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:40:01.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.854+0000 7f6ddd092640 1 -- 172.21.15.22:0/26768485 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6dd8152aa0 msgr2=0x7f6dd8142260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:40:01.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.854+0000 7f6ddd092640 1 --2- 172.21.15.22:0/26768485 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6dd8152aa0 0x7f6dd8142260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:40:01.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.854+0000 7f6ddd092640 1 -- 172.21.15.22:0/26768485 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6dd8145820 con 0x7f6dd80c7890 2024-05-21T13:40:01.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.854+0000 7f6ddd092640 1 --2- 172.21.15.22:0/26768485 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6dd80c7890 0x7f6dd8146b70 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f6dc800c7f0 tx=0x7f6dc800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:40:01.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.854+0000 7f6dce7fc640 1 -- 172.21.15.22:0/26768485 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc8007a30 con 0x7f6dd80c7890 2024-05-21T13:40:01.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.854+0000 7f6dce7fc640 1 -- 172.21.15.22:0/26768485 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dc8007bd0 con 0x7f6dd80c7890 2024-05-21T13:40:01.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.854+0000 7f6ddfaf7640 1 -- 172.21.15.22:0/26768485 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6dd8145da0 con 0x7f6dd80c7890 2024-05-21T13:40:01.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.854+0000 7f6dce7fc640 1 -- 172.21.15.22:0/26768485 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc80113f0 con 0x7f6dd80c7890 2024-05-21T13:40:01.836 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.854+0000 7f6ddfaf7640 1 -- 172.21.15.22:0/26768485 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6dd81f0350 con 0x7f6dd80c7890 2024-05-21T13:40:01.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.858+0000 7f6dce7fc640 1 -- 172.21.15.22:0/26768485 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f6dc8011590 con 0x7f6dd80c7890 2024-05-21T13:40:01.837 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.858+0000 7f6dce7fc640 1 --2- 172.21.15.22:0/26768485 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f6dbc06f430 0x7f6dbc0718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:40:01.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.858+0000 7f6dce7fc640 1 -- 172.21.15.22:0/26768485 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f6dc808f790 con 0x7f6dd80c7890 2024-05-21T13:40:01.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.858+0000 7f6ddd893640 1 --2- 172.21.15.22:0/26768485 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f6dbc06f430 0x7f6dbc0718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:40:01.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.858+0000 7f6de2c82000 1 Processor -- start 2024-05-21T13:40:01.838 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.858+0000 7f6de2c82000 1 -- start start 2024-05-21T13:40:01.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.858+0000 7f6de2c82000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ae1ac39b90 0x55ae1ac03390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:40:01.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.858+0000 7f6ddd893640 1 --2- 172.21.15.22:0/26768485 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f6dbc06f430 0x7f6dbc0718f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6dd4006fd0 tx=0x7f6dd4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:40:01.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.858+0000 7f6de2c82000 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ae1ac038d0 0x55ae1ac3e620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:40:01.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.858+0000 7f6de2c82000 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55ae1ac3eb60 0x55ae1ac3ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:40:01.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.858+0000 7f6de2c82000 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55ae1aa588a0 con 0x55ae1ac038d0 2024-05-21T13:40:01.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.858+0000 7f6de2c82000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55ae1aa48440 con 0x55ae1ac39b90 2024-05-21T13:40:01.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.858+0000 7f6de2c82000 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x55ae1aa4c480 con 0x55ae1ac3eb60 2024-05-21T13:40:01.839 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.858+0000 7f6ddd092640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ae1ac038d0 0x55ae1ac3e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:40:01.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.858+0000 7f6ddd092640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ae1ac038d0 0x55ae1ac3e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50394/0 (socket says 172.21.15.22:50394) 2024-05-21T13:40:01.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.858+0000 7f6ddd893640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ae1ac39b90 0x55ae1ac03390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:40:01.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.858+0000 7f6ddd092640 1 -- 172.21.15.22:0/1934302320 learned_addr learned my addr 172.21.15.22:0/1934302320 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:40:01.840 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.858+0000 7f6dde094640 1 --2- 172.21.15.22:0/1934302320 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55ae1ac3eb60 0x55ae1ac3ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:40:01.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.858+0000 7f6ddd092640 1 -- 172.21.15.22:0/1934302320 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55ae1ac3eb60 msgr2=0x55ae1ac3ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:40:01.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.858+0000 7f6ddd092640 1 --2- 172.21.15.22:0/1934302320 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55ae1ac3eb60 0x55ae1ac3ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:40:01.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.858+0000 7f6ddd092640 1 -- 172.21.15.22:0/1934302320 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ae1ac39b90 msgr2=0x55ae1ac03390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:40:01.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.858+0000 7f6ddd092640 1 --2- 172.21.15.22:0/1934302320 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ae1ac39b90 0x55ae1ac03390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:40:01.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.858+0000 7f6ddd092640 1 -- 172.21.15.22:0/1934302320 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae1aaf4370 con 0x55ae1ac038d0 2024-05-21T13:40:01.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.858+0000 7f6dde094640 1 --2- 172.21.15.22:0/1934302320 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55ae1ac3eb60 0x55ae1ac3ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T13:40:01.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.858+0000 7f6ddd092640 1 --2- 172.21.15.22:0/1934302320 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ae1ac038d0 0x55ae1ac3e620 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f6dc80582a0 tx=0x7f6dc8057ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74df57809257ccc5 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:40:01.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.858+0000 7f6dbb7fe640 1 -- 172.21.15.22:0/1934302320 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc801e070 con 0x55ae1ac038d0 2024-05-21T13:40:01.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.858+0000 7f6dbb7fe640 1 -- 172.21.15.22:0/1934302320 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dc8064320 con 0x55ae1ac038d0 2024-05-21T13:40:01.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.858+0000 7f6dbb7fe640 1 -- 172.21.15.22:0/1934302320 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc80623e0 con 0x55ae1ac038d0 2024-05-21T13:40:01.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.858+0000 7f6de2c82000 1 -- 172.21.15.22:0/1934302320 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ae1ac038d0 msgr2=0x55ae1ac3e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:40:01.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.858+0000 7f6de2c82000 1 --2- 172.21.15.22:0/1934302320 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ae1ac038d0 0x55ae1ac3e620 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f6dc80582a0 tx=0x7f6dc8057ca0 comp rx=0 tx=0).stop 2024-05-21T13:40:01.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.858+0000 7f6de2c82000 1 -- 172.21.15.22:0/1934302320 shutdown_connections 2024-05-21T13:40:01.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.858+0000 7f6de2c82000 1 --2- 172.21.15.22:0/1934302320 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55ae1ac3eb60 0x55ae1ac3ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:40:01.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.858+0000 7f6de2c82000 1 --2- 172.21.15.22:0/1934302320 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ae1ac038d0 0x55ae1ac3e620 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:40:01.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.858+0000 7f6de2c82000 1 --2- 172.21.15.22:0/1934302320 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ae1ac39b90 0x55ae1ac03390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:40:01.842 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.858+0000 7f6de2c82000 1 -- 172.21.15.22:0/1934302320 >> 172.21.15.22:0/1934302320 conn(0x55ae1aae5f90 msgr2=0x55ae1ac3c3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:40:01.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.858+0000 7f6de2c82000 1 -- 172.21.15.22:0/1934302320 shutdown_connections 2024-05-21T13:40:01.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.862+0000 7f6de2c82000 1 -- 172.21.15.22:0/1934302320 wait complete. 2024-05-21T13:40:01.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.862+0000 7f6de2c82000 1 -- start start 2024-05-21T13:40:01.843 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.862+0000 7f6de2c82000 1 Processor -- start 2024-05-21T13:40:01.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.862+0000 7f6de2c82000 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55ae1ac038d0 0x55ae1ac37d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:40:01.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.862+0000 7f6de2c82000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ae1ac39b90 0x55ae1ac38290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:40:01.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.862+0000 7f6de2c82000 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ae1ac3eb60 0x55ae1ac387d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:40:01.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.862+0000 7f6de2c82000 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55ae1a9f1170 con 0x55ae1ac3eb60 2024-05-21T13:40:01.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.862+0000 7f6de2c82000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55ae1a9ef4d0 con 0x55ae1ac39b90 2024-05-21T13:40:01.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.862+0000 7f6de2c82000 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x55ae1aa50ab0 con 0x55ae1ac038d0 2024-05-21T13:40:01.845 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.862+0000 7f6de2c82000 10 client.0 _ll_register_callbacks cb 0x55ae1a9eaee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-21T13:40:01.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.862+0000 7f6dde094640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ae1ac3eb60 0x55ae1ac387d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:40:01.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.862+0000 7f6dde094640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ae1ac3eb60 0x55ae1ac387d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50398/0 (socket says 172.21.15.22:50398) 2024-05-21T13:40:01.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.862+0000 7f6dde094640 1 -- 172.21.15.22:0/842072216 learned_addr learned my addr 172.21.15.22:0/842072216 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:40:01.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.862+0000 7f6ddd092640 1 --2- 172.21.15.22:0/842072216 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ae1ac39b90 0x55ae1ac38290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:40:01.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.862+0000 7f6ddd893640 1 --2- 172.21.15.22:0/842072216 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55ae1ac038d0 0x55ae1ac37d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:40:01.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.862+0000 7f6dde094640 1 -- 172.21.15.22:0/842072216 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55ae1ac038d0 msgr2=0x55ae1ac37d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:40:01.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.862+0000 7f6dde094640 1 --2- 172.21.15.22:0/842072216 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55ae1ac038d0 0x55ae1ac37d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:40:01.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.862+0000 7f6dde094640 1 -- 172.21.15.22:0/842072216 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ae1ac39b90 msgr2=0x55ae1ac38290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:40:01.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.862+0000 7f6dde094640 1 --2- 172.21.15.22:0/842072216 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ae1ac39b90 0x55ae1ac38290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:40:01.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.862+0000 7f6dde094640 1 -- 172.21.15.22:0/842072216 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae1aa92260 con 0x55ae1ac3eb60 2024-05-21T13:40:01.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.862+0000 7f6dde094640 1 --2- 172.21.15.22:0/842072216 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ae1ac3eb60 0x55ae1ac387d0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f6dd001eba0 tx=0x7f6dd001d3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89d1f7a4486cda51 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:40:01.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.862+0000 7f6db8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-05-21T13:40:01.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.862+0000 7f6db8ff9640 1 -- 172.21.15.22:0/842072216 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dd00a7a20 con 0x55ae1ac3eb60 2024-05-21T13:40:01.846 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.862+0000 7f6db8ff9640 1 -- 172.21.15.22:0/842072216 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f6dd00a7bc0 con 0x55ae1ac3eb60 2024-05-21T13:40:01.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.862+0000 7f6de2c82000 1 -- 172.21.15.22:0/842072216 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6dc8064320 con 0x55ae1ac3eb60 2024-05-21T13:40:01.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.862+0000 7f6db8ff9640 1 -- 172.21.15.22:0/842072216 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f6dd00a7dc0 con 0x55ae1ac3eb60 2024-05-21T13:40:01.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.862+0000 7f6de2c82000 10 client.5043 fetch_fsmap learned FSMap version 14 2024-05-21T13:40:01.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.862+0000 7f6de2c82000 1 -- 172.21.15.22:0/842072216 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x55ae1a9ef6e0 con 0x55ae1ac3eb60 2024-05-21T13:40:01.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.862+0000 7f6db8ff9640 1 -- 172.21.15.22:0/842072216 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dc8064320 con 0x55ae1ac3eb60 2024-05-21T13:40:01.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.862+0000 7f6db8ff9640 1 -- 172.21.15.22:0/842072216 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7f6dd0008040 con 0x55ae1ac3eb60 2024-05-21T13:40:01.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.862+0000 7f6de2c82000 10 client.5043 fetch_fsmap finished waiting for FSMap version 14 2024-05-21T13:40:01.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.862+0000 7f6de2c82000 10 client.5043 resolve_mds: validated gid 4300 aka daemon mds.f 2024-05-21T13:40:01.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.862+0000 7f6de2c82000 20 client.5043 populate_metadata read hostname 'smithi022' 2024-05-21T13:40:01.847 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.862+0000 7f6de2c82000 1 --2- 172.21.15.22:0/842072216 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x55ae1ac564c0 0x55ae1ac588b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:40:01.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.862+0000 7f6de2c82000 4 client.5043 mds_command: new command op to 4300 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-21T13:40:01.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.862+0000 7f6de2c82000 1 -- 172.21.15.22:0/842072216 --> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ae1a9e4060 con 0x55ae1ac564c0 2024-05-21T13:40:01.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.862+0000 7f6ddd893640 1 --2- 172.21.15.22:0/842072216 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x55ae1ac564c0 0x55ae1ac588b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:40:01.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.866+0000 7f6ddd893640 1 --2- 172.21.15.22:0/842072216 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x55ae1ac564c0 0x55ae1ac588b0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=47652bfee8c3848b server_cookie=39107043e85241 in_seq=0 out_seq=0 2024-05-21T13:40:01.848 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.866+0000 7f6db8ff9640 10 client.5043 ms_handle_connect on v2:172.21.15.115:6838/1525097577 2024-05-21T13:40:01.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.866+0000 7f6db8ff9640 1 -- 172.21.15.22:0/842072216 <== mds.0 v2:172.21.15.115:6838/1525097577 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x55ae1a9e4060 con 0x55ae1ac564c0 2024-05-21T13:40:01.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.866+0000 7f6db8ff9640 10 client.5043 handle_command_reply: tid=0 2024-05-21T13:40:01.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.866+0000 7f6de2c82000 1 client.5043 shutdown 2024-05-21T13:40:01.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.866+0000 7f6de2c82000 1 -- 172.21.15.22:0/842072216 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ae1ac3eb60 msgr2=0x55ae1ac387d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:40:01.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.866+0000 7f6de2c82000 1 --2- 172.21.15.22:0/842072216 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ae1ac3eb60 0x55ae1ac387d0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f6dd001eba0 tx=0x7f6dd001d3a0 comp rx=0 tx=0).stop 2024-05-21T13:40:01.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.866+0000 7f6de2c82000 1 -- 172.21.15.22:0/842072216 shutdown_connections 2024-05-21T13:40:01.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.866+0000 7f6de2c82000 1 --2- 172.21.15.22:0/842072216 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ae1ac3eb60 0x55ae1ac387d0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:40:01.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.866+0000 7f6de2c82000 1 --2- 172.21.15.22:0/842072216 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x55ae1ac564c0 0x55ae1ac588b0 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:40:01.849 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.866+0000 7f6de2c82000 1 --2- 172.21.15.22:0/842072216 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ae1ac39b90 0x55ae1ac38290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:40:01.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.866+0000 7f6de2c82000 1 --2- 172.21.15.22:0/842072216 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55ae1ac038d0 0x55ae1ac37d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:40:01.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.866+0000 7f6de2c82000 1 -- 172.21.15.22:0/842072216 >> 172.21.15.22:0/842072216 conn(0x55ae1aae5f90 msgr2=0x55ae1ac3bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:40:01.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.866+0000 7f6db8ff9640 0 client.5043 ms_handle_reset on v2:172.21.15.115:6838/1525097577 2024-05-21T13:40:01.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.866+0000 7f6de2c82000 1 -- 172.21.15.22:0/842072216 shutdown_connections 2024-05-21T13:40:01.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.866+0000 7f6de2c82000 1 -- 172.21.15.22:0/842072216 wait complete. 2024-05-21T13:40:01.850 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.866+0000 7f6de2c82000 20 client.5043 trim_cache size 0 max 16384 2024-05-21T13:40:01.865 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.886+0000 7f6de2c82000 1 Processor -- start 2024-05-21T13:40:01.866 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.886+0000 7f6de2c82000 1 -- start start 2024-05-21T13:40:01.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.886+0000 7f6de2c82000 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55ae1ac038d0 0x55ae1ac53330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:40:01.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.886+0000 7f6de2c82000 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ae1ac39b90 0x55ae1ac361b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:40:01.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.886+0000 7f6de2c82000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ae1ac3eb60 0x55ae1ac366f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:40:01.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.886+0000 7f6de2c82000 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f6dd81fd6f0 con 0x55ae1ac39b90 2024-05-21T13:40:01.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.886+0000 7f6de2c82000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f6dd81402c0 con 0x55ae1ac3eb60 2024-05-21T13:40:01.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.886+0000 7f6de2c82000 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f6dd81fd0a0 con 0x55ae1ac038d0 2024-05-21T13:40:01.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.886+0000 7f6ddd092640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ae1ac39b90 0x55ae1ac361b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:40:01.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.886+0000 7f6ddd092640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ae1ac39b90 0x55ae1ac361b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50414/0 (socket says 172.21.15.22:50414) 2024-05-21T13:40:01.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.886+0000 7f6ddd092640 1 -- 172.21.15.22:0/3898433697 learned_addr learned my addr 172.21.15.22:0/3898433697 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:40:01.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.886+0000 7f6ddd893640 1 --2- 172.21.15.22:0/3898433697 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55ae1ac038d0 0x55ae1ac53330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:40:01.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.886+0000 7f6dde094640 1 --2- 172.21.15.22:0/3898433697 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ae1ac3eb60 0x55ae1ac366f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:40:01.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.886+0000 7f6ddd092640 1 -- 172.21.15.22:0/3898433697 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55ae1ac038d0 msgr2=0x55ae1ac53330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:40:01.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.886+0000 7f6ddd092640 1 --2- 172.21.15.22:0/3898433697 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55ae1ac038d0 0x55ae1ac53330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:40:01.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.886+0000 7f6ddd092640 1 -- 172.21.15.22:0/3898433697 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ae1ac3eb60 msgr2=0x55ae1ac366f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:40:01.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.886+0000 7f6ddd092640 1 --2- 172.21.15.22:0/3898433697 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ae1ac3eb60 0x55ae1ac366f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:40:01.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.886+0000 7f6ddd092640 1 -- 172.21.15.22:0/3898433697 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae1aacdcf0 con 0x55ae1ac39b90 2024-05-21T13:40:01.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.886+0000 7f6ddd893640 1 --2- 172.21.15.22:0/3898433697 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55ae1ac038d0 0x55ae1ac53330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:40:01.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.886+0000 7f6dde094640 1 --2- 172.21.15.22:0/3898433697 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ae1ac3eb60 0x55ae1ac366f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:40:01.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.886+0000 7f6ddd092640 1 --2- 172.21.15.22:0/3898433697 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ae1ac39b90 0x55ae1ac361b0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f6dc805bc40 tx=0x7f6dc801e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39ab09b63169f0b5 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:40:01.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.886+0000 7f6dbaffd640 1 -- 172.21.15.22:0/3898433697 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc805ffb0 con 0x55ae1ac39b90 2024-05-21T13:40:01.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.886+0000 7f6dbaffd640 1 -- 172.21.15.22:0/3898433697 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dc80649d0 con 0x55ae1ac39b90 2024-05-21T13:40:01.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.886+0000 7f6dbaffd640 1 -- 172.21.15.22:0/3898433697 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dc80623e0 con 0x55ae1ac39b90 2024-05-21T13:40:01.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.886+0000 7f6de2c82000 1 -- 172.21.15.22:0/3898433697 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ae1ac39b90 msgr2=0x55ae1ac361b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:40:01.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.886+0000 7f6de2c82000 1 --2- 172.21.15.22:0/3898433697 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ae1ac39b90 0x55ae1ac361b0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f6dc805bc40 tx=0x7f6dc801e000 comp rx=0 tx=0).stop 2024-05-21T13:40:01.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.886+0000 7f6de2c82000 1 -- 172.21.15.22:0/3898433697 shutdown_connections 2024-05-21T13:40:01.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.886+0000 7f6de2c82000 1 --2- 172.21.15.22:0/3898433697 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ae1ac3eb60 0x55ae1ac366f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:40:01.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.886+0000 7f6de2c82000 1 --2- 172.21.15.22:0/3898433697 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ae1ac39b90 0x55ae1ac361b0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:40:01.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.886+0000 7f6de2c82000 1 --2- 172.21.15.22:0/3898433697 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55ae1ac038d0 0x55ae1ac53330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:40:01.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.886+0000 7f6de2c82000 1 -- 172.21.15.22:0/3898433697 >> 172.21.15.22:0/3898433697 conn(0x55ae1aae5f90 msgr2=0x55ae1ac37060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:40:01.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.886+0000 7f6de2c82000 1 -- 172.21.15.22:0/3898433697 shutdown_connections 2024-05-21T13:40:01.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.886+0000 7f6de2c82000 1 -- 172.21.15.22:0/3898433697 wait complete. 2024-05-21T13:40:01.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.886+0000 7f6de2c82000 1 -- start start 2024-05-21T13:40:01.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.890+0000 7f6de2c82000 1 Processor -- start 2024-05-21T13:40:01.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.890+0000 7f6de2c82000 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ae1ac038d0 0x55ae1ac7bb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:40:01.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.890+0000 7f6de2c82000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ae1ac39b90 0x55ae1ac7c050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:40:01.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.890+0000 7f6de2c82000 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55ae1ac3eb60 0x55ae1ac7c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:40:01.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.890+0000 7f6de2c82000 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x55ae1aa445f0 con 0x55ae1ac038d0 2024-05-21T13:40:01.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.890+0000 7f6de2c82000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x55ae1aacd860 con 0x55ae1ac39b90 2024-05-21T13:40:01.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.890+0000 7f6de2c82000 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x55ae1a9e0c50 con 0x55ae1ac3eb60 2024-05-21T13:40:01.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.890+0000 7f6de2c82000 10 client.0 _ll_register_callbacks cb 0x7f6dd000be20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-21T13:40:01.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.890+0000 7f6ddd893640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ae1ac038d0 0x55ae1ac7bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:40:01.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.890+0000 7f6ddd893640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ae1ac038d0 0x55ae1ac7bb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:50420/0 (socket says 172.21.15.22:50420) 2024-05-21T13:40:01.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.890+0000 7f6ddd893640 1 -- 172.21.15.22:0/3410149028 learned_addr learned my addr 172.21.15.22:0/3410149028 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:40:01.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.890+0000 7f6dde094640 1 --2- 172.21.15.22:0/3410149028 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55ae1ac3eb60 0x55ae1ac7c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:40:01.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.890+0000 7f6ddd092640 1 --2- 172.21.15.22:0/3410149028 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ae1ac39b90 0x55ae1ac7c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:40:01.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.890+0000 7f6ddd893640 1 -- 172.21.15.22:0/3410149028 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55ae1ac3eb60 msgr2=0x55ae1ac7c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:40:01.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.890+0000 7f6ddd893640 1 --2- 172.21.15.22:0/3410149028 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55ae1ac3eb60 0x55ae1ac7c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:40:01.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.890+0000 7f6ddd893640 1 -- 172.21.15.22:0/3410149028 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ae1ac39b90 msgr2=0x55ae1ac7c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:40:01.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.890+0000 7f6ddd893640 1 --2- 172.21.15.22:0/3410149028 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ae1ac39b90 0x55ae1ac7c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:40:01.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.890+0000 7f6ddd893640 1 -- 172.21.15.22:0/3410149028 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae1a9faca0 con 0x55ae1ac038d0 2024-05-21T13:40:01.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.890+0000 7f6ddd092640 1 --2- 172.21.15.22:0/3410149028 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ae1ac39b90 0x55ae1ac7c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:40:01.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.890+0000 7f6ddd893640 1 --2- 172.21.15.22:0/3410149028 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ae1ac038d0 0x55ae1ac7bb10 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f6dd400a7b0 tx=0x7f6dd4004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e22b2f26f9a05067 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:40:01.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.890+0000 7f6db8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-05-21T13:40:01.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.890+0000 7f6db8ff9640 1 -- 172.21.15.22:0/3410149028 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6dd402a7b0 con 0x55ae1ac038d0 2024-05-21T13:40:01.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.890+0000 7f6db8ff9640 1 -- 172.21.15.22:0/3410149028 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f6dd402a950 con 0x55ae1ac038d0 2024-05-21T13:40:01.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.890+0000 7f6de2c82000 1 -- 172.21.15.22:0/3410149028 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6dc80649d0 con 0x55ae1ac038d0 2024-05-21T13:40:01.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.890+0000 7f6db8ff9640 1 -- 172.21.15.22:0/3410149028 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f6dd403a050 con 0x55ae1ac038d0 2024-05-21T13:40:01.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.890+0000 7f6de2c82000 10 client.5049 fetch_fsmap learned FSMap version 14 2024-05-21T13:40:01.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.890+0000 7f6de2c82000 1 -- 172.21.15.22:0/3410149028 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x55ae1a9df9c0 con 0x55ae1ac038d0 2024-05-21T13:40:01.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.890+0000 7f6db8ff9640 1 -- 172.21.15.22:0/3410149028 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6dc80649d0 con 0x55ae1ac038d0 2024-05-21T13:40:01.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.890+0000 7f6db8ff9640 1 -- 172.21.15.22:0/3410149028 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7f6dd403d020 con 0x55ae1ac038d0 2024-05-21T13:40:01.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.890+0000 7f6de2c82000 10 client.5049 fetch_fsmap finished waiting for FSMap version 14 2024-05-21T13:40:01.875 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.890+0000 7f6de2c82000 10 client.5049 resolve_mds: validated gid 4300 aka daemon mds.f 2024-05-21T13:40:01.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.890+0000 7f6de2c82000 20 client.5049 populate_metadata read hostname 'smithi022' 2024-05-21T13:40:01.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.890+0000 7f6de2c82000 1 --2- 172.21.15.22:0/3410149028 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x55ae1acc19c0 0x55ae1acc3db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:40:01.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.890+0000 7f6de2c82000 4 client.5049 mds_command: new command op to 4300 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "b76c2ead", "release": true, "await": true}] 2024-05-21T13:40:01.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.890+0000 7f6de2c82000 1 -- 172.21.15.22:0/3410149028 --> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] -- command(tid 0: {"prefix": "quiesce db", "set_id": "b76c2ead", "release": true, "await": true}) -- 0x55ae1aa5a7f0 con 0x55ae1acc19c0 2024-05-21T13:40:01.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.890+0000 7f6ddd092640 1 --2- 172.21.15.22:0/3410149028 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x55ae1acc19c0 0x55ae1acc3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:40:01.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.890+0000 7f6ddd092640 1 --2- 172.21.15.22:0/3410149028 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x55ae1acc19c0 0x55ae1acc3db0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa420e3524614ece server_cookie=f801238bc588baff in_seq=0 out_seq=0 2024-05-21T13:40:01.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.890+0000 7f6db8ff9640 10 client.5049 ms_handle_connect on v2:172.21.15.115:6838/1525097577 2024-05-21T13:40:01.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.894+0000 7f6db8ff9640 1 -- 172.21.15.22:0/3410149028 <== mds.0 v2:172.21.15.115:6838/1525097577 1 ==== command_reply(tid 0: 0 ) ==== 8+0+590 (crc 0 0 0) 0x55ae1aa5a7f0 con 0x55ae1acc19c0 2024-05-21T13:40:01.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.894+0000 7f6db8ff9640 10 client.5049 handle_command_reply: tid=0 2024-05-21T13:40:01.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.894+0000 7f6de2c82000 1 client.5049 shutdown 2024-05-21T13:40:01.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.894+0000 7f6de2c82000 1 -- 172.21.15.22:0/3410149028 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ae1ac038d0 msgr2=0x55ae1ac7bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:40:01.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.894+0000 7f6de2c82000 1 --2- 172.21.15.22:0/3410149028 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ae1ac038d0 0x55ae1ac7bb10 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f6dd400a7b0 tx=0x7f6dd4004740 comp rx=0 tx=0).stop 2024-05-21T13:40:01.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.894+0000 7f6de2c82000 1 -- 172.21.15.22:0/3410149028 shutdown_connections 2024-05-21T13:40:01.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.894+0000 7f6de2c82000 1 --2- 172.21.15.22:0/3410149028 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x55ae1ac3eb60 0x55ae1ac7c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:40:01.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.894+0000 7f6de2c82000 1 --2- 172.21.15.22:0/3410149028 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x55ae1acc19c0 0x55ae1acc3db0 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:40:01.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.894+0000 7f6de2c82000 1 --2- 172.21.15.22:0/3410149028 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x55ae1ac39b90 0x55ae1ac7c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:40:01.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.894+0000 7f6de2c82000 1 --2- 172.21.15.22:0/3410149028 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x55ae1ac038d0 0x55ae1ac7bb10 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:40:01.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.894+0000 7f6db8ff9640 0 client.5049 ms_handle_reset on v2:172.21.15.115:6838/1525097577 2024-05-21T13:40:01.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.894+0000 7f6de2c82000 1 -- 172.21.15.22:0/3410149028 >> 172.21.15.22:0/3410149028 conn(0x55ae1aae5f90 msgr2=0x55ae1ac3dc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:40:01.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.894+0000 7f6de2c82000 1 -- 172.21.15.22:0/3410149028 shutdown_connections 2024-05-21T13:40:01.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.894+0000 7f6de2c82000 1 -- 172.21.15.22:0/3410149028 wait complete. 2024-05-21T13:40:01.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.894+0000 7f6de2c82000 20 client.5049 trim_cache size 0 max 16384 2024-05-21T13:40:01.878 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-05-21T13:40:01.878 INFO:teuthology.orchestra.run.smithi022.stdout: "epoch": 14, 2024-05-21T13:40:01.878 INFO:teuthology.orchestra.run.smithi022.stdout: "leader": 4300, 2024-05-21T13:40:01.878 INFO:teuthology.orchestra.run.smithi022.stdout: "set_version": 16, 2024-05-21T13:40:01.878 INFO:teuthology.orchestra.run.smithi022.stdout: "sets": { 2024-05-21T13:40:01.878 INFO:teuthology.orchestra.run.smithi022.stdout: "b76c2ead": { 2024-05-21T13:40:01.879 INFO:teuthology.orchestra.run.smithi022.stdout: "version": 16, 2024-05-21T13:40:01.879 INFO:teuthology.orchestra.run.smithi022.stdout: "age_ref": 0.0, 2024-05-21T13:40:01.879 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-05-21T13:40:01.879 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RELEASED", 2024-05-21T13:40:01.879 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-05-21T13:40:01.879 INFO:teuthology.orchestra.run.smithi022.stdout: }, 2024-05-21T13:40:01.879 INFO:teuthology.orchestra.run.smithi022.stdout: "timeout": 90.0, 2024-05-21T13:40:01.879 INFO:teuthology.orchestra.run.smithi022.stdout: "expiration": 140.4, 2024-05-21T13:40:01.879 INFO:teuthology.orchestra.run.smithi022.stdout: "members": { 2024-05-21T13:40:01.879 INFO:teuthology.orchestra.run.smithi022.stdout: "file:/": { 2024-05-21T13:40:01.879 INFO:teuthology.orchestra.run.smithi022.stdout: "excluded": false, 2024-05-21T13:40:01.879 INFO:teuthology.orchestra.run.smithi022.stdout: "state": { 2024-05-21T13:40:01.879 INFO:teuthology.orchestra.run.smithi022.stdout: "name": "RELEASED", 2024-05-21T13:40:01.879 INFO:teuthology.orchestra.run.smithi022.stdout: "age": 0.0 2024-05-21T13:40:01.879 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-05-21T13:40:01.880 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-05-21T13:40:01.880 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-05-21T13:40:01.880 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-05-21T13:40:01.880 INFO:teuthology.orchestra.run.smithi022.stdout: } 2024-05-21T13:40:01.880 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-05-21T13:40:01.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.894+0000 7f6ddfaf7640 1 -- 172.21.15.22:0/26768485 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f6dbc06f430 msgr2=0x7f6dbc0718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:40:01.880 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.894+0000 7f6ddfaf7640 1 --2- 172.21.15.22:0/26768485 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f6dbc06f430 0x7f6dbc0718f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f6dd4006fd0 tx=0x7f6dd4008040 comp rx=0 tx=0).stop 2024-05-21T13:40:01.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.894+0000 7f6ddfaf7640 1 -- 172.21.15.22:0/26768485 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6dd80c7890 msgr2=0x7f6dd8146b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:40:01.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.894+0000 7f6ddfaf7640 1 --2- 172.21.15.22:0/26768485 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6dd80c7890 0x7f6dd8146b70 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f6dc800c7f0 tx=0x7f6dc800ccb0 comp rx=0 tx=0).stop 2024-05-21T13:40:01.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.894+0000 7f6ddfaf7640 1 -- 172.21.15.22:0/26768485 shutdown_connections 2024-05-21T13:40:01.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.894+0000 7f6ddfaf7640 1 --2- 172.21.15.22:0/26768485 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f6dbc06f430 0x7f6dbc0718f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:40:01.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.894+0000 7f6ddfaf7640 1 --2- 172.21.15.22:0/26768485 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6dd8152aa0 0x7f6dd8142260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:40:01.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.894+0000 7f6ddfaf7640 1 --2- 172.21.15.22:0/26768485 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f6dd80c7890 0x7f6dd8146b70 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:40:01.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.894+0000 7f6ddfaf7640 1 --2- 172.21.15.22:0/26768485 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f6dd80c5800 0x7f6dd81f0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:40:01.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.894+0000 7f6ddfaf7640 1 -- 172.21.15.22:0/26768485 >> 172.21.15.22:0/26768485 conn(0x7f6dd806f260 msgr2=0x7f6dd80c89d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:40:01.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.894+0000 7f6ddfaf7640 1 -- 172.21.15.22:0/26768485 shutdown_connections 2024-05-21T13:40:01.881 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:40:01.894+0000 7f6ddfaf7640 1 -- 172.21.15.22:0/26768485 wait complete. 2024-05-21T13:40:01.905 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'b76c2ead', total seconds elapsed: 21.0 2024-05-21T13:40:17.716 INFO:tasks.workunit.client.0.smithi022.stdout: 2024-05-21T13:40:17.716 INFO:tasks.workunit.client.0.smithi022.stdout: Children see throughput for 1 initial writers = 177302.33 kB/sec 2024-05-21T13:40:17.716 INFO:tasks.workunit.client.0.smithi022.stdout: Parent sees throughput for 1 initial writers = 177298.52 kB/sec 2024-05-21T13:40:17.716 INFO:tasks.workunit.client.0.smithi022.stdout: Min throughput per process = 177302.33 kB/sec 2024-05-21T13:40:17.716 INFO:tasks.workunit.client.0.smithi022.stdout: Max throughput per process = 177302.33 kB/sec 2024-05-21T13:40:17.716 INFO:tasks.workunit.client.0.smithi022.stdout: Avg throughput per process = 177302.33 kB/sec 2024-05-21T13:40:17.716 INFO:tasks.workunit.client.0.smithi022.stdout: Min xfer = 10485760.00 kB 2024-05-21T13:40:30.404 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-21T13:40:30.406 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-21T13:40:39.877 INFO:tasks.workunit.client.0.smithi022.stdout: 2024-05-21T13:40:39.878 INFO:tasks.workunit.client.0.smithi022.stdout: Children see throughput for 1 rewriters = 595927.38 kB/sec 2024-05-21T13:40:39.878 INFO:tasks.workunit.client.0.smithi022.stdout: Parent sees throughput for 1 rewriters = 595910.21 kB/sec 2024-05-21T13:40:39.878 INFO:tasks.workunit.client.0.smithi022.stdout: Min throughput per process = 595927.38 kB/sec 2024-05-21T13:40:39.878 INFO:tasks.workunit.client.0.smithi022.stdout: Max throughput per process = 595927.38 kB/sec 2024-05-21T13:40:39.878 INFO:tasks.workunit.client.0.smithi022.stdout: Avg throughput per process = 595927.38 kB/sec 2024-05-21T13:40:39.878 INFO:tasks.workunit.client.0.smithi022.stdout: Min xfer = 10485760.00 kB 2024-05-21T13:40:52.808 INFO:tasks.workunit.client.0.smithi022.stdout: 2024-05-21T13:40:52.808 INFO:tasks.workunit.client.0.smithi022.stdout: Children see throughput for 1 readers = 8381963.50 kB/sec 2024-05-21T13:40:52.808 INFO:tasks.workunit.client.0.smithi022.stdout: Parent sees throughput for 1 readers = 8378131.81 kB/sec 2024-05-21T13:40:52.808 INFO:tasks.workunit.client.0.smithi022.stdout: Min throughput per process = 8381963.50 kB/sec 2024-05-21T13:40:52.809 INFO:tasks.workunit.client.0.smithi022.stdout: Max throughput per process = 8381963.50 kB/sec 2024-05-21T13:40:52.809 INFO:tasks.workunit.client.0.smithi022.stdout: Avg throughput per process = 8381963.50 kB/sec 2024-05-21T13:40:52.809 INFO:tasks.workunit.client.0.smithi022.stdout: Min xfer = 10485760.00 kB 2024-05-21T13:40:56.540 INFO:tasks.workunit.client.0.smithi022.stdout: 2024-05-21T13:40:56.540 INFO:tasks.workunit.client.0.smithi022.stdout: Children see throughput for 1 re-readers = 6531661.50 kB/sec 2024-05-21T13:40:56.540 INFO:tasks.workunit.client.0.smithi022.stdout: Parent sees throughput for 1 re-readers = 6529722.08 kB/sec 2024-05-21T13:40:56.540 INFO:tasks.workunit.client.0.smithi022.stdout: Min throughput per process = 6531661.50 kB/sec 2024-05-21T13:40:56.541 INFO:tasks.workunit.client.0.smithi022.stdout: Max throughput per process = 6531661.50 kB/sec 2024-05-21T13:40:56.541 INFO:tasks.workunit.client.0.smithi022.stdout: Avg throughput per process = 6531661.50 kB/sec 2024-05-21T13:40:56.541 INFO:tasks.workunit.client.0.smithi022.stdout: Min xfer = 10485760.00 kB 2024-05-21T13:41:00.443 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-21T13:41:00.447 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-21T13:41:03.508 INFO:tasks.workunit.client.0.smithi022.stdout: 2024-05-21T13:41:03.508 INFO:tasks.workunit.client.0.smithi022.stdout: 2024-05-21T13:41:03.509 INFO:tasks.workunit.client.0.smithi022.stdout: 2024-05-21T13:41:03.509 INFO:tasks.workunit.client.0.smithi022.stdout:iozone test complete. 2024-05-21T13:41:03.514 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-05-21T13:41:03.515 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-05-21T13:41:03.553 INFO:tasks.workunit:Stopping ['suites/iozone.sh'] on client.0... 2024-05-21T13:41:03.553 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-05-21T13:41:03.881 DEBUG:teuthology.parallel:result is None 2024-05-21T13:41:03.881 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-05-21T13:41:03.918 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-05-21T13:41:03.918 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2024-05-21T13:41:03.928 INFO:tasks.quiescer:joining Quiescers 2024-05-21T13:41:03.928 WARNING:tasks.quiescer:The quiescer is requested to stop, running cancel all 2024-05-21T13:41:03.928 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-21T13:41:04.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.110+0000 7fe04e9b0640 1 Processor -- start 2024-05-21T13:41:04.085 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.110+0000 7fe04e9b0640 1 -- start start 2024-05-21T13:41:04.087 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.110+0000 7fe04e9b0640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe04806c4f0 0x7fe0481640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:04.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.110+0000 7fe04e9b0640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe0481608d0 con 0x7fe04815a4c0 2024-05-21T13:41:04.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.110+0000 7fe04e9b0640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe048160bb0 con 0x7fe0480ca540 2024-05-21T13:41:04.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.110+0000 7fe04e9b0640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7fe048160e90 con 0x7fe04806c4f0 2024-05-21T13:41:04.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.110+0000 7fe047fff640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fe04815a4c0 0x7fe048160060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:33678/0 (socket says 172.21.15.22:33678) 2024-05-21T13:41:04.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.110+0000 7fe047fff640 1 -- 172.21.15.22:0/2823680042 learned_addr learned my addr 172.21.15.22:0/2823680042 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-21T13:41:04.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.110+0000 7fe0477fe640 1 --2- 172.21.15.22:0/2823680042 >> v2:172.21.15.115:3300/0 conn(0x7fe04806c4f0 0x7fe0481640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:04.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.110+0000 7fe046ffd640 1 -- 172.21.15.22:0/2823680042 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2286167122 0 0) 0x7fe0481608d0 con 0x7fe04815a4c0 2024-05-21T13:41:04.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.110+0000 7fe046ffd640 1 -- 172.21.15.22:0/2823680042 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe030003530 con 0x7fe04815a4c0 2024-05-21T13:41:04.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.110+0000 7fe046ffd640 1 -- 172.21.15.22:0/2823680042 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2015718994 0 0) 0x7fe030003530 con 0x7fe04815a4c0 2024-05-21T13:41:04.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.110+0000 7fe046ffd640 1 -- 172.21.15.22:0/2823680042 >> v2:172.21.15.115:3300/0 conn(0x7fe04806c4f0 msgr2=0x7fe0481640f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:41:04.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.110+0000 7fe046ffd640 1 --2- 172.21.15.22:0/2823680042 >> v2:172.21.15.115:3300/0 conn(0x7fe04806c4f0 0x7fe0481640f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:04.088 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.110+0000 7fe046ffd640 1 -- 172.21.15.22:0/2823680042 >> v1:172.21.15.115:6789/0 conn(0x7fe0480ca540 legacy=0x7fe0480c9200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:04.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.110+0000 7fe046ffd640 1 -- 172.21.15.22:0/2823680042 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe048163610 con 0x7fe04815a4c0 2024-05-21T13:41:04.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.110+0000 7fe046ffd640 1 -- 172.21.15.22:0/2823680042 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2684847062 0 0) 0x7fe038001a80 con 0x7fe04815a4c0 2024-05-21T13:41:04.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.110+0000 7fe046ffd640 1 -- 172.21.15.22:0/2823680042 >> v1:172.21.15.22:6789/0 conn(0x7fe04815a4c0 legacy=0x7fe048160060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:04.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.110+0000 7fe046ffd640 1 --2- 172.21.15.22:0/2823680042 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe030003a60 0x7fe030003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:04.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.110+0000 7fe046ffd640 1 --2- 172.21.15.22:0/2823680042 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe030004810 0x7fe030004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:04.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.110+0000 7fe046ffd640 1 --2- 172.21.15.22:0/2823680042 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0300051d0 0x7fe03000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:04.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.110+0000 7fe046ffd640 1 -- 172.21.15.22:0/2823680042 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe048160e90 con 0x7fe030004810 2024-05-21T13:41:04.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.110+0000 7fe046ffd640 1 -- 172.21.15.22:0/2823680042 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fe03000c150 con 0x7fe0300051d0 2024-05-21T13:41:04.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.110+0000 7fe046ffd640 1 -- 172.21.15.22:0/2823680042 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7fe03000c350 con 0x7fe030003a60 2024-05-21T13:41:04.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.110+0000 7fe0477fe640 1 --2- 172.21.15.22:0/2823680042 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe030004810 0x7fe030004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:04.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.110+0000 7fe04cf4d640 1 --2- 172.21.15.22:0/2823680042 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0300051d0 0x7fe03000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:04.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.110+0000 7fe047fff640 1 --2- 172.21.15.22:0/2823680042 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe030003a60 0x7fe030003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:04.089 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.110+0000 7fe0477fe640 1 -- 172.21.15.22:0/2823680042 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe030003a60 msgr2=0x7fe030003e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:41:04.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.110+0000 7fe0477fe640 1 --2- 172.21.15.22:0/2823680042 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe030003a60 0x7fe030003e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:04.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.110+0000 7fe0477fe640 1 -- 172.21.15.22:0/2823680042 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0300051d0 msgr2=0x7fe03000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:41:04.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.110+0000 7fe0477fe640 1 --2- 172.21.15.22:0/2823680042 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0300051d0 0x7fe03000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:04.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.110+0000 7fe0477fe640 1 -- 172.21.15.22:0/2823680042 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe030003530 con 0x7fe030004810 2024-05-21T13:41:04.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.110+0000 7fe04cf4d640 1 -- 172.21.15.22:0/2823680042 reap_dead start 2024-05-21T13:41:04.090 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.110+0000 7fe047fff640 1 --2- 172.21.15.22:0/2823680042 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe030003a60 0x7fe030003e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:41:04.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.114+0000 7fe0477fe640 1 --2- 172.21.15.22:0/2823680042 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe030004810 0x7fe030004c90 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fe03c009ae0 tx=0x7fe03c01ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b0e774319381c8c server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:04.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.114+0000 7fe046ffd640 1 -- 172.21.15.22:0/2823680042 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe03c0b2070 con 0x7fe030004810 2024-05-21T13:41:04.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.114+0000 7fe046ffd640 1 -- 172.21.15.22:0/2823680042 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe03c0a56f0 con 0x7fe030004810 2024-05-21T13:41:04.091 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.114+0000 7fe046ffd640 1 -- 172.21.15.22:0/2823680042 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe03c0096b0 con 0x7fe030004810 2024-05-21T13:41:04.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.114+0000 7fe04e9b0640 1 -- 172.21.15.22:0/2823680042 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe030004810 msgr2=0x7fe030004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:04.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.114+0000 7fe04e9b0640 1 --2- 172.21.15.22:0/2823680042 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe030004810 0x7fe030004c90 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fe03c009ae0 tx=0x7fe03c01ca70 comp rx=0 tx=0).stop 2024-05-21T13:41:04.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.114+0000 7fe04e9b0640 1 -- 172.21.15.22:0/2823680042 shutdown_connections 2024-05-21T13:41:04.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.114+0000 7fe04e9b0640 1 --2- 172.21.15.22:0/2823680042 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe030004810 0x7fe030004c90 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:04.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.114+0000 7fe04e9b0640 1 -- 172.21.15.22:0/2823680042 >> 172.21.15.22:0/2823680042 conn(0x7fe048070fd0 msgr2=0x7fe0480713e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:41:04.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.114+0000 7fe04e9b0640 1 -- 172.21.15.22:0/2823680042 shutdown_connections 2024-05-21T13:41:04.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.114+0000 7fe04e9b0640 1 -- 172.21.15.22:0/2823680042 wait complete. 2024-05-21T13:41:04.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.114+0000 7fe04e9b0640 1 Processor -- start 2024-05-21T13:41:04.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.114+0000 7fe04e9b0640 1 -- start start 2024-05-21T13:41:04.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.114+0000 7fe04e9b0640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0481eb440 0x7fe04815a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:04.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.114+0000 7fe04e9b0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe04815af10 0x7fe0481f9b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:04.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.114+0000 7fe04e9b0640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe04806ddd0 0x7fe0481fa0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:04.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.118+0000 7fe04e9b0640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe0480ca950 con 0x7fe04815af10 2024-05-21T13:41:04.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.118+0000 7fe04e9b0640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fe048163bd0 con 0x7fe0481eb440 2024-05-21T13:41:04.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.118+0000 7fe04e9b0640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7fe0480caad0 con 0x7fe04806ddd0 2024-05-21T13:41:04.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.118+0000 7fe0477fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe04815af10 0x7fe0481f9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:04.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.118+0000 7fe0477fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe04815af10 0x7fe0481f9b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47582/0 (socket says 172.21.15.22:47582) 2024-05-21T13:41:04.094 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.118+0000 7fe0477fe640 1 -- 172.21.15.22:0/1200618930 learned_addr learned my addr 172.21.15.22:0/1200618930 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:41:04.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.118+0000 7fe04cf4d640 1 --2- 172.21.15.22:0/1200618930 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe04806ddd0 0x7fe0481fa0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:04.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.118+0000 7fe047fff640 1 --2- 172.21.15.22:0/1200618930 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0481eb440 0x7fe04815a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:04.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.118+0000 7fe0477fe640 1 -- 172.21.15.22:0/1200618930 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe04806ddd0 msgr2=0x7fe0481fa0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:04.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.118+0000 7fe0477fe640 1 --2- 172.21.15.22:0/1200618930 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe04806ddd0 0x7fe0481fa0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:04.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.118+0000 7fe0477fe640 1 -- 172.21.15.22:0/1200618930 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0481eb440 msgr2=0x7fe04815a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:04.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.118+0000 7fe0477fe640 1 --2- 172.21.15.22:0/1200618930 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0481eb440 0x7fe04815a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:04.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.118+0000 7fe0477fe640 1 -- 172.21.15.22:0/1200618930 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe048159ed0 con 0x7fe04815af10 2024-05-21T13:41:04.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.118+0000 7fe0477fe640 1 --2- 172.21.15.22:0/1200618930 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe04815af10 0x7fe0481f9b70 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe03c01c8a0 tx=0x7fe03c019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:04.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.118+0000 7fe044ff9640 1 -- 172.21.15.22:0/1200618930 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe03c0bd070 con 0x7fe04815af10 2024-05-21T13:41:04.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.118+0000 7fe044ff9640 1 -- 172.21.15.22:0/1200618930 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe03c0ad440 con 0x7fe04815af10 2024-05-21T13:41:04.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.118+0000 7fe04e9b0640 1 -- 172.21.15.22:0/1200618930 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0480c9a00 con 0x7fe04815af10 2024-05-21T13:41:04.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.118+0000 7fe044ff9640 1 -- 172.21.15.22:0/1200618930 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe03c0b2040 con 0x7fe04815af10 2024-05-21T13:41:04.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.118+0000 7fe04e9b0640 1 -- 172.21.15.22:0/1200618930 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0480c4fe0 con 0x7fe04815af10 2024-05-21T13:41:04.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.118+0000 7fe04e9b0640 1 -- 172.21.15.22:0/1200618930 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0480697d0 con 0x7fe04815af10 2024-05-21T13:41:04.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.118+0000 7fe044ff9640 1 -- 172.21.15.22:0/1200618930 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fe03c0c0070 con 0x7fe04815af10 2024-05-21T13:41:04.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.118+0000 7fe044ff9640 1 --2- 172.21.15.22:0/1200618930 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fe03406f400 0x7fe0340718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:04.096 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.118+0000 7fe044ff9640 1 -- 172.21.15.22:0/1200618930 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7fe03c129310 con 0x7fe04815af10 2024-05-21T13:41:04.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.118+0000 7fe047fff640 1 --2- 172.21.15.22:0/1200618930 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fe03406f400 0x7fe0340718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:04.097 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.122+0000 7fe047fff640 1 --2- 172.21.15.22:0/1200618930 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fe03406f400 0x7fe0340718c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe038001c30 tx=0x7fe038009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:04.100 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.122+0000 7fe044ff9640 1 -- 172.21.15.22:0/1200618930 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fe03c016780 con 0x7fe04815af10 2024-05-21T13:41:04.295 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.318+0000 7fe04e9b0640 1 -- 172.21.15.22:0/1200618930 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe0480c7800 con 0x7fe04815af10 2024-05-21T13:41:04.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.318+0000 7fe044ff9640 1 -- 172.21.15.22:0/1200618930 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6875 (secure 0 0 0) 0x7fe03c0f5840 con 0x7fe04815af10 2024-05-21T13:41:04.296 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-21T13:41:04.296 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4224,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/355756580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":355756580},{"type":"v1","addr":"172.21.15.22:6833","nonce":355756580}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4230,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3277017116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":3277017116},{"type":"v1","addr":"172.21.15.22:6835","nonce":3277017116}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4233,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3840772609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3840772609},{"type":"v1","addr":"172.21.15.22:6837","nonce":3840772609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-21T13:35:57.106892+0000","modified":"2024-05-21T13:36:32.396351+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4300,"mds_1":4294,"mds_2":4248},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4248":{"gid":4248,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":12,"addr":"172.21.15.115:6837/2009761279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":2009761279},{"type":"v1","addr":"172.21.15.115:6837","nonce":2009761279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4294":{"gid":4294,"name":"b","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.115:6835/3894678097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3894678097},{"type":"v1","addr":"172.21.15.115:6835","nonce":3894678097}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4300":{"gid":4300,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.115:6839/1525097577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6838","nonce":1525097577},{"type":"v1","addr":"172.21.15.115:6839","nonce":1525097577}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4300,"qdb_cluster":[4248,4300,4294]},"id":1}]} 2024-05-21T13:41:04.296 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 14 2024-05-21T13:41:04.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.322+0000 7fe04e9b0640 1 -- 172.21.15.22:0/1200618930 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fe03406f400 msgr2=0x7fe0340718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:04.299 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.322+0000 7fe04e9b0640 1 --2- 172.21.15.22:0/1200618930 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fe03406f400 0x7fe0340718c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fe038001c30 tx=0x7fe038009040 comp rx=0 tx=0).stop 2024-05-21T13:41:04.299 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.322+0000 7fe04e9b0640 1 -- 172.21.15.22:0/1200618930 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe04815af10 msgr2=0x7fe0481f9b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:04.299 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.322+0000 7fe04e9b0640 1 --2- 172.21.15.22:0/1200618930 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe04815af10 0x7fe0481f9b70 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe03c01c8a0 tx=0x7fe03c019810 comp rx=0 tx=0).stop 2024-05-21T13:41:04.299 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.322+0000 7fe04e9b0640 1 -- 172.21.15.22:0/1200618930 shutdown_connections 2024-05-21T13:41:04.299 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.322+0000 7fe04e9b0640 1 --2- 172.21.15.22:0/1200618930 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fe03406f400 0x7fe0340718c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:04.299 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.322+0000 7fe04e9b0640 1 --2- 172.21.15.22:0/1200618930 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe04806ddd0 0x7fe0481fa0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:04.299 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.322+0000 7fe04e9b0640 1 --2- 172.21.15.22:0/1200618930 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe04815af10 0x7fe0481f9b70 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:04.299 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.322+0000 7fe04e9b0640 1 --2- 172.21.15.22:0/1200618930 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe0481eb440 0x7fe04815a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:04.299 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.322+0000 7fe04e9b0640 1 -- 172.21.15.22:0/1200618930 >> 172.21.15.22:0/1200618930 conn(0x7fe048070fd0 msgr2=0x7fe0480c63f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:41:04.299 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.322+0000 7fe04e9b0640 1 -- 172.21.15.22:0/1200618930 shutdown_connections 2024-05-21T13:41:04.299 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.322+0000 7fe04e9b0640 1 -- 172.21.15.22:0/1200618930 wait complete. 2024-05-21T13:41:04.314 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4300 quiesce db --cancel --all' 2024-05-21T13:41:04.314 DEBUG:teuthology.orchestra.run.smithi022:> timeout 105 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4300 quiesce db --cancel --all 2024-05-21T13:41:04.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.470+0000 7fbc1deb8640 1 Processor -- start 2024-05-21T13:41:04.447 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.470+0000 7fbc1deb8640 1 -- start start 2024-05-21T13:41:04.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.470+0000 7fbc1deb8640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbc1815f130 0x7fbc1815fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:04.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.470+0000 7fbc1deb8640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc180c9260 con 0x7fbc180cb620 2024-05-21T13:41:04.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.470+0000 7fbc1deb8640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc1815f9a0 con 0x7fbc1815f510 2024-05-21T13:41:04.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.470+0000 7fbc1deb8640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7fbc180ca8f0 con 0x7fbc1815f130 2024-05-21T13:41:04.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.470+0000 7fbc16ffd640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fbc180cb620 0x7fbc18073570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:33688/0 (socket says 172.21.15.22:33688) 2024-05-21T13:41:04.448 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.470+0000 7fbc16ffd640 1 -- 172.21.15.22:0/3335006688 learned_addr learned my addr 172.21.15.22:0/3335006688 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-21T13:41:04.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.470+0000 7fbc177fe640 1 --2- 172.21.15.22:0/3335006688 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbc1815f130 0x7fbc1815fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:04.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.474+0000 7fbc167fc640 1 -- 172.21.15.22:0/3335006688 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 59487259 0 0) 0x7fbc180c9260 con 0x7fbc180cb620 2024-05-21T13:41:04.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.474+0000 7fbc167fc640 1 -- 172.21.15.22:0/3335006688 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbc00003530 con 0x7fbc180cb620 2024-05-21T13:41:04.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.474+0000 7fbc167fc640 1 -- 172.21.15.22:0/3335006688 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1938694427 0 0) 0x7fbc00003530 con 0x7fbc180cb620 2024-05-21T13:41:04.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.474+0000 7fbc167fc640 1 -- 172.21.15.22:0/3335006688 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbc1815f130 msgr2=0x7fbc1815fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:41:04.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.474+0000 7fbc167fc640 1 --2- 172.21.15.22:0/3335006688 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbc1815f130 0x7fbc1815fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:04.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.474+0000 7fbc167fc640 1 -- 172.21.15.22:0/3335006688 >> v1:172.21.15.115:6789/0 conn(0x7fbc1815f510 legacy=0x7fbc180ca100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:04.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.474+0000 7fbc167fc640 1 -- 172.21.15.22:0/3335006688 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc180c85a0 con 0x7fbc180cb620 2024-05-21T13:41:04.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.474+0000 7fbc167fc640 1 -- 172.21.15.22:0/3335006688 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2684847062 0 0) 0x7fbc0c001700 con 0x7fbc180cb620 2024-05-21T13:41:04.450 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.474+0000 7fbc167fc640 1 -- 172.21.15.22:0/3335006688 >> v1:172.21.15.22:6789/0 conn(0x7fbc180cb620 legacy=0x7fbc18073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:04.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.474+0000 7fbc167fc640 1 --2- 172.21.15.22:0/3335006688 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc00003a40 0x7fbc00003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:04.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.474+0000 7fbc167fc640 1 --2- 172.21.15.22:0/3335006688 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc00004810 0x7fbc00004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:04.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.474+0000 7fbc167fc640 1 --2- 172.21.15.22:0/3335006688 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbc1815f130 0x7fbc00005230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:04.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.474+0000 7fbc167fc640 1 -- 172.21.15.22:0/3335006688 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fbc180ca8f0 con 0x7fbc00003a40 2024-05-21T13:41:04.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.474+0000 7fbc167fc640 1 -- 172.21.15.22:0/3335006688 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fbc0000bb90 con 0x7fbc00004810 2024-05-21T13:41:04.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.474+0000 7fbc167fc640 1 -- 172.21.15.22:0/3335006688 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7fbc0000bd90 con 0x7fbc1815f130 2024-05-21T13:41:04.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.474+0000 7fbc177fe640 1 --2- 172.21.15.22:0/3335006688 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc00003a40 0x7fbc00003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:04.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.474+0000 7fbc16ffd640 1 --2- 172.21.15.22:0/3335006688 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc00004810 0x7fbc00004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:04.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.474+0000 7fbc17fff640 1 --2- 172.21.15.22:0/3335006688 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbc1815f130 0x7fbc00005230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:04.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.474+0000 7fbc177fe640 1 -- 172.21.15.22:0/3335006688 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbc1815f130 msgr2=0x7fbc00005230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:41:04.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.474+0000 7fbc177fe640 1 --2- 172.21.15.22:0/3335006688 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbc1815f130 0x7fbc00005230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:04.451 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.474+0000 7fbc177fe640 1 -- 172.21.15.22:0/3335006688 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc00004810 msgr2=0x7fbc00004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:41:04.452 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.474+0000 7fbc177fe640 1 --2- 172.21.15.22:0/3335006688 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc00004810 0x7fbc00004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:04.452 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.474+0000 7fbc177fe640 1 -- 172.21.15.22:0/3335006688 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc00003530 con 0x7fbc00003a40 2024-05-21T13:41:04.452 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.474+0000 7fbc16ffd640 1 --2- 172.21.15.22:0/3335006688 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc00004810 0x7fbc00004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:41:04.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.474+0000 7fbc177fe640 1 --2- 172.21.15.22:0/3335006688 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc00003a40 0x7fbc00003e80 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fbc08009ae0 tx=0x7fbc0801ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddf15200a4bbab70 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:04.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.474+0000 7fbc167fc640 1 -- 172.21.15.22:0/3335006688 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc080b2070 con 0x7fbc00003a40 2024-05-21T13:41:04.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.474+0000 7fbc167fc640 1 -- 172.21.15.22:0/3335006688 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc080a5550 con 0x7fbc00003a40 2024-05-21T13:41:04.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.474+0000 7fbc167fc640 1 -- 172.21.15.22:0/3335006688 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc080096b0 con 0x7fbc00003a40 2024-05-21T13:41:04.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.474+0000 7fbc1deb8640 1 -- 172.21.15.22:0/3335006688 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc00003a40 msgr2=0x7fbc00003e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:04.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.474+0000 7fbc1deb8640 1 --2- 172.21.15.22:0/3335006688 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc00003a40 0x7fbc00003e80 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fbc08009ae0 tx=0x7fbc0801ca70 comp rx=0 tx=0).stop 2024-05-21T13:41:04.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.474+0000 7fbc17fff640 1 -- 172.21.15.22:0/3335006688 reap_dead start 2024-05-21T13:41:04.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.474+0000 7fbc1deb8640 1 -- 172.21.15.22:0/3335006688 shutdown_connections 2024-05-21T13:41:04.453 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.474+0000 7fbc1deb8640 1 -- 172.21.15.22:0/3335006688 >> 172.21.15.22:0/3335006688 conn(0x7fbc180ce550 msgr2=0x7fbc180ce960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:41:04.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.474+0000 7fbc1deb8640 1 -- 172.21.15.22:0/3335006688 shutdown_connections 2024-05-21T13:41:04.454 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.474+0000 7fbc1deb8640 1 -- 172.21.15.22:0/3335006688 wait complete. 2024-05-21T13:41:04.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.478+0000 7fbc1deb8640 1 Processor -- start 2024-05-21T13:41:04.455 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.478+0000 7fbc1deb8640 1 -- start start 2024-05-21T13:41:04.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.478+0000 7fbc1deb8640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc00003a40 0x7fbc181588e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:04.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.478+0000 7fbc1deb8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc181f2d60 0x7fbc18165b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:04.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.478+0000 7fbc1deb8640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbc181660a0 0x7fbc181f8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:04.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.478+0000 7fbc1deb8640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fbc18160040 con 0x7fbc181f2d60 2024-05-21T13:41:04.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.478+0000 7fbc1deb8640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fbc180cb100 con 0x7fbc00003a40 2024-05-21T13:41:04.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.478+0000 7fbc1deb8640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7fbc18155e40 con 0x7fbc181660a0 2024-05-21T13:41:04.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.478+0000 7fbc16ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc181f2d60 0x7fbc18165b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:04.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.478+0000 7fbc16ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc181f2d60 0x7fbc18165b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47610/0 (socket says 172.21.15.22:47610) 2024-05-21T13:41:04.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.478+0000 7fbc16ffd640 1 -- 172.21.15.22:0/1449016361 learned_addr learned my addr 172.21.15.22:0/1449016361 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:41:04.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.478+0000 7fbc17fff640 1 --2- 172.21.15.22:0/1449016361 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbc181660a0 0x7fbc181f8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:04.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.478+0000 7fbc177fe640 1 --2- 172.21.15.22:0/1449016361 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc00003a40 0x7fbc181588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:04.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.478+0000 7fbc16ffd640 1 -- 172.21.15.22:0/1449016361 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbc181660a0 msgr2=0x7fbc181f8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:04.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.478+0000 7fbc16ffd640 1 --2- 172.21.15.22:0/1449016361 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbc181660a0 0x7fbc181f8500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:04.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.478+0000 7fbc16ffd640 1 -- 172.21.15.22:0/1449016361 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc00003a40 msgr2=0x7fbc181588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:04.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.478+0000 7fbc16ffd640 1 --2- 172.21.15.22:0/1449016361 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc00003a40 0x7fbc181588e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:04.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.478+0000 7fbc16ffd640 1 -- 172.21.15.22:0/1449016361 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc181f91c0 con 0x7fbc181f2d60 2024-05-21T13:41:04.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.478+0000 7fbc16ffd640 1 --2- 172.21.15.22:0/1449016361 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc181f2d60 0x7fbc18165b60 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fbc0c000f70 tx=0x7fbc0c00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:04.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.478+0000 7fbbfffff640 1 -- 172.21.15.22:0/1449016361 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc0c0074e0 con 0x7fbc181f2d60 2024-05-21T13:41:04.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.478+0000 7fbbfffff640 1 -- 172.21.15.22:0/1449016361 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc0c0047f0 con 0x7fbc181f2d60 2024-05-21T13:41:04.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.478+0000 7fbbfffff640 1 -- 172.21.15.22:0/1449016361 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc0c007680 con 0x7fbc181f2d60 2024-05-21T13:41:04.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.478+0000 7fbc1deb8640 1 -- 172.21.15.22:0/1449016361 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc18153300 con 0x7fbc181f2d60 2024-05-21T13:41:04.457 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.478+0000 7fbc1deb8640 1 -- 172.21.15.22:0/1449016361 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc181580e0 con 0x7fbc181f2d60 2024-05-21T13:41:04.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.482+0000 7fbbfffff640 1 -- 172.21.15.22:0/1449016361 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fbc0c01b020 con 0x7fbc181f2d60 2024-05-21T13:41:04.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.482+0000 7fbbfffff640 1 --2- 172.21.15.22:0/1449016361 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fbc0406f430 0x7fbc040718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:04.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.482+0000 7fbbfffff640 1 -- 172.21.15.22:0/1449016361 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7fbc0c08f4a0 con 0x7fbc181f2d60 2024-05-21T13:41:04.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.482+0000 7fbc177fe640 1 --2- 172.21.15.22:0/1449016361 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fbc0406f430 0x7fbc040718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:04.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.482+0000 7fbc21043000 1 Processor -- start 2024-05-21T13:41:04.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.482+0000 7fbc21043000 1 -- start start 2024-05-21T13:41:04.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.482+0000 7fbc177fe640 1 --2- 172.21.15.22:0/1449016361 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fbc0406f430 0x7fbc040718f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fbc080af000 tx=0x7fbc08008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:04.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.482+0000 7fbc21043000 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x560b6f122ac0 0x560b6f122ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:04.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.482+0000 7fbc21043000 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560b6f1233e0 0x560b6f1237c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:04.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.482+0000 7fbc21043000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x560b6f123d00 0x560b6f147160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:04.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.482+0000 7fbc21043000 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x560b6ef56590 con 0x560b6f1233e0 2024-05-21T13:41:04.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.482+0000 7fbc21043000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x560b6ef46130 con 0x560b6f123d00 2024-05-21T13:41:04.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.482+0000 7fbc21043000 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x560b6ef4a170 con 0x560b6f122ac0 2024-05-21T13:41:04.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.482+0000 7fbc16ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560b6f1233e0 0x560b6f1237c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:04.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.482+0000 7fbc16ffd640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560b6f1233e0 0x560b6f1237c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47618/0 (socket says 172.21.15.22:47618) 2024-05-21T13:41:04.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.482+0000 7fbc16ffd640 1 -- 172.21.15.22:0/2159042039 learned_addr learned my addr 172.21.15.22:0/2159042039 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:41:04.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.482+0000 7fbc17fff640 1 --2- 172.21.15.22:0/2159042039 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x560b6f123d00 0x560b6f147160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:04.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.482+0000 7fbc16ffd640 1 -- 172.21.15.22:0/2159042039 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x560b6f122ac0 msgr2=0x560b6f122ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:41:04.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.482+0000 7fbc177fe640 1 --2- 172.21.15.22:0/2159042039 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x560b6f122ac0 0x560b6f122ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:04.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.482+0000 7fbc16ffd640 1 --2- 172.21.15.22:0/2159042039 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x560b6f122ac0 0x560b6f122ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:04.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.482+0000 7fbc16ffd640 1 -- 172.21.15.22:0/2159042039 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x560b6f123d00 msgr2=0x560b6f147160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:41:04.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.482+0000 7fbc16ffd640 1 --2- 172.21.15.22:0/2159042039 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x560b6f123d00 0x560b6f147160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:04.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.482+0000 7fbc16ffd640 1 -- 172.21.15.22:0/2159042039 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b6ef8e610 con 0x560b6f1233e0 2024-05-21T13:41:04.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.482+0000 7fbc17fff640 1 --2- 172.21.15.22:0/2159042039 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x560b6f123d00 0x560b6f147160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:41:04.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.482+0000 7fbc16ffd640 1 --2- 172.21.15.22:0/2159042039 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560b6f1233e0 0x560b6f1237c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fbc0c08d690 tx=0x7fbc0c05b690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11c2436f0aa99ef4 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:04.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.482+0000 7fbbfd7fa640 1 -- 172.21.15.22:0/2159042039 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc0c064160 con 0x560b6f1233e0 2024-05-21T13:41:04.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.482+0000 7fbbfd7fa640 1 -- 172.21.15.22:0/2159042039 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc0c05fdf0 con 0x560b6f1233e0 2024-05-21T13:41:04.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.482+0000 7fbbfd7fa640 1 -- 172.21.15.22:0/2159042039 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc0c064810 con 0x560b6f1233e0 2024-05-21T13:41:04.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.486+0000 7fbc21043000 1 -- 172.21.15.22:0/2159042039 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560b6f1233e0 msgr2=0x560b6f1237c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:04.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.486+0000 7fbc21043000 1 --2- 172.21.15.22:0/2159042039 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560b6f1233e0 0x560b6f1237c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fbc0c08d690 tx=0x7fbc0c05b690 comp rx=0 tx=0).stop 2024-05-21T13:41:04.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.486+0000 7fbc21043000 1 -- 172.21.15.22:0/2159042039 shutdown_connections 2024-05-21T13:41:04.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.486+0000 7fbc21043000 1 --2- 172.21.15.22:0/2159042039 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x560b6f123d00 0x560b6f147160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:04.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.486+0000 7fbc21043000 1 --2- 172.21.15.22:0/2159042039 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560b6f1233e0 0x560b6f1237c0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:04.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.486+0000 7fbc21043000 1 --2- 172.21.15.22:0/2159042039 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x560b6f122ac0 0x560b6f122ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:04.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.486+0000 7fbc21043000 1 -- 172.21.15.22:0/2159042039 >> 172.21.15.22:0/2159042039 conn(0x560b6efe2600 msgr2=0x560b6f139c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:41:04.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.486+0000 7fbc21043000 1 -- 172.21.15.22:0/2159042039 shutdown_connections 2024-05-21T13:41:04.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.486+0000 7fbc21043000 1 -- 172.21.15.22:0/2159042039 wait complete. 2024-05-21T13:41:04.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.486+0000 7fbc21043000 1 -- start start 2024-05-21T13:41:04.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.486+0000 7fbc21043000 1 Processor -- start 2024-05-21T13:41:04.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.486+0000 7fbc21043000 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x560b6f122ac0 0x560b6f120860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:04.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.486+0000 7fbc21043000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x560b6f1233e0 0x560b6f120da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:04.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.486+0000 7fbc21043000 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560b6f123d00 0x560b6f142350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:04.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.486+0000 7fbc21043000 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x560b6f0147e0 con 0x560b6f123d00 2024-05-21T13:41:04.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.486+0000 7fbc21043000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x560b6ef55360 con 0x560b6f1233e0 2024-05-21T13:41:04.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.486+0000 7fbc21043000 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x560b6ef0d7f0 con 0x560b6f122ac0 2024-05-21T13:41:04.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.486+0000 7fbc21043000 10 client.0 _ll_register_callbacks cb 0x560b6f0e6010 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-21T13:41:04.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.486+0000 7fbc17fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560b6f123d00 0x560b6f142350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:04.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.486+0000 7fbc17fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560b6f123d00 0x560b6f142350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47630/0 (socket says 172.21.15.22:47630) 2024-05-21T13:41:04.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.486+0000 7fbc17fff640 1 -- 172.21.15.22:0/4246830510 learned_addr learned my addr 172.21.15.22:0/4246830510 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:41:04.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.486+0000 7fbc16ffd640 1 --2- 172.21.15.22:0/4246830510 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x560b6f1233e0 0x560b6f120da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:04.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.486+0000 7fbc177fe640 1 --2- 172.21.15.22:0/4246830510 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x560b6f122ac0 0x560b6f120860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:04.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.486+0000 7fbc17fff640 1 -- 172.21.15.22:0/4246830510 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x560b6f122ac0 msgr2=0x560b6f120860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:41:04.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.486+0000 7fbc17fff640 1 --2- 172.21.15.22:0/4246830510 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x560b6f122ac0 0x560b6f120860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:04.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.486+0000 7fbc17fff640 1 -- 172.21.15.22:0/4246830510 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x560b6f1233e0 msgr2=0x560b6f120da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:41:04.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.486+0000 7fbc17fff640 1 --2- 172.21.15.22:0/4246830510 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x560b6f1233e0 0x560b6f120da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:04.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.486+0000 7fbc17fff640 1 -- 172.21.15.22:0/4246830510 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b6ef13930 con 0x560b6f123d00 2024-05-21T13:41:04.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.486+0000 7fbc16ffd640 1 --2- 172.21.15.22:0/4246830510 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x560b6f1233e0 0x560b6f120da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:41:04.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.486+0000 7fbc17fff640 1 --2- 172.21.15.22:0/4246830510 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560b6f123d00 0x560b6f142350 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fbc1815f8f0 tx=0x7fbc10010980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bb4cc0a86aec5cb server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:04.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.486+0000 7fbbf67fc640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-05-21T13:41:04.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.486+0000 7fbbf67fc640 1 -- 172.21.15.22:0/4246830510 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc10003d90 con 0x560b6f123d00 2024-05-21T13:41:04.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.486+0000 7fbbf67fc640 1 -- 172.21.15.22:0/4246830510 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7fbc100050d0 con 0x560b6f123d00 2024-05-21T13:41:04.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.486+0000 7fbc21043000 1 -- 172.21.15.22:0/4246830510 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc0c05fdf0 con 0x560b6f123d00 2024-05-21T13:41:04.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.486+0000 7fbbf67fc640 1 -- 172.21.15.22:0/4246830510 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7fbc10021050 con 0x560b6f123d00 2024-05-21T13:41:04.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.486+0000 7fbc21043000 10 client.5067 fetch_fsmap learned FSMap version 14 2024-05-21T13:41:04.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.486+0000 7fbc21043000 1 -- 172.21.15.22:0/4246830510 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x560b6ef01d30 con 0x560b6f123d00 2024-05-21T13:41:04.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.486+0000 7fbbf67fc640 1 -- 172.21.15.22:0/4246830510 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc0c05fdf0 con 0x560b6f123d00 2024-05-21T13:41:04.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.486+0000 7fbbf67fc640 1 -- 172.21.15.22:0/4246830510 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7fbc10024020 con 0x560b6f123d00 2024-05-21T13:41:04.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.486+0000 7fbc21043000 10 client.5067 fetch_fsmap finished waiting for FSMap version 14 2024-05-21T13:41:04.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.486+0000 7fbc21043000 10 client.5067 resolve_mds: validated gid 4300 aka daemon mds.f 2024-05-21T13:41:04.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.486+0000 7fbc21043000 20 client.5067 populate_metadata read hostname 'smithi022' 2024-05-21T13:41:04.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.486+0000 7fbc21043000 1 --2- 172.21.15.22:0/4246830510 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x560b6f1430f0 0x560b6f1434d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:04.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.486+0000 7fbc21043000 4 client.5067 mds_command: new command op to 4300 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-05-21T13:41:04.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.486+0000 7fbc21043000 1 -- 172.21.15.22:0/4246830510 --> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560b6efcd900 con 0x560b6f1430f0 2024-05-21T13:41:04.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.486+0000 7fbc177fe640 1 --2- 172.21.15.22:0/4246830510 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x560b6f1430f0 0x560b6f1434d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:04.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.490+0000 7fbc177fe640 1 --2- 172.21.15.22:0/4246830510 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x560b6f1430f0 0x560b6f1434d0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cea8074d3851e7b9 server_cookie=2c3627fd7e1ef86d in_seq=0 out_seq=0 2024-05-21T13:41:04.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.490+0000 7fbbf67fc640 10 client.5067 ms_handle_connect on v2:172.21.15.115:6838/1525097577 2024-05-21T13:41:04.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.490+0000 7fbbf67fc640 1 -- 172.21.15.22:0/4246830510 <== mds.0 v2:172.21.15.115:6838/1525097577 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24041 (crc 0 0 0) 0x560b6efcd900 con 0x560b6f1430f0 2024-05-21T13:41:04.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.490+0000 7fbbf67fc640 10 client.5067 handle_command_reply: tid=0 2024-05-21T13:41:04.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.490+0000 7fbc21043000 1 client.5067 shutdown 2024-05-21T13:41:04.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.490+0000 7fbc21043000 1 -- 172.21.15.22:0/4246830510 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560b6f123d00 msgr2=0x560b6f142350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:04.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.490+0000 7fbc21043000 1 --2- 172.21.15.22:0/4246830510 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560b6f123d00 0x560b6f142350 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fbc1815f8f0 tx=0x7fbc10010980 comp rx=0 tx=0).stop 2024-05-21T13:41:04.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.490+0000 7fbc21043000 1 -- 172.21.15.22:0/4246830510 shutdown_connections 2024-05-21T13:41:04.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.490+0000 7fbc21043000 1 --2- 172.21.15.22:0/4246830510 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560b6f123d00 0x560b6f142350 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:04.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.490+0000 7fbc21043000 1 --2- 172.21.15.22:0/4246830510 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x560b6f1430f0 0x560b6f1434d0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:04.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.490+0000 7fbc21043000 1 --2- 172.21.15.22:0/4246830510 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x560b6f1233e0 0x560b6f120da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:04.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.490+0000 7fbc21043000 1 --2- 172.21.15.22:0/4246830510 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x560b6f122ac0 0x560b6f120860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:04.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.490+0000 7fbbf67fc640 0 client.5067 ms_handle_reset on v2:172.21.15.115:6838/1525097577 2024-05-21T13:41:04.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.490+0000 7fbc21043000 1 -- 172.21.15.22:0/4246830510 >> 172.21.15.22:0/4246830510 conn(0x560b6efe2600 msgr2=0x560b6f121f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:41:04.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.490+0000 7fbc21043000 1 -- 172.21.15.22:0/4246830510 shutdown_connections 2024-05-21T13:41:04.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.490+0000 7fbc21043000 1 -- 172.21.15.22:0/4246830510 wait complete. 2024-05-21T13:41:04.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.490+0000 7fbc21043000 20 client.5067 trim_cache size 0 max 16384 2024-05-21T13:41:04.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.506+0000 7fbc21043000 1 Processor -- start 2024-05-21T13:41:04.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.510+0000 7fbc21043000 1 -- start start 2024-05-21T13:41:04.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.510+0000 7fbc21043000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x560b6f122ac0 0x560b6f157b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:04.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.510+0000 7fbc21043000 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x560b6f1233e0 0x560b6f158080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:04.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.510+0000 7fbc21043000 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560b6f123d00 0x560b6f136170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:04.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.510+0000 7fbc21043000 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fbc182020c0 con 0x560b6f123d00 2024-05-21T13:41:04.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.510+0000 7fbc21043000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fbc18201420 con 0x560b6f122ac0 2024-05-21T13:41:04.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.510+0000 7fbc21043000 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7fbc18201a70 con 0x560b6f1233e0 2024-05-21T13:41:04.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.510+0000 7fbc17fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560b6f123d00 0x560b6f136170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:04.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.510+0000 7fbc17fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560b6f123d00 0x560b6f136170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47634/0 (socket says 172.21.15.22:47634) 2024-05-21T13:41:04.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.510+0000 7fbc17fff640 1 -- 172.21.15.22:0/943485651 learned_addr learned my addr 172.21.15.22:0/943485651 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:41:04.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.510+0000 7fbc17fff640 1 -- 172.21.15.22:0/943485651 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x560b6f1233e0 msgr2=0x560b6f158080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:41:04.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.510+0000 7fbc177fe640 1 --2- 172.21.15.22:0/943485651 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x560b6f122ac0 0x560b6f157b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:04.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.510+0000 7fbc17fff640 1 --2- 172.21.15.22:0/943485651 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x560b6f1233e0 0x560b6f158080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:04.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.510+0000 7fbc17fff640 1 -- 172.21.15.22:0/943485651 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x560b6f122ac0 msgr2=0x560b6f157b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:41:04.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.510+0000 7fbc17fff640 1 --2- 172.21.15.22:0/943485651 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x560b6f122ac0 0x560b6f157b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:04.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.510+0000 7fbc17fff640 1 -- 172.21.15.22:0/943485651 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560b6f100480 con 0x560b6f123d00 2024-05-21T13:41:04.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.510+0000 7fbc17fff640 1 --2- 172.21.15.22:0/943485651 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560b6f123d00 0x560b6f136170 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fbc10001c90 tx=0x7fbc1000b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd6f3a294ced6fb6 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:04.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.510+0000 7fbbfcff9640 1 -- 172.21.15.22:0/943485651 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc10005690 con 0x560b6f123d00 2024-05-21T13:41:04.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.510+0000 7fbbfcff9640 1 -- 172.21.15.22:0/943485651 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc10019070 con 0x560b6f123d00 2024-05-21T13:41:04.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.510+0000 7fbbfcff9640 1 -- 172.21.15.22:0/943485651 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc1001c350 con 0x560b6f123d00 2024-05-21T13:41:04.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.510+0000 7fbc21043000 1 -- 172.21.15.22:0/943485651 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560b6f123d00 msgr2=0x560b6f136170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:04.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.510+0000 7fbc21043000 1 --2- 172.21.15.22:0/943485651 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560b6f123d00 0x560b6f136170 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fbc10001c90 tx=0x7fbc1000b000 comp rx=0 tx=0).stop 2024-05-21T13:41:04.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.510+0000 7fbc21043000 1 -- 172.21.15.22:0/943485651 shutdown_connections 2024-05-21T13:41:04.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.510+0000 7fbc21043000 1 --2- 172.21.15.22:0/943485651 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560b6f123d00 0x560b6f136170 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:04.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.510+0000 7fbc21043000 1 --2- 172.21.15.22:0/943485651 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x560b6f1233e0 0x560b6f158080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:04.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.510+0000 7fbc21043000 1 --2- 172.21.15.22:0/943485651 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x560b6f122ac0 0x560b6f157b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:04.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.510+0000 7fbc21043000 1 -- 172.21.15.22:0/943485651 >> 172.21.15.22:0/943485651 conn(0x560b6efe2600 msgr2=0x560b6f14d520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:41:04.488 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.510+0000 7fbc21043000 1 -- 172.21.15.22:0/943485651 shutdown_connections 2024-05-21T13:41:04.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.510+0000 7fbc21043000 1 -- 172.21.15.22:0/943485651 wait complete. 2024-05-21T13:41:04.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.510+0000 7fbc21043000 1 -- start start 2024-05-21T13:41:04.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.510+0000 7fbc21043000 1 Processor -- start 2024-05-21T13:41:04.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.510+0000 7fbc21043000 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560b6f122ac0 0x560b6f141d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:04.492 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.510+0000 7fbc21043000 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x560b6f1233e0 0x560b6f142270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:04.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.510+0000 7fbc21043000 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x560b6f123d00 0x560b6f0fbac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:04.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.510+0000 7fbc21043000 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x560b6ef49480 con 0x560b6f122ac0 2024-05-21T13:41:04.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.510+0000 7fbc21043000 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x560b6ef04ec0 con 0x560b6f1233e0 2024-05-21T13:41:04.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.510+0000 7fbc21043000 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x560b6ef4e7a0 con 0x560b6f123d00 2024-05-21T13:41:04.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.510+0000 7fbc21043000 10 client.0 _ll_register_callbacks cb 0x7fbc10007f00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-05-21T13:41:04.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.510+0000 7fbc177fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560b6f122ac0 0x560b6f141d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:04.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.510+0000 7fbc177fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560b6f122ac0 0x560b6f141d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47642/0 (socket says 172.21.15.22:47642) 2024-05-21T13:41:04.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.510+0000 7fbc177fe640 1 -- 172.21.15.22:0/93264599 learned_addr learned my addr 172.21.15.22:0/93264599 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:41:04.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.510+0000 7fbc16ffd640 1 --2- 172.21.15.22:0/93264599 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x560b6f1233e0 0x560b6f142270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:04.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.510+0000 7fbc17fff640 1 --2- 172.21.15.22:0/93264599 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x560b6f123d00 0x560b6f0fbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:04.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.510+0000 7fbc177fe640 1 -- 172.21.15.22:0/93264599 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x560b6f123d00 msgr2=0x560b6f0fbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:41:04.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.510+0000 7fbc177fe640 1 --2- 172.21.15.22:0/93264599 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x560b6f123d00 0x560b6f0fbac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:04.493 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.514+0000 7fbc177fe640 1 -- 172.21.15.22:0/93264599 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x560b6f1233e0 msgr2=0x560b6f142270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:41:04.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.514+0000 7fbc177fe640 1 --2- 172.21.15.22:0/93264599 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x560b6f1233e0 0x560b6f142270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:04.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.514+0000 7fbc177fe640 1 -- 172.21.15.22:0/93264599 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560b6efca6b0 con 0x560b6f122ac0 2024-05-21T13:41:04.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.514+0000 7fbc177fe640 1 --2- 172.21.15.22:0/93264599 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560b6f122ac0 0x560b6f141d30 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fbc08098370 tx=0x7fbc08019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d79dd300969bad4d server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:04.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.514+0000 7fbbf67fc640 10 client.0 ms_handle_connect on v2:172.21.15.22:3300/0 2024-05-21T13:41:04.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.514+0000 7fbbf67fc640 1 -- 172.21.15.22:0/93264599 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc080c5430 con 0x560b6f122ac0 2024-05-21T13:41:04.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.514+0000 7fbbf67fc640 1 -- 172.21.15.22:0/93264599 <== mon.0 v2:172.21.15.22:3300/0 2 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7fbc080c55d0 con 0x560b6f122ac0 2024-05-21T13:41:04.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.514+0000 7fbc21043000 1 -- 172.21.15.22:0/93264599 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc10019070 con 0x560b6f122ac0 2024-05-21T13:41:04.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.514+0000 7fbbf67fc640 1 -- 172.21.15.22:0/93264599 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7fbc080d3050 con 0x560b6f122ac0 2024-05-21T13:41:04.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.514+0000 7fbc21043000 10 client.5073 fetch_fsmap learned FSMap version 14 2024-05-21T13:41:04.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.514+0000 7fbc21043000 1 -- 172.21.15.22:0/93264599 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x560b6efa17d0 con 0x560b6f122ac0 2024-05-21T13:41:04.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.514+0000 7fbbf67fc640 1 -- 172.21.15.22:0/93264599 <== mon.0 v2:172.21.15.22:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc10019070 con 0x560b6f122ac0 2024-05-21T13:41:04.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.514+0000 7fbbf67fc640 1 -- 172.21.15.22:0/93264599 <== mon.0 v2:172.21.15.22:3300/0 5 ==== fsmap(e 14) ==== 4752+0+0 (secure 0 0 0) 0x7fbc080d6020 con 0x560b6f122ac0 2024-05-21T13:41:04.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.514+0000 7fbc21043000 10 client.5073 fetch_fsmap finished waiting for FSMap version 14 2024-05-21T13:41:04.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.514+0000 7fbc21043000 10 client.5073 resolve_mds: validated gid 4300 aka daemon mds.f 2024-05-21T13:41:04.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.514+0000 7fbc21043000 20 client.5073 populate_metadata read hostname 'smithi022' 2024-05-21T13:41:04.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.514+0000 7fbc21043000 1 --2- 172.21.15.22:0/93264599 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x560b6f0fc000 0x560b6f0fc410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:04.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.514+0000 7fbc21043000 4 client.5073 mds_command: new command op to 4300 tid=0 multi_id=0 [{"prefix": "quiesce db", "cancel": true, "all": true}] 2024-05-21T13:41:04.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.514+0000 7fbc21043000 1 -- 172.21.15.22:0/93264599 --> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] -- command(tid 0: {"prefix": "quiesce db", "cancel": true, "all": true}) -- 0x560b6eee1df0 con 0x560b6f0fc000 2024-05-21T13:41:04.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.514+0000 7fbc16ffd640 1 --2- 172.21.15.22:0/93264599 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x560b6f0fc000 0x560b6f0fc410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:04.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.514+0000 7fbbf67fc640 10 client.5073 ms_handle_connect on v2:172.21.15.115:6838/1525097577 2024-05-21T13:41:04.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.514+0000 7fbc16ffd640 1 --2- 172.21.15.22:0/93264599 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x560b6f0fc000 0x560b6f0fc410 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6519c1cbe79ed745 server_cookie=51c73da098251e9 in_seq=0 out_seq=0 2024-05-21T13:41:04.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.514+0000 7fbbf67fc640 1 -- 172.21.15.22:0/93264599 <== mds.0 v2:172.21.15.115:6838/1525097577 1 ==== command_reply(tid 0: 0 ) ==== 8+0+79 (crc 0 0 0) 0x560b6eee1df0 con 0x560b6f0fc000 2024-05-21T13:41:04.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.514+0000 7fbbf67fc640 10 client.5073 handle_command_reply: tid=0 2024-05-21T13:41:04.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.514+0000 7fbc21043000 1 client.5073 shutdown 2024-05-21T13:41:04.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.514+0000 7fbc21043000 1 -- 172.21.15.22:0/93264599 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560b6f122ac0 msgr2=0x560b6f141d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:04.495 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.514+0000 7fbc21043000 1 --2- 172.21.15.22:0/93264599 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560b6f122ac0 0x560b6f141d30 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fbc08098370 tx=0x7fbc08019810 comp rx=0 tx=0).stop 2024-05-21T13:41:04.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.514+0000 7fbc21043000 1 -- 172.21.15.22:0/93264599 shutdown_connections 2024-05-21T13:41:04.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.514+0000 7fbc21043000 1 --2- 172.21.15.22:0/93264599 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x560b6f123d00 0x560b6f0fbac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:04.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.514+0000 7fbc21043000 1 --2- 172.21.15.22:0/93264599 >> [v2:172.21.15.115:6838/1525097577,v1:172.21.15.115:6839/1525097577] conn(0x560b6f0fc000 0x560b6f0fc410 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:04.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.514+0000 7fbc21043000 1 --2- 172.21.15.22:0/93264599 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x560b6f1233e0 0x560b6f142270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:04.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.514+0000 7fbc21043000 1 --2- 172.21.15.22:0/93264599 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x560b6f122ac0 0x560b6f141d30 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:04.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.514+0000 7fbbf67fc640 0 client.5073 ms_handle_reset on v2:172.21.15.115:6838/1525097577 2024-05-21T13:41:04.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.514+0000 7fbc21043000 1 -- 172.21.15.22:0/93264599 >> 172.21.15.22:0/93264599 conn(0x560b6efe2600 msgr2=0x560b6f0ffd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:41:04.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.514+0000 7fbc21043000 1 -- 172.21.15.22:0/93264599 shutdown_connections 2024-05-21T13:41:04.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.514+0000 7fbc21043000 1 -- 172.21.15.22:0/93264599 wait complete. 2024-05-21T13:41:04.496 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.514+0000 7fbc21043000 20 client.5073 trim_cache size 0 max 16384 2024-05-21T13:41:04.496 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-05-21T13:41:04.497 INFO:teuthology.orchestra.run.smithi022.stdout: "epoch": 14, 2024-05-21T13:41:04.497 INFO:teuthology.orchestra.run.smithi022.stdout: "leader": 4300, 2024-05-21T13:41:04.497 INFO:teuthology.orchestra.run.smithi022.stdout: "set_version": 16, 2024-05-21T13:41:04.497 INFO:teuthology.orchestra.run.smithi022.stdout: "sets": {} 2024-05-21T13:41:04.497 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-05-21T13:41:04.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.514+0000 7fbc1deb8640 1 -- 172.21.15.22:0/1449016361 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fbc0406f430 msgr2=0x7fbc040718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:04.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.514+0000 7fbc1deb8640 1 --2- 172.21.15.22:0/1449016361 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fbc0406f430 0x7fbc040718f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fbc080af000 tx=0x7fbc08008040 comp rx=0 tx=0).stop 2024-05-21T13:41:04.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.514+0000 7fbc1deb8640 1 -- 172.21.15.22:0/1449016361 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc181f2d60 msgr2=0x7fbc18165b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:04.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.514+0000 7fbc1deb8640 1 --2- 172.21.15.22:0/1449016361 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc181f2d60 0x7fbc18165b60 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fbc0c000f70 tx=0x7fbc0c00dd40 comp rx=0 tx=0).stop 2024-05-21T13:41:04.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.514+0000 7fbc1deb8640 1 -- 172.21.15.22:0/1449016361 shutdown_connections 2024-05-21T13:41:04.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.514+0000 7fbc1deb8640 1 --2- 172.21.15.22:0/1449016361 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fbc0406f430 0x7fbc040718f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:04.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.514+0000 7fbc1deb8640 1 --2- 172.21.15.22:0/1449016361 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fbc181660a0 0x7fbc181f8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:04.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.514+0000 7fbc1deb8640 1 --2- 172.21.15.22:0/1449016361 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fbc181f2d60 0x7fbc18165b60 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:04.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.514+0000 7fbc1deb8640 1 --2- 172.21.15.22:0/1449016361 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fbc00003a40 0x7fbc181588e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:04.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.514+0000 7fbc1deb8640 1 -- 172.21.15.22:0/1449016361 >> 172.21.15.22:0/1449016361 conn(0x7fbc180ce550 msgr2=0x7fbc18154210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:41:04.498 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.514+0000 7fbc1deb8640 1 -- 172.21.15.22:0/1449016361 shutdown_connections 2024-05-21T13:41:04.499 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.514+0000 7fbc1deb8640 1 -- 172.21.15.22:0/1449016361 wait complete. 2024-05-21T13:41:04.509 INFO:tasks.quiescer:done joining Quiescers 2024-05-21T13:41:04.509 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-05-21T13:41:04.518 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-05-21T13:41:04.519 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-05-21T13:41:04.519 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-21T13:41:04.524 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-05-21T13:41:04.525 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-21T13:41:04.573 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-21T13:41:04.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.762+0000 7f5fdacab640 1 Processor -- start 2024-05-21T13:41:04.739 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.762+0000 7f5fdacab640 1 -- start start 2024-05-21T13:41:04.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.762+0000 7f5fdacab640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5fd40c47f0 0x7f5fd415d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:04.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.762+0000 7f5fdacab640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5fd4159b20 con 0x7f5fd4153b20 2024-05-21T13:41:04.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.762+0000 7f5fdacab640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5fd40c9a60 con 0x7f5fd415d650 2024-05-21T13:41:04.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.762+0000 7f5fdacab640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f5fd4159da0 con 0x7f5fd40c47f0 2024-05-21T13:41:04.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.762+0000 7f5fd8a47640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f5fd4153b20 0x7f5fd40c9020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:33690/0 (socket says 172.21.15.22:33690) 2024-05-21T13:41:04.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.762+0000 7f5fd8a47640 1 -- 172.21.15.22:0/2244240498 learned_addr learned my addr 172.21.15.22:0/2244240498 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-21T13:41:04.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.762+0000 7f5fd3fff640 1 --2- 172.21.15.22:0/2244240498 >> v2:172.21.15.115:3300/0 conn(0x7f5fd40c47f0 0x7f5fd415d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:04.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.766+0000 7f5fd37fe640 1 -- 172.21.15.22:0/2244240498 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 311831385 0 0) 0x7f5fc0001120 con 0x7f5fd4153b20 2024-05-21T13:41:04.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.766+0000 7f5fd37fe640 1 -- 172.21.15.22:0/2244240498 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5fc4003530 con 0x7f5fd4153b20 2024-05-21T13:41:04.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.766+0000 7f5fd37fe640 1 -- 172.21.15.22:0/2244240498 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 937607362 0 0) 0x7f5fc4003530 con 0x7f5fd4153b20 2024-05-21T13:41:04.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.766+0000 7f5fd37fe640 1 -- 172.21.15.22:0/2244240498 >> v2:172.21.15.115:3300/0 conn(0x7f5fd40c47f0 msgr2=0x7f5fd415d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:41:04.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.766+0000 7f5fd37fe640 1 --2- 172.21.15.22:0/2244240498 >> v2:172.21.15.115:3300/0 conn(0x7f5fd40c47f0 0x7f5fd415d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:04.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.766+0000 7f5fd37fe640 1 -- 172.21.15.22:0/2244240498 >> v1:172.21.15.115:6789/0 conn(0x7f5fd415d650 legacy=0x7f5fd406df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:04.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.766+0000 7f5fd37fe640 1 -- 172.21.15.22:0/2244240498 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fd415a080 con 0x7f5fd4153b20 2024-05-21T13:41:04.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.766+0000 7f5fd37fe640 1 -- 172.21.15.22:0/2244240498 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2684847062 0 0) 0x7f5fc00018d0 con 0x7f5fd4153b20 2024-05-21T13:41:04.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.766+0000 7f5fd37fe640 1 -- 172.21.15.22:0/2244240498 >> v1:172.21.15.22:6789/0 conn(0x7f5fd4153b20 legacy=0x7f5fd40c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:04.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.766+0000 7f5fd37fe640 1 --2- 172.21.15.22:0/2244240498 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5fc4003a10 0x7f5fc4003df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:04.743 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.766+0000 7f5fd37fe640 1 --2- 172.21.15.22:0/2244240498 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5fc4004810 0x7f5fc4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:04.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.766+0000 7f5fd37fe640 1 --2- 172.21.15.22:0/2244240498 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5fc40051d0 0x7f5fc400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:04.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.766+0000 7f5fd37fe640 1 -- 172.21.15.22:0/2244240498 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5fd4159da0 con 0x7f5fc4003a10 2024-05-21T13:41:04.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.766+0000 7f5fd8a47640 1 --2- 172.21.15.22:0/2244240498 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5fc4003a10 0x7f5fc4003df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:04.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.766+0000 7f5fd37fe640 1 -- 172.21.15.22:0/2244240498 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f5fc400bff0 con 0x7f5fc4004810 2024-05-21T13:41:04.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.766+0000 7f5fd37fe640 1 -- 172.21.15.22:0/2244240498 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f5fc400c1f0 con 0x7f5fc40051d0 2024-05-21T13:41:04.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.766+0000 7f5fd3fff640 1 --2- 172.21.15.22:0/2244240498 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5fc4004810 0x7f5fc4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:04.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.766+0000 7f5fd9248640 1 --2- 172.21.15.22:0/2244240498 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5fc40051d0 0x7f5fc400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:04.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.766+0000 7f5fd8a47640 1 -- 172.21.15.22:0/2244240498 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5fc40051d0 msgr2=0x7f5fc400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:41:04.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.766+0000 7f5fd8a47640 1 --2- 172.21.15.22:0/2244240498 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5fc40051d0 0x7f5fc400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:04.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.766+0000 7f5fd8a47640 1 -- 172.21.15.22:0/2244240498 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5fc4004810 msgr2=0x7f5fc4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:41:04.744 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.766+0000 7f5fd8a47640 1 --2- 172.21.15.22:0/2244240498 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5fc4004810 0x7f5fc4004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:04.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.766+0000 7f5fd8a47640 1 -- 172.21.15.22:0/2244240498 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fc4003530 con 0x7f5fc4003a10 2024-05-21T13:41:04.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.766+0000 7f5fd9248640 1 -- 172.21.15.22:0/2244240498 reap_dead start 2024-05-21T13:41:04.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.766+0000 7f5fd8a47640 1 --2- 172.21.15.22:0/2244240498 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5fc4003a10 0x7f5fc4003df0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f5fc000c4c0 tx=0x7f5fc001cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcaf06309ac6b27e server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:04.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.766+0000 7f5fd37fe640 1 -- 172.21.15.22:0/2244240498 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fc000c0e0 con 0x7f5fc4003a10 2024-05-21T13:41:04.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.766+0000 7f5fd37fe640 1 -- 172.21.15.22:0/2244240498 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fc00a9020 con 0x7f5fc4003a10 2024-05-21T13:41:04.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.766+0000 7f5fd37fe640 1 -- 172.21.15.22:0/2244240498 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fc0005b00 con 0x7f5fc4003a10 2024-05-21T13:41:04.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.770+0000 7f5fdacab640 1 -- 172.21.15.22:0/2244240498 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5fc4003a10 msgr2=0x7f5fc4003df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:04.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.770+0000 7f5fdacab640 1 --2- 172.21.15.22:0/2244240498 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5fc4003a10 0x7f5fc4003df0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f5fc000c4c0 tx=0x7f5fc001cbc0 comp rx=0 tx=0).stop 2024-05-21T13:41:04.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.770+0000 7f5fdacab640 1 -- 172.21.15.22:0/2244240498 shutdown_connections 2024-05-21T13:41:04.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.770+0000 7f5fdacab640 1 --2- 172.21.15.22:0/2244240498 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5fc4003a10 0x7f5fc4003df0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:04.752 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.770+0000 7f5fdacab640 1 -- 172.21.15.22:0/2244240498 >> 172.21.15.22:0/2244240498 conn(0x7f5fd406ce70 msgr2=0x7f5fd40cd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:41:04.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.770+0000 7f5fdacab640 1 -- 172.21.15.22:0/2244240498 shutdown_connections 2024-05-21T13:41:04.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.770+0000 7f5fdacab640 1 -- 172.21.15.22:0/2244240498 wait complete. 2024-05-21T13:41:04.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.770+0000 7f5fdacab640 1 Processor -- start 2024-05-21T13:41:04.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.770+0000 7f5fdacab640 1 -- start start 2024-05-21T13:41:04.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.770+0000 7f5fdacab640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5fc4003a10 0x7f5fd4070020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:04.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.770+0000 7f5fdacab640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5fd414dba0 0x7f5fd41efa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:04.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.770+0000 7f5fdacab640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5fd4146e60 0x7f5fd41effd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:04.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.770+0000 7f5fdacab640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5fd4153f00 con 0x7f5fd4146e60 2024-05-21T13:41:04.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.770+0000 7f5fdacab640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f5fd415a640 con 0x7f5fc4003a10 2024-05-21T13:41:04.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.770+0000 7f5fdacab640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f5fd415d110 con 0x7f5fd414dba0 2024-05-21T13:41:04.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.770+0000 7f5fd9248640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5fd4146e60 0x7f5fd41effd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:04.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.770+0000 7f5fd9248640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5fd4146e60 0x7f5fd41effd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47648/0 (socket says 172.21.15.22:47648) 2024-05-21T13:41:04.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.770+0000 7f5fd9248640 1 -- 172.21.15.22:0/2138802044 learned_addr learned my addr 172.21.15.22:0/2138802044 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:41:04.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.770+0000 7f5fd3fff640 1 --2- 172.21.15.22:0/2138802044 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5fd414dba0 0x7f5fd41efa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:04.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.770+0000 7f5fd8a47640 1 --2- 172.21.15.22:0/2138802044 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5fc4003a10 0x7f5fd4070020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:04.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.770+0000 7f5fd9248640 1 -- 172.21.15.22:0/2138802044 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5fd414dba0 msgr2=0x7f5fd41efa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:04.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.770+0000 7f5fd9248640 1 --2- 172.21.15.22:0/2138802044 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5fd414dba0 0x7f5fd41efa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:04.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.770+0000 7f5fd9248640 1 -- 172.21.15.22:0/2138802044 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5fc4003a10 msgr2=0x7f5fd4070020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:04.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.770+0000 7f5fd9248640 1 --2- 172.21.15.22:0/2138802044 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5fc4003a10 0x7f5fd4070020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:04.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.770+0000 7f5fd9248640 1 -- 172.21.15.22:0/2138802044 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fd414fd40 con 0x7f5fd4146e60 2024-05-21T13:41:04.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.770+0000 7f5fd9248640 1 --2- 172.21.15.22:0/2138802044 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5fd4146e60 0x7f5fd41effd0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f5fd40c4d60 tx=0x7f5fcc00e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:04.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.770+0000 7f5fd17fa640 1 -- 172.21.15.22:0/2138802044 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fcc00ed30 con 0x7f5fd4146e60 2024-05-21T13:41:04.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.770+0000 7f5fd17fa640 1 -- 172.21.15.22:0/2138802044 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fcc019070 con 0x7f5fd4146e60 2024-05-21T13:41:04.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.770+0000 7f5fdacab640 1 -- 172.21.15.22:0/2138802044 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fd40cb570 con 0x7f5fd4146e60 2024-05-21T13:41:04.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.770+0000 7f5fd17fa640 1 -- 172.21.15.22:0/2138802044 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fcc003bc0 con 0x7f5fd4146e60 2024-05-21T13:41:04.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.770+0000 7f5fdacab640 1 -- 172.21.15.22:0/2138802044 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fd40cbb30 con 0x7f5fd4146e60 2024-05-21T13:41:04.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.774+0000 7f5fdacab640 1 -- 172.21.15.22:0/2138802044 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fd4077bb0 con 0x7f5fd4146e60 2024-05-21T13:41:04.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.774+0000 7f5fd17fa640 1 -- 172.21.15.22:0/2138802044 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f5fcc013070 con 0x7f5fd4146e60 2024-05-21T13:41:04.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.774+0000 7f5fd17fa640 1 --2- 172.21.15.22:0/2138802044 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f5fb806f430 0x7f5fb80718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:04.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.774+0000 7f5fd17fa640 1 -- 172.21.15.22:0/2138802044 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f5fcc0925e0 con 0x7f5fd4146e60 2024-05-21T13:41:04.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.774+0000 7f5fd8a47640 1 --2- 172.21.15.22:0/2138802044 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f5fb806f430 0x7f5fb80718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:04.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.774+0000 7f5fd8a47640 1 --2- 172.21.15.22:0/2138802044 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f5fb806f430 0x7f5fb80718f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5fc00aa000 tx=0x7f5fd40c4eb0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:04.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:04.778+0000 7f5fd17fa640 1 -- 172.21.15.22:0/2138802044 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f5fd414fd40 con 0x7f5fd4146e60 2024-05-21T13:41:05.019 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:05.042+0000 7f5fdacab640 1 -- 172.21.15.22:0/2138802044 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f5fd40c0f70 con 0x7f5fd4146e60 2024-05-21T13:41:05.019 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:05.042+0000 7f5fd17fa640 1 -- 172.21.15.22:0/2138802044 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7f5fcc05f150 con 0x7f5fd4146e60 2024-05-21T13:41:05.019 INFO:teuthology.orchestra.run.smithi022.stderr:listed 0 entries 2024-05-21T13:41:05.023 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:05.046+0000 7f5fdacab640 1 -- 172.21.15.22:0/2138802044 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f5fb806f430 msgr2=0x7f5fb80718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:05.024 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:05.046+0000 7f5fdacab640 1 --2- 172.21.15.22:0/2138802044 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f5fb806f430 0x7f5fb80718f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5fc00aa000 tx=0x7f5fd40c4eb0 comp rx=0 tx=0).stop 2024-05-21T13:41:05.024 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:05.046+0000 7f5fdacab640 1 -- 172.21.15.22:0/2138802044 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5fd4146e60 msgr2=0x7f5fd41effd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:05.024 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:05.046+0000 7f5fdacab640 1 --2- 172.21.15.22:0/2138802044 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5fd4146e60 0x7f5fd41effd0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f5fd40c4d60 tx=0x7f5fcc00e530 comp rx=0 tx=0).stop 2024-05-21T13:41:05.024 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:05.046+0000 7f5fdacab640 1 -- 172.21.15.22:0/2138802044 shutdown_connections 2024-05-21T13:41:05.024 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:05.046+0000 7f5fdacab640 1 --2- 172.21.15.22:0/2138802044 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f5fb806f430 0x7f5fb80718f0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:05.024 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:05.046+0000 7f5fdacab640 1 --2- 172.21.15.22:0/2138802044 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5fd4146e60 0x7f5fd41effd0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:05.024 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:05.046+0000 7f5fdacab640 1 --2- 172.21.15.22:0/2138802044 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5fd414dba0 0x7f5fd41efa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:05.024 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:05.046+0000 7f5fdacab640 1 --2- 172.21.15.22:0/2138802044 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5fc4003a10 0x7f5fd4070020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:05.024 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:05.046+0000 7f5fdacab640 1 -- 172.21.15.22:0/2138802044 >> 172.21.15.22:0/2138802044 conn(0x7f5fd406ce70 msgr2=0x7f5fd4158fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:41:05.024 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:05.046+0000 7f5fdacab640 1 -- 172.21.15.22:0/2138802044 shutdown_connections 2024-05-21T13:41:05.024 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:05.046+0000 7f5fdacab640 1 -- 172.21.15.22:0/2138802044 wait complete. 2024-05-21T13:41:05.052 DEBUG:teuthology.orchestra.run.smithi022:> set -ex 2024-05-21T13:41:05.052 DEBUG:teuthology.orchestra.run.smithi022:> dd if=/proc/self/mounts of=/dev/stdout 2024-05-21T13:41:05.060 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-05-21T13:41:05.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:05.290+0000 7ff9f83db640 1 Processor -- start 2024-05-21T13:41:05.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:05.290+0000 7ff9f83db640 1 -- start start 2024-05-21T13:41:05.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:05.290+0000 7ff9f83db640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7ff9f015a030 0x7ff9f015a410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:05.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:05.290+0000 7ff9f83db640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff9f00c9bf0 0x7ff9f0073e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:05.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:05.294+0000 7ff9f83db640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9f0070fb0 con 0x7ff9f00c8240 2024-05-21T13:41:05.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:05.294+0000 7ff9f83db640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7ff9f00c9760 con 0x7ff9f00c9bf0 2024-05-21T13:41:05.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:05.294+0000 7ff9f83db640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7ff9f00cad30 con 0x7ff9f015a030 2024-05-21T13:41:05.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:05.294+0000 7ff9f6978640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7ff9f00c9bf0 0x7ff9f0073e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:05.269 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:05.294+0000 7ff9f5976640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7ff9f00c8240 0x7ff9f00708a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:33706/0 (socket says 172.21.15.22:33706) 2024-05-21T13:41:05.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:05.294+0000 7ff9f5976640 1 -- 172.21.15.22:0/4083266727 learned_addr learned my addr 172.21.15.22:0/4083266727 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-21T13:41:05.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:05.294+0000 7ff9f6177640 1 --2- 172.21.15.22:0/4083266727 >> v2:172.21.15.115:3300/0 conn(0x7ff9f015a030 0x7ff9f015a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:05.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:05.294+0000 7ff9f6978640 1 -- 172.21.15.22:0/4083266727 >> v2:172.21.15.115:3300/0 conn(0x7ff9f015a030 msgr2=0x7ff9f015a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:41:05.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:05.294+0000 7ff9f5175640 1 -- 172.21.15.22:0/4083266727 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1244600521 0 0) 0x7ff9f0070fb0 con 0x7ff9f00c8240 2024-05-21T13:41:05.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:05.294+0000 7ff9f6978640 1 --2- 172.21.15.22:0/4083266727 >> v2:172.21.15.115:3300/0 conn(0x7ff9f015a030 0x7ff9f015a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:05.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:05.294+0000 7ff9f6978640 1 -- 172.21.15.22:0/4083266727 >> v1:172.21.15.22:6789/0 conn(0x7ff9f00c8240 legacy=0x7ff9f00708a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:05.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:05.294+0000 7ff9f6978640 1 -- 172.21.15.22:0/4083266727 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9f00cb010 con 0x7ff9f00c9bf0 2024-05-21T13:41:05.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:05.294+0000 7ff9f6978640 1 --2- 172.21.15.22:0/4083266727 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9f00c9bf0 0x7ff9f0073e90 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ff9f00cb9b0 tx=0x7ff9e801f110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60f04a4efb7d51de server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:05.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:05.294+0000 7ff9f5175640 1 -- 172.21.15.22:0/4083266727 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e80b4070 con 0x7ff9f00c9bf0 2024-05-21T13:41:05.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:05.298+0000 7ff9f5175640 1 -- 172.21.15.22:0/4083266727 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9e80af600 con 0x7ff9f00c9bf0 2024-05-21T13:41:05.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:05.298+0000 7ff9f5175640 1 -- 172.21.15.22:0/4083266727 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e80af9d0 con 0x7ff9f00c9bf0 2024-05-21T13:41:05.274 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:05.298+0000 7ff9f83db640 1 -- 172.21.15.22:0/4083266727 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9f00c9bf0 msgr2=0x7ff9f0073e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:05.274 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:05.298+0000 7ff9f83db640 1 --2- 172.21.15.22:0/4083266727 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9f00c9bf0 0x7ff9f0073e90 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7ff9f00cb9b0 tx=0x7ff9e801f110 comp rx=0 tx=0).stop 2024-05-21T13:41:05.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:05.298+0000 7ff9f83db640 1 -- 172.21.15.22:0/4083266727 shutdown_connections 2024-05-21T13:41:05.279 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:05.298+0000 7ff9f83db640 1 --2- 172.21.15.22:0/4083266727 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9f00c9bf0 0x7ff9f0073e90 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:05.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:05.298+0000 7ff9f83db640 1 --2- 172.21.15.22:0/4083266727 >> v2:172.21.15.115:3300/0 conn(0x7ff9f015a030 0x7ff9f015a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:05.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:05.298+0000 7ff9f83db640 1 -- 172.21.15.22:0/4083266727 >> 172.21.15.22:0/4083266727 conn(0x7ff9f006d600 msgr2=0x7ff9f006da10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:41:05.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:05.298+0000 7ff9f83db640 1 -- 172.21.15.22:0/4083266727 shutdown_connections 2024-05-21T13:41:05.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:05.298+0000 7ff9f83db640 1 -- 172.21.15.22:0/4083266727 wait complete. 2024-05-21T13:41:05.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:05.302+0000 7ff9f83db640 1 Processor -- start 2024-05-21T13:41:05.280 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:05.302+0000 7ff9f83db640 1 -- start start 2024-05-21T13:41:05.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:05.302+0000 7ff9f83db640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9f00c8240 0x7ff9f008d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:05.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:05.302+0000 7ff9f83db640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff9f00c9bf0 0x7ff9f0209c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:05.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:05.302+0000 7ff9f83db640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff9f015a030 0x7ff9f015d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:05.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:05.302+0000 7ff9f83db640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f015fff0 con 0x7ff9f00c8240 2024-05-21T13:41:05.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:05.302+0000 7ff9f83db640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7ff9f00cb5d0 con 0x7ff9f015a030 2024-05-21T13:41:05.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:05.302+0000 7ff9f83db640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7ff9f00ca040 con 0x7ff9f00c9bf0 2024-05-21T13:41:05.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:05.302+0000 7ff9f6177640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9f00c8240 0x7ff9f008d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:05.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:05.302+0000 7ff9f6177640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9f00c8240 0x7ff9f008d600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:47672/0 (socket says 172.21.15.22:47672) 2024-05-21T13:41:05.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:05.302+0000 7ff9f6177640 1 -- 172.21.15.22:0/1232347519 learned_addr learned my addr 172.21.15.22:0/1232347519 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:41:05.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:05.302+0000 7ff9f5976640 1 --2- 172.21.15.22:0/1232347519 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff9f00c9bf0 0x7ff9f0209c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:05.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:05.302+0000 7ff9f6978640 1 --2- 172.21.15.22:0/1232347519 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff9f015a030 0x7ff9f015d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:05.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:05.306+0000 7ff9f6177640 1 -- 172.21.15.22:0/1232347519 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff9f00c9bf0 msgr2=0x7ff9f0209c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:05.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:05.306+0000 7ff9f6177640 1 --2- 172.21.15.22:0/1232347519 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff9f00c9bf0 0x7ff9f0209c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:05.282 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:05.306+0000 7ff9f6177640 1 -- 172.21.15.22:0/1232347519 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff9f015a030 msgr2=0x7ff9f015d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:05.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:05.306+0000 7ff9f6177640 1 --2- 172.21.15.22:0/1232347519 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff9f015a030 0x7ff9f015d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:05.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:05.306+0000 7ff9f6177640 1 -- 172.21.15.22:0/1232347519 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9f00cc200 con 0x7ff9f00c8240 2024-05-21T13:41:05.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:05.306+0000 7ff9f6177640 1 --2- 172.21.15.22:0/1232347519 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9f00c8240 0x7ff9f008d600 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec00d620 tx=0x7ff9ec00dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:05.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:05.306+0000 7ff9e6ffd640 1 -- 172.21.15.22:0/1232347519 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9ec00b620 con 0x7ff9f00c8240 2024-05-21T13:41:05.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:05.306+0000 7ff9f83db640 1 -- 172.21.15.22:0/1232347519 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9f01525a0 con 0x7ff9f00c8240 2024-05-21T13:41:05.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:05.306+0000 7ff9f83db640 1 -- 172.21.15.22:0/1232347519 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9f0152b60 con 0x7ff9f00c8240 2024-05-21T13:41:05.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:05.306+0000 7ff9e6ffd640 1 -- 172.21.15.22:0/1232347519 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9ec019070 con 0x7ff9f00c8240 2024-05-21T13:41:05.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:05.306+0000 7ff9e6ffd640 1 -- 172.21.15.22:0/1232347519 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9ec00b9e0 con 0x7ff9f00c8240 2024-05-21T13:41:05.283 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:05.306+0000 7ff9f83db640 1 -- 172.21.15.22:0/1232347519 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9d80052a0 con 0x7ff9f00c8240 2024-05-21T13:41:05.284 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:05.306+0000 7ff9e6ffd640 1 -- 172.21.15.22:0/1232347519 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ff9ec00bb80 con 0x7ff9f00c8240 2024-05-21T13:41:05.288 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:05.310+0000 7ff9e6ffd640 1 --2- 172.21.15.22:0/1232347519 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7ff9d406f430 0x7ff9d40718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:05.288 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:05.310+0000 7ff9e6ffd640 1 -- 172.21.15.22:0/1232347519 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7ff9ec08f8f0 con 0x7ff9f00c8240 2024-05-21T13:41:05.288 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:05.310+0000 7ff9f5976640 1 --2- 172.21.15.22:0/1232347519 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7ff9d406f430 0x7ff9d40718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:05.288 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:05.310+0000 7ff9f5976640 1 --2- 172.21.15.22:0/1232347519 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7ff9d406f430 0x7ff9d40718f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff9f00749b0 tx=0x7ff9e0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:05.291 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:05.314+0000 7ff9e6ffd640 1 -- 172.21.15.22:0/1232347519 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7ff9ec05c500 con 0x7ff9f00c8240 2024-05-21T13:41:05.627 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:05.650+0000 7ff9f83db640 1 -- 172.21.15.22:0/1232347519 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ff9d8005860 con 0x7ff9f00c8240 2024-05-21T13:41:05.628 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:05.650+0000 7ff9e6ffd640 1 -- 172.21.15.22:0/1232347519 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) ==== 80+0+0 (secure 0 0 0) 0x7ff9ec05be00 con 0x7ff9f00c8240 2024-05-21T13:41:05.628 INFO:teuthology.orchestra.run.smithi022.stderr:listed 0 entries 2024-05-21T13:41:05.631 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:05.654+0000 7ff9f83db640 1 -- 172.21.15.22:0/1232347519 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7ff9d406f430 msgr2=0x7ff9d40718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:05.631 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:05.654+0000 7ff9f83db640 1 --2- 172.21.15.22:0/1232347519 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7ff9d406f430 0x7ff9d40718f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7ff9f00749b0 tx=0x7ff9e0009040 comp rx=0 tx=0).stop 2024-05-21T13:41:05.631 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:05.654+0000 7ff9f83db640 1 -- 172.21.15.22:0/1232347519 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9f00c8240 msgr2=0x7ff9f008d600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:05.632 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:05.654+0000 7ff9f83db640 1 --2- 172.21.15.22:0/1232347519 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9f00c8240 0x7ff9f008d600 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec00d620 tx=0x7ff9ec00dae0 comp rx=0 tx=0).stop 2024-05-21T13:41:05.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:05.658+0000 7ff9f83db640 1 -- 172.21.15.22:0/1232347519 shutdown_connections 2024-05-21T13:41:05.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:05.658+0000 7ff9f83db640 1 --2- 172.21.15.22:0/1232347519 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7ff9d406f430 0x7ff9d40718f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:05.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:05.658+0000 7ff9f83db640 1 --2- 172.21.15.22:0/1232347519 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff9f015a030 0x7ff9f015d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:05.633 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:05.658+0000 7ff9f83db640 1 --2- 172.21.15.22:0/1232347519 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff9f00c9bf0 0x7ff9f0209c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:05.634 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:05.658+0000 7ff9f83db640 1 --2- 172.21.15.22:0/1232347519 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff9f00c8240 0x7ff9f008d600 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:05.634 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:05.658+0000 7ff9f83db640 1 -- 172.21.15.22:0/1232347519 >> 172.21.15.22:0/1232347519 conn(0x7ff9f006d600 msgr2=0x7ff9f00c7b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:41:05.634 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:05.658+0000 7ff9f83db640 1 -- 172.21.15.22:0/1232347519 shutdown_connections 2024-05-21T13:41:05.634 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:05.658+0000 7ff9f83db640 1 -- 172.21.15.22:0/1232347519 wait complete. 2024-05-21T13:41:05.670 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi022.front.sepia.ceph.com... 2024-05-21T13:41:05.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-21T13:41:05.671 DEBUG:teuthology.orchestra.run.smithi022:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-05-21T13:41:05.718 INFO:teuthology.orchestra.run:waiting for 300 2024-05-21T13:41:05.719 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi022.stderr:ceph-fuse[33615]: fuse finished with error 0 and tester_r 0 2024-05-21T13:41:11.820 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi022.front.sepia.ceph.com 2024-05-21T13:41:11.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-21T13:41:11.820 DEBUG:teuthology.orchestra.run.smithi022:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-05-21T13:41:11.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-21T13:41:11.829 DEBUG:teuthology.orchestra.run.smithi022:> ip netns list 2024-05-21T13:41:11.878 INFO:teuthology.orchestra.run.smithi022.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-05-21T13:41:11.878 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-21T13:41:11.878 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-05-21T13:41:11.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-05-21T13:41:11.938 DEBUG:teuthology.orchestra.run.smithi022:> sudo ip link delete ceph-brx 2024-05-21T13:41:12.126 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-05-21T13:41:12.136 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-05-21T13:41:12.136 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-21T13:41:12.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.290+0000 7f815595d640 1 Processor -- start 2024-05-21T13:41:12.266 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.290+0000 7f815595d640 1 -- start start 2024-05-21T13:41:12.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.290+0000 7f815595d640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8150155ee0 0x7f815015bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:12.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.290+0000 7f815595d640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f815015fb30 0x7f81500cc1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:12.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.290+0000 7f815595d640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f815015cc10 con 0x7f815015ff80 2024-05-21T13:41:12.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.290+0000 7f815595d640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f815015c370 con 0x7f8150155ee0 2024-05-21T13:41:12.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.290+0000 7f815595d640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f815015c650 con 0x7f815015fb30 2024-05-21T13:41:12.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.290+0000 7f814e7fc640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f815015fb30 0x7f81500cc1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:12.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.290+0000 7f814effd640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f8150155ee0 0x7f815015bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:12.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.290+0000 7f814e7fc640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f815015fb30 0x7f81500cc1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.22:38240/0 (socket says 172.21.15.22:38240) 2024-05-21T13:41:12.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.290+0000 7f814e7fc640 1 -- 172.21.15.22:0/70199835 learned_addr learned my addr 172.21.15.22:0/70199835 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:41:12.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.290+0000 7f814f7fe640 1 --1- 172.21.15.22:0/70199835 >> v1:172.21.15.115:6789/0 conn(0x7f815015ff80 0x7f8150072120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.22:43400/0 (socket says 172.21.15.22:43400) 2024-05-21T13:41:12.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.290+0000 7f814e7fc640 1 -- 172.21.15.22:0/70199835 >> v2:172.21.15.115:3300/0 conn(0x7f8150155ee0 msgr2=0x7f815015bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:41:12.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.290+0000 7f814e7fc640 1 --2- 172.21.15.22:0/70199835 >> v2:172.21.15.115:3300/0 conn(0x7f8150155ee0 0x7f815015bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:12.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.290+0000 7f814e7fc640 1 -- 172.21.15.22:0/70199835 >> v1:172.21.15.115:6789/0 conn(0x7f815015ff80 legacy=0x7f8150072120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:12.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.290+0000 7f814e7fc640 1 -- 172.21.15.22:0/70199835 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f815015c930 con 0x7f815015fb30 2024-05-21T13:41:12.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.294+0000 7f814e7fc640 1 --2- 172.21.15.22:0/70199835 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f815015fb30 0x7f81500cc1b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8144009870 tx=0x7f814401c530 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6882f3ce389e96fe server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:12.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.294+0000 7f814dffb640 1 -- 172.21.15.22:0/70199835 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81440ab640 con 0x7f815015fb30 2024-05-21T13:41:12.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.294+0000 7f814dffb640 1 -- 172.21.15.22:0/70199835 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f81440b0070 con 0x7f815015fb30 2024-05-21T13:41:12.270 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.294+0000 7f814dffb640 1 -- 172.21.15.22:0/70199835 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81440aba00 con 0x7f815015fb30 2024-05-21T13:41:12.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.294+0000 7f815595d640 1 -- 172.21.15.22:0/70199835 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f815015fb30 msgr2=0x7f81500cc1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:12.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.294+0000 7f815595d640 1 --2- 172.21.15.22:0/70199835 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f815015fb30 0x7f81500cc1b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8144009870 tx=0x7f814401c530 comp rx=0 tx=0).stop 2024-05-21T13:41:12.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.294+0000 7f815595d640 1 -- 172.21.15.22:0/70199835 shutdown_connections 2024-05-21T13:41:12.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.294+0000 7f815595d640 1 --2- 172.21.15.22:0/70199835 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f815015fb30 0x7f81500cc1b0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:12.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.294+0000 7f815595d640 1 --2- 172.21.15.22:0/70199835 >> v2:172.21.15.115:3300/0 conn(0x7f8150155ee0 0x7f815015bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:12.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.294+0000 7f815595d640 1 -- 172.21.15.22:0/70199835 >> 172.21.15.22:0/70199835 conn(0x7f8150070750 msgr2=0x7f815006c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:41:12.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.294+0000 7f815595d640 1 -- 172.21.15.22:0/70199835 shutdown_connections 2024-05-21T13:41:12.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.294+0000 7f815595d640 1 -- 172.21.15.22:0/70199835 wait complete. 2024-05-21T13:41:12.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.294+0000 7f815595d640 1 Processor -- start 2024-05-21T13:41:12.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.294+0000 7f815595d640 1 -- start start 2024-05-21T13:41:12.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.298+0000 7f815595d640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8150155ee0 0x7f8150158f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:12.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.298+0000 7f815595d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f815015fb30 0x7f8150157fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:12.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.298+0000 7f815595d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f815015ff80 0x7f81501584e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:12.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.298+0000 7f815595d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8150156440 con 0x7f815015ff80 2024-05-21T13:41:12.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.298+0000 7f815595d640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f81501562c0 con 0x7f815015fb30 2024-05-21T13:41:12.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.298+0000 7f815595d640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f8150072830 con 0x7f8150155ee0 2024-05-21T13:41:12.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.298+0000 7f814f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f815015ff80 0x7f81501584e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:12.274 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.298+0000 7f814f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f815015ff80 0x7f81501584e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36472/0 (socket says 172.21.15.22:36472) 2024-05-21T13:41:12.274 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.298+0000 7f814f7fe640 1 -- 172.21.15.22:0/783477141 learned_addr learned my addr 172.21.15.22:0/783477141 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:41:12.274 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.298+0000 7f814effd640 1 --2- 172.21.15.22:0/783477141 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8150155ee0 0x7f8150158f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:12.274 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.298+0000 7f814e7fc640 1 --2- 172.21.15.22:0/783477141 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f815015fb30 0x7f8150157fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:12.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.298+0000 7f814f7fe640 1 -- 172.21.15.22:0/783477141 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8150155ee0 msgr2=0x7f8150158f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:12.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.298+0000 7f814f7fe640 1 --2- 172.21.15.22:0/783477141 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8150155ee0 0x7f8150158f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:12.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.298+0000 7f814f7fe640 1 -- 172.21.15.22:0/783477141 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f815015fb30 msgr2=0x7f8150157fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:12.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.298+0000 7f814f7fe640 1 --2- 172.21.15.22:0/783477141 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f815015fb30 0x7f8150157fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:12.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.298+0000 7f814f7fe640 1 -- 172.21.15.22:0/783477141 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81500cf1b0 con 0x7f815015ff80 2024-05-21T13:41:12.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.298+0000 7f814e7fc640 1 --2- 172.21.15.22:0/783477141 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f815015fb30 0x7f8150157fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T13:41:12.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.298+0000 7f814f7fe640 1 --2- 172.21.15.22:0/783477141 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f815015ff80 0x7f81501584e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f814800c6e0 tx=0x7f814800cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:12.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.298+0000 7f8137fff640 1 -- 172.21.15.22:0/783477141 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8148018070 con 0x7f815015ff80 2024-05-21T13:41:12.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.298+0000 7f8137fff640 1 -- 172.21.15.22:0/783477141 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8148004d70 con 0x7f815015ff80 2024-05-21T13:41:12.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.298+0000 7f8137fff640 1 -- 172.21.15.22:0/783477141 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f814800a860 con 0x7f815015ff80 2024-05-21T13:41:12.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.298+0000 7f815595d640 1 -- 172.21.15.22:0/783477141 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81500cf490 con 0x7f815015ff80 2024-05-21T13:41:12.276 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.298+0000 7f815595d640 1 -- 172.21.15.22:0/783477141 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81500cfa50 con 0x7f815015ff80 2024-05-21T13:41:12.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.298+0000 7f815595d640 1 -- 172.21.15.22:0/783477141 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81500697d0 con 0x7f815015ff80 2024-05-21T13:41:12.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.302+0000 7f8137fff640 1 -- 172.21.15.22:0/783477141 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f814800aa00 con 0x7f815015ff80 2024-05-21T13:41:12.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.302+0000 7f8137fff640 1 --2- 172.21.15.22:0/783477141 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f813c06f430 0x7f813c0718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:12.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.302+0000 7f8137fff640 1 -- 172.21.15.22:0/783477141 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f814808e960 con 0x7f815015ff80 2024-05-21T13:41:12.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.302+0000 7f814effd640 1 --2- 172.21.15.22:0/783477141 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f813c06f430 0x7f813c0718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:12.277 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.302+0000 7f814effd640 1 --2- 172.21.15.22:0/783477141 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f813c06f430 0x7f813c0718f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8140009b60 tx=0x7f8140009190 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:12.281 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.306+0000 7f8137fff640 1 -- 172.21.15.22:0/783477141 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f814805af20 con 0x7f815015ff80 2024-05-21T13:41:12.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.466+0000 7f815595d640 1 -- 172.21.15.22:0/783477141 --> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f81500cccf0 con 0x7f813c06f430 2024-05-21T13:41:12.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.494+0000 7f8137fff640 1 -- 172.21.15.22:0/783477141 <== mgr.4103 v2:172.21.15.115:6832/184591771 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+333483 (secure 0 0 0) 0x7f81500cccf0 con 0x7f813c06f430 2024-05-21T13:41:12.474 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-21T13:41:12.476 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-05-21T13:41:12.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.498+0000 7f815595d640 1 -- 172.21.15.22:0/783477141 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f813c06f430 msgr2=0x7f813c0718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:12.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.498+0000 7f815595d640 1 --2- 172.21.15.22:0/783477141 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f813c06f430 0x7f813c0718f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f8140009b60 tx=0x7f8140009190 comp rx=0 tx=0).stop 2024-05-21T13:41:12.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.498+0000 7f815595d640 1 -- 172.21.15.22:0/783477141 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f815015ff80 msgr2=0x7f81501584e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:12.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.498+0000 7f815595d640 1 --2- 172.21.15.22:0/783477141 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f815015ff80 0x7f81501584e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f814800c6e0 tx=0x7f814800cba0 comp rx=0 tx=0).stop 2024-05-21T13:41:12.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.498+0000 7f815595d640 1 -- 172.21.15.22:0/783477141 shutdown_connections 2024-05-21T13:41:12.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.498+0000 7f815595d640 1 --2- 172.21.15.22:0/783477141 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f813c06f430 0x7f813c0718f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:12.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.498+0000 7f815595d640 1 --2- 172.21.15.22:0/783477141 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f815015ff80 0x7f81501584e0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:12.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.498+0000 7f815595d640 1 --2- 172.21.15.22:0/783477141 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f815015fb30 0x7f8150157fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:12.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.498+0000 7f815595d640 1 --2- 172.21.15.22:0/783477141 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8150155ee0 0x7f8150158f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:12.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.498+0000 7f815595d640 1 -- 172.21.15.22:0/783477141 >> 172.21.15.22:0/783477141 conn(0x7f8150070750 msgr2=0x7f8150152c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:41:12.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.498+0000 7f815595d640 1 -- 172.21.15.22:0/783477141 shutdown_connections 2024-05-21T13:41:12.478 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.498+0000 7f815595d640 1 -- 172.21.15.22:0/783477141 wait complete. 2024-05-21T13:41:12.493 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":184,"stamp":"2024-05-21T13:41:10.624622+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":803826,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":70,"num_read_kb":59,"num_write":9588,"num_write_kb":25167756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10033,"ondisk_log_size":10033,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":364888,"kb_used_data":3032,"kb_used_omap":12,"kb_used_meta":361779,"kb_avail":754609832,"statfs":{"total":773094113280,"available":772720467968,"internally_reserved":0,"allocated":3104768,"data_stored":4624862,"data_compressed":171812,"data_compressed_allocated":221184,"data_compressed_original":3244032,"omap_allocated":12752,"internal_metadata":370462256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,1,1,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-10737402839,"num_objects":-2560,"num_object_clones":0,"num_object_copies":-10240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2560,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2586,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004209"},"pg_stats":[{"pgid":"2.1f","version":"25'9","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:38:03.532918+0000","last_change":"2024-05-21T13:35:56.739488+0000","last_active":"2024-05-21T13:38:03.532918+0000","last_peered":"2024-05-21T13:38:03.532918+0000","last_clean":"2024-05-21T13:38:03.532918+0000","last_became_active":"2024-05-21T13:35:56.738481+0000","last_became_peered":"2024-05-21T13:35:56.738481+0000","last_unstale":"2024-05-21T13:38:03.532918+0000","last_undegraded":"2024-05-21T13:38:03.532918+0000","last_fullsized":"2024-05-21T13:38:03.532918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:20:48.149770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"27'5","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.810535+0000","last_change":"2024-05-21T13:35:57.779462+0000","last_active":"2024-05-21T13:41:05.810535+0000","last_peered":"2024-05-21T13:41:05.810535+0000","last_clean":"2024-05-21T13:41:05.810535+0000","last_became_active":"2024-05-21T13:35:57.778721+0000","last_became_peered":"2024-05-21T13:35:57.778721+0000","last_unstale":"2024-05-21T13:41:05.810535+0000","last_undegraded":"2024-05-21T13:41:05.810535+0000","last_fullsized":"2024-05-21T13:41:05.810535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:13:05.005747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"27'306","reported_seq":319,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.328568+0000","last_change":"2024-05-21T13:36:39.721406+0000","last_active":"2024-05-21T13:41:07.328568+0000","last_peered":"2024-05-21T13:41:07.328568+0000","last_clean":"2024-05-21T13:41:07.328568+0000","last_became_active":"2024-05-21T13:36:39.720879+0000","last_became_peered":"2024-05-21T13:36:39.720879+0000","last_unstale":"2024-05-21T13:41:07.328568+0000","last_undegraded":"2024-05-21T13:41:07.328568+0000","last_fullsized":"2024-05-21T13:41:07.328568+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":306,"log_dups_size":0,"ondisk_log_size":306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:18:35.640050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":306,"num_write_kb":835584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4,1],"acting":[0,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"25'2","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:37:59.540059+0000","last_change":"2024-05-21T13:35:56.775054+0000","last_active":"2024-05-21T13:37:59.540059+0000","last_peered":"2024-05-21T13:37:59.540059+0000","last_clean":"2024-05-21T13:37:59.540059+0000","last_became_active":"2024-05-21T13:35:56.770566+0000","last_became_peered":"2024-05-21T13:35:56.770566+0000","last_unstale":"2024-05-21T13:37:59.540059+0000","last_undegraded":"2024-05-21T13:37:59.540059+0000","last_fullsized":"2024-05-21T13:37:59.540059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:05:11.539201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"27'6","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.810509+0000","last_change":"2024-05-21T13:35:57.782094+0000","last_active":"2024-05-21T13:41:05.810509+0000","last_peered":"2024-05-21T13:41:05.810509+0000","last_clean":"2024-05-21T13:41:05.810509+0000","last_became_active":"2024-05-21T13:35:57.780590+0000","last_became_peered":"2024-05-21T13:35:57.780590+0000","last_unstale":"2024-05-21T13:41:05.810509+0000","last_undegraded":"2024-05-21T13:41:05.810509+0000","last_fullsized":"2024-05-21T13:41:05.810509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:30:50.929103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"27'339","reported_seq":359,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.400325+0000","last_change":"2024-05-21T13:36:01.852092+0000","last_active":"2024-05-21T13:41:07.400325+0000","last_peered":"2024-05-21T13:41:07.400325+0000","last_clean":"2024-05-21T13:41:07.400325+0000","last_became_active":"2024-05-21T13:36:01.851745+0000","last_became_peered":"2024-05-21T13:36:01.851745+0000","last_unstale":"2024-05-21T13:41:07.400325+0000","last_undegraded":"2024-05-21T13:41:07.400325+0000","last_fullsized":"2024-05-21T13:41:07.400325+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:57:21.599860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":339,"num_write_kb":925696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"27'5","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:39:00.707764+0000","last_change":"2024-05-21T13:35:56.731106+0000","last_active":"2024-05-21T13:39:00.707764+0000","last_peered":"2024-05-21T13:39:00.707764+0000","last_clean":"2024-05-21T13:39:00.707764+0000","last_became_active":"2024-05-21T13:35:56.730746+0000","last_became_peered":"2024-05-21T13:35:56.730746+0000","last_unstale":"2024-05-21T13:39:00.707764+0000","last_undegraded":"2024-05-21T13:39:00.707764+0000","last_fullsized":"2024-05-21T13:39:00.707764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:23:17.798397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"27'9","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.817410+0000","last_change":"2024-05-21T13:35:57.771371+0000","last_active":"2024-05-21T13:41:05.817410+0000","last_peered":"2024-05-21T13:41:05.817410+0000","last_clean":"2024-05-21T13:41:05.817410+0000","last_became_active":"2024-05-21T13:35:57.770595+0000","last_became_peered":"2024-05-21T13:35:57.770595+0000","last_unstale":"2024-05-21T13:41:05.817410+0000","last_undegraded":"2024-05-21T13:41:05.817410+0000","last_fullsized":"2024-05-21T13:41:05.817410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:53:17.771310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"27'273","reported_seq":293,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.380074+0000","last_change":"2024-05-21T13:36:01.849638+0000","last_active":"2024-05-21T13:41:07.380074+0000","last_peered":"2024-05-21T13:41:07.380074+0000","last_clean":"2024-05-21T13:41:07.380074+0000","last_became_active":"2024-05-21T13:36:01.848996+0000","last_became_peered":"2024-05-21T13:36:01.848996+0000","last_unstale":"2024-05-21T13:41:07.380074+0000","last_undegraded":"2024-05-21T13:41:07.380074+0000","last_fullsized":"2024-05-21T13:41:07.380074+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:24:31.613874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:38:30.549252+0000","last_change":"2024-05-21T13:35:56.737279+0000","last_active":"2024-05-21T13:38:30.549252+0000","last_peered":"2024-05-21T13:38:30.549252+0000","last_clean":"2024-05-21T13:38:30.549252+0000","last_became_active":"2024-05-21T13:35:56.731150+0000","last_became_peered":"2024-05-21T13:35:56.731150+0000","last_unstale":"2024-05-21T13:38:30.549252+0000","last_undegraded":"2024-05-21T13:38:30.549252+0000","last_fullsized":"2024-05-21T13:38:30.549252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:17:07.571294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"27'15","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.830064+0000","last_change":"2024-05-21T13:35:57.799803+0000","last_active":"2024-05-21T13:41:05.830064+0000","last_peered":"2024-05-21T13:41:05.830064+0000","last_clean":"2024-05-21T13:41:05.830064+0000","last_became_active":"2024-05-21T13:35:57.799043+0000","last_became_peered":"2024-05-21T13:35:57.799043+0000","last_unstale":"2024-05-21T13:41:05.830064+0000","last_undegraded":"2024-05-21T13:41:05.830064+0000","last_fullsized":"2024-05-21T13:41:05.830064+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:22:48.607953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"27'252","reported_seq":272,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.370027+0000","last_change":"2024-05-21T13:36:01.852469+0000","last_active":"2024-05-21T13:41:07.370027+0000","last_peered":"2024-05-21T13:41:07.370027+0000","last_clean":"2024-05-21T13:41:07.370027+0000","last_became_active":"2024-05-21T13:36:01.851913+0000","last_became_peered":"2024-05-21T13:36:01.851913+0000","last_unstale":"2024-05-21T13:41:07.370027+0000","last_undegraded":"2024-05-21T13:41:07.370027+0000","last_fullsized":"2024-05-21T13:41:07.370027+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":252,"log_dups_size":0,"ondisk_log_size":252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:42:58.062540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":252,"num_write_kb":688128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"27'5","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.818127+0000","last_change":"2024-05-21T13:35:57.796516+0000","last_active":"2024-05-21T13:41:05.818127+0000","last_peered":"2024-05-21T13:41:05.818127+0000","last_clean":"2024-05-21T13:41:05.818127+0000","last_became_active":"2024-05-21T13:35:57.795638+0000","last_became_peered":"2024-05-21T13:35:57.795638+0000","last_unstale":"2024-05-21T13:41:05.818127+0000","last_undegraded":"2024-05-21T13:41:05.818127+0000","last_fullsized":"2024-05-21T13:41:05.818127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:46:40.541835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"27'5","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:39:00.706951+0000","last_change":"2024-05-21T13:35:56.748046+0000","last_active":"2024-05-21T13:39:00.706951+0000","last_peered":"2024-05-21T13:39:00.706951+0000","last_clean":"2024-05-21T13:39:00.706951+0000","last_became_active":"2024-05-21T13:35:56.747635+0000","last_became_peered":"2024-05-21T13:35:56.747635+0000","last_unstale":"2024-05-21T13:39:00.706951+0000","last_undegraded":"2024-05-21T13:39:00.706951+0000","last_fullsized":"2024-05-21T13:39:00.706951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:52:28.665244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"27'309","reported_seq":329,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.399148+0000","last_change":"2024-05-21T13:36:01.862153+0000","last_active":"2024-05-21T13:41:07.399148+0000","last_peered":"2024-05-21T13:41:07.399148+0000","last_clean":"2024-05-21T13:41:07.399148+0000","last_became_active":"2024-05-21T13:36:01.861520+0000","last_became_peered":"2024-05-21T13:36:01.861520+0000","last_unstale":"2024-05-21T13:41:07.399148+0000","last_undegraded":"2024-05-21T13:41:07.399148+0000","last_fullsized":"2024-05-21T13:41:07.399148+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":309,"log_dups_size":0,"ondisk_log_size":309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:04:37.306132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":309,"num_write_kb":843776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"27'8","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.790220+0000","last_change":"2024-05-21T13:35:57.786463+0000","last_active":"2024-05-21T13:41:05.790220+0000","last_peered":"2024-05-21T13:41:05.790220+0000","last_clean":"2024-05-21T13:41:05.790220+0000","last_became_active":"2024-05-21T13:35:57.786126+0000","last_became_peered":"2024-05-21T13:35:57.786126+0000","last_unstale":"2024-05-21T13:41:05.790220+0000","last_undegraded":"2024-05-21T13:41:05.790220+0000","last_fullsized":"2024-05-21T13:41:05.790220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:39:32.076464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"27'3","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:40:20.575038+0000","last_change":"2024-05-21T13:35:56.765178+0000","last_active":"2024-05-21T13:40:20.575038+0000","last_peered":"2024-05-21T13:40:20.575038+0000","last_clean":"2024-05-21T13:40:20.575038+0000","last_became_active":"2024-05-21T13:35:56.764551+0000","last_became_peered":"2024-05-21T13:35:56.764551+0000","last_unstale":"2024-05-21T13:40:20.575038+0000","last_undegraded":"2024-05-21T13:40:20.575038+0000","last_fullsized":"2024-05-21T13:40:20.575038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:34:28.955222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"27'291","reported_seq":311,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.364679+0000","last_change":"2024-05-21T13:36:01.854410+0000","last_active":"2024-05-21T13:41:07.364679+0000","last_peered":"2024-05-21T13:41:07.364679+0000","last_clean":"2024-05-21T13:41:07.364679+0000","last_became_active":"2024-05-21T13:36:01.853975+0000","last_became_peered":"2024-05-21T13:36:01.853975+0000","last_unstale":"2024-05-21T13:41:07.364679+0000","last_undegraded":"2024-05-21T13:41:07.364679+0000","last_fullsized":"2024-05-21T13:41:07.364679+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:15:34.710504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":291,"num_write_kb":794624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"27'9","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.796423+0000","last_change":"2024-05-21T13:35:57.762509+0000","last_active":"2024-05-21T13:41:05.796423+0000","last_peered":"2024-05-21T13:41:05.796423+0000","last_clean":"2024-05-21T13:41:05.796423+0000","last_became_active":"2024-05-21T13:35:57.761739+0000","last_became_peered":"2024-05-21T13:35:57.761739+0000","last_unstale":"2024-05-21T13:41:05.796423+0000","last_undegraded":"2024-05-21T13:41:05.796423+0000","last_fullsized":"2024-05-21T13:41:05.796423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:41:17.911126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"25'3","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:38:08.533743+0000","last_change":"2024-05-21T13:35:56.734017+0000","last_active":"2024-05-21T13:38:08.533743+0000","last_peered":"2024-05-21T13:38:08.533743+0000","last_clean":"2024-05-21T13:38:08.533743+0000","last_became_active":"2024-05-21T13:35:56.733249+0000","last_became_peered":"2024-05-21T13:35:56.733249+0000","last_unstale":"2024-05-21T13:38:08.533743+0000","last_undegraded":"2024-05-21T13:38:08.533743+0000","last_fullsized":"2024-05-21T13:38:08.533743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:13:27.279557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"27'267","reported_seq":287,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.357200+0000","last_change":"2024-05-21T13:36:01.868669+0000","last_active":"2024-05-21T13:41:07.357200+0000","last_peered":"2024-05-21T13:41:07.357200+0000","last_clean":"2024-05-21T13:41:07.357200+0000","last_became_active":"2024-05-21T13:36:01.867701+0000","last_became_peered":"2024-05-21T13:36:01.867701+0000","last_unstale":"2024-05-21T13:41:07.357200+0000","last_undegraded":"2024-05-21T13:41:07.357200+0000","last_fullsized":"2024-05-21T13:41:07.357200+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":267,"log_dups_size":0,"ondisk_log_size":267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:09:21.615570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":267,"num_write_kb":729088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"27'2","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.777072+0000","last_change":"2024-05-21T13:35:57.789966+0000","last_active":"2024-05-21T13:41:05.777072+0000","last_peered":"2024-05-21T13:41:05.777072+0000","last_clean":"2024-05-21T13:41:05.777072+0000","last_became_active":"2024-05-21T13:35:57.789213+0000","last_became_peered":"2024-05-21T13:35:57.789213+0000","last_unstale":"2024-05-21T13:41:05.777072+0000","last_undegraded":"2024-05-21T13:41:05.777072+0000","last_fullsized":"2024-05-21T13:41:05.777072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:33:24.183958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"25'2","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:38:10.545909+0000","last_change":"2024-05-21T13:35:56.746878+0000","last_active":"2024-05-21T13:38:10.545909+0000","last_peered":"2024-05-21T13:38:10.545909+0000","last_clean":"2024-05-21T13:38:10.545909+0000","last_became_active":"2024-05-21T13:35:56.746534+0000","last_became_peered":"2024-05-21T13:35:56.746534+0000","last_unstale":"2024-05-21T13:38:10.545909+0000","last_undegraded":"2024-05-21T13:38:10.545909+0000","last_fullsized":"2024-05-21T13:38:10.545909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:45:56.935415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"27'288","reported_seq":308,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.420341+0000","last_change":"2024-05-21T13:36:01.841632+0000","last_active":"2024-05-21T13:41:07.420341+0000","last_peered":"2024-05-21T13:41:07.420341+0000","last_clean":"2024-05-21T13:41:07.420341+0000","last_became_active":"2024-05-21T13:36:01.841216+0000","last_became_peered":"2024-05-21T13:36:01.841216+0000","last_unstale":"2024-05-21T13:41:07.420341+0000","last_undegraded":"2024-05-21T13:41:07.420341+0000","last_fullsized":"2024-05-21T13:41:07.420341+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:49:05.576221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":288,"num_write_kb":786432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"27'7","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.796201+0000","last_change":"2024-05-21T13:35:57.764793+0000","last_active":"2024-05-21T13:41:05.796201+0000","last_peered":"2024-05-21T13:41:05.796201+0000","last_clean":"2024-05-21T13:41:05.796201+0000","last_became_active":"2024-05-21T13:35:57.764017+0000","last_became_peered":"2024-05-21T13:35:57.764017+0000","last_unstale":"2024-05-21T13:41:05.796201+0000","last_undegraded":"2024-05-21T13:41:05.796201+0000","last_fullsized":"2024-05-21T13:41:05.796201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:25:45.006614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"27'5","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:40:20.578707+0000","last_change":"2024-05-21T13:35:56.752278+0000","last_active":"2024-05-21T13:40:20.578707+0000","last_peered":"2024-05-21T13:40:20.578707+0000","last_clean":"2024-05-21T13:40:20.578707+0000","last_became_active":"2024-05-21T13:35:56.751883+0000","last_became_peered":"2024-05-21T13:35:56.751883+0000","last_unstale":"2024-05-21T13:40:20.578707+0000","last_undegraded":"2024-05-21T13:40:20.578707+0000","last_fullsized":"2024-05-21T13:40:20.578707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:08:05.279701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"27'249","reported_seq":269,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.413059+0000","last_change":"2024-05-21T13:36:01.832621+0000","last_active":"2024-05-21T13:41:07.413059+0000","last_peered":"2024-05-21T13:41:07.413059+0000","last_clean":"2024-05-21T13:41:07.413059+0000","last_became_active":"2024-05-21T13:36:01.831609+0000","last_became_peered":"2024-05-21T13:36:01.831609+0000","last_unstale":"2024-05-21T13:41:07.413059+0000","last_undegraded":"2024-05-21T13:41:07.413059+0000","last_fullsized":"2024-05-21T13:41:07.413059+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:26:43.075259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":249,"num_write_kb":679936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"27'5","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.794857+0000","last_change":"2024-05-21T13:35:57.783487+0000","last_active":"2024-05-21T13:41:05.794857+0000","last_peered":"2024-05-21T13:41:05.794857+0000","last_clean":"2024-05-21T13:41:05.794857+0000","last_became_active":"2024-05-21T13:35:57.783150+0000","last_became_peered":"2024-05-21T13:35:57.783150+0000","last_unstale":"2024-05-21T13:41:05.794857+0000","last_undegraded":"2024-05-21T13:41:05.794857+0000","last_fullsized":"2024-05-21T13:41:05.794857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:14:56.991945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"27'22","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:04.606673+0000","last_change":"2024-05-21T13:35:56.745122+0000","last_active":"2024-05-21T13:41:04.606673+0000","last_peered":"2024-05-21T13:41:04.606673+0000","last_clean":"2024-05-21T13:41:04.606673+0000","last_became_active":"2024-05-21T13:35:56.744218+0000","last_became_peered":"2024-05-21T13:35:56.744218+0000","last_unstale":"2024-05-21T13:41:04.606673+0000","last_undegraded":"2024-05-21T13:41:04.606673+0000","last_fullsized":"2024-05-21T13:41:04.606673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:45:03.790591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"27'264","reported_seq":284,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.394488+0000","last_change":"2024-05-21T13:36:01.838971+0000","last_active":"2024-05-21T13:41:07.394488+0000","last_peered":"2024-05-21T13:41:07.394488+0000","last_clean":"2024-05-21T13:41:07.394488+0000","last_became_active":"2024-05-21T13:36:01.837401+0000","last_became_peered":"2024-05-21T13:36:01.837401+0000","last_unstale":"2024-05-21T13:41:07.394488+0000","last_undegraded":"2024-05-21T13:41:07.394488+0000","last_fullsized":"2024-05-21T13:41:07.394488+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:16:25.666568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":720896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"27'9","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.801162+0000","last_change":"2024-05-21T13:35:57.784993+0000","last_active":"2024-05-21T13:41:05.801162+0000","last_peered":"2024-05-21T13:41:05.801162+0000","last_clean":"2024-05-21T13:41:05.801162+0000","last_became_active":"2024-05-21T13:35:57.784664+0000","last_became_peered":"2024-05-21T13:35:57.784664+0000","last_unstale":"2024-05-21T13:41:05.801162+0000","last_undegraded":"2024-05-21T13:41:05.801162+0000","last_fullsized":"2024-05-21T13:41:05.801162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:58:20.045901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"25'1","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:38:05.553882+0000","last_change":"2024-05-21T13:35:56.741285+0000","last_active":"2024-05-21T13:38:05.553882+0000","last_peered":"2024-05-21T13:38:05.553882+0000","last_clean":"2024-05-21T13:38:05.553882+0000","last_became_active":"2024-05-21T13:35:56.740846+0000","last_became_peered":"2024-05-21T13:35:56.740846+0000","last_unstale":"2024-05-21T13:38:05.553882+0000","last_undegraded":"2024-05-21T13:38:05.553882+0000","last_fullsized":"2024-05-21T13:38:05.553882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:34:17.960870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"27'249","reported_seq":269,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.372636+0000","last_change":"2024-05-21T13:36:01.873172+0000","last_active":"2024-05-21T13:41:07.372636+0000","last_peered":"2024-05-21T13:41:07.372636+0000","last_clean":"2024-05-21T13:41:07.372636+0000","last_became_active":"2024-05-21T13:36:01.872085+0000","last_became_peered":"2024-05-21T13:36:01.872085+0000","last_unstale":"2024-05-21T13:41:07.372636+0000","last_undegraded":"2024-05-21T13:41:07.372636+0000","last_fullsized":"2024-05-21T13:41:07.372636+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:24:57.031323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":249,"num_write_kb":679936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"27'5","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.803329+0000","last_change":"2024-05-21T13:35:57.783176+0000","last_active":"2024-05-21T13:41:05.803329+0000","last_peered":"2024-05-21T13:41:05.803329+0000","last_clean":"2024-05-21T13:41:05.803329+0000","last_became_active":"2024-05-21T13:35:57.782517+0000","last_became_peered":"2024-05-21T13:35:57.782517+0000","last_unstale":"2024-05-21T13:41:05.803329+0000","last_undegraded":"2024-05-21T13:41:05.803329+0000","last_fullsized":"2024-05-21T13:41:05.803329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:06:58.203996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:38:04.540828+0000","last_change":"2024-05-21T13:35:56.767544+0000","last_active":"2024-05-21T13:38:04.540828+0000","last_peered":"2024-05-21T13:38:04.540828+0000","last_clean":"2024-05-21T13:38:04.540828+0000","last_became_active":"2024-05-21T13:35:56.764987+0000","last_became_peered":"2024-05-21T13:35:56.764987+0000","last_unstale":"2024-05-21T13:38:04.540828+0000","last_undegraded":"2024-05-21T13:38:04.540828+0000","last_fullsized":"2024-05-21T13:38:04.540828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:12:46.828769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"27'273","reported_seq":293,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.388266+0000","last_change":"2024-05-21T13:36:01.872215+0000","last_active":"2024-05-21T13:41:07.388266+0000","last_peered":"2024-05-21T13:41:07.388266+0000","last_clean":"2024-05-21T13:41:07.388266+0000","last_became_active":"2024-05-21T13:36:01.870831+0000","last_became_peered":"2024-05-21T13:36:01.870831+0000","last_unstale":"2024-05-21T13:41:07.388266+0000","last_undegraded":"2024-05-21T13:41:07.388266+0000","last_fullsized":"2024-05-21T13:41:07.388266+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:04:09.689206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"27'7","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.811209+0000","last_change":"2024-05-21T13:35:57.783616+0000","last_active":"2024-05-21T13:41:05.811209+0000","last_peered":"2024-05-21T13:41:05.811209+0000","last_clean":"2024-05-21T13:41:05.811209+0000","last_became_active":"2024-05-21T13:35:57.780521+0000","last_became_peered":"2024-05-21T13:35:57.780521+0000","last_unstale":"2024-05-21T13:41:05.811209+0000","last_undegraded":"2024-05-21T13:41:05.811209+0000","last_fullsized":"2024-05-21T13:41:05.811209+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:59:44.121631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"25'1","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:38:05.553834+0000","last_change":"2024-05-21T13:35:56.750341+0000","last_active":"2024-05-21T13:38:05.553834+0000","last_peered":"2024-05-21T13:38:05.553834+0000","last_clean":"2024-05-21T13:38:05.553834+0000","last_became_active":"2024-05-21T13:35:56.750006+0000","last_became_peered":"2024-05-21T13:35:56.750006+0000","last_unstale":"2024-05-21T13:38:05.553834+0000","last_undegraded":"2024-05-21T13:38:05.553834+0000","last_fullsized":"2024-05-21T13:38:05.553834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:15:21.416234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"27'264","reported_seq":284,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.398103+0000","last_change":"2024-05-21T13:36:01.873693+0000","last_active":"2024-05-21T13:41:07.398103+0000","last_peered":"2024-05-21T13:41:07.398103+0000","last_clean":"2024-05-21T13:41:07.398103+0000","last_became_active":"2024-05-21T13:36:01.872363+0000","last_became_peered":"2024-05-21T13:36:01.872363+0000","last_unstale":"2024-05-21T13:41:07.398103+0000","last_undegraded":"2024-05-21T13:41:07.398103+0000","last_fullsized":"2024-05-21T13:41:07.398103+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:27:25.974289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":720896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"27'8","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.803951+0000","last_change":"2024-05-21T13:35:57.780809+0000","last_active":"2024-05-21T13:41:05.803951+0000","last_peered":"2024-05-21T13:41:05.803951+0000","last_clean":"2024-05-21T13:41:05.803951+0000","last_became_active":"2024-05-21T13:35:57.780313+0000","last_became_peered":"2024-05-21T13:35:57.780313+0000","last_unstale":"2024-05-21T13:41:05.803951+0000","last_undegraded":"2024-05-21T13:41:05.803951+0000","last_fullsized":"2024-05-21T13:41:05.803951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:43:11.778238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"27'9","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:06.810080+0000","last_change":"2024-05-21T13:35:56.771138+0000","last_active":"2024-05-21T13:41:06.810080+0000","last_peered":"2024-05-21T13:41:06.810080+0000","last_clean":"2024-05-21T13:41:06.810080+0000","last_became_active":"2024-05-21T13:35:56.770465+0000","last_became_peered":"2024-05-21T13:35:56.770465+0000","last_unstale":"2024-05-21T13:41:06.810080+0000","last_undegraded":"2024-05-21T13:41:06.810080+0000","last_fullsized":"2024-05-21T13:41:06.810080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:21:16.702309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":619,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"27'270","reported_seq":290,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.403240+0000","last_change":"2024-05-21T13:36:01.871328+0000","last_active":"2024-05-21T13:41:07.403240+0000","last_peered":"2024-05-21T13:41:07.403240+0000","last_clean":"2024-05-21T13:41:07.403240+0000","last_became_active":"2024-05-21T13:36:01.870678+0000","last_became_peered":"2024-05-21T13:36:01.870678+0000","last_unstale":"2024-05-21T13:41:07.403240+0000","last_undegraded":"2024-05-21T13:41:07.403240+0000","last_fullsized":"2024-05-21T13:41:07.403240+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:22:47.393065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":737280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"27'5","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.809299+0000","last_change":"2024-05-21T13:35:57.782665+0000","last_active":"2024-05-21T13:41:05.809299+0000","last_peered":"2024-05-21T13:41:05.809299+0000","last_clean":"2024-05-21T13:41:05.809299+0000","last_became_active":"2024-05-21T13:35:57.781299+0000","last_became_peered":"2024-05-21T13:35:57.781299+0000","last_unstale":"2024-05-21T13:41:05.809299+0000","last_undegraded":"2024-05-21T13:41:05.809299+0000","last_fullsized":"2024-05-21T13:41:05.809299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:21:22.721124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"25'3","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:38:00.553325+0000","last_change":"2024-05-21T13:35:56.768193+0000","last_active":"2024-05-21T13:38:00.553325+0000","last_peered":"2024-05-21T13:38:00.553325+0000","last_clean":"2024-05-21T13:38:00.553325+0000","last_became_active":"2024-05-21T13:35:56.767788+0000","last_became_peered":"2024-05-21T13:35:56.767788+0000","last_unstale":"2024-05-21T13:38:00.553325+0000","last_undegraded":"2024-05-21T13:38:00.553325+0000","last_fullsized":"2024-05-21T13:38:00.553325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:12:52.911816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"27'339","reported_seq":359,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.377321+0000","last_change":"2024-05-21T13:36:01.860305+0000","last_active":"2024-05-21T13:41:07.377321+0000","last_peered":"2024-05-21T13:41:07.377321+0000","last_clean":"2024-05-21T13:41:07.377321+0000","last_became_active":"2024-05-21T13:36:01.859141+0000","last_became_peered":"2024-05-21T13:36:01.859141+0000","last_unstale":"2024-05-21T13:41:07.377321+0000","last_undegraded":"2024-05-21T13:41:07.377321+0000","last_fullsized":"2024-05-21T13:41:07.377321+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:05:45.203241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":339,"num_write_kb":925696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"27'8","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.809899+0000","last_change":"2024-05-21T13:35:57.775523+0000","last_active":"2024-05-21T13:41:05.809899+0000","last_peered":"2024-05-21T13:41:05.809899+0000","last_clean":"2024-05-21T13:41:05.809899+0000","last_became_active":"2024-05-21T13:35:57.774322+0000","last_became_peered":"2024-05-21T13:35:57.774322+0000","last_unstale":"2024-05-21T13:41:05.809899+0000","last_undegraded":"2024-05-21T13:41:05.809899+0000","last_fullsized":"2024-05-21T13:41:05.809899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:06:35.118540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"25'3","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:38:05.553854+0000","last_change":"2024-05-21T13:35:56.748185+0000","last_active":"2024-05-21T13:38:05.553854+0000","last_peered":"2024-05-21T13:38:05.553854+0000","last_clean":"2024-05-21T13:38:05.553854+0000","last_became_active":"2024-05-21T13:35:56.747823+0000","last_became_peered":"2024-05-21T13:35:56.747823+0000","last_unstale":"2024-05-21T13:38:05.553854+0000","last_undegraded":"2024-05-21T13:38:05.553854+0000","last_fullsized":"2024-05-21T13:38:05.553854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:38:00.235330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":123,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:37:45.542454+0000","last_change":"2024-05-21T13:35:45.682484+0000","last_active":"2024-05-21T13:37:45.542454+0000","last_peered":"2024-05-21T13:37:45.542454+0000","last_clean":"2024-05-21T13:37:45.542454+0000","last_became_active":"2024-05-21T13:35:45.680732+0000","last_became_peered":"2024-05-21T13:35:45.680732+0000","last_unstale":"2024-05-21T13:37:45.542454+0000","last_undegraded":"2024-05-21T13:37:45.542454+0000","last_fullsized":"2024-05-21T13:37:45.542454+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:44.542324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:44.542324+0000","last_clean_scrub_stamp":"2024-05-21T13:35:44.542324+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:16:05.034161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"27'276","reported_seq":296,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.403558+0000","last_change":"2024-05-21T13:36:01.830034+0000","last_active":"2024-05-21T13:41:07.403558+0000","last_peered":"2024-05-21T13:41:07.403558+0000","last_clean":"2024-05-21T13:41:07.403558+0000","last_became_active":"2024-05-21T13:36:01.828957+0000","last_became_peered":"2024-05-21T13:36:01.828957+0000","last_unstale":"2024-05-21T13:41:07.403558+0000","last_undegraded":"2024-05-21T13:41:07.403558+0000","last_fullsized":"2024-05-21T13:41:07.403558+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:21:59.514268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":276,"num_write_kb":753664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"27'7","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.824727+0000","last_change":"2024-05-21T13:35:57.796419+0000","last_active":"2024-05-21T13:41:05.824727+0000","last_peered":"2024-05-21T13:41:05.824727+0000","last_clean":"2024-05-21T13:41:05.824727+0000","last_became_active":"2024-05-21T13:35:57.796050+0000","last_became_peered":"2024-05-21T13:35:57.796050+0000","last_unstale":"2024-05-21T13:41:05.824727+0000","last_undegraded":"2024-05-21T13:41:05.824727+0000","last_fullsized":"2024-05-21T13:41:05.824727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:56:07.121391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"25'3","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:38:15.541313+0000","last_change":"2024-05-21T13:35:56.751619+0000","last_active":"2024-05-21T13:38:15.541313+0000","last_peered":"2024-05-21T13:38:15.541313+0000","last_clean":"2024-05-21T13:38:15.541313+0000","last_became_active":"2024-05-21T13:35:56.748604+0000","last_became_peered":"2024-05-21T13:35:56.748604+0000","last_unstale":"2024-05-21T13:38:15.541313+0000","last_undegraded":"2024-05-21T13:38:15.541313+0000","last_fullsized":"2024-05-21T13:38:15.541313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:19:03.052434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"27'280","reported_seq":300,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.378299+0000","last_change":"2024-05-21T13:36:01.825464+0000","last_active":"2024-05-21T13:41:07.378299+0000","last_peered":"2024-05-21T13:41:07.378299+0000","last_clean":"2024-05-21T13:41:07.378299+0000","last_became_active":"2024-05-21T13:36:01.824653+0000","last_became_peered":"2024-05-21T13:36:01.824653+0000","last_unstale":"2024-05-21T13:41:07.378299+0000","last_undegraded":"2024-05-21T13:41:07.378299+0000","last_fullsized":"2024-05-21T13:41:07.378299+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:29:32.830052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":280,"num_write_kb":761856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"27'6","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.814113+0000","last_change":"2024-05-21T13:35:57.784031+0000","last_active":"2024-05-21T13:41:05.814113+0000","last_peered":"2024-05-21T13:41:05.814113+0000","last_clean":"2024-05-21T13:41:05.814113+0000","last_became_active":"2024-05-21T13:35:57.771695+0000","last_became_peered":"2024-05-21T13:35:57.771695+0000","last_unstale":"2024-05-21T13:41:05.814113+0000","last_undegraded":"2024-05-21T13:41:05.814113+0000","last_fullsized":"2024-05-21T13:41:05.814113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:46:33.308257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:38:14.542410+0000","last_change":"2024-05-21T13:35:56.768166+0000","last_active":"2024-05-21T13:38:14.542410+0000","last_peered":"2024-05-21T13:38:14.542410+0000","last_clean":"2024-05-21T13:38:14.542410+0000","last_became_active":"2024-05-21T13:35:56.767053+0000","last_became_peered":"2024-05-21T13:35:56.767053+0000","last_unstale":"2024-05-21T13:38:14.542410+0000","last_undegraded":"2024-05-21T13:38:14.542410+0000","last_fullsized":"2024-05-21T13:38:14.542410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:10:16.639491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"27'261","reported_seq":281,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.410654+0000","last_change":"2024-05-21T13:36:01.834253+0000","last_active":"2024-05-21T13:41:07.410654+0000","last_peered":"2024-05-21T13:41:07.410654+0000","last_clean":"2024-05-21T13:41:07.410654+0000","last_became_active":"2024-05-21T13:36:01.832972+0000","last_became_peered":"2024-05-21T13:36:01.832972+0000","last_unstale":"2024-05-21T13:41:07.410654+0000","last_undegraded":"2024-05-21T13:41:07.410654+0000","last_fullsized":"2024-05-21T13:41:07.410654+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":261,"log_dups_size":0,"ondisk_log_size":261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:52:05.576063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":261,"num_write_kb":712704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"27'9","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.828863+0000","last_change":"2024-05-21T13:35:57.766504+0000","last_active":"2024-05-21T13:41:05.828863+0000","last_peered":"2024-05-21T13:41:05.828863+0000","last_clean":"2024-05-21T13:41:05.828863+0000","last_became_active":"2024-05-21T13:35:57.765756+0000","last_became_peered":"2024-05-21T13:35:57.765756+0000","last_unstale":"2024-05-21T13:41:05.828863+0000","last_undegraded":"2024-05-21T13:41:05.828863+0000","last_fullsized":"2024-05-21T13:41:05.828863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:52:13.025110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:38:13.534751+0000","last_change":"2024-05-21T13:35:56.770347+0000","last_active":"2024-05-21T13:38:13.534751+0000","last_peered":"2024-05-21T13:38:13.534751+0000","last_clean":"2024-05-21T13:38:13.534751+0000","last_became_active":"2024-05-21T13:35:56.769767+0000","last_became_peered":"2024-05-21T13:35:56.769767+0000","last_unstale":"2024-05-21T13:38:13.534751+0000","last_undegraded":"2024-05-21T13:38:13.534751+0000","last_fullsized":"2024-05-21T13:38:13.534751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:40:01.698967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"27'318","reported_seq":338,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.383172+0000","last_change":"2024-05-21T13:36:01.827091+0000","last_active":"2024-05-21T13:41:07.383172+0000","last_peered":"2024-05-21T13:41:07.383172+0000","last_clean":"2024-05-21T13:41:07.383172+0000","last_became_active":"2024-05-21T13:36:01.826686+0000","last_became_peered":"2024-05-21T13:36:01.826686+0000","last_unstale":"2024-05-21T13:41:07.383172+0000","last_undegraded":"2024-05-21T13:41:07.383172+0000","last_fullsized":"2024-05-21T13:41:07.383172+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":318,"log_dups_size":0,"ondisk_log_size":318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:42:47.638921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":318,"num_write_kb":868352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"27'5","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.816970+0000","last_change":"2024-05-21T13:35:57.781528+0000","last_active":"2024-05-21T13:41:05.816970+0000","last_peered":"2024-05-21T13:41:05.816970+0000","last_clean":"2024-05-21T13:41:05.816970+0000","last_became_active":"2024-05-21T13:35:57.781111+0000","last_became_peered":"2024-05-21T13:35:57.781111+0000","last_unstale":"2024-05-21T13:41:05.816970+0000","last_undegraded":"2024-05-21T13:41:05.816970+0000","last_fullsized":"2024-05-21T13:41:05.816970+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:15:43.847640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"25'2","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:38:15.546666+0000","last_change":"2024-05-21T13:35:56.755413+0000","last_active":"2024-05-21T13:38:15.546666+0000","last_peered":"2024-05-21T13:38:15.546666+0000","last_clean":"2024-05-21T13:38:15.546666+0000","last_became_active":"2024-05-21T13:35:56.755158+0000","last_became_peered":"2024-05-21T13:35:56.755158+0000","last_unstale":"2024-05-21T13:38:15.546666+0000","last_undegraded":"2024-05-21T13:38:15.546666+0000","last_fullsized":"2024-05-21T13:38:15.546666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:23:05.102098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"27'258","reported_seq":278,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.275439+0000","last_change":"2024-05-21T13:36:01.827237+0000","last_active":"2024-05-21T13:41:07.275439+0000","last_peered":"2024-05-21T13:41:07.275439+0000","last_clean":"2024-05-21T13:41:07.275439+0000","last_became_active":"2024-05-21T13:36:01.826374+0000","last_became_peered":"2024-05-21T13:36:01.826374+0000","last_unstale":"2024-05-21T13:41:07.275439+0000","last_undegraded":"2024-05-21T13:41:07.275439+0000","last_fullsized":"2024-05-21T13:41:07.275439+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":258,"log_dups_size":0,"ondisk_log_size":258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:12:33.528068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":258,"num_write_kb":704512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"27'6","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.815755+0000","last_change":"2024-05-21T13:35:57.787940+0000","last_active":"2024-05-21T13:41:05.815755+0000","last_peered":"2024-05-21T13:41:05.815755+0000","last_clean":"2024-05-21T13:41:05.815755+0000","last_became_active":"2024-05-21T13:35:57.787544+0000","last_became_peered":"2024-05-21T13:35:57.787544+0000","last_unstale":"2024-05-21T13:41:05.815755+0000","last_undegraded":"2024-05-21T13:41:05.815755+0000","last_fullsized":"2024-05-21T13:41:05.815755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:46:20.335316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"27'16","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:40:38.563607+0000","last_change":"2024-05-21T13:35:56.756262+0000","last_active":"2024-05-21T13:40:38.563607+0000","last_peered":"2024-05-21T13:40:38.563607+0000","last_clean":"2024-05-21T13:40:38.563607+0000","last_became_active":"2024-05-21T13:35:56.752342+0000","last_became_peered":"2024-05-21T13:35:56.752342+0000","last_unstale":"2024-05-21T13:40:38.563607+0000","last_undegraded":"2024-05-21T13:40:38.563607+0000","last_fullsized":"2024-05-21T13:40:38.563607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:59:09.541382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"27'360","reported_seq":380,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.427307+0000","last_change":"2024-05-21T13:36:01.859498+0000","last_active":"2024-05-21T13:41:07.427307+0000","last_peered":"2024-05-21T13:41:07.427307+0000","last_clean":"2024-05-21T13:41:07.427307+0000","last_became_active":"2024-05-21T13:36:01.857707+0000","last_became_peered":"2024-05-21T13:36:01.857707+0000","last_unstale":"2024-05-21T13:41:07.427307+0000","last_undegraded":"2024-05-21T13:41:07.427307+0000","last_fullsized":"2024-05-21T13:41:07.427307+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:38:06.966814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":360,"num_write_kb":983040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"27'6","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.806663+0000","last_change":"2024-05-21T13:35:57.783007+0000","last_active":"2024-05-21T13:41:05.806663+0000","last_peered":"2024-05-21T13:41:05.806663+0000","last_clean":"2024-05-21T13:41:05.806663+0000","last_became_active":"2024-05-21T13:35:57.782330+0000","last_became_peered":"2024-05-21T13:35:57.782330+0000","last_unstale":"2024-05-21T13:41:05.806663+0000","last_undegraded":"2024-05-21T13:41:05.806663+0000","last_fullsized":"2024-05-21T13:41:05.806663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:26:14.697766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"25'3","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:38:20.547215+0000","last_change":"2024-05-21T13:35:56.745787+0000","last_active":"2024-05-21T13:38:20.547215+0000","last_peered":"2024-05-21T13:38:20.547215+0000","last_clean":"2024-05-21T13:38:20.547215+0000","last_became_active":"2024-05-21T13:35:56.745202+0000","last_became_peered":"2024-05-21T13:35:56.745202+0000","last_unstale":"2024-05-21T13:38:20.547215+0000","last_undegraded":"2024-05-21T13:38:20.547215+0000","last_fullsized":"2024-05-21T13:38:20.547215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:31:13.498003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"27'273","reported_seq":293,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.415841+0000","last_change":"2024-05-21T13:36:01.858550+0000","last_active":"2024-05-21T13:41:07.415841+0000","last_peered":"2024-05-21T13:41:07.415841+0000","last_clean":"2024-05-21T13:41:07.415841+0000","last_became_active":"2024-05-21T13:36:01.857716+0000","last_became_peered":"2024-05-21T13:36:01.857716+0000","last_unstale":"2024-05-21T13:41:07.415841+0000","last_undegraded":"2024-05-21T13:41:07.415841+0000","last_fullsized":"2024-05-21T13:41:07.415841+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:48:32.490678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"27'15","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.824416+0000","last_change":"2024-05-21T13:35:57.799702+0000","last_active":"2024-05-21T13:41:05.824416+0000","last_peered":"2024-05-21T13:41:05.824416+0000","last_clean":"2024-05-21T13:41:05.824416+0000","last_became_active":"2024-05-21T13:35:57.799225+0000","last_became_peered":"2024-05-21T13:35:57.799225+0000","last_unstale":"2024-05-21T13:41:05.824416+0000","last_undegraded":"2024-05-21T13:41:05.824416+0000","last_fullsized":"2024-05-21T13:41:05.824416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:29:54.094448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"25'3","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:38:20.556128+0000","last_change":"2024-05-21T13:35:56.742650+0000","last_active":"2024-05-21T13:38:20.556128+0000","last_peered":"2024-05-21T13:38:20.556128+0000","last_clean":"2024-05-21T13:38:20.556128+0000","last_became_active":"2024-05-21T13:35:56.742296+0000","last_became_peered":"2024-05-21T13:35:56.742296+0000","last_unstale":"2024-05-21T13:38:20.556128+0000","last_undegraded":"2024-05-21T13:38:20.556128+0000","last_fullsized":"2024-05-21T13:38:20.556128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:18:55.514845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"27'273","reported_seq":293,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.341060+0000","last_change":"2024-05-21T13:36:01.873708+0000","last_active":"2024-05-21T13:41:07.341060+0000","last_peered":"2024-05-21T13:41:07.341060+0000","last_clean":"2024-05-21T13:41:07.341060+0000","last_became_active":"2024-05-21T13:36:01.872320+0000","last_became_peered":"2024-05-21T13:36:01.872320+0000","last_unstale":"2024-05-21T13:41:07.341060+0000","last_undegraded":"2024-05-21T13:41:07.341060+0000","last_fullsized":"2024-05-21T13:41:07.341060+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:01:15.545756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"27'10","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.819407+0000","last_change":"2024-05-21T13:35:57.802763+0000","last_active":"2024-05-21T13:41:05.819407+0000","last_peered":"2024-05-21T13:41:05.819407+0000","last_clean":"2024-05-21T13:41:05.819407+0000","last_became_active":"2024-05-21T13:35:57.802433+0000","last_became_peered":"2024-05-21T13:35:57.802433+0000","last_unstale":"2024-05-21T13:41:05.819407+0000","last_undegraded":"2024-05-21T13:41:05.819407+0000","last_fullsized":"2024-05-21T13:41:05.819407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:09:48.463186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"25'6","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:38:20.545542+0000","last_change":"2024-05-21T13:35:56.754087+0000","last_active":"2024-05-21T13:38:20.545542+0000","last_peered":"2024-05-21T13:38:20.545542+0000","last_clean":"2024-05-21T13:38:20.545542+0000","last_became_active":"2024-05-21T13:35:56.753319+0000","last_became_peered":"2024-05-21T13:35:56.753319+0000","last_unstale":"2024-05-21T13:38:20.545542+0000","last_undegraded":"2024-05-21T13:38:20.545542+0000","last_fullsized":"2024-05-21T13:38:20.545542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:19:21.276993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"27'327","reported_seq":347,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.315452+0000","last_change":"2024-05-21T13:36:01.836017+0000","last_active":"2024-05-21T13:41:07.315452+0000","last_peered":"2024-05-21T13:41:07.315452+0000","last_clean":"2024-05-21T13:41:07.315452+0000","last_became_active":"2024-05-21T13:36:01.835450+0000","last_became_peered":"2024-05-21T13:36:01.835450+0000","last_unstale":"2024-05-21T13:41:07.315452+0000","last_undegraded":"2024-05-21T13:41:07.315452+0000","last_fullsized":"2024-05-21T13:41:07.315452+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:05:56.077605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":327,"num_write_kb":892928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"27'6","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.819794+0000","last_change":"2024-05-21T13:35:57.787177+0000","last_active":"2024-05-21T13:41:05.819794+0000","last_peered":"2024-05-21T13:41:05.819794+0000","last_clean":"2024-05-21T13:41:05.819794+0000","last_became_active":"2024-05-21T13:35:57.786401+0000","last_became_peered":"2024-05-21T13:35:57.786401+0000","last_unstale":"2024-05-21T13:41:05.819794+0000","last_undegraded":"2024-05-21T13:41:05.819794+0000","last_fullsized":"2024-05-21T13:41:05.819794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:17:18.939002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'99","reported_seq":127,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.851553+0000","last_change":"2024-05-21T13:35:56.751229+0000","last_active":"2024-05-21T13:41:05.851553+0000","last_peered":"2024-05-21T13:41:05.851553+0000","last_clean":"2024-05-21T13:41:05.851553+0000","last_became_active":"2024-05-21T13:35:56.750831+0000","last_became_peered":"2024-05-21T13:35:56.750831+0000","last_unstale":"2024-05-21T13:41:05.851553+0000","last_undegraded":"2024-05-21T13:41:05.851553+0000","last_fullsized":"2024-05-21T13:41:05.851553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:03:40.186241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":208737,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":99,"num_write_kb":246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"27'289","reported_seq":309,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.407451+0000","last_change":"2024-05-21T13:36:01.832691+0000","last_active":"2024-05-21T13:41:07.407451+0000","last_peered":"2024-05-21T13:41:07.407451+0000","last_clean":"2024-05-21T13:41:07.407451+0000","last_became_active":"2024-05-21T13:36:01.831476+0000","last_became_peered":"2024-05-21T13:36:01.831476+0000","last_unstale":"2024-05-21T13:41:07.407451+0000","last_undegraded":"2024-05-21T13:41:07.407451+0000","last_fullsized":"2024-05-21T13:41:07.407451+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":289,"log_dups_size":0,"ondisk_log_size":289,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:08:38.092592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":288,"num_write_kb":786432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"27'11","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.817770+0000","last_change":"2024-05-21T13:35:57.788547+0000","last_active":"2024-05-21T13:41:05.817770+0000","last_peered":"2024-05-21T13:41:05.817770+0000","last_clean":"2024-05-21T13:41:05.817770+0000","last_became_active":"2024-05-21T13:35:57.787785+0000","last_became_peered":"2024-05-21T13:35:57.787785+0000","last_unstale":"2024-05-21T13:41:05.817770+0000","last_undegraded":"2024-05-21T13:41:05.817770+0000","last_fullsized":"2024-05-21T13:41:05.817770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:51:08.781399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"27'10","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:08.320430+0000","last_change":"2024-05-21T13:35:56.760557+0000","last_active":"2024-05-21T13:41:08.320430+0000","last_peered":"2024-05-21T13:41:08.320430+0000","last_clean":"2024-05-21T13:41:08.320430+0000","last_became_active":"2024-05-21T13:35:56.759728+0000","last_became_peered":"2024-05-21T13:35:56.759728+0000","last_unstale":"2024-05-21T13:41:08.320430+0000","last_undegraded":"2024-05-21T13:41:08.320430+0000","last_fullsized":"2024-05-21T13:41:08.320430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:56:19.754940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"27'297","reported_seq":317,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.383028+0000","last_change":"2024-05-21T13:36:01.861622+0000","last_active":"2024-05-21T13:41:07.383028+0000","last_peered":"2024-05-21T13:41:07.383028+0000","last_clean":"2024-05-21T13:41:07.383028+0000","last_became_active":"2024-05-21T13:36:01.861172+0000","last_became_peered":"2024-05-21T13:36:01.861172+0000","last_unstale":"2024-05-21T13:41:07.383028+0000","last_undegraded":"2024-05-21T13:41:07.383028+0000","last_fullsized":"2024-05-21T13:41:07.383028+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:39:53.211812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":297,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"27'9","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.819358+0000","last_change":"2024-05-21T13:35:57.804520+0000","last_active":"2024-05-21T13:41:05.819358+0000","last_peered":"2024-05-21T13:41:05.819358+0000","last_clean":"2024-05-21T13:41:05.819358+0000","last_became_active":"2024-05-21T13:35:57.804139+0000","last_became_peered":"2024-05-21T13:35:57.804139+0000","last_unstale":"2024-05-21T13:41:05.819358+0000","last_undegraded":"2024-05-21T13:41:05.819358+0000","last_fullsized":"2024-05-21T13:41:05.819358+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:21:52.433019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"25'2","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:38:25.548413+0000","last_change":"2024-05-21T13:35:56.733821+0000","last_active":"2024-05-21T13:38:25.548413+0000","last_peered":"2024-05-21T13:38:25.548413+0000","last_clean":"2024-05-21T13:38:25.548413+0000","last_became_active":"2024-05-21T13:35:56.732488+0000","last_became_peered":"2024-05-21T13:35:56.732488+0000","last_unstale":"2024-05-21T13:38:25.548413+0000","last_undegraded":"2024-05-21T13:38:25.548413+0000","last_fullsized":"2024-05-21T13:38:25.548413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:10:01.786931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"27'297","reported_seq":317,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.370538+0000","last_change":"2024-05-21T13:36:01.868781+0000","last_active":"2024-05-21T13:41:07.370538+0000","last_peered":"2024-05-21T13:41:07.370538+0000","last_clean":"2024-05-21T13:41:07.370538+0000","last_became_active":"2024-05-21T13:36:01.864254+0000","last_became_peered":"2024-05-21T13:36:01.864254+0000","last_unstale":"2024-05-21T13:41:07.370538+0000","last_undegraded":"2024-05-21T13:41:07.370538+0000","last_fullsized":"2024-05-21T13:41:07.370538+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:34:12.632333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":297,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"27'10","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.820694+0000","last_change":"2024-05-21T13:35:57.788313+0000","last_active":"2024-05-21T13:41:05.820694+0000","last_peered":"2024-05-21T13:41:05.820694+0000","last_clean":"2024-05-21T13:41:05.820694+0000","last_became_active":"2024-05-21T13:35:57.787963+0000","last_became_peered":"2024-05-21T13:35:57.787963+0000","last_unstale":"2024-05-21T13:41:05.820694+0000","last_undegraded":"2024-05-21T13:41:05.820694+0000","last_fullsized":"2024-05-21T13:41:05.820694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:16:21.586571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"27'5","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:40:50.568172+0000","last_change":"2024-05-21T13:35:56.748334+0000","last_active":"2024-05-21T13:40:50.568172+0000","last_peered":"2024-05-21T13:40:50.568172+0000","last_clean":"2024-05-21T13:40:50.568172+0000","last_became_active":"2024-05-21T13:35:56.748049+0000","last_became_peered":"2024-05-21T13:35:56.748049+0000","last_unstale":"2024-05-21T13:40:50.568172+0000","last_undegraded":"2024-05-21T13:40:50.568172+0000","last_fullsized":"2024-05-21T13:40:50.568172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:59:02.802905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"27'327","reported_seq":347,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.407451+0000","last_change":"2024-05-21T13:36:01.856216+0000","last_active":"2024-05-21T13:41:07.407451+0000","last_peered":"2024-05-21T13:41:07.407451+0000","last_clean":"2024-05-21T13:41:07.407451+0000","last_became_active":"2024-05-21T13:36:01.855417+0000","last_became_peered":"2024-05-21T13:36:01.855417+0000","last_unstale":"2024-05-21T13:41:07.407451+0000","last_undegraded":"2024-05-21T13:41:07.407451+0000","last_fullsized":"2024-05-21T13:41:07.407451+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:36:01.423944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":327,"num_write_kb":892928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"27'273","reported_seq":293,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.396046+0000","last_change":"2024-05-21T13:36:01.838966+0000","last_active":"2024-05-21T13:41:07.396046+0000","last_peered":"2024-05-21T13:41:07.396046+0000","last_clean":"2024-05-21T13:41:07.396046+0000","last_became_active":"2024-05-21T13:36:01.837777+0000","last_became_peered":"2024-05-21T13:36:01.837777+0000","last_unstale":"2024-05-21T13:41:07.396046+0000","last_undegraded":"2024-05-21T13:41:07.396046+0000","last_fullsized":"2024-05-21T13:41:07.396046+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:40:55.688338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"27'11","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.798229+0000","last_change":"2024-05-21T13:35:57.762719+0000","last_active":"2024-05-21T13:41:05.798229+0000","last_peered":"2024-05-21T13:41:05.798229+0000","last_clean":"2024-05-21T13:41:05.798229+0000","last_became_active":"2024-05-21T13:35:57.762071+0000","last_became_peered":"2024-05-21T13:35:57.762071+0000","last_unstale":"2024-05-21T13:41:05.798229+0000","last_undegraded":"2024-05-21T13:41:05.798229+0000","last_fullsized":"2024-05-21T13:41:05.798229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:55:37.631695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"25'1","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:38:25.556862+0000","last_change":"2024-05-21T13:35:56.751481+0000","last_active":"2024-05-21T13:38:25.556862+0000","last_peered":"2024-05-21T13:38:25.556862+0000","last_clean":"2024-05-21T13:38:25.556862+0000","last_became_active":"2024-05-21T13:35:56.751201+0000","last_became_peered":"2024-05-21T13:35:56.751201+0000","last_unstale":"2024-05-21T13:38:25.556862+0000","last_undegraded":"2024-05-21T13:38:25.556862+0000","last_fullsized":"2024-05-21T13:38:25.556862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:33:28.720246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"27'267","reported_seq":287,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.412161+0000","last_change":"2024-05-21T13:36:01.837042+0000","last_active":"2024-05-21T13:41:07.412161+0000","last_peered":"2024-05-21T13:41:07.412161+0000","last_clean":"2024-05-21T13:41:07.412161+0000","last_became_active":"2024-05-21T13:36:01.836194+0000","last_became_peered":"2024-05-21T13:36:01.836194+0000","last_unstale":"2024-05-21T13:41:07.412161+0000","last_undegraded":"2024-05-21T13:41:07.412161+0000","last_fullsized":"2024-05-21T13:41:07.412161+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":267,"log_dups_size":0,"ondisk_log_size":267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:15:50.751693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":267,"num_write_kb":729088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"27'8","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.804092+0000","last_change":"2024-05-21T13:35:57.788838+0000","last_active":"2024-05-21T13:41:05.804092+0000","last_peered":"2024-05-21T13:41:05.804092+0000","last_clean":"2024-05-21T13:41:05.804092+0000","last_became_active":"2024-05-21T13:35:57.786307+0000","last_became_peered":"2024-05-21T13:35:57.786307+0000","last_unstale":"2024-05-21T13:41:05.804092+0000","last_undegraded":"2024-05-21T13:41:05.804092+0000","last_fullsized":"2024-05-21T13:41:05.804092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:52:09.086807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"25'2","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:38:25.543227+0000","last_change":"2024-05-21T13:35:56.746564+0000","last_active":"2024-05-21T13:38:25.543227+0000","last_peered":"2024-05-21T13:38:25.543227+0000","last_clean":"2024-05-21T13:38:25.543227+0000","last_became_active":"2024-05-21T13:35:56.745884+0000","last_became_peered":"2024-05-21T13:35:56.745884+0000","last_unstale":"2024-05-21T13:38:25.543227+0000","last_undegraded":"2024-05-21T13:38:25.543227+0000","last_fullsized":"2024-05-21T13:38:25.543227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:01:44.738607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"25'3","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:38:30.557677+0000","last_change":"2024-05-21T13:35:56.753930+0000","last_active":"2024-05-21T13:38:30.557677+0000","last_peered":"2024-05-21T13:38:30.557677+0000","last_clean":"2024-05-21T13:38:30.557677+0000","last_became_active":"2024-05-21T13:35:56.753499+0000","last_became_peered":"2024-05-21T13:35:56.753499+0000","last_unstale":"2024-05-21T13:38:30.557677+0000","last_undegraded":"2024-05-21T13:38:30.557677+0000","last_fullsized":"2024-05-21T13:38:30.557677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:40:51.516544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"27'8","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.797802+0000","last_change":"2024-05-21T13:36:39.802963+0000","last_active":"2024-05-21T13:41:05.797802+0000","last_peered":"2024-05-21T13:41:05.797802+0000","last_clean":"2024-05-21T13:41:05.797802+0000","last_became_active":"2024-05-21T13:36:39.802110+0000","last_became_peered":"2024-05-21T13:36:39.802110+0000","last_unstale":"2024-05-21T13:41:05.797802+0000","last_undegraded":"2024-05-21T13:41:05.797802+0000","last_fullsized":"2024-05-21T13:41:05.797802+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:41:46.124629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"27'297","reported_seq":317,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.324032+0000","last_change":"2024-05-21T13:36:01.844240+0000","last_active":"2024-05-21T13:41:07.324032+0000","last_peered":"2024-05-21T13:41:07.324032+0000","last_clean":"2024-05-21T13:41:07.324032+0000","last_became_active":"2024-05-21T13:36:01.842792+0000","last_became_peered":"2024-05-21T13:36:01.842792+0000","last_unstale":"2024-05-21T13:41:07.324032+0000","last_undegraded":"2024-05-21T13:41:07.324032+0000","last_fullsized":"2024-05-21T13:41:07.324032+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:19:54.016465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":297,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"27'7","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:40:59.597142+0000","last_change":"2024-05-21T13:35:56.770864+0000","last_active":"2024-05-21T13:40:59.597142+0000","last_peered":"2024-05-21T13:40:59.597142+0000","last_clean":"2024-05-21T13:40:59.597142+0000","last_became_active":"2024-05-21T13:35:56.766873+0000","last_became_peered":"2024-05-21T13:35:56.766873+0000","last_unstale":"2024-05-21T13:40:59.597142+0000","last_undegraded":"2024-05-21T13:40:59.597142+0000","last_fullsized":"2024-05-21T13:40:59.597142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:13:02.633858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"27'7","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.807437+0000","last_change":"2024-05-21T13:35:57.787563+0000","last_active":"2024-05-21T13:41:05.807437+0000","last_peered":"2024-05-21T13:41:05.807437+0000","last_clean":"2024-05-21T13:41:05.807437+0000","last_became_active":"2024-05-21T13:35:57.787255+0000","last_became_peered":"2024-05-21T13:35:57.787255+0000","last_unstale":"2024-05-21T13:41:05.807437+0000","last_undegraded":"2024-05-21T13:41:05.807437+0000","last_fullsized":"2024-05-21T13:41:05.807437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:32:49.325049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"27'312","reported_seq":332,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.373780+0000","last_change":"2024-05-21T13:36:01.868514+0000","last_active":"2024-05-21T13:41:07.373780+0000","last_peered":"2024-05-21T13:41:07.373780+0000","last_clean":"2024-05-21T13:41:07.373780+0000","last_became_active":"2024-05-21T13:36:01.867522+0000","last_became_peered":"2024-05-21T13:36:01.867522+0000","last_unstale":"2024-05-21T13:41:07.373780+0000","last_undegraded":"2024-05-21T13:41:07.373780+0000","last_fullsized":"2024-05-21T13:41:07.373780+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:19:13.533784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":312,"num_write_kb":851968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"27'9","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.809025+0000","last_change":"2024-05-21T13:35:57.782641+0000","last_active":"2024-05-21T13:41:05.809025+0000","last_peered":"2024-05-21T13:41:05.809025+0000","last_clean":"2024-05-21T13:41:05.809025+0000","last_became_active":"2024-05-21T13:35:57.782233+0000","last_became_peered":"2024-05-21T13:35:57.782233+0000","last_unstale":"2024-05-21T13:41:05.809025+0000","last_undegraded":"2024-05-21T13:41:05.809025+0000","last_fullsized":"2024-05-21T13:41:05.809025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:55:18.808229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"27'12","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.792142+0000","last_change":"2024-05-21T13:35:57.770591+0000","last_active":"2024-05-21T13:41:05.792142+0000","last_peered":"2024-05-21T13:41:05.792142+0000","last_clean":"2024-05-21T13:41:05.792142+0000","last_became_active":"2024-05-21T13:35:57.769785+0000","last_became_peered":"2024-05-21T13:35:57.769785+0000","last_unstale":"2024-05-21T13:41:05.792142+0000","last_undegraded":"2024-05-21T13:41:05.792142+0000","last_fullsized":"2024-05-21T13:41:05.792142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:18:28.168393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"27'8","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.817815+0000","last_change":"2024-05-21T13:35:57.799153+0000","last_active":"2024-05-21T13:41:05.817815+0000","last_peered":"2024-05-21T13:41:05.817815+0000","last_clean":"2024-05-21T13:41:05.817815+0000","last_became_active":"2024-05-21T13:35:57.796495+0000","last_became_peered":"2024-05-21T13:35:57.796495+0000","last_unstale":"2024-05-21T13:41:05.817815+0000","last_undegraded":"2024-05-21T13:41:05.817815+0000","last_fullsized":"2024-05-21T13:41:05.817815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:53:04.109036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"27'7","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.800426+0000","last_change":"2024-05-21T13:35:57.784335+0000","last_active":"2024-05-21T13:41:05.800426+0000","last_peered":"2024-05-21T13:41:05.800426+0000","last_clean":"2024-05-21T13:41:05.800426+0000","last_became_active":"2024-05-21T13:35:57.783968+0000","last_became_peered":"2024-05-21T13:35:57.783968+0000","last_unstale":"2024-05-21T13:41:05.800426+0000","last_undegraded":"2024-05-21T13:41:05.800426+0000","last_fullsized":"2024-05-21T13:41:05.800426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:57:20.832617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"27'4","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.818581+0000","last_change":"2024-05-21T13:35:57.795153+0000","last_active":"2024-05-21T13:41:05.818581+0000","last_peered":"2024-05-21T13:41:05.818581+0000","last_clean":"2024-05-21T13:41:05.818581+0000","last_became_active":"2024-05-21T13:35:57.794885+0000","last_became_peered":"2024-05-21T13:35:57.794885+0000","last_unstale":"2024-05-21T13:41:05.818581+0000","last_undegraded":"2024-05-21T13:41:05.818581+0000","last_fullsized":"2024-05-21T13:41:05.818581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:17:00.454371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"27'6","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.789707+0000","last_change":"2024-05-21T13:35:57.778916+0000","last_active":"2024-05-21T13:41:05.789707+0000","last_peered":"2024-05-21T13:41:05.789707+0000","last_clean":"2024-05-21T13:41:05.789707+0000","last_became_active":"2024-05-21T13:35:57.778171+0000","last_became_peered":"2024-05-21T13:35:57.778171+0000","last_unstale":"2024-05-21T13:41:05.789707+0000","last_undegraded":"2024-05-21T13:41:05.789707+0000","last_fullsized":"2024-05-21T13:41:05.789707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:15:37.425836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"27'15","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.820287+0000","last_change":"2024-05-21T13:35:57.791367+0000","last_active":"2024-05-21T13:41:05.820287+0000","last_peered":"2024-05-21T13:41:05.820287+0000","last_clean":"2024-05-21T13:41:05.820287+0000","last_became_active":"2024-05-21T13:35:57.790971+0000","last_became_peered":"2024-05-21T13:35:57.790971+0000","last_unstale":"2024-05-21T13:41:05.820287+0000","last_undegraded":"2024-05-21T13:41:05.820287+0000","last_fullsized":"2024-05-21T13:41:05.820287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:14:47.428631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"27'2","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.810357+0000","last_change":"2024-05-21T13:35:57.785257+0000","last_active":"2024-05-21T13:41:05.810357+0000","last_peered":"2024-05-21T13:41:05.810357+0000","last_clean":"2024-05-21T13:41:05.810357+0000","last_became_active":"2024-05-21T13:35:57.781533+0000","last_became_peered":"2024-05-21T13:35:57.781533+0000","last_unstale":"2024-05-21T13:41:05.810357+0000","last_undegraded":"2024-05-21T13:41:05.810357+0000","last_fullsized":"2024-05-21T13:41:05.810357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:18:32.591803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"27'6","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.815829+0000","last_change":"2024-05-21T13:35:57.799128+0000","last_active":"2024-05-21T13:41:05.815829+0000","last_peered":"2024-05-21T13:41:05.815829+0000","last_clean":"2024-05-21T13:41:05.815829+0000","last_became_active":"2024-05-21T13:35:57.797044+0000","last_became_peered":"2024-05-21T13:35:57.797044+0000","last_unstale":"2024-05-21T13:41:05.815829+0000","last_undegraded":"2024-05-21T13:41:05.815829+0000","last_fullsized":"2024-05-21T13:41:05.815829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:57:13.472309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"27'8","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.810610+0000","last_change":"2024-05-21T13:35:57.789768+0000","last_active":"2024-05-21T13:41:05.810610+0000","last_peered":"2024-05-21T13:41:05.810610+0000","last_clean":"2024-05-21T13:41:05.810610+0000","last_became_active":"2024-05-21T13:35:57.789474+0000","last_became_peered":"2024-05-21T13:35:57.789474+0000","last_unstale":"2024-05-21T13:41:05.810610+0000","last_undegraded":"2024-05-21T13:41:05.810610+0000","last_fullsized":"2024-05-21T13:41:05.810610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:42:53.993281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"27'10","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.817266+0000","last_change":"2024-05-21T13:35:57.756607+0000","last_active":"2024-05-21T13:41:05.817266+0000","last_peered":"2024-05-21T13:41:05.817266+0000","last_clean":"2024-05-21T13:41:05.817266+0000","last_became_active":"2024-05-21T13:35:57.755889+0000","last_became_peered":"2024-05-21T13:35:57.755889+0000","last_unstale":"2024-05-21T13:41:05.817266+0000","last_undegraded":"2024-05-21T13:41:05.817266+0000","last_fullsized":"2024-05-21T13:41:05.817266+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:16:19.541597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"27'11","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.810097+0000","last_change":"2024-05-21T13:35:57.775322+0000","last_active":"2024-05-21T13:41:05.810097+0000","last_peered":"2024-05-21T13:41:05.810097+0000","last_clean":"2024-05-21T13:41:05.810097+0000","last_became_active":"2024-05-21T13:35:57.774386+0000","last_became_peered":"2024-05-21T13:35:57.774386+0000","last_unstale":"2024-05-21T13:41:05.810097+0000","last_undegraded":"2024-05-21T13:41:05.810097+0000","last_fullsized":"2024-05-21T13:41:05.810097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:01:02.106172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"27'8","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.828971+0000","last_change":"2024-05-21T13:35:57.769931+0000","last_active":"2024-05-21T13:41:05.828971+0000","last_peered":"2024-05-21T13:41:05.828971+0000","last_clean":"2024-05-21T13:41:05.828971+0000","last_became_active":"2024-05-21T13:35:57.769149+0000","last_became_peered":"2024-05-21T13:35:57.769149+0000","last_unstale":"2024-05-21T13:41:05.828971+0000","last_undegraded":"2024-05-21T13:41:05.828971+0000","last_fullsized":"2024-05-21T13:41:05.828971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:55:56.268307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"27'7","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.824572+0000","last_change":"2024-05-21T13:35:57.796153+0000","last_active":"2024-05-21T13:41:05.824572+0000","last_peered":"2024-05-21T13:41:05.824572+0000","last_clean":"2024-05-21T13:41:05.824572+0000","last_became_active":"2024-05-21T13:35:57.795799+0000","last_became_peered":"2024-05-21T13:35:57.795799+0000","last_unstale":"2024-05-21T13:41:05.824572+0000","last_undegraded":"2024-05-21T13:41:05.824572+0000","last_fullsized":"2024-05-21T13:41:05.824572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:52:04.794391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"27'10","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.796637+0000","last_change":"2024-05-21T13:35:57.776414+0000","last_active":"2024-05-21T13:41:05.796637+0000","last_peered":"2024-05-21T13:41:05.796637+0000","last_clean":"2024-05-21T13:41:05.796637+0000","last_became_active":"2024-05-21T13:35:57.775573+0000","last_became_peered":"2024-05-21T13:35:57.775573+0000","last_unstale":"2024-05-21T13:41:05.796637+0000","last_undegraded":"2024-05-21T13:41:05.796637+0000","last_fullsized":"2024-05-21T13:41:05.796637+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:47:47.624662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"27'8","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.823028+0000","last_change":"2024-05-21T13:35:57.799673+0000","last_active":"2024-05-21T13:41:05.823028+0000","last_peered":"2024-05-21T13:41:05.823028+0000","last_clean":"2024-05-21T13:41:05.823028+0000","last_became_active":"2024-05-21T13:35:57.799313+0000","last_became_peered":"2024-05-21T13:35:57.799313+0000","last_unstale":"2024-05-21T13:41:05.823028+0000","last_undegraded":"2024-05-21T13:41:05.823028+0000","last_fullsized":"2024-05-21T13:41:05.823028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:40:52.516216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"27'9","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.815899+0000","last_change":"2024-05-21T13:35:57.790705+0000","last_active":"2024-05-21T13:41:05.815899+0000","last_peered":"2024-05-21T13:41:05.815899+0000","last_clean":"2024-05-21T13:41:05.815899+0000","last_became_active":"2024-05-21T13:35:57.787735+0000","last_became_peered":"2024-05-21T13:35:57.787735+0000","last_unstale":"2024-05-21T13:41:05.815899+0000","last_undegraded":"2024-05-21T13:41:05.815899+0000","last_fullsized":"2024-05-21T13:41:05.815899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:17:24.376182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"27'7","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.825286+0000","last_change":"2024-05-21T13:35:57.786838+0000","last_active":"2024-05-21T13:41:05.825286+0000","last_peered":"2024-05-21T13:41:05.825286+0000","last_clean":"2024-05-21T13:41:05.825286+0000","last_became_active":"2024-05-21T13:35:57.786403+0000","last_became_peered":"2024-05-21T13:35:57.786403+0000","last_unstale":"2024-05-21T13:41:05.825286+0000","last_undegraded":"2024-05-21T13:41:05.825286+0000","last_fullsized":"2024-05-21T13:41:05.825286+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:29:28.760793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"27'8","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.791110+0000","last_change":"2024-05-21T13:35:57.783561+0000","last_active":"2024-05-21T13:41:05.791110+0000","last_peered":"2024-05-21T13:41:05.791110+0000","last_clean":"2024-05-21T13:41:05.791110+0000","last_became_active":"2024-05-21T13:35:57.783060+0000","last_became_peered":"2024-05-21T13:35:57.783060+0000","last_unstale":"2024-05-21T13:41:05.791110+0000","last_undegraded":"2024-05-21T13:41:05.791110+0000","last_fullsized":"2024-05-21T13:41:05.791110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:27:27.261449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"27'10","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.817817+0000","last_change":"2024-05-21T13:35:57.788210+0000","last_active":"2024-05-21T13:41:05.817817+0000","last_peered":"2024-05-21T13:41:05.817817+0000","last_clean":"2024-05-21T13:41:05.817817+0000","last_became_active":"2024-05-21T13:35:57.787508+0000","last_became_peered":"2024-05-21T13:35:57.787508+0000","last_unstale":"2024-05-21T13:41:05.817817+0000","last_undegraded":"2024-05-21T13:41:05.817817+0000","last_fullsized":"2024-05-21T13:41:05.817817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:12:56.914580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"27'7","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.829116+0000","last_change":"2024-05-21T13:35:57.787335+0000","last_active":"2024-05-21T13:41:05.829116+0000","last_peered":"2024-05-21T13:41:05.829116+0000","last_clean":"2024-05-21T13:41:05.829116+0000","last_became_active":"2024-05-21T13:35:57.786292+0000","last_became_peered":"2024-05-21T13:35:57.786292+0000","last_unstale":"2024-05-21T13:41:05.829116+0000","last_undegraded":"2024-05-21T13:41:05.829116+0000","last_fullsized":"2024-05-21T13:41:05.829116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:49:40.480948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"27'6","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.830434+0000","last_change":"2024-05-21T13:35:57.801121+0000","last_active":"2024-05-21T13:41:05.830434+0000","last_peered":"2024-05-21T13:41:05.830434+0000","last_clean":"2024-05-21T13:41:05.830434+0000","last_became_active":"2024-05-21T13:35:57.800858+0000","last_became_peered":"2024-05-21T13:35:57.800858+0000","last_unstale":"2024-05-21T13:41:05.830434+0000","last_undegraded":"2024-05-21T13:41:05.830434+0000","last_fullsized":"2024-05-21T13:41:05.830434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:41:08.765821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"27'16","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.814491+0000","last_change":"2024-05-21T13:35:57.778753+0000","last_active":"2024-05-21T13:41:05.814491+0000","last_peered":"2024-05-21T13:41:05.814491+0000","last_clean":"2024-05-21T13:41:05.814491+0000","last_became_active":"2024-05-21T13:35:57.777962+0000","last_became_peered":"2024-05-21T13:35:57.777962+0000","last_unstale":"2024-05-21T13:41:05.814491+0000","last_undegraded":"2024-05-21T13:41:05.814491+0000","last_fullsized":"2024-05-21T13:41:05.814491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:51:49.102945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"27'11","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.819045+0000","last_change":"2024-05-21T13:35:57.798312+0000","last_active":"2024-05-21T13:41:05.819045+0000","last_peered":"2024-05-21T13:41:05.819045+0000","last_clean":"2024-05-21T13:41:05.819045+0000","last_became_active":"2024-05-21T13:35:57.797793+0000","last_became_peered":"2024-05-21T13:35:57.797793+0000","last_unstale":"2024-05-21T13:41:05.819045+0000","last_undegraded":"2024-05-21T13:41:05.819045+0000","last_fullsized":"2024-05-21T13:41:05.819045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:28:47.276868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"27'9","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.825487+0000","last_change":"2024-05-21T13:35:57.782412+0000","last_active":"2024-05-21T13:41:05.825487+0000","last_peered":"2024-05-21T13:41:05.825487+0000","last_clean":"2024-05-21T13:41:05.825487+0000","last_became_active":"2024-05-21T13:35:57.782058+0000","last_became_peered":"2024-05-21T13:35:57.782058+0000","last_unstale":"2024-05-21T13:41:05.825487+0000","last_undegraded":"2024-05-21T13:41:05.825487+0000","last_fullsized":"2024-05-21T13:41:05.825487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:39:49.142554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"27'5","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.810805+0000","last_change":"2024-05-21T13:35:57.779771+0000","last_active":"2024-05-21T13:41:05.810805+0000","last_peered":"2024-05-21T13:41:05.810805+0000","last_clean":"2024-05-21T13:41:05.810805+0000","last_became_active":"2024-05-21T13:35:57.779168+0000","last_became_peered":"2024-05-21T13:35:57.779168+0000","last_unstale":"2024-05-21T13:41:05.810805+0000","last_undegraded":"2024-05-21T13:41:05.810805+0000","last_fullsized":"2024-05-21T13:41:05.810805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T13:59:58.966203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"27'6","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.806310+0000","last_change":"2024-05-21T13:35:57.773098+0000","last_active":"2024-05-21T13:41:05.806310+0000","last_peered":"2024-05-21T13:41:05.806310+0000","last_clean":"2024-05-21T13:41:05.806310+0000","last_became_active":"2024-05-21T13:35:57.772268+0000","last_became_peered":"2024-05-21T13:35:57.772268+0000","last_unstale":"2024-05-21T13:41:05.806310+0000","last_undegraded":"2024-05-21T13:41:05.806310+0000","last_fullsized":"2024-05-21T13:41:05.806310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:05:25.482434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"27'4","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.829420+0000","last_change":"2024-05-21T13:35:57.788980+0000","last_active":"2024-05-21T13:41:05.829420+0000","last_peered":"2024-05-21T13:41:05.829420+0000","last_clean":"2024-05-21T13:41:05.829420+0000","last_became_active":"2024-05-21T13:35:57.788689+0000","last_became_peered":"2024-05-21T13:35:57.788689+0000","last_unstale":"2024-05-21T13:41:05.829420+0000","last_undegraded":"2024-05-21T13:41:05.829420+0000","last_fullsized":"2024-05-21T13:41:05.829420+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:15:07.615363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"27'8","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.809482+0000","last_change":"2024-05-21T13:35:57.772867+0000","last_active":"2024-05-21T13:41:05.809482+0000","last_peered":"2024-05-21T13:41:05.809482+0000","last_clean":"2024-05-21T13:41:05.809482+0000","last_became_active":"2024-05-21T13:35:57.772160+0000","last_became_peered":"2024-05-21T13:35:57.772160+0000","last_unstale":"2024-05-21T13:41:05.809482+0000","last_undegraded":"2024-05-21T13:41:05.809482+0000","last_fullsized":"2024-05-21T13:41:05.809482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:11:24.428796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"27'7","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.805509+0000","last_change":"2024-05-21T13:35:57.785297+0000","last_active":"2024-05-21T13:41:05.805509+0000","last_peered":"2024-05-21T13:41:05.805509+0000","last_clean":"2024-05-21T13:41:05.805509+0000","last_became_active":"2024-05-21T13:35:57.784741+0000","last_became_peered":"2024-05-21T13:35:57.784741+0000","last_unstale":"2024-05-21T13:41:05.805509+0000","last_undegraded":"2024-05-21T13:41:05.805509+0000","last_fullsized":"2024-05-21T13:41:05.805509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:45:08.507286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"27'4","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.800168+0000","last_change":"2024-05-21T13:35:57.788875+0000","last_active":"2024-05-21T13:41:05.800168+0000","last_peered":"2024-05-21T13:41:05.800168+0000","last_clean":"2024-05-21T13:41:05.800168+0000","last_became_active":"2024-05-21T13:35:57.786629+0000","last_became_peered":"2024-05-21T13:35:57.786629+0000","last_unstale":"2024-05-21T13:41:05.800168+0000","last_undegraded":"2024-05-21T13:41:05.800168+0000","last_fullsized":"2024-05-21T13:41:05.800168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:40:07.549210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"27'8","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.828969+0000","last_change":"2024-05-21T13:35:57.803316+0000","last_active":"2024-05-21T13:41:05.828969+0000","last_peered":"2024-05-21T13:41:05.828969+0000","last_clean":"2024-05-21T13:41:05.828969+0000","last_became_active":"2024-05-21T13:35:57.802925+0000","last_became_peered":"2024-05-21T13:35:57.802925+0000","last_unstale":"2024-05-21T13:41:05.828969+0000","last_undegraded":"2024-05-21T13:41:05.828969+0000","last_fullsized":"2024-05-21T13:41:05.828969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:17:16.304097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9217,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9218,"ondisk_log_size":9218,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":503,"ondisk_log_size":503,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":213458,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":270,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":581632,"data_stored":426916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":240,"ondisk_log_size":240,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66916,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509509,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49528,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94322312,"statfs":{"total":96636764160,"available":96586047488,"internally_reserved":0,"allocated":311296,"data_stored":116594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509509,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45352,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326488,"statfs":{"total":96636764160,"available":96590323712,"internally_reserved":0,"allocated":294912,"data_stored":116943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509508,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53676,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94318164,"statfs":{"total":96636764160,"available":96581799936,"internally_reserved":0,"allocated":299008,"data_stored":116383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509509,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27508,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344332,"statfs":{"total":96636764160,"available":96608595968,"internally_reserved":0,"allocated":503808,"data_stored":323928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509509,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57892,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313948,"statfs":{"total":96636764160,"available":96577482752,"internally_reserved":0,"allocated":356352,"data_stored":705685,"data_compressed":33458,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509508,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39792,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94332048,"statfs":{"total":96636764160,"available":96596017152,"internally_reserved":0,"allocated":303104,"data_stored":116473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542211,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45428,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326412,"statfs":{"total":96636764160,"available":96590245888,"internally_reserved":0,"allocated":372736,"data_stored":707440,"data_compressed":33458,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574915,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45712,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326128,"statfs":{"total":96636764160,"available":96589955072,"internally_reserved":0,"allocated":663552,"data_stored":2421416,"data_compressed":104896,"data_compressed_allocated":131072,"data_compressed_original":2097152,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33458,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33458,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":221184,"data_stored":208771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":249856,"data_stored":210305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-21T13:41:12.499 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-21T13:41:12.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.690+0000 7fb9e1feb640 1 Processor -- start 2024-05-21T13:41:12.665 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.690+0000 7fb9e1feb640 1 -- start start 2024-05-21T13:41:12.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.690+0000 7fb9e1feb640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fb9dc155d80 0x7fb9dc15b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:12.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.690+0000 7fb9e1feb640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9dc156160 con 0x7fb9dc0cd1c0 2024-05-21T13:41:12.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.690+0000 7fb9e1feb640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9dc15c4a0 con 0x7fb9dc15bf30 2024-05-21T13:41:12.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.690+0000 7fb9e1feb640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7fb9dc0ccfc0 con 0x7fb9dc155d80 2024-05-21T13:41:12.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.690+0000 7fb9dbfff640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fb9dc0cd1c0 0x7fb9dc0d1420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:37362/0 (socket says 172.21.15.22:37362) 2024-05-21T13:41:12.666 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.690+0000 7fb9dbfff640 1 -- 172.21.15.22:0/990113684 learned_addr learned my addr 172.21.15.22:0/990113684 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-21T13:41:12.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.690+0000 7fb9db7fe640 1 --2- 172.21.15.22:0/990113684 >> v2:172.21.15.115:3300/0 conn(0x7fb9dc155d80 0x7fb9dc15b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:12.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.690+0000 7fb9da7fc640 1 -- 172.21.15.22:0/990113684 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1435403865 0 0) 0x7fb9dc156160 con 0x7fb9dc0cd1c0 2024-05-21T13:41:12.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.690+0000 7fb9da7fc640 1 -- 172.21.15.22:0/990113684 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb9c4003530 con 0x7fb9dc0cd1c0 2024-05-21T13:41:12.667 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.690+0000 7fb9da7fc640 1 -- 172.21.15.22:0/990113684 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1348559757 0 0) 0x7fb9c4003530 con 0x7fb9dc0cd1c0 2024-05-21T13:41:12.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.690+0000 7fb9db7fe640 1 -- 172.21.15.22:0/990113684 >> v1:172.21.15.115:6789/0 conn(0x7fb9dc15bf30 legacy=0x7fb9dc0ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:12.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.690+0000 7fb9db7fe640 1 -- 172.21.15.22:0/990113684 >> v1:172.21.15.22:6789/0 conn(0x7fb9dc0cd1c0 legacy=0x7fb9dc0d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:12.668 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.690+0000 7fb9db7fe640 1 -- 172.21.15.22:0/990113684 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9dc15c780 con 0x7fb9dc155d80 2024-05-21T13:41:12.669 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.694+0000 7fb9db7fe640 1 --2- 172.21.15.22:0/990113684 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb9dc155d80 0x7fb9dc15b9f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc0097c0 tx=0x7fb9cc01c330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=91b791fb0ec60491 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:12.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.694+0000 7fb9da7fc640 1 -- 172.21.15.22:0/990113684 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc0b0070 con 0x7fb9dc155d80 2024-05-21T13:41:12.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.694+0000 7fb9da7fc640 1 -- 172.21.15.22:0/990113684 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9cc0ab400 con 0x7fb9dc155d80 2024-05-21T13:41:12.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.694+0000 7fb9da7fc640 1 -- 172.21.15.22:0/990113684 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9d4001a80 con 0x7fb9dc155d80 2024-05-21T13:41:12.670 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.694+0000 7fb9e1feb640 1 -- 172.21.15.22:0/990113684 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb9dc155d80 msgr2=0x7fb9dc15b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:12.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.694+0000 7fb9e1feb640 1 --2- 172.21.15.22:0/990113684 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb9dc155d80 0x7fb9dc15b9f0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc0097c0 tx=0x7fb9cc01c330 comp rx=0 tx=0).stop 2024-05-21T13:41:12.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.694+0000 7fb9e1feb640 1 -- 172.21.15.22:0/990113684 shutdown_connections 2024-05-21T13:41:12.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.694+0000 7fb9e1feb640 1 --2- 172.21.15.22:0/990113684 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb9dc155d80 0x7fb9dc15b9f0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:12.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.694+0000 7fb9e1feb640 1 -- 172.21.15.22:0/990113684 >> 172.21.15.22:0/990113684 conn(0x7fb9dc06f3b0 msgr2=0x7fb9dc06d430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:41:12.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.694+0000 7fb9e1feb640 1 -- 172.21.15.22:0/990113684 shutdown_connections 2024-05-21T13:41:12.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.694+0000 7fb9e1feb640 1 -- 172.21.15.22:0/990113684 wait complete. 2024-05-21T13:41:12.671 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.694+0000 7fb9e1feb640 1 Processor -- start 2024-05-21T13:41:12.672 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.694+0000 7fb9e1feb640 1 -- start start 2024-05-21T13:41:12.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.694+0000 7fb9e1feb640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb9dc0cd1c0 0x7fb9dc14b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:12.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.694+0000 7fb9e1feb640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb9dc155d80 0x7fb9dc0c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:12.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.694+0000 7fb9e1feb640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb9dc15bf30 0x7fb9dc0ca410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:12.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.694+0000 7fb9e1feb640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb9dc0ceda0 con 0x7fb9dc0cd1c0 2024-05-21T13:41:12.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.694+0000 7fb9e1feb640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fb9dc0cec20 con 0x7fb9dc155d80 2024-05-21T13:41:12.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.694+0000 7fb9e1feb640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7fb9dc0d1b30 con 0x7fb9dc15bf30 2024-05-21T13:41:12.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.698+0000 7fb9db7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb9dc0cd1c0 0x7fb9dc14b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:12.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.698+0000 7fb9db7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb9dc0cd1c0 0x7fb9dc14b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36478/0 (socket says 172.21.15.22:36478) 2024-05-21T13:41:12.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.698+0000 7fb9db7fe640 1 -- 172.21.15.22:0/1497484743 learned_addr learned my addr 172.21.15.22:0/1497484743 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:41:12.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.698+0000 7fb9daffd640 1 --2- 172.21.15.22:0/1497484743 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb9dc155d80 0x7fb9dc0c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:12.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.698+0000 7fb9db7fe640 1 -- 172.21.15.22:0/1497484743 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb9dc15bf30 msgr2=0x7fb9dc0ca410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:12.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.698+0000 7fb9dbfff640 1 --2- 172.21.15.22:0/1497484743 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb9dc15bf30 0x7fb9dc0ca410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:12.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.698+0000 7fb9db7fe640 1 --2- 172.21.15.22:0/1497484743 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb9dc15bf30 0x7fb9dc0ca410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:12.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.698+0000 7fb9db7fe640 1 -- 172.21.15.22:0/1497484743 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb9dc155d80 msgr2=0x7fb9dc0c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:12.674 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.698+0000 7fb9db7fe640 1 --2- 172.21.15.22:0/1497484743 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb9dc155d80 0x7fb9dc0c9ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:12.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.698+0000 7fb9db7fe640 1 -- 172.21.15.22:0/1497484743 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9dc15fa80 con 0x7fb9dc0cd1c0 2024-05-21T13:41:12.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.698+0000 7fb9daffd640 1 --2- 172.21.15.22:0/1497484743 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb9dc155d80 0x7fb9dc0c9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:41:12.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.698+0000 7fb9dbfff640 1 --2- 172.21.15.22:0/1497484743 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb9dc15bf30 0x7fb9dc0ca410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:41:12.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.698+0000 7fb9db7fe640 1 --2- 172.21.15.22:0/1497484743 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb9dc0cd1c0 0x7fb9dc14b0b0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc0097c0 tx=0x7fb9cc01ab70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:12.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.698+0000 7fb9c3fff640 1 -- 172.21.15.22:0/1497484743 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc0b0050 con 0x7fb9dc0cd1c0 2024-05-21T13:41:12.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.698+0000 7fb9c3fff640 1 -- 172.21.15.22:0/1497484743 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9cc0bc070 con 0x7fb9dc0cd1c0 2024-05-21T13:41:12.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.698+0000 7fb9c3fff640 1 -- 172.21.15.22:0/1497484743 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9cc006e20 con 0x7fb9dc0cd1c0 2024-05-21T13:41:12.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.698+0000 7fb9e1feb640 1 -- 172.21.15.22:0/1497484743 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9dc0c93f0 con 0x7fb9dc0cd1c0 2024-05-21T13:41:12.675 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.698+0000 7fb9e1feb640 1 -- 172.21.15.22:0/1497484743 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9dc15a3e0 con 0x7fb9dc0cd1c0 2024-05-21T13:41:12.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.698+0000 7fb9e1feb640 1 -- 172.21.15.22:0/1497484743 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9dc077bb0 con 0x7fb9dc0cd1c0 2024-05-21T13:41:12.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.698+0000 7fb9c3fff640 1 -- 172.21.15.22:0/1497484743 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fb9cc0b7850 con 0x7fb9dc0cd1c0 2024-05-21T13:41:12.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.698+0000 7fb9c3fff640 1 --2- 172.21.15.22:0/1497484743 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fb9c806f400 0x7fb9c80718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:12.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.698+0000 7fb9c3fff640 1 -- 172.21.15.22:0/1497484743 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7fb9cc129cd0 con 0x7fb9dc0cd1c0 2024-05-21T13:41:12.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.698+0000 7fb9daffd640 1 --2- 172.21.15.22:0/1497484743 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fb9c806f400 0x7fb9c80718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:12.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.702+0000 7fb9daffd640 1 --2- 172.21.15.22:0/1497484743 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fb9c806f400 0x7fb9c80718c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb9d0000f70 tx=0x7fb9d0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:12.679 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.702+0000 7fb9c3fff640 1 -- 172.21.15.22:0/1497484743 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fb9cc015fb0 con 0x7fb9dc0cd1c0 2024-05-21T13:41:12.841 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.866+0000 7fb9e1feb640 1 -- 172.21.15.22:0/1497484743 --> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb9dc0d17c0 con 0x7fb9c806f400 2024-05-21T13:41:12.864 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.886+0000 7fb9c3fff640 1 -- 172.21.15.22:0/1497484743 <== mgr.4103 v2:172.21.15.115:6832/184591771 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+333483 (secure 0 0 0) 0x7fb9dc0d17c0 con 0x7fb9c806f400 2024-05-21T13:41:12.868 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-21T13:41:12.870 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-05-21T13:41:12.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.894+0000 7fb9e1feb640 1 -- 172.21.15.22:0/1497484743 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fb9c806f400 msgr2=0x7fb9c80718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:12.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.894+0000 7fb9e1feb640 1 --2- 172.21.15.22:0/1497484743 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fb9c806f400 0x7fb9c80718c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fb9d0000f70 tx=0x7fb9d0009040 comp rx=0 tx=0).stop 2024-05-21T13:41:12.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.894+0000 7fb9e1feb640 1 -- 172.21.15.22:0/1497484743 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb9dc0cd1c0 msgr2=0x7fb9dc14b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:12.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.894+0000 7fb9e1feb640 1 --2- 172.21.15.22:0/1497484743 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb9dc0cd1c0 0x7fb9dc14b0b0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fb9cc0097c0 tx=0x7fb9cc01ab70 comp rx=0 tx=0).stop 2024-05-21T13:41:12.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.894+0000 7fb9e1feb640 1 -- 172.21.15.22:0/1497484743 shutdown_connections 2024-05-21T13:41:12.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.894+0000 7fb9e1feb640 1 --2- 172.21.15.22:0/1497484743 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fb9c806f400 0x7fb9c80718c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:12.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.894+0000 7fb9e1feb640 1 --2- 172.21.15.22:0/1497484743 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb9dc15bf30 0x7fb9dc0ca410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:12.871 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.894+0000 7fb9e1feb640 1 --2- 172.21.15.22:0/1497484743 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb9dc155d80 0x7fb9dc0c9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:12.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.894+0000 7fb9e1feb640 1 --2- 172.21.15.22:0/1497484743 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb9dc0cd1c0 0x7fb9dc14b0b0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:12.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.894+0000 7fb9e1feb640 1 -- 172.21.15.22:0/1497484743 >> 172.21.15.22:0/1497484743 conn(0x7fb9dc06f3b0 msgr2=0x7fb9dc0c7a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:41:12.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.894+0000 7fb9e1feb640 1 -- 172.21.15.22:0/1497484743 shutdown_connections 2024-05-21T13:41:12.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:12.894+0000 7fb9e1feb640 1 -- 172.21.15.22:0/1497484743 wait complete. 2024-05-21T13:41:12.890 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":185,"stamp":"2024-05-21T13:41:12.625676+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":803826,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":70,"num_read_kb":59,"num_write":9588,"num_write_kb":25167756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10033,"ondisk_log_size":10033,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":364888,"kb_used_data":3032,"kb_used_omap":12,"kb_used_meta":361779,"kb_avail":754609832,"statfs":{"total":773094113280,"available":772720467968,"internally_reserved":0,"allocated":3104768,"data_stored":4624862,"data_compressed":171812,"data_compressed_allocated":221184,"data_compressed_original":3244032,"omap_allocated":12752,"internal_metadata":370462256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,1,1,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-10737402839,"num_objects":-2560,"num_object_clones":0,"num_object_copies":-10240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2560,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2586,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004601"},"pg_stats":[{"pgid":"2.1f","version":"25'9","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:38:03.532918+0000","last_change":"2024-05-21T13:35:56.739488+0000","last_active":"2024-05-21T13:38:03.532918+0000","last_peered":"2024-05-21T13:38:03.532918+0000","last_clean":"2024-05-21T13:38:03.532918+0000","last_became_active":"2024-05-21T13:35:56.738481+0000","last_became_peered":"2024-05-21T13:35:56.738481+0000","last_unstale":"2024-05-21T13:38:03.532918+0000","last_undegraded":"2024-05-21T13:38:03.532918+0000","last_fullsized":"2024-05-21T13:38:03.532918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:20:48.149770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"27'5","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.810535+0000","last_change":"2024-05-21T13:35:57.779462+0000","last_active":"2024-05-21T13:41:05.810535+0000","last_peered":"2024-05-21T13:41:05.810535+0000","last_clean":"2024-05-21T13:41:05.810535+0000","last_became_active":"2024-05-21T13:35:57.778721+0000","last_became_peered":"2024-05-21T13:35:57.778721+0000","last_unstale":"2024-05-21T13:41:05.810535+0000","last_undegraded":"2024-05-21T13:41:05.810535+0000","last_fullsized":"2024-05-21T13:41:05.810535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:13:05.005747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"27'306","reported_seq":319,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.328568+0000","last_change":"2024-05-21T13:36:39.721406+0000","last_active":"2024-05-21T13:41:07.328568+0000","last_peered":"2024-05-21T13:41:07.328568+0000","last_clean":"2024-05-21T13:41:07.328568+0000","last_became_active":"2024-05-21T13:36:39.720879+0000","last_became_peered":"2024-05-21T13:36:39.720879+0000","last_unstale":"2024-05-21T13:41:07.328568+0000","last_undegraded":"2024-05-21T13:41:07.328568+0000","last_fullsized":"2024-05-21T13:41:07.328568+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":306,"log_dups_size":0,"ondisk_log_size":306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:18:35.640050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":306,"num_write_kb":835584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4,1],"acting":[0,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"25'2","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:37:59.540059+0000","last_change":"2024-05-21T13:35:56.775054+0000","last_active":"2024-05-21T13:37:59.540059+0000","last_peered":"2024-05-21T13:37:59.540059+0000","last_clean":"2024-05-21T13:37:59.540059+0000","last_became_active":"2024-05-21T13:35:56.770566+0000","last_became_peered":"2024-05-21T13:35:56.770566+0000","last_unstale":"2024-05-21T13:37:59.540059+0000","last_undegraded":"2024-05-21T13:37:59.540059+0000","last_fullsized":"2024-05-21T13:37:59.540059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:05:11.539201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"27'6","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.810509+0000","last_change":"2024-05-21T13:35:57.782094+0000","last_active":"2024-05-21T13:41:05.810509+0000","last_peered":"2024-05-21T13:41:05.810509+0000","last_clean":"2024-05-21T13:41:05.810509+0000","last_became_active":"2024-05-21T13:35:57.780590+0000","last_became_peered":"2024-05-21T13:35:57.780590+0000","last_unstale":"2024-05-21T13:41:05.810509+0000","last_undegraded":"2024-05-21T13:41:05.810509+0000","last_fullsized":"2024-05-21T13:41:05.810509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:30:50.929103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"27'339","reported_seq":359,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.400325+0000","last_change":"2024-05-21T13:36:01.852092+0000","last_active":"2024-05-21T13:41:07.400325+0000","last_peered":"2024-05-21T13:41:07.400325+0000","last_clean":"2024-05-21T13:41:07.400325+0000","last_became_active":"2024-05-21T13:36:01.851745+0000","last_became_peered":"2024-05-21T13:36:01.851745+0000","last_unstale":"2024-05-21T13:41:07.400325+0000","last_undegraded":"2024-05-21T13:41:07.400325+0000","last_fullsized":"2024-05-21T13:41:07.400325+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:57:21.599860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":339,"num_write_kb":925696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"27'5","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:39:00.707764+0000","last_change":"2024-05-21T13:35:56.731106+0000","last_active":"2024-05-21T13:39:00.707764+0000","last_peered":"2024-05-21T13:39:00.707764+0000","last_clean":"2024-05-21T13:39:00.707764+0000","last_became_active":"2024-05-21T13:35:56.730746+0000","last_became_peered":"2024-05-21T13:35:56.730746+0000","last_unstale":"2024-05-21T13:39:00.707764+0000","last_undegraded":"2024-05-21T13:39:00.707764+0000","last_fullsized":"2024-05-21T13:39:00.707764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:23:17.798397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"27'9","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.817410+0000","last_change":"2024-05-21T13:35:57.771371+0000","last_active":"2024-05-21T13:41:05.817410+0000","last_peered":"2024-05-21T13:41:05.817410+0000","last_clean":"2024-05-21T13:41:05.817410+0000","last_became_active":"2024-05-21T13:35:57.770595+0000","last_became_peered":"2024-05-21T13:35:57.770595+0000","last_unstale":"2024-05-21T13:41:05.817410+0000","last_undegraded":"2024-05-21T13:41:05.817410+0000","last_fullsized":"2024-05-21T13:41:05.817410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:53:17.771310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"27'273","reported_seq":293,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.380074+0000","last_change":"2024-05-21T13:36:01.849638+0000","last_active":"2024-05-21T13:41:07.380074+0000","last_peered":"2024-05-21T13:41:07.380074+0000","last_clean":"2024-05-21T13:41:07.380074+0000","last_became_active":"2024-05-21T13:36:01.848996+0000","last_became_peered":"2024-05-21T13:36:01.848996+0000","last_unstale":"2024-05-21T13:41:07.380074+0000","last_undegraded":"2024-05-21T13:41:07.380074+0000","last_fullsized":"2024-05-21T13:41:07.380074+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:24:31.613874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:38:30.549252+0000","last_change":"2024-05-21T13:35:56.737279+0000","last_active":"2024-05-21T13:38:30.549252+0000","last_peered":"2024-05-21T13:38:30.549252+0000","last_clean":"2024-05-21T13:38:30.549252+0000","last_became_active":"2024-05-21T13:35:56.731150+0000","last_became_peered":"2024-05-21T13:35:56.731150+0000","last_unstale":"2024-05-21T13:38:30.549252+0000","last_undegraded":"2024-05-21T13:38:30.549252+0000","last_fullsized":"2024-05-21T13:38:30.549252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:17:07.571294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"27'15","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.830064+0000","last_change":"2024-05-21T13:35:57.799803+0000","last_active":"2024-05-21T13:41:05.830064+0000","last_peered":"2024-05-21T13:41:05.830064+0000","last_clean":"2024-05-21T13:41:05.830064+0000","last_became_active":"2024-05-21T13:35:57.799043+0000","last_became_peered":"2024-05-21T13:35:57.799043+0000","last_unstale":"2024-05-21T13:41:05.830064+0000","last_undegraded":"2024-05-21T13:41:05.830064+0000","last_fullsized":"2024-05-21T13:41:05.830064+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:22:48.607953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"27'252","reported_seq":272,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.370027+0000","last_change":"2024-05-21T13:36:01.852469+0000","last_active":"2024-05-21T13:41:07.370027+0000","last_peered":"2024-05-21T13:41:07.370027+0000","last_clean":"2024-05-21T13:41:07.370027+0000","last_became_active":"2024-05-21T13:36:01.851913+0000","last_became_peered":"2024-05-21T13:36:01.851913+0000","last_unstale":"2024-05-21T13:41:07.370027+0000","last_undegraded":"2024-05-21T13:41:07.370027+0000","last_fullsized":"2024-05-21T13:41:07.370027+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":252,"log_dups_size":0,"ondisk_log_size":252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:42:58.062540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":252,"num_write_kb":688128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"27'5","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.818127+0000","last_change":"2024-05-21T13:35:57.796516+0000","last_active":"2024-05-21T13:41:05.818127+0000","last_peered":"2024-05-21T13:41:05.818127+0000","last_clean":"2024-05-21T13:41:05.818127+0000","last_became_active":"2024-05-21T13:35:57.795638+0000","last_became_peered":"2024-05-21T13:35:57.795638+0000","last_unstale":"2024-05-21T13:41:05.818127+0000","last_undegraded":"2024-05-21T13:41:05.818127+0000","last_fullsized":"2024-05-21T13:41:05.818127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:46:40.541835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"27'5","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:39:00.706951+0000","last_change":"2024-05-21T13:35:56.748046+0000","last_active":"2024-05-21T13:39:00.706951+0000","last_peered":"2024-05-21T13:39:00.706951+0000","last_clean":"2024-05-21T13:39:00.706951+0000","last_became_active":"2024-05-21T13:35:56.747635+0000","last_became_peered":"2024-05-21T13:35:56.747635+0000","last_unstale":"2024-05-21T13:39:00.706951+0000","last_undegraded":"2024-05-21T13:39:00.706951+0000","last_fullsized":"2024-05-21T13:39:00.706951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:52:28.665244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"27'309","reported_seq":329,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.399148+0000","last_change":"2024-05-21T13:36:01.862153+0000","last_active":"2024-05-21T13:41:07.399148+0000","last_peered":"2024-05-21T13:41:07.399148+0000","last_clean":"2024-05-21T13:41:07.399148+0000","last_became_active":"2024-05-21T13:36:01.861520+0000","last_became_peered":"2024-05-21T13:36:01.861520+0000","last_unstale":"2024-05-21T13:41:07.399148+0000","last_undegraded":"2024-05-21T13:41:07.399148+0000","last_fullsized":"2024-05-21T13:41:07.399148+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":309,"log_dups_size":0,"ondisk_log_size":309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:04:37.306132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":309,"num_write_kb":843776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"27'8","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.790220+0000","last_change":"2024-05-21T13:35:57.786463+0000","last_active":"2024-05-21T13:41:05.790220+0000","last_peered":"2024-05-21T13:41:05.790220+0000","last_clean":"2024-05-21T13:41:05.790220+0000","last_became_active":"2024-05-21T13:35:57.786126+0000","last_became_peered":"2024-05-21T13:35:57.786126+0000","last_unstale":"2024-05-21T13:41:05.790220+0000","last_undegraded":"2024-05-21T13:41:05.790220+0000","last_fullsized":"2024-05-21T13:41:05.790220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:39:32.076464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"27'3","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:40:20.575038+0000","last_change":"2024-05-21T13:35:56.765178+0000","last_active":"2024-05-21T13:40:20.575038+0000","last_peered":"2024-05-21T13:40:20.575038+0000","last_clean":"2024-05-21T13:40:20.575038+0000","last_became_active":"2024-05-21T13:35:56.764551+0000","last_became_peered":"2024-05-21T13:35:56.764551+0000","last_unstale":"2024-05-21T13:40:20.575038+0000","last_undegraded":"2024-05-21T13:40:20.575038+0000","last_fullsized":"2024-05-21T13:40:20.575038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:34:28.955222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"27'291","reported_seq":311,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.364679+0000","last_change":"2024-05-21T13:36:01.854410+0000","last_active":"2024-05-21T13:41:07.364679+0000","last_peered":"2024-05-21T13:41:07.364679+0000","last_clean":"2024-05-21T13:41:07.364679+0000","last_became_active":"2024-05-21T13:36:01.853975+0000","last_became_peered":"2024-05-21T13:36:01.853975+0000","last_unstale":"2024-05-21T13:41:07.364679+0000","last_undegraded":"2024-05-21T13:41:07.364679+0000","last_fullsized":"2024-05-21T13:41:07.364679+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:15:34.710504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":291,"num_write_kb":794624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"27'9","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.796423+0000","last_change":"2024-05-21T13:35:57.762509+0000","last_active":"2024-05-21T13:41:05.796423+0000","last_peered":"2024-05-21T13:41:05.796423+0000","last_clean":"2024-05-21T13:41:05.796423+0000","last_became_active":"2024-05-21T13:35:57.761739+0000","last_became_peered":"2024-05-21T13:35:57.761739+0000","last_unstale":"2024-05-21T13:41:05.796423+0000","last_undegraded":"2024-05-21T13:41:05.796423+0000","last_fullsized":"2024-05-21T13:41:05.796423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:41:17.911126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"25'3","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:38:08.533743+0000","last_change":"2024-05-21T13:35:56.734017+0000","last_active":"2024-05-21T13:38:08.533743+0000","last_peered":"2024-05-21T13:38:08.533743+0000","last_clean":"2024-05-21T13:38:08.533743+0000","last_became_active":"2024-05-21T13:35:56.733249+0000","last_became_peered":"2024-05-21T13:35:56.733249+0000","last_unstale":"2024-05-21T13:38:08.533743+0000","last_undegraded":"2024-05-21T13:38:08.533743+0000","last_fullsized":"2024-05-21T13:38:08.533743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:13:27.279557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"27'267","reported_seq":287,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.357200+0000","last_change":"2024-05-21T13:36:01.868669+0000","last_active":"2024-05-21T13:41:07.357200+0000","last_peered":"2024-05-21T13:41:07.357200+0000","last_clean":"2024-05-21T13:41:07.357200+0000","last_became_active":"2024-05-21T13:36:01.867701+0000","last_became_peered":"2024-05-21T13:36:01.867701+0000","last_unstale":"2024-05-21T13:41:07.357200+0000","last_undegraded":"2024-05-21T13:41:07.357200+0000","last_fullsized":"2024-05-21T13:41:07.357200+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":267,"log_dups_size":0,"ondisk_log_size":267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:09:21.615570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":267,"num_write_kb":729088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"27'2","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.777072+0000","last_change":"2024-05-21T13:35:57.789966+0000","last_active":"2024-05-21T13:41:05.777072+0000","last_peered":"2024-05-21T13:41:05.777072+0000","last_clean":"2024-05-21T13:41:05.777072+0000","last_became_active":"2024-05-21T13:35:57.789213+0000","last_became_peered":"2024-05-21T13:35:57.789213+0000","last_unstale":"2024-05-21T13:41:05.777072+0000","last_undegraded":"2024-05-21T13:41:05.777072+0000","last_fullsized":"2024-05-21T13:41:05.777072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:33:24.183958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"25'2","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:38:10.545909+0000","last_change":"2024-05-21T13:35:56.746878+0000","last_active":"2024-05-21T13:38:10.545909+0000","last_peered":"2024-05-21T13:38:10.545909+0000","last_clean":"2024-05-21T13:38:10.545909+0000","last_became_active":"2024-05-21T13:35:56.746534+0000","last_became_peered":"2024-05-21T13:35:56.746534+0000","last_unstale":"2024-05-21T13:38:10.545909+0000","last_undegraded":"2024-05-21T13:38:10.545909+0000","last_fullsized":"2024-05-21T13:38:10.545909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:45:56.935415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"27'288","reported_seq":308,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.420341+0000","last_change":"2024-05-21T13:36:01.841632+0000","last_active":"2024-05-21T13:41:07.420341+0000","last_peered":"2024-05-21T13:41:07.420341+0000","last_clean":"2024-05-21T13:41:07.420341+0000","last_became_active":"2024-05-21T13:36:01.841216+0000","last_became_peered":"2024-05-21T13:36:01.841216+0000","last_unstale":"2024-05-21T13:41:07.420341+0000","last_undegraded":"2024-05-21T13:41:07.420341+0000","last_fullsized":"2024-05-21T13:41:07.420341+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:49:05.576221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":288,"num_write_kb":786432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"27'7","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.796201+0000","last_change":"2024-05-21T13:35:57.764793+0000","last_active":"2024-05-21T13:41:05.796201+0000","last_peered":"2024-05-21T13:41:05.796201+0000","last_clean":"2024-05-21T13:41:05.796201+0000","last_became_active":"2024-05-21T13:35:57.764017+0000","last_became_peered":"2024-05-21T13:35:57.764017+0000","last_unstale":"2024-05-21T13:41:05.796201+0000","last_undegraded":"2024-05-21T13:41:05.796201+0000","last_fullsized":"2024-05-21T13:41:05.796201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:25:45.006614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"27'5","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:40:20.578707+0000","last_change":"2024-05-21T13:35:56.752278+0000","last_active":"2024-05-21T13:40:20.578707+0000","last_peered":"2024-05-21T13:40:20.578707+0000","last_clean":"2024-05-21T13:40:20.578707+0000","last_became_active":"2024-05-21T13:35:56.751883+0000","last_became_peered":"2024-05-21T13:35:56.751883+0000","last_unstale":"2024-05-21T13:40:20.578707+0000","last_undegraded":"2024-05-21T13:40:20.578707+0000","last_fullsized":"2024-05-21T13:40:20.578707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:08:05.279701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"27'249","reported_seq":269,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.413059+0000","last_change":"2024-05-21T13:36:01.832621+0000","last_active":"2024-05-21T13:41:07.413059+0000","last_peered":"2024-05-21T13:41:07.413059+0000","last_clean":"2024-05-21T13:41:07.413059+0000","last_became_active":"2024-05-21T13:36:01.831609+0000","last_became_peered":"2024-05-21T13:36:01.831609+0000","last_unstale":"2024-05-21T13:41:07.413059+0000","last_undegraded":"2024-05-21T13:41:07.413059+0000","last_fullsized":"2024-05-21T13:41:07.413059+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:26:43.075259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":249,"num_write_kb":679936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"27'5","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.794857+0000","last_change":"2024-05-21T13:35:57.783487+0000","last_active":"2024-05-21T13:41:05.794857+0000","last_peered":"2024-05-21T13:41:05.794857+0000","last_clean":"2024-05-21T13:41:05.794857+0000","last_became_active":"2024-05-21T13:35:57.783150+0000","last_became_peered":"2024-05-21T13:35:57.783150+0000","last_unstale":"2024-05-21T13:41:05.794857+0000","last_undegraded":"2024-05-21T13:41:05.794857+0000","last_fullsized":"2024-05-21T13:41:05.794857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:14:56.991945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"27'22","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:04.606673+0000","last_change":"2024-05-21T13:35:56.745122+0000","last_active":"2024-05-21T13:41:04.606673+0000","last_peered":"2024-05-21T13:41:04.606673+0000","last_clean":"2024-05-21T13:41:04.606673+0000","last_became_active":"2024-05-21T13:35:56.744218+0000","last_became_peered":"2024-05-21T13:35:56.744218+0000","last_unstale":"2024-05-21T13:41:04.606673+0000","last_undegraded":"2024-05-21T13:41:04.606673+0000","last_fullsized":"2024-05-21T13:41:04.606673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:45:03.790591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"27'264","reported_seq":284,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.394488+0000","last_change":"2024-05-21T13:36:01.838971+0000","last_active":"2024-05-21T13:41:07.394488+0000","last_peered":"2024-05-21T13:41:07.394488+0000","last_clean":"2024-05-21T13:41:07.394488+0000","last_became_active":"2024-05-21T13:36:01.837401+0000","last_became_peered":"2024-05-21T13:36:01.837401+0000","last_unstale":"2024-05-21T13:41:07.394488+0000","last_undegraded":"2024-05-21T13:41:07.394488+0000","last_fullsized":"2024-05-21T13:41:07.394488+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:16:25.666568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":720896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"27'9","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.801162+0000","last_change":"2024-05-21T13:35:57.784993+0000","last_active":"2024-05-21T13:41:05.801162+0000","last_peered":"2024-05-21T13:41:05.801162+0000","last_clean":"2024-05-21T13:41:05.801162+0000","last_became_active":"2024-05-21T13:35:57.784664+0000","last_became_peered":"2024-05-21T13:35:57.784664+0000","last_unstale":"2024-05-21T13:41:05.801162+0000","last_undegraded":"2024-05-21T13:41:05.801162+0000","last_fullsized":"2024-05-21T13:41:05.801162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:58:20.045901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"25'1","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:38:05.553882+0000","last_change":"2024-05-21T13:35:56.741285+0000","last_active":"2024-05-21T13:38:05.553882+0000","last_peered":"2024-05-21T13:38:05.553882+0000","last_clean":"2024-05-21T13:38:05.553882+0000","last_became_active":"2024-05-21T13:35:56.740846+0000","last_became_peered":"2024-05-21T13:35:56.740846+0000","last_unstale":"2024-05-21T13:38:05.553882+0000","last_undegraded":"2024-05-21T13:38:05.553882+0000","last_fullsized":"2024-05-21T13:38:05.553882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:34:17.960870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"27'249","reported_seq":269,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.372636+0000","last_change":"2024-05-21T13:36:01.873172+0000","last_active":"2024-05-21T13:41:07.372636+0000","last_peered":"2024-05-21T13:41:07.372636+0000","last_clean":"2024-05-21T13:41:07.372636+0000","last_became_active":"2024-05-21T13:36:01.872085+0000","last_became_peered":"2024-05-21T13:36:01.872085+0000","last_unstale":"2024-05-21T13:41:07.372636+0000","last_undegraded":"2024-05-21T13:41:07.372636+0000","last_fullsized":"2024-05-21T13:41:07.372636+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:24:57.031323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":249,"num_write_kb":679936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"27'5","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.803329+0000","last_change":"2024-05-21T13:35:57.783176+0000","last_active":"2024-05-21T13:41:05.803329+0000","last_peered":"2024-05-21T13:41:05.803329+0000","last_clean":"2024-05-21T13:41:05.803329+0000","last_became_active":"2024-05-21T13:35:57.782517+0000","last_became_peered":"2024-05-21T13:35:57.782517+0000","last_unstale":"2024-05-21T13:41:05.803329+0000","last_undegraded":"2024-05-21T13:41:05.803329+0000","last_fullsized":"2024-05-21T13:41:05.803329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:06:58.203996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:38:04.540828+0000","last_change":"2024-05-21T13:35:56.767544+0000","last_active":"2024-05-21T13:38:04.540828+0000","last_peered":"2024-05-21T13:38:04.540828+0000","last_clean":"2024-05-21T13:38:04.540828+0000","last_became_active":"2024-05-21T13:35:56.764987+0000","last_became_peered":"2024-05-21T13:35:56.764987+0000","last_unstale":"2024-05-21T13:38:04.540828+0000","last_undegraded":"2024-05-21T13:38:04.540828+0000","last_fullsized":"2024-05-21T13:38:04.540828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:12:46.828769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"27'273","reported_seq":293,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.388266+0000","last_change":"2024-05-21T13:36:01.872215+0000","last_active":"2024-05-21T13:41:07.388266+0000","last_peered":"2024-05-21T13:41:07.388266+0000","last_clean":"2024-05-21T13:41:07.388266+0000","last_became_active":"2024-05-21T13:36:01.870831+0000","last_became_peered":"2024-05-21T13:36:01.870831+0000","last_unstale":"2024-05-21T13:41:07.388266+0000","last_undegraded":"2024-05-21T13:41:07.388266+0000","last_fullsized":"2024-05-21T13:41:07.388266+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:04:09.689206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"27'7","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.811209+0000","last_change":"2024-05-21T13:35:57.783616+0000","last_active":"2024-05-21T13:41:05.811209+0000","last_peered":"2024-05-21T13:41:05.811209+0000","last_clean":"2024-05-21T13:41:05.811209+0000","last_became_active":"2024-05-21T13:35:57.780521+0000","last_became_peered":"2024-05-21T13:35:57.780521+0000","last_unstale":"2024-05-21T13:41:05.811209+0000","last_undegraded":"2024-05-21T13:41:05.811209+0000","last_fullsized":"2024-05-21T13:41:05.811209+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:59:44.121631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"25'1","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:38:05.553834+0000","last_change":"2024-05-21T13:35:56.750341+0000","last_active":"2024-05-21T13:38:05.553834+0000","last_peered":"2024-05-21T13:38:05.553834+0000","last_clean":"2024-05-21T13:38:05.553834+0000","last_became_active":"2024-05-21T13:35:56.750006+0000","last_became_peered":"2024-05-21T13:35:56.750006+0000","last_unstale":"2024-05-21T13:38:05.553834+0000","last_undegraded":"2024-05-21T13:38:05.553834+0000","last_fullsized":"2024-05-21T13:38:05.553834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:15:21.416234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"27'264","reported_seq":284,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.398103+0000","last_change":"2024-05-21T13:36:01.873693+0000","last_active":"2024-05-21T13:41:07.398103+0000","last_peered":"2024-05-21T13:41:07.398103+0000","last_clean":"2024-05-21T13:41:07.398103+0000","last_became_active":"2024-05-21T13:36:01.872363+0000","last_became_peered":"2024-05-21T13:36:01.872363+0000","last_unstale":"2024-05-21T13:41:07.398103+0000","last_undegraded":"2024-05-21T13:41:07.398103+0000","last_fullsized":"2024-05-21T13:41:07.398103+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:27:25.974289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":720896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"27'8","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.803951+0000","last_change":"2024-05-21T13:35:57.780809+0000","last_active":"2024-05-21T13:41:05.803951+0000","last_peered":"2024-05-21T13:41:05.803951+0000","last_clean":"2024-05-21T13:41:05.803951+0000","last_became_active":"2024-05-21T13:35:57.780313+0000","last_became_peered":"2024-05-21T13:35:57.780313+0000","last_unstale":"2024-05-21T13:41:05.803951+0000","last_undegraded":"2024-05-21T13:41:05.803951+0000","last_fullsized":"2024-05-21T13:41:05.803951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:43:11.778238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"27'9","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:06.810080+0000","last_change":"2024-05-21T13:35:56.771138+0000","last_active":"2024-05-21T13:41:06.810080+0000","last_peered":"2024-05-21T13:41:06.810080+0000","last_clean":"2024-05-21T13:41:06.810080+0000","last_became_active":"2024-05-21T13:35:56.770465+0000","last_became_peered":"2024-05-21T13:35:56.770465+0000","last_unstale":"2024-05-21T13:41:06.810080+0000","last_undegraded":"2024-05-21T13:41:06.810080+0000","last_fullsized":"2024-05-21T13:41:06.810080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:21:16.702309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":619,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"27'270","reported_seq":290,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.403240+0000","last_change":"2024-05-21T13:36:01.871328+0000","last_active":"2024-05-21T13:41:07.403240+0000","last_peered":"2024-05-21T13:41:07.403240+0000","last_clean":"2024-05-21T13:41:07.403240+0000","last_became_active":"2024-05-21T13:36:01.870678+0000","last_became_peered":"2024-05-21T13:36:01.870678+0000","last_unstale":"2024-05-21T13:41:07.403240+0000","last_undegraded":"2024-05-21T13:41:07.403240+0000","last_fullsized":"2024-05-21T13:41:07.403240+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:22:47.393065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":737280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"27'5","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.809299+0000","last_change":"2024-05-21T13:35:57.782665+0000","last_active":"2024-05-21T13:41:05.809299+0000","last_peered":"2024-05-21T13:41:05.809299+0000","last_clean":"2024-05-21T13:41:05.809299+0000","last_became_active":"2024-05-21T13:35:57.781299+0000","last_became_peered":"2024-05-21T13:35:57.781299+0000","last_unstale":"2024-05-21T13:41:05.809299+0000","last_undegraded":"2024-05-21T13:41:05.809299+0000","last_fullsized":"2024-05-21T13:41:05.809299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:21:22.721124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"25'3","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:38:00.553325+0000","last_change":"2024-05-21T13:35:56.768193+0000","last_active":"2024-05-21T13:38:00.553325+0000","last_peered":"2024-05-21T13:38:00.553325+0000","last_clean":"2024-05-21T13:38:00.553325+0000","last_became_active":"2024-05-21T13:35:56.767788+0000","last_became_peered":"2024-05-21T13:35:56.767788+0000","last_unstale":"2024-05-21T13:38:00.553325+0000","last_undegraded":"2024-05-21T13:38:00.553325+0000","last_fullsized":"2024-05-21T13:38:00.553325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:12:52.911816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"27'339","reported_seq":359,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.377321+0000","last_change":"2024-05-21T13:36:01.860305+0000","last_active":"2024-05-21T13:41:07.377321+0000","last_peered":"2024-05-21T13:41:07.377321+0000","last_clean":"2024-05-21T13:41:07.377321+0000","last_became_active":"2024-05-21T13:36:01.859141+0000","last_became_peered":"2024-05-21T13:36:01.859141+0000","last_unstale":"2024-05-21T13:41:07.377321+0000","last_undegraded":"2024-05-21T13:41:07.377321+0000","last_fullsized":"2024-05-21T13:41:07.377321+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:05:45.203241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":339,"num_write_kb":925696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"27'8","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.809899+0000","last_change":"2024-05-21T13:35:57.775523+0000","last_active":"2024-05-21T13:41:05.809899+0000","last_peered":"2024-05-21T13:41:05.809899+0000","last_clean":"2024-05-21T13:41:05.809899+0000","last_became_active":"2024-05-21T13:35:57.774322+0000","last_became_peered":"2024-05-21T13:35:57.774322+0000","last_unstale":"2024-05-21T13:41:05.809899+0000","last_undegraded":"2024-05-21T13:41:05.809899+0000","last_fullsized":"2024-05-21T13:41:05.809899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:06:35.118540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"25'3","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:38:05.553854+0000","last_change":"2024-05-21T13:35:56.748185+0000","last_active":"2024-05-21T13:38:05.553854+0000","last_peered":"2024-05-21T13:38:05.553854+0000","last_clean":"2024-05-21T13:38:05.553854+0000","last_became_active":"2024-05-21T13:35:56.747823+0000","last_became_peered":"2024-05-21T13:35:56.747823+0000","last_unstale":"2024-05-21T13:38:05.553854+0000","last_undegraded":"2024-05-21T13:38:05.553854+0000","last_fullsized":"2024-05-21T13:38:05.553854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:38:00.235330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":123,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:37:45.542454+0000","last_change":"2024-05-21T13:35:45.682484+0000","last_active":"2024-05-21T13:37:45.542454+0000","last_peered":"2024-05-21T13:37:45.542454+0000","last_clean":"2024-05-21T13:37:45.542454+0000","last_became_active":"2024-05-21T13:35:45.680732+0000","last_became_peered":"2024-05-21T13:35:45.680732+0000","last_unstale":"2024-05-21T13:37:45.542454+0000","last_undegraded":"2024-05-21T13:37:45.542454+0000","last_fullsized":"2024-05-21T13:37:45.542454+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:44.542324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:44.542324+0000","last_clean_scrub_stamp":"2024-05-21T13:35:44.542324+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:16:05.034161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"27'276","reported_seq":296,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.403558+0000","last_change":"2024-05-21T13:36:01.830034+0000","last_active":"2024-05-21T13:41:07.403558+0000","last_peered":"2024-05-21T13:41:07.403558+0000","last_clean":"2024-05-21T13:41:07.403558+0000","last_became_active":"2024-05-21T13:36:01.828957+0000","last_became_peered":"2024-05-21T13:36:01.828957+0000","last_unstale":"2024-05-21T13:41:07.403558+0000","last_undegraded":"2024-05-21T13:41:07.403558+0000","last_fullsized":"2024-05-21T13:41:07.403558+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:21:59.514268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":276,"num_write_kb":753664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"27'7","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.824727+0000","last_change":"2024-05-21T13:35:57.796419+0000","last_active":"2024-05-21T13:41:05.824727+0000","last_peered":"2024-05-21T13:41:05.824727+0000","last_clean":"2024-05-21T13:41:05.824727+0000","last_became_active":"2024-05-21T13:35:57.796050+0000","last_became_peered":"2024-05-21T13:35:57.796050+0000","last_unstale":"2024-05-21T13:41:05.824727+0000","last_undegraded":"2024-05-21T13:41:05.824727+0000","last_fullsized":"2024-05-21T13:41:05.824727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:56:07.121391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"25'3","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:38:15.541313+0000","last_change":"2024-05-21T13:35:56.751619+0000","last_active":"2024-05-21T13:38:15.541313+0000","last_peered":"2024-05-21T13:38:15.541313+0000","last_clean":"2024-05-21T13:38:15.541313+0000","last_became_active":"2024-05-21T13:35:56.748604+0000","last_became_peered":"2024-05-21T13:35:56.748604+0000","last_unstale":"2024-05-21T13:38:15.541313+0000","last_undegraded":"2024-05-21T13:38:15.541313+0000","last_fullsized":"2024-05-21T13:38:15.541313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:19:03.052434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"27'280","reported_seq":300,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.378299+0000","last_change":"2024-05-21T13:36:01.825464+0000","last_active":"2024-05-21T13:41:07.378299+0000","last_peered":"2024-05-21T13:41:07.378299+0000","last_clean":"2024-05-21T13:41:07.378299+0000","last_became_active":"2024-05-21T13:36:01.824653+0000","last_became_peered":"2024-05-21T13:36:01.824653+0000","last_unstale":"2024-05-21T13:41:07.378299+0000","last_undegraded":"2024-05-21T13:41:07.378299+0000","last_fullsized":"2024-05-21T13:41:07.378299+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:29:32.830052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":280,"num_write_kb":761856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"27'6","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.814113+0000","last_change":"2024-05-21T13:35:57.784031+0000","last_active":"2024-05-21T13:41:05.814113+0000","last_peered":"2024-05-21T13:41:05.814113+0000","last_clean":"2024-05-21T13:41:05.814113+0000","last_became_active":"2024-05-21T13:35:57.771695+0000","last_became_peered":"2024-05-21T13:35:57.771695+0000","last_unstale":"2024-05-21T13:41:05.814113+0000","last_undegraded":"2024-05-21T13:41:05.814113+0000","last_fullsized":"2024-05-21T13:41:05.814113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:46:33.308257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:38:14.542410+0000","last_change":"2024-05-21T13:35:56.768166+0000","last_active":"2024-05-21T13:38:14.542410+0000","last_peered":"2024-05-21T13:38:14.542410+0000","last_clean":"2024-05-21T13:38:14.542410+0000","last_became_active":"2024-05-21T13:35:56.767053+0000","last_became_peered":"2024-05-21T13:35:56.767053+0000","last_unstale":"2024-05-21T13:38:14.542410+0000","last_undegraded":"2024-05-21T13:38:14.542410+0000","last_fullsized":"2024-05-21T13:38:14.542410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:10:16.639491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"27'261","reported_seq":281,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.410654+0000","last_change":"2024-05-21T13:36:01.834253+0000","last_active":"2024-05-21T13:41:07.410654+0000","last_peered":"2024-05-21T13:41:07.410654+0000","last_clean":"2024-05-21T13:41:07.410654+0000","last_became_active":"2024-05-21T13:36:01.832972+0000","last_became_peered":"2024-05-21T13:36:01.832972+0000","last_unstale":"2024-05-21T13:41:07.410654+0000","last_undegraded":"2024-05-21T13:41:07.410654+0000","last_fullsized":"2024-05-21T13:41:07.410654+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":261,"log_dups_size":0,"ondisk_log_size":261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:52:05.576063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":261,"num_write_kb":712704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"27'9","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.828863+0000","last_change":"2024-05-21T13:35:57.766504+0000","last_active":"2024-05-21T13:41:05.828863+0000","last_peered":"2024-05-21T13:41:05.828863+0000","last_clean":"2024-05-21T13:41:05.828863+0000","last_became_active":"2024-05-21T13:35:57.765756+0000","last_became_peered":"2024-05-21T13:35:57.765756+0000","last_unstale":"2024-05-21T13:41:05.828863+0000","last_undegraded":"2024-05-21T13:41:05.828863+0000","last_fullsized":"2024-05-21T13:41:05.828863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:52:13.025110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:38:13.534751+0000","last_change":"2024-05-21T13:35:56.770347+0000","last_active":"2024-05-21T13:38:13.534751+0000","last_peered":"2024-05-21T13:38:13.534751+0000","last_clean":"2024-05-21T13:38:13.534751+0000","last_became_active":"2024-05-21T13:35:56.769767+0000","last_became_peered":"2024-05-21T13:35:56.769767+0000","last_unstale":"2024-05-21T13:38:13.534751+0000","last_undegraded":"2024-05-21T13:38:13.534751+0000","last_fullsized":"2024-05-21T13:38:13.534751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:40:01.698967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"27'318","reported_seq":338,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.383172+0000","last_change":"2024-05-21T13:36:01.827091+0000","last_active":"2024-05-21T13:41:07.383172+0000","last_peered":"2024-05-21T13:41:07.383172+0000","last_clean":"2024-05-21T13:41:07.383172+0000","last_became_active":"2024-05-21T13:36:01.826686+0000","last_became_peered":"2024-05-21T13:36:01.826686+0000","last_unstale":"2024-05-21T13:41:07.383172+0000","last_undegraded":"2024-05-21T13:41:07.383172+0000","last_fullsized":"2024-05-21T13:41:07.383172+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":318,"log_dups_size":0,"ondisk_log_size":318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:42:47.638921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":318,"num_write_kb":868352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"27'5","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.816970+0000","last_change":"2024-05-21T13:35:57.781528+0000","last_active":"2024-05-21T13:41:05.816970+0000","last_peered":"2024-05-21T13:41:05.816970+0000","last_clean":"2024-05-21T13:41:05.816970+0000","last_became_active":"2024-05-21T13:35:57.781111+0000","last_became_peered":"2024-05-21T13:35:57.781111+0000","last_unstale":"2024-05-21T13:41:05.816970+0000","last_undegraded":"2024-05-21T13:41:05.816970+0000","last_fullsized":"2024-05-21T13:41:05.816970+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:15:43.847640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"25'2","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:38:15.546666+0000","last_change":"2024-05-21T13:35:56.755413+0000","last_active":"2024-05-21T13:38:15.546666+0000","last_peered":"2024-05-21T13:38:15.546666+0000","last_clean":"2024-05-21T13:38:15.546666+0000","last_became_active":"2024-05-21T13:35:56.755158+0000","last_became_peered":"2024-05-21T13:35:56.755158+0000","last_unstale":"2024-05-21T13:38:15.546666+0000","last_undegraded":"2024-05-21T13:38:15.546666+0000","last_fullsized":"2024-05-21T13:38:15.546666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:23:05.102098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"27'258","reported_seq":278,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.275439+0000","last_change":"2024-05-21T13:36:01.827237+0000","last_active":"2024-05-21T13:41:07.275439+0000","last_peered":"2024-05-21T13:41:07.275439+0000","last_clean":"2024-05-21T13:41:07.275439+0000","last_became_active":"2024-05-21T13:36:01.826374+0000","last_became_peered":"2024-05-21T13:36:01.826374+0000","last_unstale":"2024-05-21T13:41:07.275439+0000","last_undegraded":"2024-05-21T13:41:07.275439+0000","last_fullsized":"2024-05-21T13:41:07.275439+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":258,"log_dups_size":0,"ondisk_log_size":258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:12:33.528068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":258,"num_write_kb":704512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"27'6","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.815755+0000","last_change":"2024-05-21T13:35:57.787940+0000","last_active":"2024-05-21T13:41:05.815755+0000","last_peered":"2024-05-21T13:41:05.815755+0000","last_clean":"2024-05-21T13:41:05.815755+0000","last_became_active":"2024-05-21T13:35:57.787544+0000","last_became_peered":"2024-05-21T13:35:57.787544+0000","last_unstale":"2024-05-21T13:41:05.815755+0000","last_undegraded":"2024-05-21T13:41:05.815755+0000","last_fullsized":"2024-05-21T13:41:05.815755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:46:20.335316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"27'16","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:40:38.563607+0000","last_change":"2024-05-21T13:35:56.756262+0000","last_active":"2024-05-21T13:40:38.563607+0000","last_peered":"2024-05-21T13:40:38.563607+0000","last_clean":"2024-05-21T13:40:38.563607+0000","last_became_active":"2024-05-21T13:35:56.752342+0000","last_became_peered":"2024-05-21T13:35:56.752342+0000","last_unstale":"2024-05-21T13:40:38.563607+0000","last_undegraded":"2024-05-21T13:40:38.563607+0000","last_fullsized":"2024-05-21T13:40:38.563607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:59:09.541382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"27'360","reported_seq":380,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.427307+0000","last_change":"2024-05-21T13:36:01.859498+0000","last_active":"2024-05-21T13:41:07.427307+0000","last_peered":"2024-05-21T13:41:07.427307+0000","last_clean":"2024-05-21T13:41:07.427307+0000","last_became_active":"2024-05-21T13:36:01.857707+0000","last_became_peered":"2024-05-21T13:36:01.857707+0000","last_unstale":"2024-05-21T13:41:07.427307+0000","last_undegraded":"2024-05-21T13:41:07.427307+0000","last_fullsized":"2024-05-21T13:41:07.427307+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:38:06.966814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":360,"num_write_kb":983040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"27'6","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.806663+0000","last_change":"2024-05-21T13:35:57.783007+0000","last_active":"2024-05-21T13:41:05.806663+0000","last_peered":"2024-05-21T13:41:05.806663+0000","last_clean":"2024-05-21T13:41:05.806663+0000","last_became_active":"2024-05-21T13:35:57.782330+0000","last_became_peered":"2024-05-21T13:35:57.782330+0000","last_unstale":"2024-05-21T13:41:05.806663+0000","last_undegraded":"2024-05-21T13:41:05.806663+0000","last_fullsized":"2024-05-21T13:41:05.806663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:26:14.697766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"25'3","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:38:20.547215+0000","last_change":"2024-05-21T13:35:56.745787+0000","last_active":"2024-05-21T13:38:20.547215+0000","last_peered":"2024-05-21T13:38:20.547215+0000","last_clean":"2024-05-21T13:38:20.547215+0000","last_became_active":"2024-05-21T13:35:56.745202+0000","last_became_peered":"2024-05-21T13:35:56.745202+0000","last_unstale":"2024-05-21T13:38:20.547215+0000","last_undegraded":"2024-05-21T13:38:20.547215+0000","last_fullsized":"2024-05-21T13:38:20.547215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:31:13.498003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"27'273","reported_seq":293,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.415841+0000","last_change":"2024-05-21T13:36:01.858550+0000","last_active":"2024-05-21T13:41:07.415841+0000","last_peered":"2024-05-21T13:41:07.415841+0000","last_clean":"2024-05-21T13:41:07.415841+0000","last_became_active":"2024-05-21T13:36:01.857716+0000","last_became_peered":"2024-05-21T13:36:01.857716+0000","last_unstale":"2024-05-21T13:41:07.415841+0000","last_undegraded":"2024-05-21T13:41:07.415841+0000","last_fullsized":"2024-05-21T13:41:07.415841+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:48:32.490678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"27'15","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.824416+0000","last_change":"2024-05-21T13:35:57.799702+0000","last_active":"2024-05-21T13:41:05.824416+0000","last_peered":"2024-05-21T13:41:05.824416+0000","last_clean":"2024-05-21T13:41:05.824416+0000","last_became_active":"2024-05-21T13:35:57.799225+0000","last_became_peered":"2024-05-21T13:35:57.799225+0000","last_unstale":"2024-05-21T13:41:05.824416+0000","last_undegraded":"2024-05-21T13:41:05.824416+0000","last_fullsized":"2024-05-21T13:41:05.824416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:29:54.094448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"25'3","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:38:20.556128+0000","last_change":"2024-05-21T13:35:56.742650+0000","last_active":"2024-05-21T13:38:20.556128+0000","last_peered":"2024-05-21T13:38:20.556128+0000","last_clean":"2024-05-21T13:38:20.556128+0000","last_became_active":"2024-05-21T13:35:56.742296+0000","last_became_peered":"2024-05-21T13:35:56.742296+0000","last_unstale":"2024-05-21T13:38:20.556128+0000","last_undegraded":"2024-05-21T13:38:20.556128+0000","last_fullsized":"2024-05-21T13:38:20.556128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:18:55.514845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"27'273","reported_seq":293,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.341060+0000","last_change":"2024-05-21T13:36:01.873708+0000","last_active":"2024-05-21T13:41:07.341060+0000","last_peered":"2024-05-21T13:41:07.341060+0000","last_clean":"2024-05-21T13:41:07.341060+0000","last_became_active":"2024-05-21T13:36:01.872320+0000","last_became_peered":"2024-05-21T13:36:01.872320+0000","last_unstale":"2024-05-21T13:41:07.341060+0000","last_undegraded":"2024-05-21T13:41:07.341060+0000","last_fullsized":"2024-05-21T13:41:07.341060+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:01:15.545756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"27'10","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.819407+0000","last_change":"2024-05-21T13:35:57.802763+0000","last_active":"2024-05-21T13:41:05.819407+0000","last_peered":"2024-05-21T13:41:05.819407+0000","last_clean":"2024-05-21T13:41:05.819407+0000","last_became_active":"2024-05-21T13:35:57.802433+0000","last_became_peered":"2024-05-21T13:35:57.802433+0000","last_unstale":"2024-05-21T13:41:05.819407+0000","last_undegraded":"2024-05-21T13:41:05.819407+0000","last_fullsized":"2024-05-21T13:41:05.819407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:09:48.463186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"25'6","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:38:20.545542+0000","last_change":"2024-05-21T13:35:56.754087+0000","last_active":"2024-05-21T13:38:20.545542+0000","last_peered":"2024-05-21T13:38:20.545542+0000","last_clean":"2024-05-21T13:38:20.545542+0000","last_became_active":"2024-05-21T13:35:56.753319+0000","last_became_peered":"2024-05-21T13:35:56.753319+0000","last_unstale":"2024-05-21T13:38:20.545542+0000","last_undegraded":"2024-05-21T13:38:20.545542+0000","last_fullsized":"2024-05-21T13:38:20.545542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:19:21.276993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"27'327","reported_seq":347,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.315452+0000","last_change":"2024-05-21T13:36:01.836017+0000","last_active":"2024-05-21T13:41:07.315452+0000","last_peered":"2024-05-21T13:41:07.315452+0000","last_clean":"2024-05-21T13:41:07.315452+0000","last_became_active":"2024-05-21T13:36:01.835450+0000","last_became_peered":"2024-05-21T13:36:01.835450+0000","last_unstale":"2024-05-21T13:41:07.315452+0000","last_undegraded":"2024-05-21T13:41:07.315452+0000","last_fullsized":"2024-05-21T13:41:07.315452+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:05:56.077605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":327,"num_write_kb":892928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"27'6","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.819794+0000","last_change":"2024-05-21T13:35:57.787177+0000","last_active":"2024-05-21T13:41:05.819794+0000","last_peered":"2024-05-21T13:41:05.819794+0000","last_clean":"2024-05-21T13:41:05.819794+0000","last_became_active":"2024-05-21T13:35:57.786401+0000","last_became_peered":"2024-05-21T13:35:57.786401+0000","last_unstale":"2024-05-21T13:41:05.819794+0000","last_undegraded":"2024-05-21T13:41:05.819794+0000","last_fullsized":"2024-05-21T13:41:05.819794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:17:18.939002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'99","reported_seq":127,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.851553+0000","last_change":"2024-05-21T13:35:56.751229+0000","last_active":"2024-05-21T13:41:05.851553+0000","last_peered":"2024-05-21T13:41:05.851553+0000","last_clean":"2024-05-21T13:41:05.851553+0000","last_became_active":"2024-05-21T13:35:56.750831+0000","last_became_peered":"2024-05-21T13:35:56.750831+0000","last_unstale":"2024-05-21T13:41:05.851553+0000","last_undegraded":"2024-05-21T13:41:05.851553+0000","last_fullsized":"2024-05-21T13:41:05.851553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:03:40.186241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":208737,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":99,"num_write_kb":246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"27'289","reported_seq":309,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.407451+0000","last_change":"2024-05-21T13:36:01.832691+0000","last_active":"2024-05-21T13:41:07.407451+0000","last_peered":"2024-05-21T13:41:07.407451+0000","last_clean":"2024-05-21T13:41:07.407451+0000","last_became_active":"2024-05-21T13:36:01.831476+0000","last_became_peered":"2024-05-21T13:36:01.831476+0000","last_unstale":"2024-05-21T13:41:07.407451+0000","last_undegraded":"2024-05-21T13:41:07.407451+0000","last_fullsized":"2024-05-21T13:41:07.407451+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":289,"log_dups_size":0,"ondisk_log_size":289,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:08:38.092592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":288,"num_write_kb":786432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"27'11","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.817770+0000","last_change":"2024-05-21T13:35:57.788547+0000","last_active":"2024-05-21T13:41:05.817770+0000","last_peered":"2024-05-21T13:41:05.817770+0000","last_clean":"2024-05-21T13:41:05.817770+0000","last_became_active":"2024-05-21T13:35:57.787785+0000","last_became_peered":"2024-05-21T13:35:57.787785+0000","last_unstale":"2024-05-21T13:41:05.817770+0000","last_undegraded":"2024-05-21T13:41:05.817770+0000","last_fullsized":"2024-05-21T13:41:05.817770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:51:08.781399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"27'10","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:08.320430+0000","last_change":"2024-05-21T13:35:56.760557+0000","last_active":"2024-05-21T13:41:08.320430+0000","last_peered":"2024-05-21T13:41:08.320430+0000","last_clean":"2024-05-21T13:41:08.320430+0000","last_became_active":"2024-05-21T13:35:56.759728+0000","last_became_peered":"2024-05-21T13:35:56.759728+0000","last_unstale":"2024-05-21T13:41:08.320430+0000","last_undegraded":"2024-05-21T13:41:08.320430+0000","last_fullsized":"2024-05-21T13:41:08.320430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:56:19.754940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"27'297","reported_seq":317,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.383028+0000","last_change":"2024-05-21T13:36:01.861622+0000","last_active":"2024-05-21T13:41:07.383028+0000","last_peered":"2024-05-21T13:41:07.383028+0000","last_clean":"2024-05-21T13:41:07.383028+0000","last_became_active":"2024-05-21T13:36:01.861172+0000","last_became_peered":"2024-05-21T13:36:01.861172+0000","last_unstale":"2024-05-21T13:41:07.383028+0000","last_undegraded":"2024-05-21T13:41:07.383028+0000","last_fullsized":"2024-05-21T13:41:07.383028+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:39:53.211812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":297,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"27'9","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.819358+0000","last_change":"2024-05-21T13:35:57.804520+0000","last_active":"2024-05-21T13:41:05.819358+0000","last_peered":"2024-05-21T13:41:05.819358+0000","last_clean":"2024-05-21T13:41:05.819358+0000","last_became_active":"2024-05-21T13:35:57.804139+0000","last_became_peered":"2024-05-21T13:35:57.804139+0000","last_unstale":"2024-05-21T13:41:05.819358+0000","last_undegraded":"2024-05-21T13:41:05.819358+0000","last_fullsized":"2024-05-21T13:41:05.819358+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:21:52.433019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"25'2","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:38:25.548413+0000","last_change":"2024-05-21T13:35:56.733821+0000","last_active":"2024-05-21T13:38:25.548413+0000","last_peered":"2024-05-21T13:38:25.548413+0000","last_clean":"2024-05-21T13:38:25.548413+0000","last_became_active":"2024-05-21T13:35:56.732488+0000","last_became_peered":"2024-05-21T13:35:56.732488+0000","last_unstale":"2024-05-21T13:38:25.548413+0000","last_undegraded":"2024-05-21T13:38:25.548413+0000","last_fullsized":"2024-05-21T13:38:25.548413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:10:01.786931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"27'297","reported_seq":317,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.370538+0000","last_change":"2024-05-21T13:36:01.868781+0000","last_active":"2024-05-21T13:41:07.370538+0000","last_peered":"2024-05-21T13:41:07.370538+0000","last_clean":"2024-05-21T13:41:07.370538+0000","last_became_active":"2024-05-21T13:36:01.864254+0000","last_became_peered":"2024-05-21T13:36:01.864254+0000","last_unstale":"2024-05-21T13:41:07.370538+0000","last_undegraded":"2024-05-21T13:41:07.370538+0000","last_fullsized":"2024-05-21T13:41:07.370538+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:34:12.632333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":297,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"27'10","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.820694+0000","last_change":"2024-05-21T13:35:57.788313+0000","last_active":"2024-05-21T13:41:05.820694+0000","last_peered":"2024-05-21T13:41:05.820694+0000","last_clean":"2024-05-21T13:41:05.820694+0000","last_became_active":"2024-05-21T13:35:57.787963+0000","last_became_peered":"2024-05-21T13:35:57.787963+0000","last_unstale":"2024-05-21T13:41:05.820694+0000","last_undegraded":"2024-05-21T13:41:05.820694+0000","last_fullsized":"2024-05-21T13:41:05.820694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:16:21.586571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"27'5","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:40:50.568172+0000","last_change":"2024-05-21T13:35:56.748334+0000","last_active":"2024-05-21T13:40:50.568172+0000","last_peered":"2024-05-21T13:40:50.568172+0000","last_clean":"2024-05-21T13:40:50.568172+0000","last_became_active":"2024-05-21T13:35:56.748049+0000","last_became_peered":"2024-05-21T13:35:56.748049+0000","last_unstale":"2024-05-21T13:40:50.568172+0000","last_undegraded":"2024-05-21T13:40:50.568172+0000","last_fullsized":"2024-05-21T13:40:50.568172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:59:02.802905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"27'327","reported_seq":347,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.407451+0000","last_change":"2024-05-21T13:36:01.856216+0000","last_active":"2024-05-21T13:41:07.407451+0000","last_peered":"2024-05-21T13:41:07.407451+0000","last_clean":"2024-05-21T13:41:07.407451+0000","last_became_active":"2024-05-21T13:36:01.855417+0000","last_became_peered":"2024-05-21T13:36:01.855417+0000","last_unstale":"2024-05-21T13:41:07.407451+0000","last_undegraded":"2024-05-21T13:41:07.407451+0000","last_fullsized":"2024-05-21T13:41:07.407451+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:36:01.423944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":327,"num_write_kb":892928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"27'273","reported_seq":293,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.396046+0000","last_change":"2024-05-21T13:36:01.838966+0000","last_active":"2024-05-21T13:41:07.396046+0000","last_peered":"2024-05-21T13:41:07.396046+0000","last_clean":"2024-05-21T13:41:07.396046+0000","last_became_active":"2024-05-21T13:36:01.837777+0000","last_became_peered":"2024-05-21T13:36:01.837777+0000","last_unstale":"2024-05-21T13:41:07.396046+0000","last_undegraded":"2024-05-21T13:41:07.396046+0000","last_fullsized":"2024-05-21T13:41:07.396046+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:40:55.688338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"27'11","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.798229+0000","last_change":"2024-05-21T13:35:57.762719+0000","last_active":"2024-05-21T13:41:05.798229+0000","last_peered":"2024-05-21T13:41:05.798229+0000","last_clean":"2024-05-21T13:41:05.798229+0000","last_became_active":"2024-05-21T13:35:57.762071+0000","last_became_peered":"2024-05-21T13:35:57.762071+0000","last_unstale":"2024-05-21T13:41:05.798229+0000","last_undegraded":"2024-05-21T13:41:05.798229+0000","last_fullsized":"2024-05-21T13:41:05.798229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:55:37.631695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"25'1","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:38:25.556862+0000","last_change":"2024-05-21T13:35:56.751481+0000","last_active":"2024-05-21T13:38:25.556862+0000","last_peered":"2024-05-21T13:38:25.556862+0000","last_clean":"2024-05-21T13:38:25.556862+0000","last_became_active":"2024-05-21T13:35:56.751201+0000","last_became_peered":"2024-05-21T13:35:56.751201+0000","last_unstale":"2024-05-21T13:38:25.556862+0000","last_undegraded":"2024-05-21T13:38:25.556862+0000","last_fullsized":"2024-05-21T13:38:25.556862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:33:28.720246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"27'267","reported_seq":287,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.412161+0000","last_change":"2024-05-21T13:36:01.837042+0000","last_active":"2024-05-21T13:41:07.412161+0000","last_peered":"2024-05-21T13:41:07.412161+0000","last_clean":"2024-05-21T13:41:07.412161+0000","last_became_active":"2024-05-21T13:36:01.836194+0000","last_became_peered":"2024-05-21T13:36:01.836194+0000","last_unstale":"2024-05-21T13:41:07.412161+0000","last_undegraded":"2024-05-21T13:41:07.412161+0000","last_fullsized":"2024-05-21T13:41:07.412161+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":267,"log_dups_size":0,"ondisk_log_size":267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:15:50.751693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":267,"num_write_kb":729088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"27'8","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.804092+0000","last_change":"2024-05-21T13:35:57.788838+0000","last_active":"2024-05-21T13:41:05.804092+0000","last_peered":"2024-05-21T13:41:05.804092+0000","last_clean":"2024-05-21T13:41:05.804092+0000","last_became_active":"2024-05-21T13:35:57.786307+0000","last_became_peered":"2024-05-21T13:35:57.786307+0000","last_unstale":"2024-05-21T13:41:05.804092+0000","last_undegraded":"2024-05-21T13:41:05.804092+0000","last_fullsized":"2024-05-21T13:41:05.804092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:52:09.086807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"25'2","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:38:25.543227+0000","last_change":"2024-05-21T13:35:56.746564+0000","last_active":"2024-05-21T13:38:25.543227+0000","last_peered":"2024-05-21T13:38:25.543227+0000","last_clean":"2024-05-21T13:38:25.543227+0000","last_became_active":"2024-05-21T13:35:56.745884+0000","last_became_peered":"2024-05-21T13:35:56.745884+0000","last_unstale":"2024-05-21T13:38:25.543227+0000","last_undegraded":"2024-05-21T13:38:25.543227+0000","last_fullsized":"2024-05-21T13:38:25.543227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:01:44.738607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"25'3","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:38:30.557677+0000","last_change":"2024-05-21T13:35:56.753930+0000","last_active":"2024-05-21T13:38:30.557677+0000","last_peered":"2024-05-21T13:38:30.557677+0000","last_clean":"2024-05-21T13:38:30.557677+0000","last_became_active":"2024-05-21T13:35:56.753499+0000","last_became_peered":"2024-05-21T13:35:56.753499+0000","last_unstale":"2024-05-21T13:38:30.557677+0000","last_undegraded":"2024-05-21T13:38:30.557677+0000","last_fullsized":"2024-05-21T13:38:30.557677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:40:51.516544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"27'8","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.797802+0000","last_change":"2024-05-21T13:36:39.802963+0000","last_active":"2024-05-21T13:41:05.797802+0000","last_peered":"2024-05-21T13:41:05.797802+0000","last_clean":"2024-05-21T13:41:05.797802+0000","last_became_active":"2024-05-21T13:36:39.802110+0000","last_became_peered":"2024-05-21T13:36:39.802110+0000","last_unstale":"2024-05-21T13:41:05.797802+0000","last_undegraded":"2024-05-21T13:41:05.797802+0000","last_fullsized":"2024-05-21T13:41:05.797802+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:41:46.124629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"27'297","reported_seq":317,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.324032+0000","last_change":"2024-05-21T13:36:01.844240+0000","last_active":"2024-05-21T13:41:07.324032+0000","last_peered":"2024-05-21T13:41:07.324032+0000","last_clean":"2024-05-21T13:41:07.324032+0000","last_became_active":"2024-05-21T13:36:01.842792+0000","last_became_peered":"2024-05-21T13:36:01.842792+0000","last_unstale":"2024-05-21T13:41:07.324032+0000","last_undegraded":"2024-05-21T13:41:07.324032+0000","last_fullsized":"2024-05-21T13:41:07.324032+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:19:54.016465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":297,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"27'7","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:40:59.597142+0000","last_change":"2024-05-21T13:35:56.770864+0000","last_active":"2024-05-21T13:40:59.597142+0000","last_peered":"2024-05-21T13:40:59.597142+0000","last_clean":"2024-05-21T13:40:59.597142+0000","last_became_active":"2024-05-21T13:35:56.766873+0000","last_became_peered":"2024-05-21T13:35:56.766873+0000","last_unstale":"2024-05-21T13:40:59.597142+0000","last_undegraded":"2024-05-21T13:40:59.597142+0000","last_fullsized":"2024-05-21T13:40:59.597142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:13:02.633858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"27'7","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.807437+0000","last_change":"2024-05-21T13:35:57.787563+0000","last_active":"2024-05-21T13:41:05.807437+0000","last_peered":"2024-05-21T13:41:05.807437+0000","last_clean":"2024-05-21T13:41:05.807437+0000","last_became_active":"2024-05-21T13:35:57.787255+0000","last_became_peered":"2024-05-21T13:35:57.787255+0000","last_unstale":"2024-05-21T13:41:05.807437+0000","last_undegraded":"2024-05-21T13:41:05.807437+0000","last_fullsized":"2024-05-21T13:41:05.807437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:32:49.325049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"27'312","reported_seq":332,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.373780+0000","last_change":"2024-05-21T13:36:01.868514+0000","last_active":"2024-05-21T13:41:07.373780+0000","last_peered":"2024-05-21T13:41:07.373780+0000","last_clean":"2024-05-21T13:41:07.373780+0000","last_became_active":"2024-05-21T13:36:01.867522+0000","last_became_peered":"2024-05-21T13:36:01.867522+0000","last_unstale":"2024-05-21T13:41:07.373780+0000","last_undegraded":"2024-05-21T13:41:07.373780+0000","last_fullsized":"2024-05-21T13:41:07.373780+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:19:13.533784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":312,"num_write_kb":851968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"27'9","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.809025+0000","last_change":"2024-05-21T13:35:57.782641+0000","last_active":"2024-05-21T13:41:05.809025+0000","last_peered":"2024-05-21T13:41:05.809025+0000","last_clean":"2024-05-21T13:41:05.809025+0000","last_became_active":"2024-05-21T13:35:57.782233+0000","last_became_peered":"2024-05-21T13:35:57.782233+0000","last_unstale":"2024-05-21T13:41:05.809025+0000","last_undegraded":"2024-05-21T13:41:05.809025+0000","last_fullsized":"2024-05-21T13:41:05.809025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:55:18.808229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"27'12","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.792142+0000","last_change":"2024-05-21T13:35:57.770591+0000","last_active":"2024-05-21T13:41:05.792142+0000","last_peered":"2024-05-21T13:41:05.792142+0000","last_clean":"2024-05-21T13:41:05.792142+0000","last_became_active":"2024-05-21T13:35:57.769785+0000","last_became_peered":"2024-05-21T13:35:57.769785+0000","last_unstale":"2024-05-21T13:41:05.792142+0000","last_undegraded":"2024-05-21T13:41:05.792142+0000","last_fullsized":"2024-05-21T13:41:05.792142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:18:28.168393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"27'8","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.817815+0000","last_change":"2024-05-21T13:35:57.799153+0000","last_active":"2024-05-21T13:41:05.817815+0000","last_peered":"2024-05-21T13:41:05.817815+0000","last_clean":"2024-05-21T13:41:05.817815+0000","last_became_active":"2024-05-21T13:35:57.796495+0000","last_became_peered":"2024-05-21T13:35:57.796495+0000","last_unstale":"2024-05-21T13:41:05.817815+0000","last_undegraded":"2024-05-21T13:41:05.817815+0000","last_fullsized":"2024-05-21T13:41:05.817815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:53:04.109036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"27'7","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.800426+0000","last_change":"2024-05-21T13:35:57.784335+0000","last_active":"2024-05-21T13:41:05.800426+0000","last_peered":"2024-05-21T13:41:05.800426+0000","last_clean":"2024-05-21T13:41:05.800426+0000","last_became_active":"2024-05-21T13:35:57.783968+0000","last_became_peered":"2024-05-21T13:35:57.783968+0000","last_unstale":"2024-05-21T13:41:05.800426+0000","last_undegraded":"2024-05-21T13:41:05.800426+0000","last_fullsized":"2024-05-21T13:41:05.800426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:57:20.832617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"27'4","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.818581+0000","last_change":"2024-05-21T13:35:57.795153+0000","last_active":"2024-05-21T13:41:05.818581+0000","last_peered":"2024-05-21T13:41:05.818581+0000","last_clean":"2024-05-21T13:41:05.818581+0000","last_became_active":"2024-05-21T13:35:57.794885+0000","last_became_peered":"2024-05-21T13:35:57.794885+0000","last_unstale":"2024-05-21T13:41:05.818581+0000","last_undegraded":"2024-05-21T13:41:05.818581+0000","last_fullsized":"2024-05-21T13:41:05.818581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:17:00.454371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"27'6","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.789707+0000","last_change":"2024-05-21T13:35:57.778916+0000","last_active":"2024-05-21T13:41:05.789707+0000","last_peered":"2024-05-21T13:41:05.789707+0000","last_clean":"2024-05-21T13:41:05.789707+0000","last_became_active":"2024-05-21T13:35:57.778171+0000","last_became_peered":"2024-05-21T13:35:57.778171+0000","last_unstale":"2024-05-21T13:41:05.789707+0000","last_undegraded":"2024-05-21T13:41:05.789707+0000","last_fullsized":"2024-05-21T13:41:05.789707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:15:37.425836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"27'15","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.820287+0000","last_change":"2024-05-21T13:35:57.791367+0000","last_active":"2024-05-21T13:41:05.820287+0000","last_peered":"2024-05-21T13:41:05.820287+0000","last_clean":"2024-05-21T13:41:05.820287+0000","last_became_active":"2024-05-21T13:35:57.790971+0000","last_became_peered":"2024-05-21T13:35:57.790971+0000","last_unstale":"2024-05-21T13:41:05.820287+0000","last_undegraded":"2024-05-21T13:41:05.820287+0000","last_fullsized":"2024-05-21T13:41:05.820287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:14:47.428631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"27'2","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.810357+0000","last_change":"2024-05-21T13:35:57.785257+0000","last_active":"2024-05-21T13:41:05.810357+0000","last_peered":"2024-05-21T13:41:05.810357+0000","last_clean":"2024-05-21T13:41:05.810357+0000","last_became_active":"2024-05-21T13:35:57.781533+0000","last_became_peered":"2024-05-21T13:35:57.781533+0000","last_unstale":"2024-05-21T13:41:05.810357+0000","last_undegraded":"2024-05-21T13:41:05.810357+0000","last_fullsized":"2024-05-21T13:41:05.810357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:18:32.591803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"27'6","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.815829+0000","last_change":"2024-05-21T13:35:57.799128+0000","last_active":"2024-05-21T13:41:05.815829+0000","last_peered":"2024-05-21T13:41:05.815829+0000","last_clean":"2024-05-21T13:41:05.815829+0000","last_became_active":"2024-05-21T13:35:57.797044+0000","last_became_peered":"2024-05-21T13:35:57.797044+0000","last_unstale":"2024-05-21T13:41:05.815829+0000","last_undegraded":"2024-05-21T13:41:05.815829+0000","last_fullsized":"2024-05-21T13:41:05.815829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:57:13.472309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"27'8","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.810610+0000","last_change":"2024-05-21T13:35:57.789768+0000","last_active":"2024-05-21T13:41:05.810610+0000","last_peered":"2024-05-21T13:41:05.810610+0000","last_clean":"2024-05-21T13:41:05.810610+0000","last_became_active":"2024-05-21T13:35:57.789474+0000","last_became_peered":"2024-05-21T13:35:57.789474+0000","last_unstale":"2024-05-21T13:41:05.810610+0000","last_undegraded":"2024-05-21T13:41:05.810610+0000","last_fullsized":"2024-05-21T13:41:05.810610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:42:53.993281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"27'10","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.817266+0000","last_change":"2024-05-21T13:35:57.756607+0000","last_active":"2024-05-21T13:41:05.817266+0000","last_peered":"2024-05-21T13:41:05.817266+0000","last_clean":"2024-05-21T13:41:05.817266+0000","last_became_active":"2024-05-21T13:35:57.755889+0000","last_became_peered":"2024-05-21T13:35:57.755889+0000","last_unstale":"2024-05-21T13:41:05.817266+0000","last_undegraded":"2024-05-21T13:41:05.817266+0000","last_fullsized":"2024-05-21T13:41:05.817266+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:16:19.541597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"27'11","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.810097+0000","last_change":"2024-05-21T13:35:57.775322+0000","last_active":"2024-05-21T13:41:05.810097+0000","last_peered":"2024-05-21T13:41:05.810097+0000","last_clean":"2024-05-21T13:41:05.810097+0000","last_became_active":"2024-05-21T13:35:57.774386+0000","last_became_peered":"2024-05-21T13:35:57.774386+0000","last_unstale":"2024-05-21T13:41:05.810097+0000","last_undegraded":"2024-05-21T13:41:05.810097+0000","last_fullsized":"2024-05-21T13:41:05.810097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:01:02.106172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"27'8","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.828971+0000","last_change":"2024-05-21T13:35:57.769931+0000","last_active":"2024-05-21T13:41:05.828971+0000","last_peered":"2024-05-21T13:41:05.828971+0000","last_clean":"2024-05-21T13:41:05.828971+0000","last_became_active":"2024-05-21T13:35:57.769149+0000","last_became_peered":"2024-05-21T13:35:57.769149+0000","last_unstale":"2024-05-21T13:41:05.828971+0000","last_undegraded":"2024-05-21T13:41:05.828971+0000","last_fullsized":"2024-05-21T13:41:05.828971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:55:56.268307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"27'7","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.824572+0000","last_change":"2024-05-21T13:35:57.796153+0000","last_active":"2024-05-21T13:41:05.824572+0000","last_peered":"2024-05-21T13:41:05.824572+0000","last_clean":"2024-05-21T13:41:05.824572+0000","last_became_active":"2024-05-21T13:35:57.795799+0000","last_became_peered":"2024-05-21T13:35:57.795799+0000","last_unstale":"2024-05-21T13:41:05.824572+0000","last_undegraded":"2024-05-21T13:41:05.824572+0000","last_fullsized":"2024-05-21T13:41:05.824572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:52:04.794391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"27'10","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.796637+0000","last_change":"2024-05-21T13:35:57.776414+0000","last_active":"2024-05-21T13:41:05.796637+0000","last_peered":"2024-05-21T13:41:05.796637+0000","last_clean":"2024-05-21T13:41:05.796637+0000","last_became_active":"2024-05-21T13:35:57.775573+0000","last_became_peered":"2024-05-21T13:35:57.775573+0000","last_unstale":"2024-05-21T13:41:05.796637+0000","last_undegraded":"2024-05-21T13:41:05.796637+0000","last_fullsized":"2024-05-21T13:41:05.796637+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:47:47.624662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"27'8","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.823028+0000","last_change":"2024-05-21T13:35:57.799673+0000","last_active":"2024-05-21T13:41:05.823028+0000","last_peered":"2024-05-21T13:41:05.823028+0000","last_clean":"2024-05-21T13:41:05.823028+0000","last_became_active":"2024-05-21T13:35:57.799313+0000","last_became_peered":"2024-05-21T13:35:57.799313+0000","last_unstale":"2024-05-21T13:41:05.823028+0000","last_undegraded":"2024-05-21T13:41:05.823028+0000","last_fullsized":"2024-05-21T13:41:05.823028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:40:52.516216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"27'9","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.815899+0000","last_change":"2024-05-21T13:35:57.790705+0000","last_active":"2024-05-21T13:41:05.815899+0000","last_peered":"2024-05-21T13:41:05.815899+0000","last_clean":"2024-05-21T13:41:05.815899+0000","last_became_active":"2024-05-21T13:35:57.787735+0000","last_became_peered":"2024-05-21T13:35:57.787735+0000","last_unstale":"2024-05-21T13:41:05.815899+0000","last_undegraded":"2024-05-21T13:41:05.815899+0000","last_fullsized":"2024-05-21T13:41:05.815899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:17:24.376182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"27'7","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.825286+0000","last_change":"2024-05-21T13:35:57.786838+0000","last_active":"2024-05-21T13:41:05.825286+0000","last_peered":"2024-05-21T13:41:05.825286+0000","last_clean":"2024-05-21T13:41:05.825286+0000","last_became_active":"2024-05-21T13:35:57.786403+0000","last_became_peered":"2024-05-21T13:35:57.786403+0000","last_unstale":"2024-05-21T13:41:05.825286+0000","last_undegraded":"2024-05-21T13:41:05.825286+0000","last_fullsized":"2024-05-21T13:41:05.825286+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:29:28.760793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"27'8","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.791110+0000","last_change":"2024-05-21T13:35:57.783561+0000","last_active":"2024-05-21T13:41:05.791110+0000","last_peered":"2024-05-21T13:41:05.791110+0000","last_clean":"2024-05-21T13:41:05.791110+0000","last_became_active":"2024-05-21T13:35:57.783060+0000","last_became_peered":"2024-05-21T13:35:57.783060+0000","last_unstale":"2024-05-21T13:41:05.791110+0000","last_undegraded":"2024-05-21T13:41:05.791110+0000","last_fullsized":"2024-05-21T13:41:05.791110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:27:27.261449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"27'10","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.817817+0000","last_change":"2024-05-21T13:35:57.788210+0000","last_active":"2024-05-21T13:41:05.817817+0000","last_peered":"2024-05-21T13:41:05.817817+0000","last_clean":"2024-05-21T13:41:05.817817+0000","last_became_active":"2024-05-21T13:35:57.787508+0000","last_became_peered":"2024-05-21T13:35:57.787508+0000","last_unstale":"2024-05-21T13:41:05.817817+0000","last_undegraded":"2024-05-21T13:41:05.817817+0000","last_fullsized":"2024-05-21T13:41:05.817817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:12:56.914580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"27'7","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.829116+0000","last_change":"2024-05-21T13:35:57.787335+0000","last_active":"2024-05-21T13:41:05.829116+0000","last_peered":"2024-05-21T13:41:05.829116+0000","last_clean":"2024-05-21T13:41:05.829116+0000","last_became_active":"2024-05-21T13:35:57.786292+0000","last_became_peered":"2024-05-21T13:35:57.786292+0000","last_unstale":"2024-05-21T13:41:05.829116+0000","last_undegraded":"2024-05-21T13:41:05.829116+0000","last_fullsized":"2024-05-21T13:41:05.829116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:49:40.480948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"27'6","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.830434+0000","last_change":"2024-05-21T13:35:57.801121+0000","last_active":"2024-05-21T13:41:05.830434+0000","last_peered":"2024-05-21T13:41:05.830434+0000","last_clean":"2024-05-21T13:41:05.830434+0000","last_became_active":"2024-05-21T13:35:57.800858+0000","last_became_peered":"2024-05-21T13:35:57.800858+0000","last_unstale":"2024-05-21T13:41:05.830434+0000","last_undegraded":"2024-05-21T13:41:05.830434+0000","last_fullsized":"2024-05-21T13:41:05.830434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:41:08.765821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"27'16","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.814491+0000","last_change":"2024-05-21T13:35:57.778753+0000","last_active":"2024-05-21T13:41:05.814491+0000","last_peered":"2024-05-21T13:41:05.814491+0000","last_clean":"2024-05-21T13:41:05.814491+0000","last_became_active":"2024-05-21T13:35:57.777962+0000","last_became_peered":"2024-05-21T13:35:57.777962+0000","last_unstale":"2024-05-21T13:41:05.814491+0000","last_undegraded":"2024-05-21T13:41:05.814491+0000","last_fullsized":"2024-05-21T13:41:05.814491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:51:49.102945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"27'11","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.819045+0000","last_change":"2024-05-21T13:35:57.798312+0000","last_active":"2024-05-21T13:41:05.819045+0000","last_peered":"2024-05-21T13:41:05.819045+0000","last_clean":"2024-05-21T13:41:05.819045+0000","last_became_active":"2024-05-21T13:35:57.797793+0000","last_became_peered":"2024-05-21T13:35:57.797793+0000","last_unstale":"2024-05-21T13:41:05.819045+0000","last_undegraded":"2024-05-21T13:41:05.819045+0000","last_fullsized":"2024-05-21T13:41:05.819045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:28:47.276868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"27'9","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.825487+0000","last_change":"2024-05-21T13:35:57.782412+0000","last_active":"2024-05-21T13:41:05.825487+0000","last_peered":"2024-05-21T13:41:05.825487+0000","last_clean":"2024-05-21T13:41:05.825487+0000","last_became_active":"2024-05-21T13:35:57.782058+0000","last_became_peered":"2024-05-21T13:35:57.782058+0000","last_unstale":"2024-05-21T13:41:05.825487+0000","last_undegraded":"2024-05-21T13:41:05.825487+0000","last_fullsized":"2024-05-21T13:41:05.825487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:39:49.142554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"27'5","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.810805+0000","last_change":"2024-05-21T13:35:57.779771+0000","last_active":"2024-05-21T13:41:05.810805+0000","last_peered":"2024-05-21T13:41:05.810805+0000","last_clean":"2024-05-21T13:41:05.810805+0000","last_became_active":"2024-05-21T13:35:57.779168+0000","last_became_peered":"2024-05-21T13:35:57.779168+0000","last_unstale":"2024-05-21T13:41:05.810805+0000","last_undegraded":"2024-05-21T13:41:05.810805+0000","last_fullsized":"2024-05-21T13:41:05.810805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T13:59:58.966203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"27'6","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.806310+0000","last_change":"2024-05-21T13:35:57.773098+0000","last_active":"2024-05-21T13:41:05.806310+0000","last_peered":"2024-05-21T13:41:05.806310+0000","last_clean":"2024-05-21T13:41:05.806310+0000","last_became_active":"2024-05-21T13:35:57.772268+0000","last_became_peered":"2024-05-21T13:35:57.772268+0000","last_unstale":"2024-05-21T13:41:05.806310+0000","last_undegraded":"2024-05-21T13:41:05.806310+0000","last_fullsized":"2024-05-21T13:41:05.806310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:05:25.482434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"27'4","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.829420+0000","last_change":"2024-05-21T13:35:57.788980+0000","last_active":"2024-05-21T13:41:05.829420+0000","last_peered":"2024-05-21T13:41:05.829420+0000","last_clean":"2024-05-21T13:41:05.829420+0000","last_became_active":"2024-05-21T13:35:57.788689+0000","last_became_peered":"2024-05-21T13:35:57.788689+0000","last_unstale":"2024-05-21T13:41:05.829420+0000","last_undegraded":"2024-05-21T13:41:05.829420+0000","last_fullsized":"2024-05-21T13:41:05.829420+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:15:07.615363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"27'8","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.809482+0000","last_change":"2024-05-21T13:35:57.772867+0000","last_active":"2024-05-21T13:41:05.809482+0000","last_peered":"2024-05-21T13:41:05.809482+0000","last_clean":"2024-05-21T13:41:05.809482+0000","last_became_active":"2024-05-21T13:35:57.772160+0000","last_became_peered":"2024-05-21T13:35:57.772160+0000","last_unstale":"2024-05-21T13:41:05.809482+0000","last_undegraded":"2024-05-21T13:41:05.809482+0000","last_fullsized":"2024-05-21T13:41:05.809482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:11:24.428796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"27'7","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.805509+0000","last_change":"2024-05-21T13:35:57.785297+0000","last_active":"2024-05-21T13:41:05.805509+0000","last_peered":"2024-05-21T13:41:05.805509+0000","last_clean":"2024-05-21T13:41:05.805509+0000","last_became_active":"2024-05-21T13:35:57.784741+0000","last_became_peered":"2024-05-21T13:35:57.784741+0000","last_unstale":"2024-05-21T13:41:05.805509+0000","last_undegraded":"2024-05-21T13:41:05.805509+0000","last_fullsized":"2024-05-21T13:41:05.805509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:45:08.507286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"27'4","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.800168+0000","last_change":"2024-05-21T13:35:57.788875+0000","last_active":"2024-05-21T13:41:05.800168+0000","last_peered":"2024-05-21T13:41:05.800168+0000","last_clean":"2024-05-21T13:41:05.800168+0000","last_became_active":"2024-05-21T13:35:57.786629+0000","last_became_peered":"2024-05-21T13:35:57.786629+0000","last_unstale":"2024-05-21T13:41:05.800168+0000","last_undegraded":"2024-05-21T13:41:05.800168+0000","last_fullsized":"2024-05-21T13:41:05.800168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:40:07.549210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"27'8","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.828969+0000","last_change":"2024-05-21T13:35:57.803316+0000","last_active":"2024-05-21T13:41:05.828969+0000","last_peered":"2024-05-21T13:41:05.828969+0000","last_clean":"2024-05-21T13:41:05.828969+0000","last_became_active":"2024-05-21T13:35:57.802925+0000","last_became_peered":"2024-05-21T13:35:57.802925+0000","last_unstale":"2024-05-21T13:41:05.828969+0000","last_undegraded":"2024-05-21T13:41:05.828969+0000","last_fullsized":"2024-05-21T13:41:05.828969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:17:16.304097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9217,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9218,"ondisk_log_size":9218,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":503,"ondisk_log_size":503,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":213458,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":270,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":581632,"data_stored":426916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":240,"ondisk_log_size":240,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66916,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509509,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49528,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94322312,"statfs":{"total":96636764160,"available":96586047488,"internally_reserved":0,"allocated":311296,"data_stored":116594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509509,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45352,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326488,"statfs":{"total":96636764160,"available":96590323712,"internally_reserved":0,"allocated":294912,"data_stored":116943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509508,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53676,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94318164,"statfs":{"total":96636764160,"available":96581799936,"internally_reserved":0,"allocated":299008,"data_stored":116383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509509,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27508,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344332,"statfs":{"total":96636764160,"available":96608595968,"internally_reserved":0,"allocated":503808,"data_stored":323928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509509,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57892,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313948,"statfs":{"total":96636764160,"available":96577482752,"internally_reserved":0,"allocated":356352,"data_stored":705685,"data_compressed":33458,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509508,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39792,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94332048,"statfs":{"total":96636764160,"available":96596017152,"internally_reserved":0,"allocated":303104,"data_stored":116473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542211,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45428,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326412,"statfs":{"total":96636764160,"available":96590245888,"internally_reserved":0,"allocated":372736,"data_stored":707440,"data_compressed":33458,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574915,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45712,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326128,"statfs":{"total":96636764160,"available":96589955072,"internally_reserved":0,"allocated":663552,"data_stored":2421416,"data_compressed":104896,"data_compressed_allocated":131072,"data_compressed_original":2097152,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33458,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33458,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":221184,"data_stored":208771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":249856,"data_stored":210305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-21T13:41:12.895 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-05-21T13:41:12.895 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-21T13:41:13.064 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.090+0000 7f8a5b4e7640 1 Processor -- start 2024-05-21T13:41:13.065 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.090+0000 7f8a5b4e7640 1 -- start start 2024-05-21T13:41:13.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.090+0000 7f8a5b4e7640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8a54153cb0 0x7f8a540c9440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:13.066 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.090+0000 7f8a5b4e7640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8a540c4d00 0x7f8a5415d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:13.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.090+0000 7f8a5b4e7640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a54159cf0 con 0x7f8a540c48f0 2024-05-21T13:41:13.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.090+0000 7f8a5b4e7640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f8a540c9c60 con 0x7f8a54153cb0 2024-05-21T13:41:13.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.090+0000 7f8a5b4e7640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f8a54159fd0 con 0x7f8a540c4d00 2024-05-21T13:41:13.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.090+0000 7f8a59283640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8a54153cb0 0x7f8a540c9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:13.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.090+0000 7f8a59283640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f8a54153cb0 0x7f8a540c9440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36482/0 (socket says 172.21.15.22:36482) 2024-05-21T13:41:13.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.090+0000 7f8a59283640 1 -- 172.21.15.22:0/1494127209 learned_addr learned my addr 172.21.15.22:0/1494127209 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:41:13.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.090+0000 7f8a59a84640 1 --2- 172.21.15.22:0/1494127209 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8a540c4d00 0x7f8a5415d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:13.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.090+0000 7f8a59283640 1 -- 172.21.15.22:0/1494127209 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8a540c4d00 msgr2=0x7f8a5415d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:41:13.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.090+0000 7f8a59283640 1 --2- 172.21.15.22:0/1494127209 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8a540c4d00 0x7f8a5415d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:13.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.090+0000 7f8a59283640 1 -- 172.21.15.22:0/1494127209 >> v1:172.21.15.115:6789/0 conn(0x7f8a540c48f0 legacy=0x7f8a540c7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:41:13.067 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.090+0000 7f8a59283640 1 -- 172.21.15.22:0/1494127209 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a5415a2b0 con 0x7f8a54153cb0 2024-05-21T13:41:13.068 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.094+0000 7f8a59283640 1 --2- 172.21.15.22:0/1494127209 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a54153cb0 0x7f8a540c9440 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f8a50009870 tx=0x7f8a5001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c01c997e2af6918 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:13.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.094+0000 7f8a4bfff640 1 -- 172.21.15.22:0/1494127209 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a500ab650 con 0x7f8a54153cb0 2024-05-21T13:41:13.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.094+0000 7f8a4bfff640 1 -- 172.21.15.22:0/1494127209 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a500b0070 con 0x7f8a54153cb0 2024-05-21T13:41:13.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.094+0000 7f8a4bfff640 1 -- 172.21.15.22:0/1494127209 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a500aba10 con 0x7f8a54153cb0 2024-05-21T13:41:13.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.094+0000 7f8a5b4e7640 1 -- 172.21.15.22:0/1494127209 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a54153cb0 msgr2=0x7f8a540c9440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:13.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.094+0000 7f8a5b4e7640 1 --2- 172.21.15.22:0/1494127209 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a54153cb0 0x7f8a540c9440 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f8a50009870 tx=0x7f8a5001c560 comp rx=0 tx=0).stop 2024-05-21T13:41:13.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.094+0000 7f8a5b4e7640 1 -- 172.21.15.22:0/1494127209 shutdown_connections 2024-05-21T13:41:13.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.094+0000 7f8a5b4e7640 1 --2- 172.21.15.22:0/1494127209 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8a540c4d00 0x7f8a5415d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:13.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.094+0000 7f8a5b4e7640 1 --2- 172.21.15.22:0/1494127209 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a54153cb0 0x7f8a540c9440 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:13.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.094+0000 7f8a5b4e7640 1 -- 172.21.15.22:0/1494127209 >> 172.21.15.22:0/1494127209 conn(0x7f8a5406ea10 msgr2=0x7f8a5406ff50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:41:13.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.094+0000 7f8a5b4e7640 1 -- 172.21.15.22:0/1494127209 shutdown_connections 2024-05-21T13:41:13.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.094+0000 7f8a5b4e7640 1 -- 172.21.15.22:0/1494127209 wait complete. 2024-05-21T13:41:13.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.094+0000 7f8a5b4e7640 1 Processor -- start 2024-05-21T13:41:13.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.094+0000 7f8a5b4e7640 1 -- start start 2024-05-21T13:41:13.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.094+0000 7f8a5b4e7640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a540c48f0 0x7f8a5413e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:13.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.094+0000 7f8a5b4e7640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8a540c4d00 0x7f8a540cb450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:13.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.094+0000 7f8a5b4e7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a54153cb0 0x7f8a540ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:13.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.094+0000 7f8a5b4e7640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f8a54154090 con 0x7f8a54153cb0 2024-05-21T13:41:13.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.094+0000 7f8a5b4e7640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f8a5415db00 con 0x7f8a540c48f0 2024-05-21T13:41:13.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.094+0000 7f8a5b4e7640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f8a54154210 con 0x7f8a540c4d00 2024-05-21T13:41:13.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.094+0000 7f8a59a84640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a54153cb0 0x7f8a540ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:13.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.094+0000 7f8a59a84640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a54153cb0 0x7f8a540ccff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36492/0 (socket says 172.21.15.22:36492) 2024-05-21T13:41:13.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.094+0000 7f8a59a84640 1 -- 172.21.15.22:0/3851971459 learned_addr learned my addr 172.21.15.22:0/3851971459 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:41:13.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.094+0000 7f8a59283640 1 --2- 172.21.15.22:0/3851971459 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a540c48f0 0x7f8a5413e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:13.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.094+0000 7f8a58a82640 1 --2- 172.21.15.22:0/3851971459 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8a540c4d00 0x7f8a540cb450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:13.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.094+0000 7f8a59a84640 1 -- 172.21.15.22:0/3851971459 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8a540c4d00 msgr2=0x7f8a540cb450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:13.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.094+0000 7f8a59a84640 1 --2- 172.21.15.22:0/3851971459 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8a540c4d00 0x7f8a540cb450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:13.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.094+0000 7f8a59a84640 1 -- 172.21.15.22:0/3851971459 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a540c48f0 msgr2=0x7f8a5413e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:13.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.094+0000 7f8a59a84640 1 --2- 172.21.15.22:0/3851971459 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a540c48f0 0x7f8a5413e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:13.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.094+0000 7f8a59a84640 1 -- 172.21.15.22:0/3851971459 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a540c7890 con 0x7f8a54153cb0 2024-05-21T13:41:13.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.094+0000 7f8a59a84640 1 --2- 172.21.15.22:0/3851971459 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a54153cb0 0x7f8a540ccff0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c007e40 tx=0x7f8a4c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:13.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.098+0000 7f8a49ffb640 1 -- 172.21.15.22:0/3851971459 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a4c014620 con 0x7f8a54153cb0 2024-05-21T13:41:13.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.098+0000 7f8a49ffb640 1 -- 172.21.15.22:0/3851971459 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a4c019070 con 0x7f8a54153cb0 2024-05-21T13:41:13.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.098+0000 7f8a5b4e7640 1 -- 172.21.15.22:0/3851971459 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a541f3910 con 0x7f8a54153cb0 2024-05-21T13:41:13.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.098+0000 7f8a49ffb640 1 -- 172.21.15.22:0/3851971459 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a4c014a20 con 0x7f8a54153cb0 2024-05-21T13:41:13.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.098+0000 7f8a5b4e7640 1 -- 172.21.15.22:0/3851971459 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a541f3bd0 con 0x7f8a54153cb0 2024-05-21T13:41:13.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.098+0000 7f8a5b4e7640 1 -- 172.21.15.22:0/3851971459 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a540cccc0 con 0x7f8a54153cb0 2024-05-21T13:41:13.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.098+0000 7f8a49ffb640 1 -- 172.21.15.22:0/3851971459 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f8a4c014bc0 con 0x7f8a54153cb0 2024-05-21T13:41:13.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.098+0000 7f8a49ffb640 1 --2- 172.21.15.22:0/3851971459 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f8a3806f400 0x7f8a380718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:13.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.098+0000 7f8a49ffb640 1 -- 172.21.15.22:0/3851971459 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f8a4c08fec0 con 0x7f8a54153cb0 2024-05-21T13:41:13.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.098+0000 7f8a59283640 1 --2- 172.21.15.22:0/3851971459 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f8a3806f400 0x7f8a380718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:13.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.098+0000 7f8a59283640 1 --2- 172.21.15.22:0/3851971459 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f8a3806f400 0x7f8a380718c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8a500af000 tx=0x7f8a500a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:13.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.102+0000 7f8a49ffb640 1 -- 172.21.15.22:0/3851971459 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f8a4c05cb60 con 0x7f8a54153cb0 2024-05-21T13:41:13.238 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.262+0000 7f8a5b4e7640 1 -- 172.21.15.22:0/3851971459 --> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8a54077bb0 con 0x7f8a3806f400 2024-05-21T13:41:13.261 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.286+0000 7f8a49ffb640 1 -- 172.21.15.22:0/3851971459 <== mgr.4103 v2:172.21.15.115:6832/184591771 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+333483 (secure 0 0 0) 0x7f8a54077bb0 con 0x7f8a3806f400 2024-05-21T13:41:13.263 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-21T13:41:13.267 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-05-21T13:41:13.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.290+0000 7f8a5b4e7640 1 -- 172.21.15.22:0/3851971459 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f8a3806f400 msgr2=0x7f8a380718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:13.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.290+0000 7f8a5b4e7640 1 --2- 172.21.15.22:0/3851971459 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f8a3806f400 0x7f8a380718c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f8a500af000 tx=0x7f8a500a7000 comp rx=0 tx=0).stop 2024-05-21T13:41:13.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.290+0000 7f8a5b4e7640 1 -- 172.21.15.22:0/3851971459 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a54153cb0 msgr2=0x7f8a540ccff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:13.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.290+0000 7f8a5b4e7640 1 --2- 172.21.15.22:0/3851971459 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a54153cb0 0x7f8a540ccff0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c007e40 tx=0x7f8a4c00e4b0 comp rx=0 tx=0).stop 2024-05-21T13:41:13.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.290+0000 7f8a5b4e7640 1 -- 172.21.15.22:0/3851971459 shutdown_connections 2024-05-21T13:41:13.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.290+0000 7f8a5b4e7640 1 --2- 172.21.15.22:0/3851971459 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f8a3806f400 0x7f8a380718c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:13.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.290+0000 7f8a5b4e7640 1 --2- 172.21.15.22:0/3851971459 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f8a54153cb0 0x7f8a540ccff0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:13.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.290+0000 7f8a5b4e7640 1 --2- 172.21.15.22:0/3851971459 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f8a540c4d00 0x7f8a540cb450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:13.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.290+0000 7f8a5b4e7640 1 --2- 172.21.15.22:0/3851971459 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f8a540c48f0 0x7f8a5413e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:13.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.290+0000 7f8a5b4e7640 1 -- 172.21.15.22:0/3851971459 >> 172.21.15.22:0/3851971459 conn(0x7f8a5406ea10 msgr2=0x7f8a540c7c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:41:13.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.290+0000 7f8a5b4e7640 1 -- 172.21.15.22:0/3851971459 shutdown_connections 2024-05-21T13:41:13.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.290+0000 7f8a5b4e7640 1 -- 172.21.15.22:0/3851971459 wait complete. 2024-05-21T13:41:13.285 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":185,"stamp":"2024-05-21T13:41:12.625676+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":803826,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":70,"num_read_kb":59,"num_write":9588,"num_write_kb":25167756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10033,"ondisk_log_size":10033,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":364888,"kb_used_data":3032,"kb_used_omap":12,"kb_used_meta":361779,"kb_avail":754609832,"statfs":{"total":773094113280,"available":772720467968,"internally_reserved":0,"allocated":3104768,"data_stored":4624862,"data_compressed":171812,"data_compressed_allocated":221184,"data_compressed_original":3244032,"omap_allocated":12752,"internal_metadata":370462256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[3,1,1,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-10737402839,"num_objects":-2560,"num_object_clones":0,"num_object_copies":-10240,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2560,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":2586,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004601"},"pg_stats":[{"pgid":"2.1f","version":"25'9","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:38:03.532918+0000","last_change":"2024-05-21T13:35:56.739488+0000","last_active":"2024-05-21T13:38:03.532918+0000","last_peered":"2024-05-21T13:38:03.532918+0000","last_clean":"2024-05-21T13:38:03.532918+0000","last_became_active":"2024-05-21T13:35:56.738481+0000","last_became_peered":"2024-05-21T13:35:56.738481+0000","last_unstale":"2024-05-21T13:38:03.532918+0000","last_undegraded":"2024-05-21T13:38:03.532918+0000","last_fullsized":"2024-05-21T13:38:03.532918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:20:48.149770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"27'5","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.810535+0000","last_change":"2024-05-21T13:35:57.779462+0000","last_active":"2024-05-21T13:41:05.810535+0000","last_peered":"2024-05-21T13:41:05.810535+0000","last_clean":"2024-05-21T13:41:05.810535+0000","last_became_active":"2024-05-21T13:35:57.778721+0000","last_became_peered":"2024-05-21T13:35:57.778721+0000","last_unstale":"2024-05-21T13:41:05.810535+0000","last_undegraded":"2024-05-21T13:41:05.810535+0000","last_fullsized":"2024-05-21T13:41:05.810535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:13:05.005747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"27'306","reported_seq":319,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.328568+0000","last_change":"2024-05-21T13:36:39.721406+0000","last_active":"2024-05-21T13:41:07.328568+0000","last_peered":"2024-05-21T13:41:07.328568+0000","last_clean":"2024-05-21T13:41:07.328568+0000","last_became_active":"2024-05-21T13:36:39.720879+0000","last_became_peered":"2024-05-21T13:36:39.720879+0000","last_unstale":"2024-05-21T13:41:07.328568+0000","last_undegraded":"2024-05-21T13:41:07.328568+0000","last_fullsized":"2024-05-21T13:41:07.328568+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":306,"log_dups_size":0,"ondisk_log_size":306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:18:35.640050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":306,"num_write_kb":835584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4,1],"acting":[0,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"25'2","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:37:59.540059+0000","last_change":"2024-05-21T13:35:56.775054+0000","last_active":"2024-05-21T13:37:59.540059+0000","last_peered":"2024-05-21T13:37:59.540059+0000","last_clean":"2024-05-21T13:37:59.540059+0000","last_became_active":"2024-05-21T13:35:56.770566+0000","last_became_peered":"2024-05-21T13:35:56.770566+0000","last_unstale":"2024-05-21T13:37:59.540059+0000","last_undegraded":"2024-05-21T13:37:59.540059+0000","last_fullsized":"2024-05-21T13:37:59.540059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:05:11.539201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"27'6","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.810509+0000","last_change":"2024-05-21T13:35:57.782094+0000","last_active":"2024-05-21T13:41:05.810509+0000","last_peered":"2024-05-21T13:41:05.810509+0000","last_clean":"2024-05-21T13:41:05.810509+0000","last_became_active":"2024-05-21T13:35:57.780590+0000","last_became_peered":"2024-05-21T13:35:57.780590+0000","last_unstale":"2024-05-21T13:41:05.810509+0000","last_undegraded":"2024-05-21T13:41:05.810509+0000","last_fullsized":"2024-05-21T13:41:05.810509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:30:50.929103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"27'339","reported_seq":359,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.400325+0000","last_change":"2024-05-21T13:36:01.852092+0000","last_active":"2024-05-21T13:41:07.400325+0000","last_peered":"2024-05-21T13:41:07.400325+0000","last_clean":"2024-05-21T13:41:07.400325+0000","last_became_active":"2024-05-21T13:36:01.851745+0000","last_became_peered":"2024-05-21T13:36:01.851745+0000","last_unstale":"2024-05-21T13:41:07.400325+0000","last_undegraded":"2024-05-21T13:41:07.400325+0000","last_fullsized":"2024-05-21T13:41:07.400325+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:57:21.599860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":339,"num_write_kb":925696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"27'5","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:39:00.707764+0000","last_change":"2024-05-21T13:35:56.731106+0000","last_active":"2024-05-21T13:39:00.707764+0000","last_peered":"2024-05-21T13:39:00.707764+0000","last_clean":"2024-05-21T13:39:00.707764+0000","last_became_active":"2024-05-21T13:35:56.730746+0000","last_became_peered":"2024-05-21T13:35:56.730746+0000","last_unstale":"2024-05-21T13:39:00.707764+0000","last_undegraded":"2024-05-21T13:39:00.707764+0000","last_fullsized":"2024-05-21T13:39:00.707764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:23:17.798397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"27'9","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.817410+0000","last_change":"2024-05-21T13:35:57.771371+0000","last_active":"2024-05-21T13:41:05.817410+0000","last_peered":"2024-05-21T13:41:05.817410+0000","last_clean":"2024-05-21T13:41:05.817410+0000","last_became_active":"2024-05-21T13:35:57.770595+0000","last_became_peered":"2024-05-21T13:35:57.770595+0000","last_unstale":"2024-05-21T13:41:05.817410+0000","last_undegraded":"2024-05-21T13:41:05.817410+0000","last_fullsized":"2024-05-21T13:41:05.817410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:53:17.771310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"27'273","reported_seq":293,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.380074+0000","last_change":"2024-05-21T13:36:01.849638+0000","last_active":"2024-05-21T13:41:07.380074+0000","last_peered":"2024-05-21T13:41:07.380074+0000","last_clean":"2024-05-21T13:41:07.380074+0000","last_became_active":"2024-05-21T13:36:01.848996+0000","last_became_peered":"2024-05-21T13:36:01.848996+0000","last_unstale":"2024-05-21T13:41:07.380074+0000","last_undegraded":"2024-05-21T13:41:07.380074+0000","last_fullsized":"2024-05-21T13:41:07.380074+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:24:31.613874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:38:30.549252+0000","last_change":"2024-05-21T13:35:56.737279+0000","last_active":"2024-05-21T13:38:30.549252+0000","last_peered":"2024-05-21T13:38:30.549252+0000","last_clean":"2024-05-21T13:38:30.549252+0000","last_became_active":"2024-05-21T13:35:56.731150+0000","last_became_peered":"2024-05-21T13:35:56.731150+0000","last_unstale":"2024-05-21T13:38:30.549252+0000","last_undegraded":"2024-05-21T13:38:30.549252+0000","last_fullsized":"2024-05-21T13:38:30.549252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:17:07.571294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"27'15","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.830064+0000","last_change":"2024-05-21T13:35:57.799803+0000","last_active":"2024-05-21T13:41:05.830064+0000","last_peered":"2024-05-21T13:41:05.830064+0000","last_clean":"2024-05-21T13:41:05.830064+0000","last_became_active":"2024-05-21T13:35:57.799043+0000","last_became_peered":"2024-05-21T13:35:57.799043+0000","last_unstale":"2024-05-21T13:41:05.830064+0000","last_undegraded":"2024-05-21T13:41:05.830064+0000","last_fullsized":"2024-05-21T13:41:05.830064+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:22:48.607953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"27'252","reported_seq":272,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.370027+0000","last_change":"2024-05-21T13:36:01.852469+0000","last_active":"2024-05-21T13:41:07.370027+0000","last_peered":"2024-05-21T13:41:07.370027+0000","last_clean":"2024-05-21T13:41:07.370027+0000","last_became_active":"2024-05-21T13:36:01.851913+0000","last_became_peered":"2024-05-21T13:36:01.851913+0000","last_unstale":"2024-05-21T13:41:07.370027+0000","last_undegraded":"2024-05-21T13:41:07.370027+0000","last_fullsized":"2024-05-21T13:41:07.370027+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":252,"log_dups_size":0,"ondisk_log_size":252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:42:58.062540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":252,"num_write_kb":688128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"27'5","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.818127+0000","last_change":"2024-05-21T13:35:57.796516+0000","last_active":"2024-05-21T13:41:05.818127+0000","last_peered":"2024-05-21T13:41:05.818127+0000","last_clean":"2024-05-21T13:41:05.818127+0000","last_became_active":"2024-05-21T13:35:57.795638+0000","last_became_peered":"2024-05-21T13:35:57.795638+0000","last_unstale":"2024-05-21T13:41:05.818127+0000","last_undegraded":"2024-05-21T13:41:05.818127+0000","last_fullsized":"2024-05-21T13:41:05.818127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:46:40.541835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"27'5","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:39:00.706951+0000","last_change":"2024-05-21T13:35:56.748046+0000","last_active":"2024-05-21T13:39:00.706951+0000","last_peered":"2024-05-21T13:39:00.706951+0000","last_clean":"2024-05-21T13:39:00.706951+0000","last_became_active":"2024-05-21T13:35:56.747635+0000","last_became_peered":"2024-05-21T13:35:56.747635+0000","last_unstale":"2024-05-21T13:39:00.706951+0000","last_undegraded":"2024-05-21T13:39:00.706951+0000","last_fullsized":"2024-05-21T13:39:00.706951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:52:28.665244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"27'309","reported_seq":329,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.399148+0000","last_change":"2024-05-21T13:36:01.862153+0000","last_active":"2024-05-21T13:41:07.399148+0000","last_peered":"2024-05-21T13:41:07.399148+0000","last_clean":"2024-05-21T13:41:07.399148+0000","last_became_active":"2024-05-21T13:36:01.861520+0000","last_became_peered":"2024-05-21T13:36:01.861520+0000","last_unstale":"2024-05-21T13:41:07.399148+0000","last_undegraded":"2024-05-21T13:41:07.399148+0000","last_fullsized":"2024-05-21T13:41:07.399148+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":309,"log_dups_size":0,"ondisk_log_size":309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:04:37.306132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":309,"num_write_kb":843776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"27'8","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.790220+0000","last_change":"2024-05-21T13:35:57.786463+0000","last_active":"2024-05-21T13:41:05.790220+0000","last_peered":"2024-05-21T13:41:05.790220+0000","last_clean":"2024-05-21T13:41:05.790220+0000","last_became_active":"2024-05-21T13:35:57.786126+0000","last_became_peered":"2024-05-21T13:35:57.786126+0000","last_unstale":"2024-05-21T13:41:05.790220+0000","last_undegraded":"2024-05-21T13:41:05.790220+0000","last_fullsized":"2024-05-21T13:41:05.790220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:39:32.076464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"27'3","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:40:20.575038+0000","last_change":"2024-05-21T13:35:56.765178+0000","last_active":"2024-05-21T13:40:20.575038+0000","last_peered":"2024-05-21T13:40:20.575038+0000","last_clean":"2024-05-21T13:40:20.575038+0000","last_became_active":"2024-05-21T13:35:56.764551+0000","last_became_peered":"2024-05-21T13:35:56.764551+0000","last_unstale":"2024-05-21T13:40:20.575038+0000","last_undegraded":"2024-05-21T13:40:20.575038+0000","last_fullsized":"2024-05-21T13:40:20.575038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:34:28.955222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"27'291","reported_seq":311,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.364679+0000","last_change":"2024-05-21T13:36:01.854410+0000","last_active":"2024-05-21T13:41:07.364679+0000","last_peered":"2024-05-21T13:41:07.364679+0000","last_clean":"2024-05-21T13:41:07.364679+0000","last_became_active":"2024-05-21T13:36:01.853975+0000","last_became_peered":"2024-05-21T13:36:01.853975+0000","last_unstale":"2024-05-21T13:41:07.364679+0000","last_undegraded":"2024-05-21T13:41:07.364679+0000","last_fullsized":"2024-05-21T13:41:07.364679+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:15:34.710504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":291,"num_write_kb":794624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"27'9","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.796423+0000","last_change":"2024-05-21T13:35:57.762509+0000","last_active":"2024-05-21T13:41:05.796423+0000","last_peered":"2024-05-21T13:41:05.796423+0000","last_clean":"2024-05-21T13:41:05.796423+0000","last_became_active":"2024-05-21T13:35:57.761739+0000","last_became_peered":"2024-05-21T13:35:57.761739+0000","last_unstale":"2024-05-21T13:41:05.796423+0000","last_undegraded":"2024-05-21T13:41:05.796423+0000","last_fullsized":"2024-05-21T13:41:05.796423+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:41:17.911126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"25'3","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:38:08.533743+0000","last_change":"2024-05-21T13:35:56.734017+0000","last_active":"2024-05-21T13:38:08.533743+0000","last_peered":"2024-05-21T13:38:08.533743+0000","last_clean":"2024-05-21T13:38:08.533743+0000","last_became_active":"2024-05-21T13:35:56.733249+0000","last_became_peered":"2024-05-21T13:35:56.733249+0000","last_unstale":"2024-05-21T13:38:08.533743+0000","last_undegraded":"2024-05-21T13:38:08.533743+0000","last_fullsized":"2024-05-21T13:38:08.533743+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:13:27.279557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"27'267","reported_seq":287,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.357200+0000","last_change":"2024-05-21T13:36:01.868669+0000","last_active":"2024-05-21T13:41:07.357200+0000","last_peered":"2024-05-21T13:41:07.357200+0000","last_clean":"2024-05-21T13:41:07.357200+0000","last_became_active":"2024-05-21T13:36:01.867701+0000","last_became_peered":"2024-05-21T13:36:01.867701+0000","last_unstale":"2024-05-21T13:41:07.357200+0000","last_undegraded":"2024-05-21T13:41:07.357200+0000","last_fullsized":"2024-05-21T13:41:07.357200+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":267,"log_dups_size":0,"ondisk_log_size":267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:09:21.615570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":267,"num_write_kb":729088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"27'2","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.777072+0000","last_change":"2024-05-21T13:35:57.789966+0000","last_active":"2024-05-21T13:41:05.777072+0000","last_peered":"2024-05-21T13:41:05.777072+0000","last_clean":"2024-05-21T13:41:05.777072+0000","last_became_active":"2024-05-21T13:35:57.789213+0000","last_became_peered":"2024-05-21T13:35:57.789213+0000","last_unstale":"2024-05-21T13:41:05.777072+0000","last_undegraded":"2024-05-21T13:41:05.777072+0000","last_fullsized":"2024-05-21T13:41:05.777072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:33:24.183958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"25'2","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:38:10.545909+0000","last_change":"2024-05-21T13:35:56.746878+0000","last_active":"2024-05-21T13:38:10.545909+0000","last_peered":"2024-05-21T13:38:10.545909+0000","last_clean":"2024-05-21T13:38:10.545909+0000","last_became_active":"2024-05-21T13:35:56.746534+0000","last_became_peered":"2024-05-21T13:35:56.746534+0000","last_unstale":"2024-05-21T13:38:10.545909+0000","last_undegraded":"2024-05-21T13:38:10.545909+0000","last_fullsized":"2024-05-21T13:38:10.545909+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:45:56.935415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"27'288","reported_seq":308,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.420341+0000","last_change":"2024-05-21T13:36:01.841632+0000","last_active":"2024-05-21T13:41:07.420341+0000","last_peered":"2024-05-21T13:41:07.420341+0000","last_clean":"2024-05-21T13:41:07.420341+0000","last_became_active":"2024-05-21T13:36:01.841216+0000","last_became_peered":"2024-05-21T13:36:01.841216+0000","last_unstale":"2024-05-21T13:41:07.420341+0000","last_undegraded":"2024-05-21T13:41:07.420341+0000","last_fullsized":"2024-05-21T13:41:07.420341+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:49:05.576221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":288,"num_write_kb":786432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"27'7","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.796201+0000","last_change":"2024-05-21T13:35:57.764793+0000","last_active":"2024-05-21T13:41:05.796201+0000","last_peered":"2024-05-21T13:41:05.796201+0000","last_clean":"2024-05-21T13:41:05.796201+0000","last_became_active":"2024-05-21T13:35:57.764017+0000","last_became_peered":"2024-05-21T13:35:57.764017+0000","last_unstale":"2024-05-21T13:41:05.796201+0000","last_undegraded":"2024-05-21T13:41:05.796201+0000","last_fullsized":"2024-05-21T13:41:05.796201+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:25:45.006614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"27'5","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:40:20.578707+0000","last_change":"2024-05-21T13:35:56.752278+0000","last_active":"2024-05-21T13:40:20.578707+0000","last_peered":"2024-05-21T13:40:20.578707+0000","last_clean":"2024-05-21T13:40:20.578707+0000","last_became_active":"2024-05-21T13:35:56.751883+0000","last_became_peered":"2024-05-21T13:35:56.751883+0000","last_unstale":"2024-05-21T13:40:20.578707+0000","last_undegraded":"2024-05-21T13:40:20.578707+0000","last_fullsized":"2024-05-21T13:40:20.578707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:08:05.279701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"27'249","reported_seq":269,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.413059+0000","last_change":"2024-05-21T13:36:01.832621+0000","last_active":"2024-05-21T13:41:07.413059+0000","last_peered":"2024-05-21T13:41:07.413059+0000","last_clean":"2024-05-21T13:41:07.413059+0000","last_became_active":"2024-05-21T13:36:01.831609+0000","last_became_peered":"2024-05-21T13:36:01.831609+0000","last_unstale":"2024-05-21T13:41:07.413059+0000","last_undegraded":"2024-05-21T13:41:07.413059+0000","last_fullsized":"2024-05-21T13:41:07.413059+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:26:43.075259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":249,"num_write_kb":679936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"27'5","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.794857+0000","last_change":"2024-05-21T13:35:57.783487+0000","last_active":"2024-05-21T13:41:05.794857+0000","last_peered":"2024-05-21T13:41:05.794857+0000","last_clean":"2024-05-21T13:41:05.794857+0000","last_became_active":"2024-05-21T13:35:57.783150+0000","last_became_peered":"2024-05-21T13:35:57.783150+0000","last_unstale":"2024-05-21T13:41:05.794857+0000","last_undegraded":"2024-05-21T13:41:05.794857+0000","last_fullsized":"2024-05-21T13:41:05.794857+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:14:56.991945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"27'22","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:04.606673+0000","last_change":"2024-05-21T13:35:56.745122+0000","last_active":"2024-05-21T13:41:04.606673+0000","last_peered":"2024-05-21T13:41:04.606673+0000","last_clean":"2024-05-21T13:41:04.606673+0000","last_became_active":"2024-05-21T13:35:56.744218+0000","last_became_peered":"2024-05-21T13:35:56.744218+0000","last_unstale":"2024-05-21T13:41:04.606673+0000","last_undegraded":"2024-05-21T13:41:04.606673+0000","last_fullsized":"2024-05-21T13:41:04.606673+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:45:03.790591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"27'264","reported_seq":284,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.394488+0000","last_change":"2024-05-21T13:36:01.838971+0000","last_active":"2024-05-21T13:41:07.394488+0000","last_peered":"2024-05-21T13:41:07.394488+0000","last_clean":"2024-05-21T13:41:07.394488+0000","last_became_active":"2024-05-21T13:36:01.837401+0000","last_became_peered":"2024-05-21T13:36:01.837401+0000","last_unstale":"2024-05-21T13:41:07.394488+0000","last_undegraded":"2024-05-21T13:41:07.394488+0000","last_fullsized":"2024-05-21T13:41:07.394488+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:16:25.666568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":720896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"27'9","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.801162+0000","last_change":"2024-05-21T13:35:57.784993+0000","last_active":"2024-05-21T13:41:05.801162+0000","last_peered":"2024-05-21T13:41:05.801162+0000","last_clean":"2024-05-21T13:41:05.801162+0000","last_became_active":"2024-05-21T13:35:57.784664+0000","last_became_peered":"2024-05-21T13:35:57.784664+0000","last_unstale":"2024-05-21T13:41:05.801162+0000","last_undegraded":"2024-05-21T13:41:05.801162+0000","last_fullsized":"2024-05-21T13:41:05.801162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:58:20.045901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"25'1","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:38:05.553882+0000","last_change":"2024-05-21T13:35:56.741285+0000","last_active":"2024-05-21T13:38:05.553882+0000","last_peered":"2024-05-21T13:38:05.553882+0000","last_clean":"2024-05-21T13:38:05.553882+0000","last_became_active":"2024-05-21T13:35:56.740846+0000","last_became_peered":"2024-05-21T13:35:56.740846+0000","last_unstale":"2024-05-21T13:38:05.553882+0000","last_undegraded":"2024-05-21T13:38:05.553882+0000","last_fullsized":"2024-05-21T13:38:05.553882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:34:17.960870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"27'249","reported_seq":269,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.372636+0000","last_change":"2024-05-21T13:36:01.873172+0000","last_active":"2024-05-21T13:41:07.372636+0000","last_peered":"2024-05-21T13:41:07.372636+0000","last_clean":"2024-05-21T13:41:07.372636+0000","last_became_active":"2024-05-21T13:36:01.872085+0000","last_became_peered":"2024-05-21T13:36:01.872085+0000","last_unstale":"2024-05-21T13:41:07.372636+0000","last_undegraded":"2024-05-21T13:41:07.372636+0000","last_fullsized":"2024-05-21T13:41:07.372636+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:24:57.031323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":249,"num_write_kb":679936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"27'5","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.803329+0000","last_change":"2024-05-21T13:35:57.783176+0000","last_active":"2024-05-21T13:41:05.803329+0000","last_peered":"2024-05-21T13:41:05.803329+0000","last_clean":"2024-05-21T13:41:05.803329+0000","last_became_active":"2024-05-21T13:35:57.782517+0000","last_became_peered":"2024-05-21T13:35:57.782517+0000","last_unstale":"2024-05-21T13:41:05.803329+0000","last_undegraded":"2024-05-21T13:41:05.803329+0000","last_fullsized":"2024-05-21T13:41:05.803329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:06:58.203996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:38:04.540828+0000","last_change":"2024-05-21T13:35:56.767544+0000","last_active":"2024-05-21T13:38:04.540828+0000","last_peered":"2024-05-21T13:38:04.540828+0000","last_clean":"2024-05-21T13:38:04.540828+0000","last_became_active":"2024-05-21T13:35:56.764987+0000","last_became_peered":"2024-05-21T13:35:56.764987+0000","last_unstale":"2024-05-21T13:38:04.540828+0000","last_undegraded":"2024-05-21T13:38:04.540828+0000","last_fullsized":"2024-05-21T13:38:04.540828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:12:46.828769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"27'273","reported_seq":293,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.388266+0000","last_change":"2024-05-21T13:36:01.872215+0000","last_active":"2024-05-21T13:41:07.388266+0000","last_peered":"2024-05-21T13:41:07.388266+0000","last_clean":"2024-05-21T13:41:07.388266+0000","last_became_active":"2024-05-21T13:36:01.870831+0000","last_became_peered":"2024-05-21T13:36:01.870831+0000","last_unstale":"2024-05-21T13:41:07.388266+0000","last_undegraded":"2024-05-21T13:41:07.388266+0000","last_fullsized":"2024-05-21T13:41:07.388266+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:04:09.689206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"27'7","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.811209+0000","last_change":"2024-05-21T13:35:57.783616+0000","last_active":"2024-05-21T13:41:05.811209+0000","last_peered":"2024-05-21T13:41:05.811209+0000","last_clean":"2024-05-21T13:41:05.811209+0000","last_became_active":"2024-05-21T13:35:57.780521+0000","last_became_peered":"2024-05-21T13:35:57.780521+0000","last_unstale":"2024-05-21T13:41:05.811209+0000","last_undegraded":"2024-05-21T13:41:05.811209+0000","last_fullsized":"2024-05-21T13:41:05.811209+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:59:44.121631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"25'1","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:38:05.553834+0000","last_change":"2024-05-21T13:35:56.750341+0000","last_active":"2024-05-21T13:38:05.553834+0000","last_peered":"2024-05-21T13:38:05.553834+0000","last_clean":"2024-05-21T13:38:05.553834+0000","last_became_active":"2024-05-21T13:35:56.750006+0000","last_became_peered":"2024-05-21T13:35:56.750006+0000","last_unstale":"2024-05-21T13:38:05.553834+0000","last_undegraded":"2024-05-21T13:38:05.553834+0000","last_fullsized":"2024-05-21T13:38:05.553834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:15:21.416234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"27'264","reported_seq":284,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.398103+0000","last_change":"2024-05-21T13:36:01.873693+0000","last_active":"2024-05-21T13:41:07.398103+0000","last_peered":"2024-05-21T13:41:07.398103+0000","last_clean":"2024-05-21T13:41:07.398103+0000","last_became_active":"2024-05-21T13:36:01.872363+0000","last_became_peered":"2024-05-21T13:36:01.872363+0000","last_unstale":"2024-05-21T13:41:07.398103+0000","last_undegraded":"2024-05-21T13:41:07.398103+0000","last_fullsized":"2024-05-21T13:41:07.398103+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:27:25.974289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":720896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"27'8","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.803951+0000","last_change":"2024-05-21T13:35:57.780809+0000","last_active":"2024-05-21T13:41:05.803951+0000","last_peered":"2024-05-21T13:41:05.803951+0000","last_clean":"2024-05-21T13:41:05.803951+0000","last_became_active":"2024-05-21T13:35:57.780313+0000","last_became_peered":"2024-05-21T13:35:57.780313+0000","last_unstale":"2024-05-21T13:41:05.803951+0000","last_undegraded":"2024-05-21T13:41:05.803951+0000","last_fullsized":"2024-05-21T13:41:05.803951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:43:11.778238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"27'9","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:06.810080+0000","last_change":"2024-05-21T13:35:56.771138+0000","last_active":"2024-05-21T13:41:06.810080+0000","last_peered":"2024-05-21T13:41:06.810080+0000","last_clean":"2024-05-21T13:41:06.810080+0000","last_became_active":"2024-05-21T13:35:56.770465+0000","last_became_peered":"2024-05-21T13:35:56.770465+0000","last_unstale":"2024-05-21T13:41:06.810080+0000","last_undegraded":"2024-05-21T13:41:06.810080+0000","last_fullsized":"2024-05-21T13:41:06.810080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:21:16.702309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":619,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"27'270","reported_seq":290,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.403240+0000","last_change":"2024-05-21T13:36:01.871328+0000","last_active":"2024-05-21T13:41:07.403240+0000","last_peered":"2024-05-21T13:41:07.403240+0000","last_clean":"2024-05-21T13:41:07.403240+0000","last_became_active":"2024-05-21T13:36:01.870678+0000","last_became_peered":"2024-05-21T13:36:01.870678+0000","last_unstale":"2024-05-21T13:41:07.403240+0000","last_undegraded":"2024-05-21T13:41:07.403240+0000","last_fullsized":"2024-05-21T13:41:07.403240+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:22:47.393065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":737280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"27'5","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.809299+0000","last_change":"2024-05-21T13:35:57.782665+0000","last_active":"2024-05-21T13:41:05.809299+0000","last_peered":"2024-05-21T13:41:05.809299+0000","last_clean":"2024-05-21T13:41:05.809299+0000","last_became_active":"2024-05-21T13:35:57.781299+0000","last_became_peered":"2024-05-21T13:35:57.781299+0000","last_unstale":"2024-05-21T13:41:05.809299+0000","last_undegraded":"2024-05-21T13:41:05.809299+0000","last_fullsized":"2024-05-21T13:41:05.809299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:21:22.721124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"25'3","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:38:00.553325+0000","last_change":"2024-05-21T13:35:56.768193+0000","last_active":"2024-05-21T13:38:00.553325+0000","last_peered":"2024-05-21T13:38:00.553325+0000","last_clean":"2024-05-21T13:38:00.553325+0000","last_became_active":"2024-05-21T13:35:56.767788+0000","last_became_peered":"2024-05-21T13:35:56.767788+0000","last_unstale":"2024-05-21T13:38:00.553325+0000","last_undegraded":"2024-05-21T13:38:00.553325+0000","last_fullsized":"2024-05-21T13:38:00.553325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:12:52.911816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"27'339","reported_seq":359,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.377321+0000","last_change":"2024-05-21T13:36:01.860305+0000","last_active":"2024-05-21T13:41:07.377321+0000","last_peered":"2024-05-21T13:41:07.377321+0000","last_clean":"2024-05-21T13:41:07.377321+0000","last_became_active":"2024-05-21T13:36:01.859141+0000","last_became_peered":"2024-05-21T13:36:01.859141+0000","last_unstale":"2024-05-21T13:41:07.377321+0000","last_undegraded":"2024-05-21T13:41:07.377321+0000","last_fullsized":"2024-05-21T13:41:07.377321+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:05:45.203241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":339,"num_write_kb":925696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"27'8","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.809899+0000","last_change":"2024-05-21T13:35:57.775523+0000","last_active":"2024-05-21T13:41:05.809899+0000","last_peered":"2024-05-21T13:41:05.809899+0000","last_clean":"2024-05-21T13:41:05.809899+0000","last_became_active":"2024-05-21T13:35:57.774322+0000","last_became_peered":"2024-05-21T13:35:57.774322+0000","last_unstale":"2024-05-21T13:41:05.809899+0000","last_undegraded":"2024-05-21T13:41:05.809899+0000","last_fullsized":"2024-05-21T13:41:05.809899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:06:35.118540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"25'3","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:38:05.553854+0000","last_change":"2024-05-21T13:35:56.748185+0000","last_active":"2024-05-21T13:38:05.553854+0000","last_peered":"2024-05-21T13:38:05.553854+0000","last_clean":"2024-05-21T13:38:05.553854+0000","last_became_active":"2024-05-21T13:35:56.747823+0000","last_became_peered":"2024-05-21T13:35:56.747823+0000","last_unstale":"2024-05-21T13:38:05.553854+0000","last_undegraded":"2024-05-21T13:38:05.553854+0000","last_fullsized":"2024-05-21T13:38:05.553854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:38:00.235330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":123,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:37:45.542454+0000","last_change":"2024-05-21T13:35:45.682484+0000","last_active":"2024-05-21T13:37:45.542454+0000","last_peered":"2024-05-21T13:37:45.542454+0000","last_clean":"2024-05-21T13:37:45.542454+0000","last_became_active":"2024-05-21T13:35:45.680732+0000","last_became_peered":"2024-05-21T13:35:45.680732+0000","last_unstale":"2024-05-21T13:37:45.542454+0000","last_undegraded":"2024-05-21T13:37:45.542454+0000","last_fullsized":"2024-05-21T13:37:45.542454+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:44.542324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:44.542324+0000","last_clean_scrub_stamp":"2024-05-21T13:35:44.542324+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:16:05.034161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"27'276","reported_seq":296,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.403558+0000","last_change":"2024-05-21T13:36:01.830034+0000","last_active":"2024-05-21T13:41:07.403558+0000","last_peered":"2024-05-21T13:41:07.403558+0000","last_clean":"2024-05-21T13:41:07.403558+0000","last_became_active":"2024-05-21T13:36:01.828957+0000","last_became_peered":"2024-05-21T13:36:01.828957+0000","last_unstale":"2024-05-21T13:41:07.403558+0000","last_undegraded":"2024-05-21T13:41:07.403558+0000","last_fullsized":"2024-05-21T13:41:07.403558+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:21:59.514268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":276,"num_write_kb":753664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"27'7","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.824727+0000","last_change":"2024-05-21T13:35:57.796419+0000","last_active":"2024-05-21T13:41:05.824727+0000","last_peered":"2024-05-21T13:41:05.824727+0000","last_clean":"2024-05-21T13:41:05.824727+0000","last_became_active":"2024-05-21T13:35:57.796050+0000","last_became_peered":"2024-05-21T13:35:57.796050+0000","last_unstale":"2024-05-21T13:41:05.824727+0000","last_undegraded":"2024-05-21T13:41:05.824727+0000","last_fullsized":"2024-05-21T13:41:05.824727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:56:07.121391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"25'3","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:38:15.541313+0000","last_change":"2024-05-21T13:35:56.751619+0000","last_active":"2024-05-21T13:38:15.541313+0000","last_peered":"2024-05-21T13:38:15.541313+0000","last_clean":"2024-05-21T13:38:15.541313+0000","last_became_active":"2024-05-21T13:35:56.748604+0000","last_became_peered":"2024-05-21T13:35:56.748604+0000","last_unstale":"2024-05-21T13:38:15.541313+0000","last_undegraded":"2024-05-21T13:38:15.541313+0000","last_fullsized":"2024-05-21T13:38:15.541313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:19:03.052434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"27'280","reported_seq":300,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.378299+0000","last_change":"2024-05-21T13:36:01.825464+0000","last_active":"2024-05-21T13:41:07.378299+0000","last_peered":"2024-05-21T13:41:07.378299+0000","last_clean":"2024-05-21T13:41:07.378299+0000","last_became_active":"2024-05-21T13:36:01.824653+0000","last_became_peered":"2024-05-21T13:36:01.824653+0000","last_unstale":"2024-05-21T13:41:07.378299+0000","last_undegraded":"2024-05-21T13:41:07.378299+0000","last_fullsized":"2024-05-21T13:41:07.378299+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:29:32.830052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":280,"num_write_kb":761856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"27'6","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.814113+0000","last_change":"2024-05-21T13:35:57.784031+0000","last_active":"2024-05-21T13:41:05.814113+0000","last_peered":"2024-05-21T13:41:05.814113+0000","last_clean":"2024-05-21T13:41:05.814113+0000","last_became_active":"2024-05-21T13:35:57.771695+0000","last_became_peered":"2024-05-21T13:35:57.771695+0000","last_unstale":"2024-05-21T13:41:05.814113+0000","last_undegraded":"2024-05-21T13:41:05.814113+0000","last_fullsized":"2024-05-21T13:41:05.814113+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:46:33.308257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:38:14.542410+0000","last_change":"2024-05-21T13:35:56.768166+0000","last_active":"2024-05-21T13:38:14.542410+0000","last_peered":"2024-05-21T13:38:14.542410+0000","last_clean":"2024-05-21T13:38:14.542410+0000","last_became_active":"2024-05-21T13:35:56.767053+0000","last_became_peered":"2024-05-21T13:35:56.767053+0000","last_unstale":"2024-05-21T13:38:14.542410+0000","last_undegraded":"2024-05-21T13:38:14.542410+0000","last_fullsized":"2024-05-21T13:38:14.542410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:10:16.639491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"27'261","reported_seq":281,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.410654+0000","last_change":"2024-05-21T13:36:01.834253+0000","last_active":"2024-05-21T13:41:07.410654+0000","last_peered":"2024-05-21T13:41:07.410654+0000","last_clean":"2024-05-21T13:41:07.410654+0000","last_became_active":"2024-05-21T13:36:01.832972+0000","last_became_peered":"2024-05-21T13:36:01.832972+0000","last_unstale":"2024-05-21T13:41:07.410654+0000","last_undegraded":"2024-05-21T13:41:07.410654+0000","last_fullsized":"2024-05-21T13:41:07.410654+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":261,"log_dups_size":0,"ondisk_log_size":261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:52:05.576063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":261,"num_write_kb":712704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"27'9","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.828863+0000","last_change":"2024-05-21T13:35:57.766504+0000","last_active":"2024-05-21T13:41:05.828863+0000","last_peered":"2024-05-21T13:41:05.828863+0000","last_clean":"2024-05-21T13:41:05.828863+0000","last_became_active":"2024-05-21T13:35:57.765756+0000","last_became_peered":"2024-05-21T13:35:57.765756+0000","last_unstale":"2024-05-21T13:41:05.828863+0000","last_undegraded":"2024-05-21T13:41:05.828863+0000","last_fullsized":"2024-05-21T13:41:05.828863+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:52:13.025110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:38:13.534751+0000","last_change":"2024-05-21T13:35:56.770347+0000","last_active":"2024-05-21T13:38:13.534751+0000","last_peered":"2024-05-21T13:38:13.534751+0000","last_clean":"2024-05-21T13:38:13.534751+0000","last_became_active":"2024-05-21T13:35:56.769767+0000","last_became_peered":"2024-05-21T13:35:56.769767+0000","last_unstale":"2024-05-21T13:38:13.534751+0000","last_undegraded":"2024-05-21T13:38:13.534751+0000","last_fullsized":"2024-05-21T13:38:13.534751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:40:01.698967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"27'318","reported_seq":338,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.383172+0000","last_change":"2024-05-21T13:36:01.827091+0000","last_active":"2024-05-21T13:41:07.383172+0000","last_peered":"2024-05-21T13:41:07.383172+0000","last_clean":"2024-05-21T13:41:07.383172+0000","last_became_active":"2024-05-21T13:36:01.826686+0000","last_became_peered":"2024-05-21T13:36:01.826686+0000","last_unstale":"2024-05-21T13:41:07.383172+0000","last_undegraded":"2024-05-21T13:41:07.383172+0000","last_fullsized":"2024-05-21T13:41:07.383172+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":318,"log_dups_size":0,"ondisk_log_size":318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:42:47.638921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":318,"num_write_kb":868352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"27'5","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.816970+0000","last_change":"2024-05-21T13:35:57.781528+0000","last_active":"2024-05-21T13:41:05.816970+0000","last_peered":"2024-05-21T13:41:05.816970+0000","last_clean":"2024-05-21T13:41:05.816970+0000","last_became_active":"2024-05-21T13:35:57.781111+0000","last_became_peered":"2024-05-21T13:35:57.781111+0000","last_unstale":"2024-05-21T13:41:05.816970+0000","last_undegraded":"2024-05-21T13:41:05.816970+0000","last_fullsized":"2024-05-21T13:41:05.816970+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:15:43.847640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"25'2","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:38:15.546666+0000","last_change":"2024-05-21T13:35:56.755413+0000","last_active":"2024-05-21T13:38:15.546666+0000","last_peered":"2024-05-21T13:38:15.546666+0000","last_clean":"2024-05-21T13:38:15.546666+0000","last_became_active":"2024-05-21T13:35:56.755158+0000","last_became_peered":"2024-05-21T13:35:56.755158+0000","last_unstale":"2024-05-21T13:38:15.546666+0000","last_undegraded":"2024-05-21T13:38:15.546666+0000","last_fullsized":"2024-05-21T13:38:15.546666+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:23:05.102098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"27'258","reported_seq":278,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.275439+0000","last_change":"2024-05-21T13:36:01.827237+0000","last_active":"2024-05-21T13:41:07.275439+0000","last_peered":"2024-05-21T13:41:07.275439+0000","last_clean":"2024-05-21T13:41:07.275439+0000","last_became_active":"2024-05-21T13:36:01.826374+0000","last_became_peered":"2024-05-21T13:36:01.826374+0000","last_unstale":"2024-05-21T13:41:07.275439+0000","last_undegraded":"2024-05-21T13:41:07.275439+0000","last_fullsized":"2024-05-21T13:41:07.275439+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":258,"log_dups_size":0,"ondisk_log_size":258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:12:33.528068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":258,"num_write_kb":704512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"27'6","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.815755+0000","last_change":"2024-05-21T13:35:57.787940+0000","last_active":"2024-05-21T13:41:05.815755+0000","last_peered":"2024-05-21T13:41:05.815755+0000","last_clean":"2024-05-21T13:41:05.815755+0000","last_became_active":"2024-05-21T13:35:57.787544+0000","last_became_peered":"2024-05-21T13:35:57.787544+0000","last_unstale":"2024-05-21T13:41:05.815755+0000","last_undegraded":"2024-05-21T13:41:05.815755+0000","last_fullsized":"2024-05-21T13:41:05.815755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:46:20.335316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"27'16","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:40:38.563607+0000","last_change":"2024-05-21T13:35:56.756262+0000","last_active":"2024-05-21T13:40:38.563607+0000","last_peered":"2024-05-21T13:40:38.563607+0000","last_clean":"2024-05-21T13:40:38.563607+0000","last_became_active":"2024-05-21T13:35:56.752342+0000","last_became_peered":"2024-05-21T13:35:56.752342+0000","last_unstale":"2024-05-21T13:40:38.563607+0000","last_undegraded":"2024-05-21T13:40:38.563607+0000","last_fullsized":"2024-05-21T13:40:38.563607+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:59:09.541382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"27'360","reported_seq":380,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.427307+0000","last_change":"2024-05-21T13:36:01.859498+0000","last_active":"2024-05-21T13:41:07.427307+0000","last_peered":"2024-05-21T13:41:07.427307+0000","last_clean":"2024-05-21T13:41:07.427307+0000","last_became_active":"2024-05-21T13:36:01.857707+0000","last_became_peered":"2024-05-21T13:36:01.857707+0000","last_unstale":"2024-05-21T13:41:07.427307+0000","last_undegraded":"2024-05-21T13:41:07.427307+0000","last_fullsized":"2024-05-21T13:41:07.427307+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:38:06.966814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":360,"num_write_kb":983040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"27'6","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.806663+0000","last_change":"2024-05-21T13:35:57.783007+0000","last_active":"2024-05-21T13:41:05.806663+0000","last_peered":"2024-05-21T13:41:05.806663+0000","last_clean":"2024-05-21T13:41:05.806663+0000","last_became_active":"2024-05-21T13:35:57.782330+0000","last_became_peered":"2024-05-21T13:35:57.782330+0000","last_unstale":"2024-05-21T13:41:05.806663+0000","last_undegraded":"2024-05-21T13:41:05.806663+0000","last_fullsized":"2024-05-21T13:41:05.806663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:26:14.697766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"25'3","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:38:20.547215+0000","last_change":"2024-05-21T13:35:56.745787+0000","last_active":"2024-05-21T13:38:20.547215+0000","last_peered":"2024-05-21T13:38:20.547215+0000","last_clean":"2024-05-21T13:38:20.547215+0000","last_became_active":"2024-05-21T13:35:56.745202+0000","last_became_peered":"2024-05-21T13:35:56.745202+0000","last_unstale":"2024-05-21T13:38:20.547215+0000","last_undegraded":"2024-05-21T13:38:20.547215+0000","last_fullsized":"2024-05-21T13:38:20.547215+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:31:13.498003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"27'273","reported_seq":293,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.415841+0000","last_change":"2024-05-21T13:36:01.858550+0000","last_active":"2024-05-21T13:41:07.415841+0000","last_peered":"2024-05-21T13:41:07.415841+0000","last_clean":"2024-05-21T13:41:07.415841+0000","last_became_active":"2024-05-21T13:36:01.857716+0000","last_became_peered":"2024-05-21T13:36:01.857716+0000","last_unstale":"2024-05-21T13:41:07.415841+0000","last_undegraded":"2024-05-21T13:41:07.415841+0000","last_fullsized":"2024-05-21T13:41:07.415841+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:48:32.490678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"27'15","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.824416+0000","last_change":"2024-05-21T13:35:57.799702+0000","last_active":"2024-05-21T13:41:05.824416+0000","last_peered":"2024-05-21T13:41:05.824416+0000","last_clean":"2024-05-21T13:41:05.824416+0000","last_became_active":"2024-05-21T13:35:57.799225+0000","last_became_peered":"2024-05-21T13:35:57.799225+0000","last_unstale":"2024-05-21T13:41:05.824416+0000","last_undegraded":"2024-05-21T13:41:05.824416+0000","last_fullsized":"2024-05-21T13:41:05.824416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:29:54.094448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"25'3","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:38:20.556128+0000","last_change":"2024-05-21T13:35:56.742650+0000","last_active":"2024-05-21T13:38:20.556128+0000","last_peered":"2024-05-21T13:38:20.556128+0000","last_clean":"2024-05-21T13:38:20.556128+0000","last_became_active":"2024-05-21T13:35:56.742296+0000","last_became_peered":"2024-05-21T13:35:56.742296+0000","last_unstale":"2024-05-21T13:38:20.556128+0000","last_undegraded":"2024-05-21T13:38:20.556128+0000","last_fullsized":"2024-05-21T13:38:20.556128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:18:55.514845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"27'273","reported_seq":293,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.341060+0000","last_change":"2024-05-21T13:36:01.873708+0000","last_active":"2024-05-21T13:41:07.341060+0000","last_peered":"2024-05-21T13:41:07.341060+0000","last_clean":"2024-05-21T13:41:07.341060+0000","last_became_active":"2024-05-21T13:36:01.872320+0000","last_became_peered":"2024-05-21T13:36:01.872320+0000","last_unstale":"2024-05-21T13:41:07.341060+0000","last_undegraded":"2024-05-21T13:41:07.341060+0000","last_fullsized":"2024-05-21T13:41:07.341060+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:01:15.545756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"27'10","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.819407+0000","last_change":"2024-05-21T13:35:57.802763+0000","last_active":"2024-05-21T13:41:05.819407+0000","last_peered":"2024-05-21T13:41:05.819407+0000","last_clean":"2024-05-21T13:41:05.819407+0000","last_became_active":"2024-05-21T13:35:57.802433+0000","last_became_peered":"2024-05-21T13:35:57.802433+0000","last_unstale":"2024-05-21T13:41:05.819407+0000","last_undegraded":"2024-05-21T13:41:05.819407+0000","last_fullsized":"2024-05-21T13:41:05.819407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:09:48.463186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"25'6","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:38:20.545542+0000","last_change":"2024-05-21T13:35:56.754087+0000","last_active":"2024-05-21T13:38:20.545542+0000","last_peered":"2024-05-21T13:38:20.545542+0000","last_clean":"2024-05-21T13:38:20.545542+0000","last_became_active":"2024-05-21T13:35:56.753319+0000","last_became_peered":"2024-05-21T13:35:56.753319+0000","last_unstale":"2024-05-21T13:38:20.545542+0000","last_undegraded":"2024-05-21T13:38:20.545542+0000","last_fullsized":"2024-05-21T13:38:20.545542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:19:21.276993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"27'327","reported_seq":347,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.315452+0000","last_change":"2024-05-21T13:36:01.836017+0000","last_active":"2024-05-21T13:41:07.315452+0000","last_peered":"2024-05-21T13:41:07.315452+0000","last_clean":"2024-05-21T13:41:07.315452+0000","last_became_active":"2024-05-21T13:36:01.835450+0000","last_became_peered":"2024-05-21T13:36:01.835450+0000","last_unstale":"2024-05-21T13:41:07.315452+0000","last_undegraded":"2024-05-21T13:41:07.315452+0000","last_fullsized":"2024-05-21T13:41:07.315452+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:05:56.077605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":327,"num_write_kb":892928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"27'6","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.819794+0000","last_change":"2024-05-21T13:35:57.787177+0000","last_active":"2024-05-21T13:41:05.819794+0000","last_peered":"2024-05-21T13:41:05.819794+0000","last_clean":"2024-05-21T13:41:05.819794+0000","last_became_active":"2024-05-21T13:35:57.786401+0000","last_became_peered":"2024-05-21T13:35:57.786401+0000","last_unstale":"2024-05-21T13:41:05.819794+0000","last_undegraded":"2024-05-21T13:41:05.819794+0000","last_fullsized":"2024-05-21T13:41:05.819794+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:17:18.939002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'99","reported_seq":127,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.851553+0000","last_change":"2024-05-21T13:35:56.751229+0000","last_active":"2024-05-21T13:41:05.851553+0000","last_peered":"2024-05-21T13:41:05.851553+0000","last_clean":"2024-05-21T13:41:05.851553+0000","last_became_active":"2024-05-21T13:35:56.750831+0000","last_became_peered":"2024-05-21T13:35:56.750831+0000","last_unstale":"2024-05-21T13:41:05.851553+0000","last_undegraded":"2024-05-21T13:41:05.851553+0000","last_fullsized":"2024-05-21T13:41:05.851553+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:03:40.186241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":208737,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":99,"num_write_kb":246,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"27'289","reported_seq":309,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.407451+0000","last_change":"2024-05-21T13:36:01.832691+0000","last_active":"2024-05-21T13:41:07.407451+0000","last_peered":"2024-05-21T13:41:07.407451+0000","last_clean":"2024-05-21T13:41:07.407451+0000","last_became_active":"2024-05-21T13:36:01.831476+0000","last_became_peered":"2024-05-21T13:36:01.831476+0000","last_unstale":"2024-05-21T13:41:07.407451+0000","last_undegraded":"2024-05-21T13:41:07.407451+0000","last_fullsized":"2024-05-21T13:41:07.407451+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":289,"log_dups_size":0,"ondisk_log_size":289,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:08:38.092592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":288,"num_write_kb":786432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"27'11","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.817770+0000","last_change":"2024-05-21T13:35:57.788547+0000","last_active":"2024-05-21T13:41:05.817770+0000","last_peered":"2024-05-21T13:41:05.817770+0000","last_clean":"2024-05-21T13:41:05.817770+0000","last_became_active":"2024-05-21T13:35:57.787785+0000","last_became_peered":"2024-05-21T13:35:57.787785+0000","last_unstale":"2024-05-21T13:41:05.817770+0000","last_undegraded":"2024-05-21T13:41:05.817770+0000","last_fullsized":"2024-05-21T13:41:05.817770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:51:08.781399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"27'10","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:08.320430+0000","last_change":"2024-05-21T13:35:56.760557+0000","last_active":"2024-05-21T13:41:08.320430+0000","last_peered":"2024-05-21T13:41:08.320430+0000","last_clean":"2024-05-21T13:41:08.320430+0000","last_became_active":"2024-05-21T13:35:56.759728+0000","last_became_peered":"2024-05-21T13:35:56.759728+0000","last_unstale":"2024-05-21T13:41:08.320430+0000","last_undegraded":"2024-05-21T13:41:08.320430+0000","last_fullsized":"2024-05-21T13:41:08.320430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:56:19.754940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"27'297","reported_seq":317,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.383028+0000","last_change":"2024-05-21T13:36:01.861622+0000","last_active":"2024-05-21T13:41:07.383028+0000","last_peered":"2024-05-21T13:41:07.383028+0000","last_clean":"2024-05-21T13:41:07.383028+0000","last_became_active":"2024-05-21T13:36:01.861172+0000","last_became_peered":"2024-05-21T13:36:01.861172+0000","last_unstale":"2024-05-21T13:41:07.383028+0000","last_undegraded":"2024-05-21T13:41:07.383028+0000","last_fullsized":"2024-05-21T13:41:07.383028+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:39:53.211812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":297,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"27'9","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.819358+0000","last_change":"2024-05-21T13:35:57.804520+0000","last_active":"2024-05-21T13:41:05.819358+0000","last_peered":"2024-05-21T13:41:05.819358+0000","last_clean":"2024-05-21T13:41:05.819358+0000","last_became_active":"2024-05-21T13:35:57.804139+0000","last_became_peered":"2024-05-21T13:35:57.804139+0000","last_unstale":"2024-05-21T13:41:05.819358+0000","last_undegraded":"2024-05-21T13:41:05.819358+0000","last_fullsized":"2024-05-21T13:41:05.819358+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:21:52.433019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"25'2","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:38:25.548413+0000","last_change":"2024-05-21T13:35:56.733821+0000","last_active":"2024-05-21T13:38:25.548413+0000","last_peered":"2024-05-21T13:38:25.548413+0000","last_clean":"2024-05-21T13:38:25.548413+0000","last_became_active":"2024-05-21T13:35:56.732488+0000","last_became_peered":"2024-05-21T13:35:56.732488+0000","last_unstale":"2024-05-21T13:38:25.548413+0000","last_undegraded":"2024-05-21T13:38:25.548413+0000","last_fullsized":"2024-05-21T13:38:25.548413+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:10:01.786931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"27'297","reported_seq":317,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.370538+0000","last_change":"2024-05-21T13:36:01.868781+0000","last_active":"2024-05-21T13:41:07.370538+0000","last_peered":"2024-05-21T13:41:07.370538+0000","last_clean":"2024-05-21T13:41:07.370538+0000","last_became_active":"2024-05-21T13:36:01.864254+0000","last_became_peered":"2024-05-21T13:36:01.864254+0000","last_unstale":"2024-05-21T13:41:07.370538+0000","last_undegraded":"2024-05-21T13:41:07.370538+0000","last_fullsized":"2024-05-21T13:41:07.370538+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:34:12.632333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":297,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"27'10","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.820694+0000","last_change":"2024-05-21T13:35:57.788313+0000","last_active":"2024-05-21T13:41:05.820694+0000","last_peered":"2024-05-21T13:41:05.820694+0000","last_clean":"2024-05-21T13:41:05.820694+0000","last_became_active":"2024-05-21T13:35:57.787963+0000","last_became_peered":"2024-05-21T13:35:57.787963+0000","last_unstale":"2024-05-21T13:41:05.820694+0000","last_undegraded":"2024-05-21T13:41:05.820694+0000","last_fullsized":"2024-05-21T13:41:05.820694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:16:21.586571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"27'5","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:40:50.568172+0000","last_change":"2024-05-21T13:35:56.748334+0000","last_active":"2024-05-21T13:40:50.568172+0000","last_peered":"2024-05-21T13:40:50.568172+0000","last_clean":"2024-05-21T13:40:50.568172+0000","last_became_active":"2024-05-21T13:35:56.748049+0000","last_became_peered":"2024-05-21T13:35:56.748049+0000","last_unstale":"2024-05-21T13:40:50.568172+0000","last_undegraded":"2024-05-21T13:40:50.568172+0000","last_fullsized":"2024-05-21T13:40:50.568172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:59:02.802905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"27'327","reported_seq":347,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.407451+0000","last_change":"2024-05-21T13:36:01.856216+0000","last_active":"2024-05-21T13:41:07.407451+0000","last_peered":"2024-05-21T13:41:07.407451+0000","last_clean":"2024-05-21T13:41:07.407451+0000","last_became_active":"2024-05-21T13:36:01.855417+0000","last_became_peered":"2024-05-21T13:36:01.855417+0000","last_unstale":"2024-05-21T13:41:07.407451+0000","last_undegraded":"2024-05-21T13:41:07.407451+0000","last_fullsized":"2024-05-21T13:41:07.407451+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:36:01.423944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":327,"num_write_kb":892928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"27'273","reported_seq":293,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.396046+0000","last_change":"2024-05-21T13:36:01.838966+0000","last_active":"2024-05-21T13:41:07.396046+0000","last_peered":"2024-05-21T13:41:07.396046+0000","last_clean":"2024-05-21T13:41:07.396046+0000","last_became_active":"2024-05-21T13:36:01.837777+0000","last_became_peered":"2024-05-21T13:36:01.837777+0000","last_unstale":"2024-05-21T13:41:07.396046+0000","last_undegraded":"2024-05-21T13:41:07.396046+0000","last_fullsized":"2024-05-21T13:41:07.396046+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:40:55.688338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"27'11","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.798229+0000","last_change":"2024-05-21T13:35:57.762719+0000","last_active":"2024-05-21T13:41:05.798229+0000","last_peered":"2024-05-21T13:41:05.798229+0000","last_clean":"2024-05-21T13:41:05.798229+0000","last_became_active":"2024-05-21T13:35:57.762071+0000","last_became_peered":"2024-05-21T13:35:57.762071+0000","last_unstale":"2024-05-21T13:41:05.798229+0000","last_undegraded":"2024-05-21T13:41:05.798229+0000","last_fullsized":"2024-05-21T13:41:05.798229+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:55:37.631695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"25'1","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:38:25.556862+0000","last_change":"2024-05-21T13:35:56.751481+0000","last_active":"2024-05-21T13:38:25.556862+0000","last_peered":"2024-05-21T13:38:25.556862+0000","last_clean":"2024-05-21T13:38:25.556862+0000","last_became_active":"2024-05-21T13:35:56.751201+0000","last_became_peered":"2024-05-21T13:35:56.751201+0000","last_unstale":"2024-05-21T13:38:25.556862+0000","last_undegraded":"2024-05-21T13:38:25.556862+0000","last_fullsized":"2024-05-21T13:38:25.556862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:33:28.720246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"27'267","reported_seq":287,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.412161+0000","last_change":"2024-05-21T13:36:01.837042+0000","last_active":"2024-05-21T13:41:07.412161+0000","last_peered":"2024-05-21T13:41:07.412161+0000","last_clean":"2024-05-21T13:41:07.412161+0000","last_became_active":"2024-05-21T13:36:01.836194+0000","last_became_peered":"2024-05-21T13:36:01.836194+0000","last_unstale":"2024-05-21T13:41:07.412161+0000","last_undegraded":"2024-05-21T13:41:07.412161+0000","last_fullsized":"2024-05-21T13:41:07.412161+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":267,"log_dups_size":0,"ondisk_log_size":267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:15:50.751693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":267,"num_write_kb":729088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"27'8","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.804092+0000","last_change":"2024-05-21T13:35:57.788838+0000","last_active":"2024-05-21T13:41:05.804092+0000","last_peered":"2024-05-21T13:41:05.804092+0000","last_clean":"2024-05-21T13:41:05.804092+0000","last_became_active":"2024-05-21T13:35:57.786307+0000","last_became_peered":"2024-05-21T13:35:57.786307+0000","last_unstale":"2024-05-21T13:41:05.804092+0000","last_undegraded":"2024-05-21T13:41:05.804092+0000","last_fullsized":"2024-05-21T13:41:05.804092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:52:09.086807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"25'2","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:38:25.543227+0000","last_change":"2024-05-21T13:35:56.746564+0000","last_active":"2024-05-21T13:38:25.543227+0000","last_peered":"2024-05-21T13:38:25.543227+0000","last_clean":"2024-05-21T13:38:25.543227+0000","last_became_active":"2024-05-21T13:35:56.745884+0000","last_became_peered":"2024-05-21T13:35:56.745884+0000","last_unstale":"2024-05-21T13:38:25.543227+0000","last_undegraded":"2024-05-21T13:38:25.543227+0000","last_fullsized":"2024-05-21T13:38:25.543227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:01:44.738607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"25'3","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:38:30.557677+0000","last_change":"2024-05-21T13:35:56.753930+0000","last_active":"2024-05-21T13:38:30.557677+0000","last_peered":"2024-05-21T13:38:30.557677+0000","last_clean":"2024-05-21T13:38:30.557677+0000","last_became_active":"2024-05-21T13:35:56.753499+0000","last_became_peered":"2024-05-21T13:35:56.753499+0000","last_unstale":"2024-05-21T13:38:30.557677+0000","last_undegraded":"2024-05-21T13:38:30.557677+0000","last_fullsized":"2024-05-21T13:38:30.557677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:40:51.516544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"27'8","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.797802+0000","last_change":"2024-05-21T13:36:39.802963+0000","last_active":"2024-05-21T13:41:05.797802+0000","last_peered":"2024-05-21T13:41:05.797802+0000","last_clean":"2024-05-21T13:41:05.797802+0000","last_became_active":"2024-05-21T13:36:39.802110+0000","last_became_peered":"2024-05-21T13:36:39.802110+0000","last_unstale":"2024-05-21T13:41:05.797802+0000","last_undegraded":"2024-05-21T13:41:05.797802+0000","last_fullsized":"2024-05-21T13:41:05.797802+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:41:46.124629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"27'297","reported_seq":317,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.324032+0000","last_change":"2024-05-21T13:36:01.844240+0000","last_active":"2024-05-21T13:41:07.324032+0000","last_peered":"2024-05-21T13:41:07.324032+0000","last_clean":"2024-05-21T13:41:07.324032+0000","last_became_active":"2024-05-21T13:36:01.842792+0000","last_became_peered":"2024-05-21T13:36:01.842792+0000","last_unstale":"2024-05-21T13:41:07.324032+0000","last_undegraded":"2024-05-21T13:41:07.324032+0000","last_fullsized":"2024-05-21T13:41:07.324032+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:19:54.016465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":297,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"27'7","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:40:59.597142+0000","last_change":"2024-05-21T13:35:56.770864+0000","last_active":"2024-05-21T13:40:59.597142+0000","last_peered":"2024-05-21T13:40:59.597142+0000","last_clean":"2024-05-21T13:40:59.597142+0000","last_became_active":"2024-05-21T13:35:56.766873+0000","last_became_peered":"2024-05-21T13:35:56.766873+0000","last_unstale":"2024-05-21T13:40:59.597142+0000","last_undegraded":"2024-05-21T13:40:59.597142+0000","last_fullsized":"2024-05-21T13:40:59.597142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:13:02.633858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"27'7","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.807437+0000","last_change":"2024-05-21T13:35:57.787563+0000","last_active":"2024-05-21T13:41:05.807437+0000","last_peered":"2024-05-21T13:41:05.807437+0000","last_clean":"2024-05-21T13:41:05.807437+0000","last_became_active":"2024-05-21T13:35:57.787255+0000","last_became_peered":"2024-05-21T13:35:57.787255+0000","last_unstale":"2024-05-21T13:41:05.807437+0000","last_undegraded":"2024-05-21T13:41:05.807437+0000","last_fullsized":"2024-05-21T13:41:05.807437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:32:49.325049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"27'312","reported_seq":332,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.373780+0000","last_change":"2024-05-21T13:36:01.868514+0000","last_active":"2024-05-21T13:41:07.373780+0000","last_peered":"2024-05-21T13:41:07.373780+0000","last_clean":"2024-05-21T13:41:07.373780+0000","last_became_active":"2024-05-21T13:36:01.867522+0000","last_became_peered":"2024-05-21T13:36:01.867522+0000","last_unstale":"2024-05-21T13:41:07.373780+0000","last_undegraded":"2024-05-21T13:41:07.373780+0000","last_fullsized":"2024-05-21T13:41:07.373780+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:19:13.533784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":312,"num_write_kb":851968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"27'9","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.809025+0000","last_change":"2024-05-21T13:35:57.782641+0000","last_active":"2024-05-21T13:41:05.809025+0000","last_peered":"2024-05-21T13:41:05.809025+0000","last_clean":"2024-05-21T13:41:05.809025+0000","last_became_active":"2024-05-21T13:35:57.782233+0000","last_became_peered":"2024-05-21T13:35:57.782233+0000","last_unstale":"2024-05-21T13:41:05.809025+0000","last_undegraded":"2024-05-21T13:41:05.809025+0000","last_fullsized":"2024-05-21T13:41:05.809025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:55:18.808229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"27'12","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.792142+0000","last_change":"2024-05-21T13:35:57.770591+0000","last_active":"2024-05-21T13:41:05.792142+0000","last_peered":"2024-05-21T13:41:05.792142+0000","last_clean":"2024-05-21T13:41:05.792142+0000","last_became_active":"2024-05-21T13:35:57.769785+0000","last_became_peered":"2024-05-21T13:35:57.769785+0000","last_unstale":"2024-05-21T13:41:05.792142+0000","last_undegraded":"2024-05-21T13:41:05.792142+0000","last_fullsized":"2024-05-21T13:41:05.792142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:18:28.168393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"27'8","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.817815+0000","last_change":"2024-05-21T13:35:57.799153+0000","last_active":"2024-05-21T13:41:05.817815+0000","last_peered":"2024-05-21T13:41:05.817815+0000","last_clean":"2024-05-21T13:41:05.817815+0000","last_became_active":"2024-05-21T13:35:57.796495+0000","last_became_peered":"2024-05-21T13:35:57.796495+0000","last_unstale":"2024-05-21T13:41:05.817815+0000","last_undegraded":"2024-05-21T13:41:05.817815+0000","last_fullsized":"2024-05-21T13:41:05.817815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:53:04.109036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"27'7","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.800426+0000","last_change":"2024-05-21T13:35:57.784335+0000","last_active":"2024-05-21T13:41:05.800426+0000","last_peered":"2024-05-21T13:41:05.800426+0000","last_clean":"2024-05-21T13:41:05.800426+0000","last_became_active":"2024-05-21T13:35:57.783968+0000","last_became_peered":"2024-05-21T13:35:57.783968+0000","last_unstale":"2024-05-21T13:41:05.800426+0000","last_undegraded":"2024-05-21T13:41:05.800426+0000","last_fullsized":"2024-05-21T13:41:05.800426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:57:20.832617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"27'4","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.818581+0000","last_change":"2024-05-21T13:35:57.795153+0000","last_active":"2024-05-21T13:41:05.818581+0000","last_peered":"2024-05-21T13:41:05.818581+0000","last_clean":"2024-05-21T13:41:05.818581+0000","last_became_active":"2024-05-21T13:35:57.794885+0000","last_became_peered":"2024-05-21T13:35:57.794885+0000","last_unstale":"2024-05-21T13:41:05.818581+0000","last_undegraded":"2024-05-21T13:41:05.818581+0000","last_fullsized":"2024-05-21T13:41:05.818581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:17:00.454371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"27'6","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.789707+0000","last_change":"2024-05-21T13:35:57.778916+0000","last_active":"2024-05-21T13:41:05.789707+0000","last_peered":"2024-05-21T13:41:05.789707+0000","last_clean":"2024-05-21T13:41:05.789707+0000","last_became_active":"2024-05-21T13:35:57.778171+0000","last_became_peered":"2024-05-21T13:35:57.778171+0000","last_unstale":"2024-05-21T13:41:05.789707+0000","last_undegraded":"2024-05-21T13:41:05.789707+0000","last_fullsized":"2024-05-21T13:41:05.789707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:15:37.425836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"27'15","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.820287+0000","last_change":"2024-05-21T13:35:57.791367+0000","last_active":"2024-05-21T13:41:05.820287+0000","last_peered":"2024-05-21T13:41:05.820287+0000","last_clean":"2024-05-21T13:41:05.820287+0000","last_became_active":"2024-05-21T13:35:57.790971+0000","last_became_peered":"2024-05-21T13:35:57.790971+0000","last_unstale":"2024-05-21T13:41:05.820287+0000","last_undegraded":"2024-05-21T13:41:05.820287+0000","last_fullsized":"2024-05-21T13:41:05.820287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:14:47.428631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"27'2","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.810357+0000","last_change":"2024-05-21T13:35:57.785257+0000","last_active":"2024-05-21T13:41:05.810357+0000","last_peered":"2024-05-21T13:41:05.810357+0000","last_clean":"2024-05-21T13:41:05.810357+0000","last_became_active":"2024-05-21T13:35:57.781533+0000","last_became_peered":"2024-05-21T13:35:57.781533+0000","last_unstale":"2024-05-21T13:41:05.810357+0000","last_undegraded":"2024-05-21T13:41:05.810357+0000","last_fullsized":"2024-05-21T13:41:05.810357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:18:32.591803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"27'6","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.815829+0000","last_change":"2024-05-21T13:35:57.799128+0000","last_active":"2024-05-21T13:41:05.815829+0000","last_peered":"2024-05-21T13:41:05.815829+0000","last_clean":"2024-05-21T13:41:05.815829+0000","last_became_active":"2024-05-21T13:35:57.797044+0000","last_became_peered":"2024-05-21T13:35:57.797044+0000","last_unstale":"2024-05-21T13:41:05.815829+0000","last_undegraded":"2024-05-21T13:41:05.815829+0000","last_fullsized":"2024-05-21T13:41:05.815829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:57:13.472309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"27'8","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.810610+0000","last_change":"2024-05-21T13:35:57.789768+0000","last_active":"2024-05-21T13:41:05.810610+0000","last_peered":"2024-05-21T13:41:05.810610+0000","last_clean":"2024-05-21T13:41:05.810610+0000","last_became_active":"2024-05-21T13:35:57.789474+0000","last_became_peered":"2024-05-21T13:35:57.789474+0000","last_unstale":"2024-05-21T13:41:05.810610+0000","last_undegraded":"2024-05-21T13:41:05.810610+0000","last_fullsized":"2024-05-21T13:41:05.810610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:42:53.993281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"27'10","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.817266+0000","last_change":"2024-05-21T13:35:57.756607+0000","last_active":"2024-05-21T13:41:05.817266+0000","last_peered":"2024-05-21T13:41:05.817266+0000","last_clean":"2024-05-21T13:41:05.817266+0000","last_became_active":"2024-05-21T13:35:57.755889+0000","last_became_peered":"2024-05-21T13:35:57.755889+0000","last_unstale":"2024-05-21T13:41:05.817266+0000","last_undegraded":"2024-05-21T13:41:05.817266+0000","last_fullsized":"2024-05-21T13:41:05.817266+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:16:19.541597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"27'11","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.810097+0000","last_change":"2024-05-21T13:35:57.775322+0000","last_active":"2024-05-21T13:41:05.810097+0000","last_peered":"2024-05-21T13:41:05.810097+0000","last_clean":"2024-05-21T13:41:05.810097+0000","last_became_active":"2024-05-21T13:35:57.774386+0000","last_became_peered":"2024-05-21T13:35:57.774386+0000","last_unstale":"2024-05-21T13:41:05.810097+0000","last_undegraded":"2024-05-21T13:41:05.810097+0000","last_fullsized":"2024-05-21T13:41:05.810097+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:01:02.106172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"27'8","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.828971+0000","last_change":"2024-05-21T13:35:57.769931+0000","last_active":"2024-05-21T13:41:05.828971+0000","last_peered":"2024-05-21T13:41:05.828971+0000","last_clean":"2024-05-21T13:41:05.828971+0000","last_became_active":"2024-05-21T13:35:57.769149+0000","last_became_peered":"2024-05-21T13:35:57.769149+0000","last_unstale":"2024-05-21T13:41:05.828971+0000","last_undegraded":"2024-05-21T13:41:05.828971+0000","last_fullsized":"2024-05-21T13:41:05.828971+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:55:56.268307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"27'7","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.824572+0000","last_change":"2024-05-21T13:35:57.796153+0000","last_active":"2024-05-21T13:41:05.824572+0000","last_peered":"2024-05-21T13:41:05.824572+0000","last_clean":"2024-05-21T13:41:05.824572+0000","last_became_active":"2024-05-21T13:35:57.795799+0000","last_became_peered":"2024-05-21T13:35:57.795799+0000","last_unstale":"2024-05-21T13:41:05.824572+0000","last_undegraded":"2024-05-21T13:41:05.824572+0000","last_fullsized":"2024-05-21T13:41:05.824572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:52:04.794391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"27'10","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.796637+0000","last_change":"2024-05-21T13:35:57.776414+0000","last_active":"2024-05-21T13:41:05.796637+0000","last_peered":"2024-05-21T13:41:05.796637+0000","last_clean":"2024-05-21T13:41:05.796637+0000","last_became_active":"2024-05-21T13:35:57.775573+0000","last_became_peered":"2024-05-21T13:35:57.775573+0000","last_unstale":"2024-05-21T13:41:05.796637+0000","last_undegraded":"2024-05-21T13:41:05.796637+0000","last_fullsized":"2024-05-21T13:41:05.796637+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:47:47.624662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"27'8","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.823028+0000","last_change":"2024-05-21T13:35:57.799673+0000","last_active":"2024-05-21T13:41:05.823028+0000","last_peered":"2024-05-21T13:41:05.823028+0000","last_clean":"2024-05-21T13:41:05.823028+0000","last_became_active":"2024-05-21T13:35:57.799313+0000","last_became_peered":"2024-05-21T13:35:57.799313+0000","last_unstale":"2024-05-21T13:41:05.823028+0000","last_undegraded":"2024-05-21T13:41:05.823028+0000","last_fullsized":"2024-05-21T13:41:05.823028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:40:52.516216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"27'9","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.815899+0000","last_change":"2024-05-21T13:35:57.790705+0000","last_active":"2024-05-21T13:41:05.815899+0000","last_peered":"2024-05-21T13:41:05.815899+0000","last_clean":"2024-05-21T13:41:05.815899+0000","last_became_active":"2024-05-21T13:35:57.787735+0000","last_became_peered":"2024-05-21T13:35:57.787735+0000","last_unstale":"2024-05-21T13:41:05.815899+0000","last_undegraded":"2024-05-21T13:41:05.815899+0000","last_fullsized":"2024-05-21T13:41:05.815899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:17:24.376182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"27'7","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.825286+0000","last_change":"2024-05-21T13:35:57.786838+0000","last_active":"2024-05-21T13:41:05.825286+0000","last_peered":"2024-05-21T13:41:05.825286+0000","last_clean":"2024-05-21T13:41:05.825286+0000","last_became_active":"2024-05-21T13:35:57.786403+0000","last_became_peered":"2024-05-21T13:35:57.786403+0000","last_unstale":"2024-05-21T13:41:05.825286+0000","last_undegraded":"2024-05-21T13:41:05.825286+0000","last_fullsized":"2024-05-21T13:41:05.825286+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:29:28.760793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"27'8","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.791110+0000","last_change":"2024-05-21T13:35:57.783561+0000","last_active":"2024-05-21T13:41:05.791110+0000","last_peered":"2024-05-21T13:41:05.791110+0000","last_clean":"2024-05-21T13:41:05.791110+0000","last_became_active":"2024-05-21T13:35:57.783060+0000","last_became_peered":"2024-05-21T13:35:57.783060+0000","last_unstale":"2024-05-21T13:41:05.791110+0000","last_undegraded":"2024-05-21T13:41:05.791110+0000","last_fullsized":"2024-05-21T13:41:05.791110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:27:27.261449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"27'10","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.817817+0000","last_change":"2024-05-21T13:35:57.788210+0000","last_active":"2024-05-21T13:41:05.817817+0000","last_peered":"2024-05-21T13:41:05.817817+0000","last_clean":"2024-05-21T13:41:05.817817+0000","last_became_active":"2024-05-21T13:35:57.787508+0000","last_became_peered":"2024-05-21T13:35:57.787508+0000","last_unstale":"2024-05-21T13:41:05.817817+0000","last_undegraded":"2024-05-21T13:41:05.817817+0000","last_fullsized":"2024-05-21T13:41:05.817817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:12:56.914580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"27'7","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.829116+0000","last_change":"2024-05-21T13:35:57.787335+0000","last_active":"2024-05-21T13:41:05.829116+0000","last_peered":"2024-05-21T13:41:05.829116+0000","last_clean":"2024-05-21T13:41:05.829116+0000","last_became_active":"2024-05-21T13:35:57.786292+0000","last_became_peered":"2024-05-21T13:35:57.786292+0000","last_unstale":"2024-05-21T13:41:05.829116+0000","last_undegraded":"2024-05-21T13:41:05.829116+0000","last_fullsized":"2024-05-21T13:41:05.829116+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:49:40.480948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"27'6","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.830434+0000","last_change":"2024-05-21T13:35:57.801121+0000","last_active":"2024-05-21T13:41:05.830434+0000","last_peered":"2024-05-21T13:41:05.830434+0000","last_clean":"2024-05-21T13:41:05.830434+0000","last_became_active":"2024-05-21T13:35:57.800858+0000","last_became_peered":"2024-05-21T13:35:57.800858+0000","last_unstale":"2024-05-21T13:41:05.830434+0000","last_undegraded":"2024-05-21T13:41:05.830434+0000","last_fullsized":"2024-05-21T13:41:05.830434+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:41:08.765821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"27'16","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.814491+0000","last_change":"2024-05-21T13:35:57.778753+0000","last_active":"2024-05-21T13:41:05.814491+0000","last_peered":"2024-05-21T13:41:05.814491+0000","last_clean":"2024-05-21T13:41:05.814491+0000","last_became_active":"2024-05-21T13:35:57.777962+0000","last_became_peered":"2024-05-21T13:35:57.777962+0000","last_unstale":"2024-05-21T13:41:05.814491+0000","last_undegraded":"2024-05-21T13:41:05.814491+0000","last_fullsized":"2024-05-21T13:41:05.814491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:51:49.102945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"27'11","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.819045+0000","last_change":"2024-05-21T13:35:57.798312+0000","last_active":"2024-05-21T13:41:05.819045+0000","last_peered":"2024-05-21T13:41:05.819045+0000","last_clean":"2024-05-21T13:41:05.819045+0000","last_became_active":"2024-05-21T13:35:57.797793+0000","last_became_peered":"2024-05-21T13:35:57.797793+0000","last_unstale":"2024-05-21T13:41:05.819045+0000","last_undegraded":"2024-05-21T13:41:05.819045+0000","last_fullsized":"2024-05-21T13:41:05.819045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:28:47.276868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"27'9","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.825487+0000","last_change":"2024-05-21T13:35:57.782412+0000","last_active":"2024-05-21T13:41:05.825487+0000","last_peered":"2024-05-21T13:41:05.825487+0000","last_clean":"2024-05-21T13:41:05.825487+0000","last_became_active":"2024-05-21T13:35:57.782058+0000","last_became_peered":"2024-05-21T13:35:57.782058+0000","last_unstale":"2024-05-21T13:41:05.825487+0000","last_undegraded":"2024-05-21T13:41:05.825487+0000","last_fullsized":"2024-05-21T13:41:05.825487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:39:49.142554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"27'5","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.810805+0000","last_change":"2024-05-21T13:35:57.779771+0000","last_active":"2024-05-21T13:41:05.810805+0000","last_peered":"2024-05-21T13:41:05.810805+0000","last_clean":"2024-05-21T13:41:05.810805+0000","last_became_active":"2024-05-21T13:35:57.779168+0000","last_became_peered":"2024-05-21T13:35:57.779168+0000","last_unstale":"2024-05-21T13:41:05.810805+0000","last_undegraded":"2024-05-21T13:41:05.810805+0000","last_fullsized":"2024-05-21T13:41:05.810805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T13:59:58.966203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"27'6","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.806310+0000","last_change":"2024-05-21T13:35:57.773098+0000","last_active":"2024-05-21T13:41:05.806310+0000","last_peered":"2024-05-21T13:41:05.806310+0000","last_clean":"2024-05-21T13:41:05.806310+0000","last_became_active":"2024-05-21T13:35:57.772268+0000","last_became_peered":"2024-05-21T13:35:57.772268+0000","last_unstale":"2024-05-21T13:41:05.806310+0000","last_undegraded":"2024-05-21T13:41:05.806310+0000","last_fullsized":"2024-05-21T13:41:05.806310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:05:25.482434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"27'4","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.829420+0000","last_change":"2024-05-21T13:35:57.788980+0000","last_active":"2024-05-21T13:41:05.829420+0000","last_peered":"2024-05-21T13:41:05.829420+0000","last_clean":"2024-05-21T13:41:05.829420+0000","last_became_active":"2024-05-21T13:35:57.788689+0000","last_became_peered":"2024-05-21T13:35:57.788689+0000","last_unstale":"2024-05-21T13:41:05.829420+0000","last_undegraded":"2024-05-21T13:41:05.829420+0000","last_fullsized":"2024-05-21T13:41:05.829420+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:15:07.615363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"27'8","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.809482+0000","last_change":"2024-05-21T13:35:57.772867+0000","last_active":"2024-05-21T13:41:05.809482+0000","last_peered":"2024-05-21T13:41:05.809482+0000","last_clean":"2024-05-21T13:41:05.809482+0000","last_became_active":"2024-05-21T13:35:57.772160+0000","last_became_peered":"2024-05-21T13:35:57.772160+0000","last_unstale":"2024-05-21T13:41:05.809482+0000","last_undegraded":"2024-05-21T13:41:05.809482+0000","last_fullsized":"2024-05-21T13:41:05.809482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:11:24.428796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"27'7","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.805509+0000","last_change":"2024-05-21T13:35:57.785297+0000","last_active":"2024-05-21T13:41:05.805509+0000","last_peered":"2024-05-21T13:41:05.805509+0000","last_clean":"2024-05-21T13:41:05.805509+0000","last_became_active":"2024-05-21T13:35:57.784741+0000","last_became_peered":"2024-05-21T13:35:57.784741+0000","last_unstale":"2024-05-21T13:41:05.805509+0000","last_undegraded":"2024-05-21T13:41:05.805509+0000","last_fullsized":"2024-05-21T13:41:05.805509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:45:08.507286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"27'4","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.800168+0000","last_change":"2024-05-21T13:35:57.788875+0000","last_active":"2024-05-21T13:41:05.800168+0000","last_peered":"2024-05-21T13:41:05.800168+0000","last_clean":"2024-05-21T13:41:05.800168+0000","last_became_active":"2024-05-21T13:35:57.786629+0000","last_became_peered":"2024-05-21T13:35:57.786629+0000","last_unstale":"2024-05-21T13:41:05.800168+0000","last_undegraded":"2024-05-21T13:41:05.800168+0000","last_fullsized":"2024-05-21T13:41:05.800168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:40:07.549210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"27'8","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.828969+0000","last_change":"2024-05-21T13:35:57.803316+0000","last_active":"2024-05-21T13:41:05.828969+0000","last_peered":"2024-05-21T13:41:05.828969+0000","last_clean":"2024-05-21T13:41:05.828969+0000","last_became_active":"2024-05-21T13:35:57.802925+0000","last_became_peered":"2024-05-21T13:35:57.802925+0000","last_unstale":"2024-05-21T13:41:05.828969+0000","last_undegraded":"2024-05-21T13:41:05.828969+0000","last_fullsized":"2024-05-21T13:41:05.828969+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:17:16.304097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9217,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9218,"ondisk_log_size":9218,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":503,"ondisk_log_size":503,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":213458,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":270,"num_write_kb":304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":581632,"data_stored":426916,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":240,"ondisk_log_size":240,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66916,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509509,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49528,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94322312,"statfs":{"total":96636764160,"available":96586047488,"internally_reserved":0,"allocated":311296,"data_stored":116594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,1,1],"upper_bound":8},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509509,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45352,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326488,"statfs":{"total":96636764160,"available":96590323712,"internally_reserved":0,"allocated":294912,"data_stored":116943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509508,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53676,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94318164,"statfs":{"total":96636764160,"available":96581799936,"internally_reserved":0,"allocated":299008,"data_stored":116383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509509,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27508,"kb_used_data":492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344332,"statfs":{"total":96636764160,"available":96608595968,"internally_reserved":0,"allocated":503808,"data_stored":323928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509509,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57892,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313948,"statfs":{"total":96636764160,"available":96577482752,"internally_reserved":0,"allocated":356352,"data_stored":705685,"data_compressed":33458,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509508,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39792,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94332048,"statfs":{"total":96636764160,"available":96596017152,"internally_reserved":0,"allocated":303104,"data_stored":116473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542211,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45428,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326412,"statfs":{"total":96636764160,"available":96590245888,"internally_reserved":0,"allocated":372736,"data_stored":707440,"data_compressed":33458,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1,0,0,0,1],"upper_bound":32},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574915,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45712,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326128,"statfs":{"total":96636764160,"available":96589955072,"internally_reserved":0,"allocated":663552,"data_stored":2421416,"data_compressed":104896,"data_compressed_allocated":131072,"data_compressed_original":2097152,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33458,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33458,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":221184,"data_stored":208771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":249856,"data_stored":210305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-21T13:41:13.289 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-21T13:41:13.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.482+0000 7f1406ebb640 1 Processor -- start 2024-05-21T13:41:13.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.482+0000 7f1406ebb640 1 -- start start 2024-05-21T13:41:13.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.486+0000 7f1406ebb640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1400152cc0 0x7f14000c4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:13.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.486+0000 7f1406ebb640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14000c9e30 0x7f14000ca2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:13.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.486+0000 7f1406ebb640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14001530a0 con 0x7f14000c66b0 2024-05-21T13:41:13.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.486+0000 7f1406ebb640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f14001592b0 con 0x7f1400152cc0 2024-05-21T13:41:13.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.486+0000 7f1406ebb640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f1400074840 con 0x7f14000c9e30 2024-05-21T13:41:13.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.486+0000 7f1404c57640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1400152cc0 0x7f14000c4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:13.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.486+0000 7f1404c57640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1400152cc0 0x7f14000c4bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36494/0 (socket says 172.21.15.22:36494) 2024-05-21T13:41:13.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.486+0000 7f1404c57640 1 -- 172.21.15.22:0/797222472 learned_addr learned my addr 172.21.15.22:0/797222472 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:41:13.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.486+0000 7f1405458640 1 --2- 172.21.15.22:0/797222472 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14000c9e30 0x7f14000ca2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:13.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.486+0000 7f1404c57640 1 -- 172.21.15.22:0/797222472 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14000c9e30 msgr2=0x7f14000ca2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:41:13.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.486+0000 7f1404c57640 1 --2- 172.21.15.22:0/797222472 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14000c9e30 0x7f14000ca2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:13.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.486+0000 7f1404c57640 1 -- 172.21.15.22:0/797222472 >> v1:172.21.15.22:6789/0 conn(0x7f14000c66b0 legacy=0x7f14000c7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:13.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.486+0000 7f1404c57640 1 -- 172.21.15.22:0/797222472 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14001589a0 con 0x7f1400152cc0 2024-05-21T13:41:13.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.486+0000 7f1404c57640 1 --2- 172.21.15.22:0/797222472 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1400152cc0 0x7f14000c4bf0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f13f0009870 tx=0x7f13f001c500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5acd90c47081ca0a server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:13.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.486+0000 7f13ff7fe640 1 -- 172.21.15.22:0/797222472 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13f00b0070 con 0x7f1400152cc0 2024-05-21T13:41:13.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.486+0000 7f13ff7fe640 1 -- 172.21.15.22:0/797222472 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13f00ab600 con 0x7f1400152cc0 2024-05-21T13:41:13.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.486+0000 7f13ff7fe640 1 -- 172.21.15.22:0/797222472 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13f00ab9d0 con 0x7f1400152cc0 2024-05-21T13:41:13.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.490+0000 7f1406ebb640 1 -- 172.21.15.22:0/797222472 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1400152cc0 msgr2=0x7f14000c4bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:13.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.490+0000 7f1406ebb640 1 --2- 172.21.15.22:0/797222472 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1400152cc0 0x7f14000c4bf0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f13f0009870 tx=0x7f13f001c500 comp rx=0 tx=0).stop 2024-05-21T13:41:13.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.490+0000 7f1406ebb640 1 -- 172.21.15.22:0/797222472 shutdown_connections 2024-05-21T13:41:13.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.490+0000 7f1406ebb640 1 --2- 172.21.15.22:0/797222472 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f14000c9e30 0x7f14000ca2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:13.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.490+0000 7f1406ebb640 1 --2- 172.21.15.22:0/797222472 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1400152cc0 0x7f14000c4bf0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:13.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.490+0000 7f1406ebb640 1 -- 172.21.15.22:0/797222472 >> 172.21.15.22:0/797222472 conn(0x7f140006ea10 msgr2=0x7f140006ff50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:41:13.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.490+0000 7f1406ebb640 1 -- 172.21.15.22:0/797222472 shutdown_connections 2024-05-21T13:41:13.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.490+0000 7f1406ebb640 1 -- 172.21.15.22:0/797222472 wait complete. 2024-05-21T13:41:13.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.490+0000 7f1406ebb640 1 Processor -- start 2024-05-21T13:41:13.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.490+0000 7f1406ebb640 1 -- start start 2024-05-21T13:41:13.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.490+0000 7f1406ebb640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14000c66b0 0x7f14001469f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:13.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.490+0000 7f1406ebb640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f14000c9e30 0x7f140013b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:13.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.490+0000 7f1406ebb640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1400152cc0 0x7f1400147570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:13.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.490+0000 7f1406ebb640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f14000c8500 con 0x7f14000c9e30 2024-05-21T13:41:13.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.490+0000 7f1406ebb640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f1400158f40 con 0x7f14000c66b0 2024-05-21T13:41:13.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.490+0000 7f1406ebb640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f1400159740 con 0x7f1400152cc0 2024-05-21T13:41:13.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.490+0000 7f13fffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f14000c9e30 0x7f140013b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:13.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.490+0000 7f13fffff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f14000c9e30 0x7f140013b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36510/0 (socket says 172.21.15.22:36510) 2024-05-21T13:41:13.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.490+0000 7f13fffff640 1 -- 172.21.15.22:0/2041260991 learned_addr learned my addr 172.21.15.22:0/2041260991 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:41:13.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.490+0000 7f1405458640 1 --2- 172.21.15.22:0/2041260991 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1400152cc0 0x7f1400147570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:13.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.490+0000 7f1404c57640 1 --2- 172.21.15.22:0/2041260991 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14000c66b0 0x7f14001469f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:13.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.490+0000 7f13fffff640 1 -- 172.21.15.22:0/2041260991 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1400152cc0 msgr2=0x7f1400147570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:13.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.490+0000 7f13fffff640 1 --2- 172.21.15.22:0/2041260991 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1400152cc0 0x7f1400147570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:13.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.490+0000 7f13fffff640 1 -- 172.21.15.22:0/2041260991 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14000c66b0 msgr2=0x7f14001469f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:13.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.490+0000 7f13fffff640 1 --2- 172.21.15.22:0/2041260991 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14000c66b0 0x7f14001469f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:13.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.490+0000 7f13fffff640 1 -- 172.21.15.22:0/2041260991 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f140013a7e0 con 0x7f14000c9e30 2024-05-21T13:41:13.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.490+0000 7f1404c57640 1 --2- 172.21.15.22:0/2041260991 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14000c66b0 0x7f14001469f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:41:13.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.490+0000 7f13fffff640 1 --2- 172.21.15.22:0/2041260991 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f14000c9e30 0x7f140013b6e0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f13f400c420 tx=0x7f13f400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:13.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.490+0000 7f13fd7fa640 1 -- 172.21.15.22:0/2041260991 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13f4017070 con 0x7f14000c9e30 2024-05-21T13:41:13.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.490+0000 7f13fd7fa640 1 -- 172.21.15.22:0/2041260991 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13f40052d0 con 0x7f14000c9e30 2024-05-21T13:41:13.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.490+0000 7f1406ebb640 1 -- 172.21.15.22:0/2041260991 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14001f28d0 con 0x7f14000c9e30 2024-05-21T13:41:13.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.490+0000 7f13fd7fa640 1 -- 172.21.15.22:0/2041260991 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13f4003820 con 0x7f14000c9e30 2024-05-21T13:41:13.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.490+0000 7f1406ebb640 1 -- 172.21.15.22:0/2041260991 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14001f2e70 con 0x7f14000c9e30 2024-05-21T13:41:13.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.494+0000 7f1406ebb640 1 -- 172.21.15.22:0/2041260991 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1400077bb0 con 0x7f14000c9e30 2024-05-21T13:41:13.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.494+0000 7f13fd7fa640 1 -- 172.21.15.22:0/2041260991 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f13f401a070 con 0x7f14000c9e30 2024-05-21T13:41:13.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.494+0000 7f13fd7fa640 1 --2- 172.21.15.22:0/2041260991 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f13ec06f400 0x7f13ec0718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:13.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.494+0000 7f13fd7fa640 1 -- 172.21.15.22:0/2041260991 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f13f408e910 con 0x7f14000c9e30 2024-05-21T13:41:13.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.494+0000 7f1404c57640 1 --2- 172.21.15.22:0/2041260991 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f13ec06f400 0x7f13ec0718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:13.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.494+0000 7f1404c57640 1 --2- 172.21.15.22:0/2041260991 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f13ec06f400 0x7f13ec0718c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f13f00ad000 tx=0x7f13f0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:13.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.498+0000 7f13fd7fa640 1 -- 172.21.15.22:0/2041260991 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f13f4005480 con 0x7f14000c9e30 2024-05-21T13:41:13.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.662+0000 7f1406ebb640 1 -- 172.21.15.22:0/2041260991 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1400072510 con 0x7f14000c9e30 2024-05-21T13:41:13.642 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.666+0000 7f13fd7fa640 1 -- 172.21.15.22:0/2041260991 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18554 (secure 0 0 0) 0x7f13f405b510 con 0x7f14000c9e30 2024-05-21T13:41:13.643 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-21T13:41:13.643 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":27,"fsid":"f2c96204-e240-4e7f-8a76-927b4f80f534","created":"2024-05-21T13:35:33.827005+0000","modified":"2024-05-21T13:36:39.578654+0000","last_up_change":"2024-05-21T13:35:44.542324+0000","last_in_change":"2024-05-21T13:35:36.061492+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-21T13:35:44.536105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-21T13:35:54.972996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-21T13:35:56.065755+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-21T13:35:59.791448+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"09157d4a-9443-4e10-bbb3-cf8ed7c42cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":222752954},{"type":"v1","addr":"172.21.15.22:6801","nonce":222752954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":222752954},{"type":"v1","addr":"172.21.15.22:6803","nonce":222752954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":222752954},{"type":"v1","addr":"172.21.15.22:6807","nonce":222752954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":222752954},{"type":"v1","addr":"172.21.15.22:6805","nonce":222752954}]},"public_addr":"172.21.15.22:6801/222752954","cluster_addr":"172.21.15.22:6803/222752954","heartbeat_back_addr":"172.21.15.22:6807/222752954","heartbeat_front_addr":"172.21.15.22:6805/222752954","state":["exists","up"]},{"osd":1,"uuid":"2a6a87c0-01ad-4a98-a538-c0a8e865b05d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":685426272},{"type":"v1","addr":"172.21.15.22:6809","nonce":685426272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":685426272},{"type":"v1","addr":"172.21.15.22:6811","nonce":685426272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":685426272},{"type":"v1","addr":"172.21.15.22:6815","nonce":685426272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":685426272},{"type":"v1","addr":"172.21.15.22:6813","nonce":685426272}]},"public_addr":"172.21.15.22:6809/685426272","cluster_addr":"172.21.15.22:6811/685426272","heartbeat_back_addr":"172.21.15.22:6815/685426272","heartbeat_front_addr":"172.21.15.22:6813/685426272","state":["exists","up"]},{"osd":2,"uuid":"4c18f931-40a4-46ac-a752-0d1be35b01a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":2092224336},{"type":"v1","addr":"172.21.15.22:6817","nonce":2092224336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":2092224336},{"type":"v1","addr":"172.21.15.22:6819","nonce":2092224336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":2092224336},{"type":"v1","addr":"172.21.15.22:6823","nonce":2092224336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":2092224336},{"type":"v1","addr":"172.21.15.22:6821","nonce":2092224336}]},"public_addr":"172.21.15.22:6817/2092224336","cluster_addr":"172.21.15.22:6819/2092224336","heartbeat_back_addr":"172.21.15.22:6823/2092224336","heartbeat_front_addr":"172.21.15.22:6821/2092224336","state":["exists","up"]},{"osd":3,"uuid":"d57ee7fd-b73e-41ec-8e3b-e62fb8898128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":1232311110},{"type":"v1","addr":"172.21.15.22:6825","nonce":1232311110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":1232311110},{"type":"v1","addr":"172.21.15.22:6827","nonce":1232311110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":1232311110},{"type":"v1","addr":"172.21.15.22:6831","nonce":1232311110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":1232311110},{"type":"v1","addr":"172.21.15.22:6829","nonce":1232311110}]},"public_addr":"172.21.15.22:6825/1232311110","cluster_addr":"172.21.15.22:6827/1232311110","heartbeat_back_addr":"172.21.15.22:6831/1232311110","heartbeat_front_addr":"172.21.15.22:6829/1232311110","state":["exists","up"]},{"osd":4,"uuid":"43c6494f-352b-42a7-b6a9-fe7e3573fab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":832695158},{"type":"v1","addr":"172.21.15.115:6801","nonce":832695158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":832695158},{"type":"v1","addr":"172.21.15.115:6803","nonce":832695158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":832695158},{"type":"v1","addr":"172.21.15.115:6807","nonce":832695158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":832695158},{"type":"v1","addr":"172.21.15.115:6805","nonce":832695158}]},"public_addr":"172.21.15.115:6801/832695158","cluster_addr":"172.21.15.115:6803/832695158","heartbeat_back_addr":"172.21.15.115:6807/832695158","heartbeat_front_addr":"172.21.15.115:6805/832695158","state":["exists","up"]},{"osd":5,"uuid":"25fc861c-593d-4d49-942a-c75c19f25994","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":1504764223},{"type":"v1","addr":"172.21.15.115:6815","nonce":1504764223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":1504764223},{"type":"v1","addr":"172.21.15.115:6823","nonce":1504764223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":1504764223},{"type":"v1","addr":"172.21.15.115:6830","nonce":1504764223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6825","nonce":1504764223},{"type":"v1","addr":"172.21.15.115:6827","nonce":1504764223}]},"public_addr":"172.21.15.115:6815/1504764223","cluster_addr":"172.21.15.115:6823/1504764223","heartbeat_back_addr":"172.21.15.115:6830/1504764223","heartbeat_front_addr":"172.21.15.115:6827/1504764223","state":["exists","up"]},{"osd":6,"uuid":"2e7fb0b8-1162-497f-bffc-e2c02b9b9ef4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":959292720},{"type":"v1","addr":"172.21.15.115:6809","nonce":959292720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":959292720},{"type":"v1","addr":"172.21.15.115:6813","nonce":959292720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":959292720},{"type":"v1","addr":"172.21.15.115:6822","nonce":959292720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":959292720},{"type":"v1","addr":"172.21.15.115:6818","nonce":959292720}]},"public_addr":"172.21.15.115:6809/959292720","cluster_addr":"172.21.15.115:6813/959292720","heartbeat_back_addr":"172.21.15.115:6822/959292720","heartbeat_front_addr":"172.21.15.115:6818/959292720","state":["exists","up"]},{"osd":7,"uuid":"a97df0dc-e370-45ce-8742-25ae31e2212e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6811","nonce":20268513},{"type":"v1","addr":"172.21.15.115:6814","nonce":20268513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":20268513},{"type":"v1","addr":"172.21.15.115:6821","nonce":20268513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6829","nonce":20268513},{"type":"v1","addr":"172.21.15.115:6831","nonce":20268513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":20268513},{"type":"v1","addr":"172.21.15.115:6826","nonce":20268513}]},"public_addr":"172.21.15.115:6814/20268513","cluster_addr":"172.21.15.115:6821/20268513","heartbeat_back_addr":"172.21.15.115:6831/20268513","heartbeat_front_addr":"172.21.15.115:6826/20268513","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.692890+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.545577+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.712724+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.681944+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.492954+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.553222+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.597022+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.601698+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1b","mappings":[{"from":0,"to":7}]},{"pgid":"4.19","mappings":[{"from":7,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-21T13:41:13.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.670+0000 7f1406ebb640 1 -- 172.21.15.22:0/2041260991 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f13ec06f400 msgr2=0x7f13ec0718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:13.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.670+0000 7f1406ebb640 1 --2- 172.21.15.22:0/2041260991 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f13ec06f400 0x7f13ec0718c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f13f00ad000 tx=0x7f13f0008040 comp rx=0 tx=0).stop 2024-05-21T13:41:13.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.670+0000 7f1406ebb640 1 -- 172.21.15.22:0/2041260991 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f14000c9e30 msgr2=0x7f140013b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:13.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.670+0000 7f1406ebb640 1 --2- 172.21.15.22:0/2041260991 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f14000c9e30 0x7f140013b6e0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f13f400c420 tx=0x7f13f400c8e0 comp rx=0 tx=0).stop 2024-05-21T13:41:13.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.670+0000 7f1406ebb640 1 -- 172.21.15.22:0/2041260991 shutdown_connections 2024-05-21T13:41:13.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.670+0000 7f1406ebb640 1 --2- 172.21.15.22:0/2041260991 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f13ec06f400 0x7f13ec0718c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:13.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.670+0000 7f1406ebb640 1 --2- 172.21.15.22:0/2041260991 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1400152cc0 0x7f1400147570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:13.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.670+0000 7f1406ebb640 1 --2- 172.21.15.22:0/2041260991 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f14000c9e30 0x7f140013b6e0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:13.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.670+0000 7f1406ebb640 1 --2- 172.21.15.22:0/2041260991 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14000c66b0 0x7f14001469f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:13.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.670+0000 7f1406ebb640 1 -- 172.21.15.22:0/2041260991 >> 172.21.15.22:0/2041260991 conn(0x7f140006ea10 msgr2=0x7f14000735c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:41:13.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.670+0000 7f1406ebb640 1 -- 172.21.15.22:0/2041260991 shutdown_connections 2024-05-21T13:41:13.646 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:13.670+0000 7f1406ebb640 1 -- 172.21.15.22:0/2041260991 wait complete. 2024-05-21T13:41:14.664 INFO:tasks.ceph:Scrubbing osd.0 2024-05-21T13:41:14.665 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-05-21T13:41:14.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.830+0000 7f3782686640 1 Processor -- start 2024-05-21T13:41:14.807 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.830+0000 7f3782686640 1 -- start start 2024-05-21T13:41:14.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.830+0000 7f3782686640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f377c150360 0x7f377c0cb9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:14.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.830+0000 7f3782686640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f377c0c9f90 0x7f377c15a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:14.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.830+0000 7f3782686640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f377c0cbff0 con 0x7f377c0c4520 2024-05-21T13:41:14.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.830+0000 7f3782686640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f377c0cade0 con 0x7f377c0c9f90 2024-05-21T13:41:14.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.830+0000 7f3782686640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f377c15d380 con 0x7f377c150360 2024-05-21T13:41:14.808 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.834+0000 7f3780c23640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f377c0c9f90 0x7f377c15a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:14.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.834+0000 7f377b7fe640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f377c0c4520 0x7f377c15d810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:37388/0 (socket says 172.21.15.22:37388) 2024-05-21T13:41:14.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.834+0000 7f377b7fe640 1 -- 172.21.15.22:0/491777870 learned_addr learned my addr 172.21.15.22:0/491777870 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-21T13:41:14.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.834+0000 7f377bfff640 1 --2- 172.21.15.22:0/491777870 >> v2:172.21.15.115:3300/0 conn(0x7f377c150360 0x7f377c0cb9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:14.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.834+0000 7f377affd640 1 -- 172.21.15.22:0/491777870 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3855990281 0 0) 0x7f377c0cbff0 con 0x7f377c0c4520 2024-05-21T13:41:14.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.834+0000 7f377affd640 1 -- 172.21.15.22:0/491777870 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3768003530 con 0x7f377c0c4520 2024-05-21T13:41:14.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.834+0000 7f3780c23640 1 -- 172.21.15.22:0/491777870 >> v2:172.21.15.115:3300/0 conn(0x7f377c150360 msgr2=0x7f377c0cb9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:41:14.809 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.834+0000 7f3780c23640 1 --2- 172.21.15.22:0/491777870 >> v2:172.21.15.115:3300/0 conn(0x7f377c150360 0x7f377c0cb9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:14.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.834+0000 7f3780c23640 1 -- 172.21.15.22:0/491777870 >> v1:172.21.15.22:6789/0 conn(0x7f377c0c4520 legacy=0x7f377c15d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:14.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.834+0000 7f3780c23640 1 -- 172.21.15.22:0/491777870 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f377c0ca860 con 0x7f377c0c9f90 2024-05-21T13:41:14.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.834+0000 7f3780c23640 1 --2- 172.21.15.22:0/491777870 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f377c0c9f90 0x7f377c15a2f0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f376c0097c0 tx=0x7f376c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f15e91b029e6f698 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:14.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.834+0000 7f377affd640 1 -- 172.21.15.22:0/491777870 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f376c0b0070 con 0x7f377c0c9f90 2024-05-21T13:41:14.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.834+0000 7f377affd640 1 -- 172.21.15.22:0/491777870 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f376c0ab600 con 0x7f377c0c9f90 2024-05-21T13:41:14.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.834+0000 7f377affd640 1 -- 172.21.15.22:0/491777870 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f376c0ab9d0 con 0x7f377c0c9f90 2024-05-21T13:41:14.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.834+0000 7f3782686640 1 -- 172.21.15.22:0/491777870 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f377c0c9f90 msgr2=0x7f377c15a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:14.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.834+0000 7f3782686640 1 --2- 172.21.15.22:0/491777870 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f377c0c9f90 0x7f377c15a2f0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f376c0097c0 tx=0x7f376c01c460 comp rx=0 tx=0).stop 2024-05-21T13:41:14.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.834+0000 7f3782686640 1 -- 172.21.15.22:0/491777870 shutdown_connections 2024-05-21T13:41:14.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.834+0000 7f3782686640 1 --2- 172.21.15.22:0/491777870 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f377c0c9f90 0x7f377c15a2f0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:14.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.834+0000 7f3782686640 1 --2- 172.21.15.22:0/491777870 >> v2:172.21.15.115:3300/0 conn(0x7f377c150360 0x7f377c0cb9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:14.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.834+0000 7f3782686640 1 -- 172.21.15.22:0/491777870 >> 172.21.15.22:0/491777870 conn(0x7f377c070410 msgr2=0x7f377c070820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:41:14.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.834+0000 7f3782686640 1 -- 172.21.15.22:0/491777870 shutdown_connections 2024-05-21T13:41:14.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.834+0000 7f3782686640 1 -- 172.21.15.22:0/491777870 wait complete. 2024-05-21T13:41:14.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.838+0000 7f3782686640 1 Processor -- start 2024-05-21T13:41:14.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.838+0000 7f3782686640 1 -- start start 2024-05-21T13:41:14.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.838+0000 7f3782686640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f377c0c4520 0x7f377c1f2b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:14.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.838+0000 7f3782686640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f377c0c9f90 0x7f377c158350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:14.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.838+0000 7f3782686640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f377c150360 0x7f377c158890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:14.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.838+0000 7f3782686640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f377c166460 con 0x7f377c0c9f90 2024-05-21T13:41:14.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.838+0000 7f3782686640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f377c15d050 con 0x7f377c0c4520 2024-05-21T13:41:14.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.838+0000 7f3782686640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f377c1665e0 con 0x7f377c150360 2024-05-21T13:41:14.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.838+0000 7f377b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f377c0c9f90 0x7f377c158350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:14.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.838+0000 7f377b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f377c0c9f90 0x7f377c158350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36530/0 (socket says 172.21.15.22:36530) 2024-05-21T13:41:14.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.838+0000 7f377b7fe640 1 -- 172.21.15.22:0/186547561 learned_addr learned my addr 172.21.15.22:0/186547561 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:41:14.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.838+0000 7f3780c23640 1 --2- 172.21.15.22:0/186547561 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f377c150360 0x7f377c158890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:14.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.838+0000 7f377bfff640 1 --2- 172.21.15.22:0/186547561 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f377c0c4520 0x7f377c1f2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:14.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.838+0000 7f377b7fe640 1 -- 172.21.15.22:0/186547561 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f377c150360 msgr2=0x7f377c158890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:14.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.838+0000 7f377b7fe640 1 --2- 172.21.15.22:0/186547561 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f377c150360 0x7f377c158890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:14.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.838+0000 7f377b7fe640 1 -- 172.21.15.22:0/186547561 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f377c0c4520 msgr2=0x7f377c1f2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:14.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.838+0000 7f377b7fe640 1 --2- 172.21.15.22:0/186547561 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f377c0c4520 0x7f377c1f2b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:14.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.838+0000 7f377b7fe640 1 -- 172.21.15.22:0/186547561 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f377c148c60 con 0x7f377c0c9f90 2024-05-21T13:41:14.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.838+0000 7f377b7fe640 1 --2- 172.21.15.22:0/186547561 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f377c0c9f90 0x7f377c158350 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f376400c4d0 tx=0x7f376400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:14.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.838+0000 7f3778ff9640 1 -- 172.21.15.22:0/186547561 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3764017070 con 0x7f377c0c9f90 2024-05-21T13:41:14.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.838+0000 7f3778ff9640 1 -- 172.21.15.22:0/186547561 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3764005cf0 con 0x7f377c0c9f90 2024-05-21T13:41:14.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.838+0000 7f3778ff9640 1 -- 172.21.15.22:0/186547561 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3764007270 con 0x7f377c0c9f90 2024-05-21T13:41:14.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.838+0000 7f3782686640 1 -- 172.21.15.22:0/186547561 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f377c0cc2b0 con 0x7f377c0c9f90 2024-05-21T13:41:14.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.838+0000 7f3782686640 1 -- 172.21.15.22:0/186547561 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f377c149200 con 0x7f377c0c9f90 2024-05-21T13:41:14.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.838+0000 7f3782686640 1 -- 172.21.15.22:0/186547561 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f377c077bb0 con 0x7f377c0c9f90 2024-05-21T13:41:14.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.842+0000 7f3778ff9640 1 -- 172.21.15.22:0/186547561 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f376401a070 con 0x7f377c0c9f90 2024-05-21T13:41:14.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.842+0000 7f3778ff9640 1 --2- 172.21.15.22:0/186547561 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f375c06f400 0x7f375c0718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:14.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.842+0000 7f3778ff9640 1 -- 172.21.15.22:0/186547561 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f376408f100 con 0x7f377c0c9f90 2024-05-21T13:41:14.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.842+0000 7f3778ff9640 1 --2- 172.21.15.22:0/186547561 >> [v2:172.21.15.22:6800/222752954,v1:172.21.15.22:6801/222752954] conn(0x7f375c078bb0 0x7f375c07b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:14.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.842+0000 7f3778ff9640 1 -- 172.21.15.22:0/186547561 --> [v2:172.21.15.22:6800/222752954,v1:172.21.15.22:6801/222752954] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f375c07b700 con 0x7f375c078bb0 2024-05-21T13:41:14.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.842+0000 7f3778ff9640 1 -- 172.21.15.22:0/186547561 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f376408f590 con 0x7f377c0c9f90 2024-05-21T13:41:14.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.842+0000 7f377bfff640 1 --2- 172.21.15.22:0/186547561 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f375c06f400 0x7f375c0718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:14.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.842+0000 7f3780c23640 1 --2- 172.21.15.22:0/186547561 >> [v2:172.21.15.22:6800/222752954,v1:172.21.15.22:6801/222752954] conn(0x7f375c078bb0 0x7f375c07b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:14.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.842+0000 7f3780c23640 1 --2- 172.21.15.22:0/186547561 >> [v2:172.21.15.22:6800/222752954,v1:172.21.15.22:6801/222752954] conn(0x7f375c078bb0 0x7f375c07b030 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:14.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.842+0000 7f377bfff640 1 --2- 172.21.15.22:0/186547561 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f375c06f400 0x7f375c0718c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3774009f60 tx=0x7f377400b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:14.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.842+0000 7f3778ff9640 1 -- 172.21.15.22:0/186547561 <== osd.0 v2:172.21.15.22:6800/222752954 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f375c07b700 con 0x7f375c078bb0 2024-05-21T13:41:14.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.858+0000 7f3782686640 1 -- 172.21.15.22:0/186547561 --> [v2:172.21.15.22:6800/222752954,v1:172.21.15.22:6801/222752954] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f377c15cc90 con 0x7f375c078bb0 2024-05-21T13:41:14.833 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.858+0000 7f3778ff9640 1 -- 172.21.15.22:0/186547561 <== osd.0 v2:172.21.15.22:6800/222752954 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f377c15cc90 con 0x7f375c078bb0 2024-05-21T13:41:14.833 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-05-21T13:41:14.833 INFO:teuthology.orchestra.run.smithi022.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-21T13:41:14.833 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-05-21T13:41:14.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.858+0000 7f3782686640 1 -- 172.21.15.22:0/186547561 >> [v2:172.21.15.22:6800/222752954,v1:172.21.15.22:6801/222752954] conn(0x7f375c078bb0 msgr2=0x7f375c07b030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:14.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.858+0000 7f3782686640 1 --2- 172.21.15.22:0/186547561 >> [v2:172.21.15.22:6800/222752954,v1:172.21.15.22:6801/222752954] conn(0x7f375c078bb0 0x7f375c07b030 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:14.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.858+0000 7f3782686640 1 -- 172.21.15.22:0/186547561 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f375c06f400 msgr2=0x7f375c0718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:14.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.858+0000 7f3782686640 1 --2- 172.21.15.22:0/186547561 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f375c06f400 0x7f375c0718c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3774009f60 tx=0x7f377400b040 comp rx=0 tx=0).stop 2024-05-21T13:41:14.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.858+0000 7f3782686640 1 -- 172.21.15.22:0/186547561 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f377c0c9f90 msgr2=0x7f377c158350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:14.834 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.858+0000 7f3782686640 1 --2- 172.21.15.22:0/186547561 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f377c0c9f90 0x7f377c158350 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f376400c4d0 tx=0x7f376400c990 comp rx=0 tx=0).stop 2024-05-21T13:41:14.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.858+0000 7f3780c23640 1 -- 172.21.15.22:0/186547561 reap_dead start 2024-05-21T13:41:14.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.858+0000 7f3782686640 1 -- 172.21.15.22:0/186547561 shutdown_connections 2024-05-21T13:41:14.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.858+0000 7f3782686640 1 -- 172.21.15.22:0/186547561 >> 172.21.15.22:0/186547561 conn(0x7f377c070410 msgr2=0x7f377c0cb270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:41:14.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.858+0000 7f3782686640 1 -- 172.21.15.22:0/186547561 shutdown_connections 2024-05-21T13:41:14.835 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.858+0000 7f3782686640 1 -- 172.21.15.22:0/186547561 wait complete. 2024-05-21T13:41:14.851 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-05-21T13:41:14.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.998+0000 7fe686cd7640 1 Processor -- start 2024-05-21T13:41:14.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.998+0000 7fe686cd7640 1 -- start start 2024-05-21T13:41:14.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.998+0000 7fe686cd7640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe680152f10 0x7fe680073860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:14.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.998+0000 7fe686cd7640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe6800c91e0 0x7fe680158e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:14.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.998+0000 7fe686cd7640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6800c47f0 con 0x7fe680152b30 2024-05-21T13:41:14.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.998+0000 7fe686cd7640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fe680073da0 con 0x7fe680152f10 2024-05-21T13:41:14.974 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.998+0000 7fe686cd7640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7fe6800c5030 con 0x7fe6800c91e0 2024-05-21T13:41:14.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.998+0000 7fe67ffff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe680152f10 0x7fe680073860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:14.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.998+0000 7fe67ffff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe680152f10 0x7fe680073860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36538/0 (socket says 172.21.15.22:36538) 2024-05-21T13:41:14.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.998+0000 7fe67ffff640 1 -- 172.21.15.22:0/3504198636 learned_addr learned my addr 172.21.15.22:0/3504198636 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:41:14.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.998+0000 7fe685274640 1 --2- 172.21.15.22:0/3504198636 >> v2:172.21.15.115:3300/0 conn(0x7fe6800c91e0 0x7fe680158e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:14.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.998+0000 7fe67ffff640 1 -- 172.21.15.22:0/3504198636 >> v2:172.21.15.115:3300/0 conn(0x7fe6800c91e0 msgr2=0x7fe680158e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:41:14.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.998+0000 7fe67ffff640 1 --2- 172.21.15.22:0/3504198636 >> v2:172.21.15.115:3300/0 conn(0x7fe6800c91e0 0x7fe680158e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:14.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.998+0000 7fe67ffff640 1 -- 172.21.15.22:0/3504198636 >> v1:172.21.15.115:6789/0 conn(0x7fe680152b30 legacy=0x7fe68006df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:14.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.998+0000 7fe67ffff640 1 -- 172.21.15.22:0/3504198636 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6800c4a90 con 0x7fe680152f10 2024-05-21T13:41:14.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:14.998+0000 7fe685274640 1 --2- 172.21.15.22:0/3504198636 >> v2:172.21.15.115:3300/0 conn(0x7fe6800c91e0 0x7fe680158e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T13:41:14.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.002+0000 7fe67ffff640 1 --2- 172.21.15.22:0/3504198636 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe680152f10 0x7fe680073860 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fe680159b90 tx=0x7fe67401ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d2a7a89eafdd286 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:14.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.002+0000 7fe67f7fe640 1 -- 172.21.15.22:0/3504198636 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6740b5070 con 0x7fe680152f10 2024-05-21T13:41:14.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.002+0000 7fe67f7fe640 1 -- 172.21.15.22:0/3504198636 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6740a8a10 con 0x7fe680152f10 2024-05-21T13:41:14.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.002+0000 7fe67f7fe640 1 -- 172.21.15.22:0/3504198636 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6740a8de0 con 0x7fe680152f10 2024-05-21T13:41:14.978 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.002+0000 7fe686cd7640 1 -- 172.21.15.22:0/3504198636 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe680152f10 msgr2=0x7fe680073860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:14.978 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.002+0000 7fe686cd7640 1 --2- 172.21.15.22:0/3504198636 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe680152f10 0x7fe680073860 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fe680159b90 tx=0x7fe67401ed10 comp rx=0 tx=0).stop 2024-05-21T13:41:14.978 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.002+0000 7fe686cd7640 1 -- 172.21.15.22:0/3504198636 shutdown_connections 2024-05-21T13:41:14.978 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.002+0000 7fe686cd7640 1 --2- 172.21.15.22:0/3504198636 >> v2:172.21.15.115:3300/0 conn(0x7fe6800c91e0 0x7fe680158e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:14.978 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.002+0000 7fe686cd7640 1 --2- 172.21.15.22:0/3504198636 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe680152f10 0x7fe680073860 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:14.978 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.002+0000 7fe686cd7640 1 -- 172.21.15.22:0/3504198636 >> 172.21.15.22:0/3504198636 conn(0x7fe68006ce70 msgr2=0x7fe6800cd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:41:14.978 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.002+0000 7fe686cd7640 1 -- 172.21.15.22:0/3504198636 shutdown_connections 2024-05-21T13:41:14.978 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.002+0000 7fe686cd7640 1 -- 172.21.15.22:0/3504198636 wait complete. 2024-05-21T13:41:14.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.002+0000 7fe686cd7640 1 Processor -- start 2024-05-21T13:41:14.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.002+0000 7fe686cd7640 1 -- start start 2024-05-21T13:41:14.980 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.002+0000 7fe686cd7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe6800c91e0 0x7fe68014dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:14.981 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.002+0000 7fe686cd7640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe680152b30 0x7fe680140b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:14.981 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.002+0000 7fe686cd7640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe680152f10 0x7fe6801410a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:14.981 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.002+0000 7fe686cd7640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe6800741f0 con 0x7fe6800c91e0 2024-05-21T13:41:14.981 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.002+0000 7fe686cd7640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fe680073fa0 con 0x7fe680152f10 2024-05-21T13:41:14.981 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.002+0000 7fe686cd7640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7fe6800744d0 con 0x7fe680152b30 2024-05-21T13:41:14.981 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.002+0000 7fe684a73640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe6800c91e0 0x7fe68014dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:14.981 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.002+0000 7fe684a73640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe6800c91e0 0x7fe68014dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36546/0 (socket says 172.21.15.22:36546) 2024-05-21T13:41:14.981 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.002+0000 7fe684a73640 1 -- 172.21.15.22:0/216764232 learned_addr learned my addr 172.21.15.22:0/216764232 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:41:14.981 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.002+0000 7fe67ffff640 1 --2- 172.21.15.22:0/216764232 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe680152b30 0x7fe680140b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:14.981 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.002+0000 7fe685274640 1 --2- 172.21.15.22:0/216764232 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe680152f10 0x7fe6801410a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:14.981 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.006+0000 7fe684a73640 1 -- 172.21.15.22:0/216764232 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe680152b30 msgr2=0x7fe680140b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:14.981 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.006+0000 7fe684a73640 1 --2- 172.21.15.22:0/216764232 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe680152b30 0x7fe680140b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:14.981 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.006+0000 7fe684a73640 1 -- 172.21.15.22:0/216764232 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe680152f10 msgr2=0x7fe6801410a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:14.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.006+0000 7fe684a73640 1 --2- 172.21.15.22:0/216764232 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe680152f10 0x7fe6801410a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:14.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.006+0000 7fe684a73640 1 -- 172.21.15.22:0/216764232 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6801ef950 con 0x7fe6800c91e0 2024-05-21T13:41:14.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.006+0000 7fe685274640 1 --2- 172.21.15.22:0/216764232 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe680152f10 0x7fe6801410a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T13:41:14.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.006+0000 7fe684a73640 1 --2- 172.21.15.22:0/216764232 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe6800c91e0 0x7fe68014dfa0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fe67000c500 tx=0x7fe67000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:14.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.006+0000 7fe67d7fa640 1 -- 172.21.15.22:0/216764232 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe670017070 con 0x7fe6800c91e0 2024-05-21T13:41:14.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.006+0000 7fe67d7fa640 1 -- 172.21.15.22:0/216764232 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6700052d0 con 0x7fe6800c91e0 2024-05-21T13:41:14.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.006+0000 7fe686cd7640 1 -- 172.21.15.22:0/216764232 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6801efc10 con 0x7fe6800c91e0 2024-05-21T13:41:14.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.006+0000 7fe67d7fa640 1 -- 172.21.15.22:0/216764232 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe670012870 con 0x7fe6800c91e0 2024-05-21T13:41:14.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.006+0000 7fe686cd7640 1 -- 172.21.15.22:0/216764232 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6801f01d0 con 0x7fe6800c91e0 2024-05-21T13:41:14.983 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.006+0000 7fe686cd7640 1 -- 172.21.15.22:0/216764232 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe680077bb0 con 0x7fe6800c91e0 2024-05-21T13:41:14.983 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.006+0000 7fe67d7fa640 1 -- 172.21.15.22:0/216764232 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fe67001a070 con 0x7fe6800c91e0 2024-05-21T13:41:14.983 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.006+0000 7fe67d7fa640 1 --2- 172.21.15.22:0/216764232 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fe66c06f400 0x7fe66c0718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:14.983 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.006+0000 7fe67d7fa640 1 -- 172.21.15.22:0/216764232 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7fe67008e860 con 0x7fe6800c91e0 2024-05-21T13:41:14.983 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.006+0000 7fe67ffff640 1 --2- 172.21.15.22:0/216764232 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fe66c06f400 0x7fe66c0718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:14.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.006+0000 7fe67ffff640 1 --2- 172.21.15.22:0/216764232 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fe66c06f400 0x7fe66c0718c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe6740b2000 tx=0x7fe674009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:14.987 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.010+0000 7fe67d7fa640 1 -- 172.21.15.22:0/216764232 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fe670005480 con 0x7fe6800c91e0 2024-05-21T13:41:15.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.170+0000 7fe686cd7640 1 -- 172.21.15.22:0/216764232 --> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7fe680159540 con 0x7fe66c06f400 2024-05-21T13:41:15.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.170+0000 7fe67d7fa640 1 -- 172.21.15.22:0/216764232 <== mgr.4103 v2:172.21.15.115:6832/184591771 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fe680159540 con 0x7fe66c06f400 2024-05-21T13:41:15.146 INFO:teuthology.orchestra.run.smithi022.stderr:instructed osd(s) 0 to deep-scrub 2024-05-21T13:41:15.149 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.174+0000 7fe686cd7640 1 -- 172.21.15.22:0/216764232 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fe66c06f400 msgr2=0x7fe66c0718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:15.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.174+0000 7fe686cd7640 1 --2- 172.21.15.22:0/216764232 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fe66c06f400 0x7fe66c0718c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe6740b2000 tx=0x7fe674009040 comp rx=0 tx=0).stop 2024-05-21T13:41:15.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.174+0000 7fe686cd7640 1 -- 172.21.15.22:0/216764232 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe6800c91e0 msgr2=0x7fe68014dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:15.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.174+0000 7fe686cd7640 1 --2- 172.21.15.22:0/216764232 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe6800c91e0 0x7fe68014dfa0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fe67000c500 tx=0x7fe67000c9c0 comp rx=0 tx=0).stop 2024-05-21T13:41:15.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.174+0000 7fe686cd7640 1 -- 172.21.15.22:0/216764232 shutdown_connections 2024-05-21T13:41:15.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.174+0000 7fe686cd7640 1 --2- 172.21.15.22:0/216764232 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fe66c06f400 0x7fe66c0718c0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:15.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.174+0000 7fe686cd7640 1 --2- 172.21.15.22:0/216764232 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe680152f10 0x7fe6801410a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:15.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.174+0000 7fe686cd7640 1 --2- 172.21.15.22:0/216764232 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe680152b30 0x7fe680140b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:15.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.174+0000 7fe686cd7640 1 --2- 172.21.15.22:0/216764232 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe6800c91e0 0x7fe68014dfa0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:15.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.174+0000 7fe686cd7640 1 -- 172.21.15.22:0/216764232 >> 172.21.15.22:0/216764232 conn(0x7fe68006ce70 msgr2=0x7fe68014bbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:41:15.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.174+0000 7fe686cd7640 1 -- 172.21.15.22:0/216764232 shutdown_connections 2024-05-21T13:41:15.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.174+0000 7fe686cd7640 1 -- 172.21.15.22:0/216764232 wait complete. 2024-05-21T13:41:15.166 INFO:tasks.ceph:Scrubbing osd.1 2024-05-21T13:41:15.167 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-05-21T13:41:15.291 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.314+0000 7f5cb2d5b640 1 Processor -- start 2024-05-21T13:41:15.291 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.314+0000 7f5cb2d5b640 1 -- start start 2024-05-21T13:41:15.292 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.318+0000 7f5cb2d5b640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f5cac0b3180 0x7f5cac06cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:15.292 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.318+0000 7f5cb2d5b640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5cac0c9580 con 0x7f5cac0b2da0 2024-05-21T13:41:15.292 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.318+0000 7f5cb2d5b640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5cac072d50 con 0x7f5cac0c85e0 2024-05-21T13:41:15.293 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.318+0000 7f5cb2d5b640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f5cac072b00 con 0x7f5cac0b3180 2024-05-21T13:41:15.293 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.318+0000 7f5cb0af7640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f5cac0b2da0 0x7f5cac15f260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:37404/0 (socket says 172.21.15.22:37404) 2024-05-21T13:41:15.293 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.318+0000 7f5cb0af7640 1 -- 172.21.15.22:0/3515481007 learned_addr learned my addr 172.21.15.22:0/3515481007 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-21T13:41:15.293 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.318+0000 7f5cabfff640 1 --2- 172.21.15.22:0/3515481007 >> v2:172.21.15.22:3300/0 conn(0x7f5cac0b3180 0x7f5cac06cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:15.293 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.318+0000 7f5cabfff640 1 -- 172.21.15.22:0/3515481007 >> v1:172.21.15.115:6789/0 conn(0x7f5cac0c85e0 legacy=0x7f5cac155850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:15.293 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.318+0000 7f5cabfff640 1 -- 172.21.15.22:0/3515481007 >> v1:172.21.15.22:6789/0 conn(0x7f5cac0b2da0 legacy=0x7f5cac15f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:15.294 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.318+0000 7f5cabfff640 1 -- 172.21.15.22:0/3515481007 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cac073030 con 0x7f5cac0b3180 2024-05-21T13:41:15.294 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.318+0000 7f5cab7fe640 1 -- 172.21.15.22:0/3515481007 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1653762309 0 0) 0x7f5cac0c9580 con 0x7f5cac0b2da0 2024-05-21T13:41:15.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.322+0000 7f5cabfff640 1 --2- 172.21.15.22:0/3515481007 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5cac0b3180 0x7f5cac06cd20 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f5c980097c0 tx=0x7f5c9801ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f151aa368bb8e0ec server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:15.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.322+0000 7f5cab7fe640 1 -- 172.21.15.22:0/3515481007 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c980b5070 con 0x7f5cac0b3180 2024-05-21T13:41:15.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.322+0000 7f5cab7fe640 1 -- 172.21.15.22:0/3515481007 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c980a8990 con 0x7f5cac0b3180 2024-05-21T13:41:15.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.322+0000 7f5cab7fe640 1 -- 172.21.15.22:0/3515481007 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c980a8d60 con 0x7f5cac0b3180 2024-05-21T13:41:15.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.322+0000 7f5cb2d5b640 1 -- 172.21.15.22:0/3515481007 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5cac0b3180 msgr2=0x7f5cac06cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:15.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.322+0000 7f5cb2d5b640 1 --2- 172.21.15.22:0/3515481007 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5cac0b3180 0x7f5cac06cd20 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f5c980097c0 tx=0x7f5c9801ec90 comp rx=0 tx=0).stop 2024-05-21T13:41:15.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.322+0000 7f5cb2d5b640 1 -- 172.21.15.22:0/3515481007 shutdown_connections 2024-05-21T13:41:15.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.322+0000 7f5cb2d5b640 1 --2- 172.21.15.22:0/3515481007 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5cac0b3180 0x7f5cac06cd20 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:15.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.322+0000 7f5cb2d5b640 1 -- 172.21.15.22:0/3515481007 >> 172.21.15.22:0/3515481007 conn(0x7f5cac06eb20 msgr2=0x7f5cac06ef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:41:15.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.322+0000 7f5cb2d5b640 1 -- 172.21.15.22:0/3515481007 shutdown_connections 2024-05-21T13:41:15.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.322+0000 7f5cb2d5b640 1 -- 172.21.15.22:0/3515481007 wait complete. 2024-05-21T13:41:15.299 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.322+0000 7f5cb2d5b640 1 Processor -- start 2024-05-21T13:41:15.299 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.322+0000 7f5cb2d5b640 1 -- start start 2024-05-21T13:41:15.301 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.322+0000 7f5cb2d5b640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5cac0b2da0 0x7f5cac15e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:15.301 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.322+0000 7f5cb2d5b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5cac0c85e0 0x7f5cac14a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:15.301 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.322+0000 7f5cb2d5b640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5cac0c61f0 0x7f5cac14ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:15.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.322+0000 7f5cb2d5b640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5cac06d370 con 0x7f5cac0c85e0 2024-05-21T13:41:15.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.322+0000 7f5cb2d5b640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f5cac0c9220 con 0x7f5cac0c61f0 2024-05-21T13:41:15.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.322+0000 7f5cb2d5b640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f5cac06d4f0 con 0x7f5cac0b2da0 2024-05-21T13:41:15.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.326+0000 7f5cabfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5cac0c85e0 0x7f5cac14a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:15.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.326+0000 7f5cabfff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5cac0c85e0 0x7f5cac14a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36572/0 (socket says 172.21.15.22:36572) 2024-05-21T13:41:15.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.326+0000 7f5cabfff640 1 -- 172.21.15.22:0/4122980242 learned_addr learned my addr 172.21.15.22:0/4122980242 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:41:15.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.326+0000 7f5cb0af7640 1 --2- 172.21.15.22:0/4122980242 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5cac0b2da0 0x7f5cac15e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:15.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.326+0000 7f5cb12f8640 1 --2- 172.21.15.22:0/4122980242 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5cac0c61f0 0x7f5cac14ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:15.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.326+0000 7f5cabfff640 1 -- 172.21.15.22:0/4122980242 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5cac0b2da0 msgr2=0x7f5cac15e700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:15.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.326+0000 7f5cabfff640 1 --2- 172.21.15.22:0/4122980242 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5cac0b2da0 0x7f5cac15e700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:15.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.326+0000 7f5cabfff640 1 -- 172.21.15.22:0/4122980242 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5cac0c61f0 msgr2=0x7f5cac14ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:15.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.326+0000 7f5cabfff640 1 --2- 172.21.15.22:0/4122980242 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5cac0c61f0 0x7f5cac14ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:15.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.326+0000 7f5cabfff640 1 -- 172.21.15.22:0/4122980242 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cac0c6730 con 0x7f5cac0c85e0 2024-05-21T13:41:15.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.326+0000 7f5cb0af7640 1 --2- 172.21.15.22:0/4122980242 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5cac0b2da0 0x7f5cac15e700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T13:41:15.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.326+0000 7f5cabfff640 1 --2- 172.21.15.22:0/4122980242 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5cac0c85e0 0x7f5cac14a710 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f5c980097c0 tx=0x7f5c9801ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:15.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.326+0000 7f5ca97fa640 1 -- 172.21.15.22:0/4122980242 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c980bf070 con 0x7f5cac0c85e0 2024-05-21T13:41:15.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.326+0000 7f5ca97fa640 1 -- 172.21.15.22:0/4122980242 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c980b0820 con 0x7f5cac0c85e0 2024-05-21T13:41:15.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.326+0000 7f5ca97fa640 1 -- 172.21.15.22:0/4122980242 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c980b5040 con 0x7f5cac0c85e0 2024-05-21T13:41:15.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.326+0000 7f5cb2d5b640 1 -- 172.21.15.22:0/4122980242 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cac0c6a10 con 0x7f5cac0c85e0 2024-05-21T13:41:15.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.326+0000 7f5cb2d5b640 1 -- 172.21.15.22:0/4122980242 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cac0c6fd0 con 0x7f5cac0c85e0 2024-05-21T13:41:15.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.326+0000 7f5cb2d5b640 1 -- 172.21.15.22:0/4122980242 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5cac0697d0 con 0x7f5cac0c85e0 2024-05-21T13:41:15.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.326+0000 7f5ca97fa640 1 -- 172.21.15.22:0/4122980242 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f5c980b0c10 con 0x7f5cac0c85e0 2024-05-21T13:41:15.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.326+0000 7f5ca97fa640 1 --2- 172.21.15.22:0/4122980242 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f5c9006f430 0x7f5c900718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:15.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.326+0000 7f5ca97fa640 1 -- 172.21.15.22:0/4122980242 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f5c9812bec0 con 0x7f5cac0c85e0 2024-05-21T13:41:15.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.326+0000 7f5ca97fa640 1 --2- 172.21.15.22:0/4122980242 >> [v2:172.21.15.22:6808/685426272,v1:172.21.15.22:6809/685426272] conn(0x7f5c90078be0 0x7f5c9007b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:15.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.326+0000 7f5ca97fa640 1 -- 172.21.15.22:0/4122980242 --> [v2:172.21.15.22:6808/685426272,v1:172.21.15.22:6809/685426272] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5c9007b730 con 0x7f5c90078be0 2024-05-21T13:41:15.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.326+0000 7f5ca97fa640 1 -- 172.21.15.22:0/4122980242 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f5c9812c350 con 0x7f5cac0c85e0 2024-05-21T13:41:15.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.326+0000 7f5cb0af7640 1 --2- 172.21.15.22:0/4122980242 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f5c9006f430 0x7f5c900718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:15.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.326+0000 7f5cb12f8640 1 --2- 172.21.15.22:0/4122980242 >> [v2:172.21.15.22:6808/685426272,v1:172.21.15.22:6809/685426272] conn(0x7f5c90078be0 0x7f5c9007b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:15.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.330+0000 7f5cb12f8640 1 --2- 172.21.15.22:0/4122980242 >> [v2:172.21.15.22:6808/685426272,v1:172.21.15.22:6809/685426272] conn(0x7f5c90078be0 0x7f5c9007b060 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:15.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.330+0000 7f5cb0af7640 1 --2- 172.21.15.22:0/4122980242 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f5c9006f430 0x7f5c900718f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5ca0000f70 tx=0x7f5ca0007dd0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:15.306 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.330+0000 7f5ca97fa640 1 -- 172.21.15.22:0/4122980242 <== osd.1 v2:172.21.15.22:6808/685426272 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5c9007b730 con 0x7f5c90078be0 2024-05-21T13:41:15.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.342+0000 7f5cb2d5b640 1 -- 172.21.15.22:0/4122980242 --> [v2:172.21.15.22:6808/685426272,v1:172.21.15.22:6809/685426272] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f5cac0c4da0 con 0x7f5c90078be0 2024-05-21T13:41:15.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.342+0000 7f5ca97fa640 1 -- 172.21.15.22:0/4122980242 <== osd.1 v2:172.21.15.22:6808/685426272 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f5cac0c4da0 con 0x7f5c90078be0 2024-05-21T13:41:15.319 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-05-21T13:41:15.319 INFO:teuthology.orchestra.run.smithi022.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-21T13:41:15.319 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-05-21T13:41:15.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.342+0000 7f5cb2d5b640 1 -- 172.21.15.22:0/4122980242 >> [v2:172.21.15.22:6808/685426272,v1:172.21.15.22:6809/685426272] conn(0x7f5c90078be0 msgr2=0x7f5c9007b060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:15.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.342+0000 7f5cb2d5b640 1 --2- 172.21.15.22:0/4122980242 >> [v2:172.21.15.22:6808/685426272,v1:172.21.15.22:6809/685426272] conn(0x7f5c90078be0 0x7f5c9007b060 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:15.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.342+0000 7f5cb2d5b640 1 -- 172.21.15.22:0/4122980242 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f5c9006f430 msgr2=0x7f5c900718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:15.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.342+0000 7f5cb2d5b640 1 --2- 172.21.15.22:0/4122980242 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f5c9006f430 0x7f5c900718f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f5ca0000f70 tx=0x7f5ca0007dd0 comp rx=0 tx=0).stop 2024-05-21T13:41:15.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.342+0000 7f5cb2d5b640 1 -- 172.21.15.22:0/4122980242 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5cac0c85e0 msgr2=0x7f5cac14a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:15.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.342+0000 7f5cb2d5b640 1 --2- 172.21.15.22:0/4122980242 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5cac0c85e0 0x7f5cac14a710 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f5c980097c0 tx=0x7f5c9801ba30 comp rx=0 tx=0).stop 2024-05-21T13:41:15.320 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.342+0000 7f5cb12f8640 1 -- 172.21.15.22:0/4122980242 reap_dead start 2024-05-21T13:41:15.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.342+0000 7f5cb2d5b640 1 -- 172.21.15.22:0/4122980242 shutdown_connections 2024-05-21T13:41:15.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.342+0000 7f5cb2d5b640 1 -- 172.21.15.22:0/4122980242 >> 172.21.15.22:0/4122980242 conn(0x7f5cac06eb20 msgr2=0x7f5cac0ca1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:41:15.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.342+0000 7f5cb2d5b640 1 -- 172.21.15.22:0/4122980242 shutdown_connections 2024-05-21T13:41:15.321 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.342+0000 7f5cb2d5b640 1 -- 172.21.15.22:0/4122980242 wait complete. 2024-05-21T13:41:15.336 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-05-21T13:41:15.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.478+0000 7f4b2e31a640 1 Processor -- start 2024-05-21T13:41:15.456 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.478+0000 7f4b2e31a640 1 -- start start 2024-05-21T13:41:15.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.482+0000 7f4b2e31a640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4b28072ed0 0x7f4b28152420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:15.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.482+0000 7f4b2e31a640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f4b28072360 0x7f4b280c7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:15.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.482+0000 7f4b2e31a640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b28073750 con 0x7f4b28158be0 2024-05-21T13:41:15.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.482+0000 7f4b2e31a640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f4b2806e660 con 0x7f4b28072ed0 2024-05-21T13:41:15.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.482+0000 7f4b2e31a640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f4b2806eec0 con 0x7f4b28072360 2024-05-21T13:41:15.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.482+0000 7f4b27fff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4b28072ed0 0x7f4b28152420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:15.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.482+0000 7f4b27fff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f4b28072ed0 0x7f4b28152420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36588/0 (socket says 172.21.15.22:36588) 2024-05-21T13:41:15.458 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.482+0000 7f4b27fff640 1 -- 172.21.15.22:0/2329411985 learned_addr learned my addr 172.21.15.22:0/2329411985 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:41:15.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.482+0000 7f4b2c8b7640 1 --2- 172.21.15.22:0/2329411985 >> v2:172.21.15.115:3300/0 conn(0x7f4b28072360 0x7f4b280c7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:15.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.482+0000 7f4b27fff640 1 -- 172.21.15.22:0/2329411985 >> v2:172.21.15.115:3300/0 conn(0x7f4b28072360 msgr2=0x7f4b280c7bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:41:15.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.482+0000 7f4b27fff640 1 --2- 172.21.15.22:0/2329411985 >> v2:172.21.15.115:3300/0 conn(0x7f4b28072360 0x7f4b280c7bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:15.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.482+0000 7f4b27fff640 1 -- 172.21.15.22:0/2329411985 >> v1:172.21.15.115:6789/0 conn(0x7f4b28158be0 legacy=0x7f4b2806df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:15.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.482+0000 7f4b27fff640 1 -- 172.21.15.22:0/2329411985 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b28073a30 con 0x7f4b28072ed0 2024-05-21T13:41:15.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.486+0000 7f4b27fff640 1 --2- 172.21.15.22:0/2329411985 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4b28072ed0 0x7f4b28152420 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f4b28070bf0 tx=0x7f4b180213e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e787227313bf94c server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:15.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.486+0000 7f4b26ffd640 1 -- 172.21.15.22:0/2329411985 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b180b6070 con 0x7f4b28072ed0 2024-05-21T13:41:15.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.486+0000 7f4b26ffd640 1 -- 172.21.15.22:0/2329411985 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b180b1600 con 0x7f4b28072ed0 2024-05-21T13:41:15.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.486+0000 7f4b26ffd640 1 -- 172.21.15.22:0/2329411985 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b180b19d0 con 0x7f4b28072ed0 2024-05-21T13:41:15.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.486+0000 7f4b2e31a640 1 -- 172.21.15.22:0/2329411985 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4b28072ed0 msgr2=0x7f4b28152420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:15.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.486+0000 7f4b2e31a640 1 --2- 172.21.15.22:0/2329411985 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4b28072ed0 0x7f4b28152420 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f4b28070bf0 tx=0x7f4b180213e0 comp rx=0 tx=0).stop 2024-05-21T13:41:15.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.486+0000 7f4b2e31a640 1 -- 172.21.15.22:0/2329411985 shutdown_connections 2024-05-21T13:41:15.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.486+0000 7f4b2e31a640 1 --2- 172.21.15.22:0/2329411985 >> v2:172.21.15.115:3300/0 conn(0x7f4b28072360 0x7f4b280c7bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:15.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.486+0000 7f4b2e31a640 1 --2- 172.21.15.22:0/2329411985 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4b28072ed0 0x7f4b28152420 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:15.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.486+0000 7f4b2e31a640 1 -- 172.21.15.22:0/2329411985 >> 172.21.15.22:0/2329411985 conn(0x7f4b2806ce70 msgr2=0x7f4b280cd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:41:15.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.486+0000 7f4b2e31a640 1 -- 172.21.15.22:0/2329411985 shutdown_connections 2024-05-21T13:41:15.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.486+0000 7f4b2e31a640 1 -- 172.21.15.22:0/2329411985 wait complete. 2024-05-21T13:41:15.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.486+0000 7f4b2e31a640 1 Processor -- start 2024-05-21T13:41:15.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.486+0000 7f4b2e31a640 1 -- start start 2024-05-21T13:41:15.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.486+0000 7f4b2e31a640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b28072360 0x7f4b280cc4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:15.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.486+0000 7f4b2e31a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4b28072ed0 0x7f4b2815a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:15.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.486+0000 7f4b2e31a640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4b28158be0 0x7f4b28157000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:15.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.486+0000 7f4b2e31a640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f4b28073ff0 con 0x7f4b28072ed0 2024-05-21T13:41:15.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.486+0000 7f4b2e31a640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f4b28074360 con 0x7f4b28072360 2024-05-21T13:41:15.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.486+0000 7f4b2e31a640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f4b280747f0 con 0x7f4b28158be0 2024-05-21T13:41:15.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.490+0000 7f4b277fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4b28072ed0 0x7f4b2815a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:15.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.490+0000 7f4b277fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4b28072ed0 0x7f4b2815a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:36602/0 (socket says 172.21.15.22:36602) 2024-05-21T13:41:15.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.490+0000 7f4b277fe640 1 -- 172.21.15.22:0/1873512839 learned_addr learned my addr 172.21.15.22:0/1873512839 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:41:15.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.490+0000 7f4b27fff640 1 --2- 172.21.15.22:0/1873512839 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b28072360 0x7f4b280cc4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:15.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.490+0000 7f4b2c8b7640 1 --2- 172.21.15.22:0/1873512839 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4b28158be0 0x7f4b28157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:15.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.490+0000 7f4b277fe640 1 -- 172.21.15.22:0/1873512839 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4b28158be0 msgr2=0x7f4b28157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:15.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.490+0000 7f4b277fe640 1 --2- 172.21.15.22:0/1873512839 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4b28158be0 0x7f4b28157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:15.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.490+0000 7f4b277fe640 1 -- 172.21.15.22:0/1873512839 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b28072360 msgr2=0x7f4b280cc4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:15.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.490+0000 7f4b277fe640 1 --2- 172.21.15.22:0/1873512839 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b28072360 0x7f4b280cc4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:15.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.490+0000 7f4b277fe640 1 -- 172.21.15.22:0/1873512839 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b2814ca10 con 0x7f4b28072ed0 2024-05-21T13:41:15.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.490+0000 7f4b277fe640 1 --2- 172.21.15.22:0/1873512839 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4b28072ed0 0x7f4b2815a4d0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c00c500 tx=0x7f4b1c00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:15.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.490+0000 7f4b24ff9640 1 -- 172.21.15.22:0/1873512839 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b1c017070 con 0x7f4b28072ed0 2024-05-21T13:41:15.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.490+0000 7f4b24ff9640 1 -- 172.21.15.22:0/1873512839 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b1c0052d0 con 0x7f4b28072ed0 2024-05-21T13:41:15.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.490+0000 7f4b2e31a640 1 -- 172.21.15.22:0/1873512839 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b2815b910 con 0x7f4b28072ed0 2024-05-21T13:41:15.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.490+0000 7f4b24ff9640 1 -- 172.21.15.22:0/1873512839 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b1c012870 con 0x7f4b28072ed0 2024-05-21T13:41:15.467 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.490+0000 7f4b2e31a640 1 -- 172.21.15.22:0/1873512839 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b2815bbb0 con 0x7f4b28072ed0 2024-05-21T13:41:15.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.490+0000 7f4b2e31a640 1 -- 172.21.15.22:0/1873512839 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b28077bb0 con 0x7f4b28072ed0 2024-05-21T13:41:15.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.490+0000 7f4b24ff9640 1 -- 172.21.15.22:0/1873512839 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f4b1c01a070 con 0x7f4b28072ed0 2024-05-21T13:41:15.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.490+0000 7f4b24ff9640 1 --2- 172.21.15.22:0/1873512839 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f4b1406f400 0x7f4b140718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:15.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.490+0000 7f4b24ff9640 1 -- 172.21.15.22:0/1873512839 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f4b1c08e930 con 0x7f4b28072ed0 2024-05-21T13:41:15.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.494+0000 7f4b27fff640 1 --2- 172.21.15.22:0/1873512839 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f4b1406f400 0x7f4b140718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:15.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.494+0000 7f4b27fff640 1 --2- 172.21.15.22:0/1873512839 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f4b1406f400 0x7f4b140718c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f4b180b3000 tx=0x7f4b180ac000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:15.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.498+0000 7f4b24ff9640 1 -- 172.21.15.22:0/1873512839 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f4b1c005480 con 0x7f4b28072ed0 2024-05-21T13:41:15.637 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.662+0000 7f4b2e31a640 1 -- 172.21.15.22:0/1873512839 --> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f4b280c9520 con 0x7f4b1406f400 2024-05-21T13:41:15.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.662+0000 7f4b24ff9640 1 -- 172.21.15.22:0/1873512839 <== mgr.4103 v2:172.21.15.115:6832/184591771 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f4b280c9520 con 0x7f4b1406f400 2024-05-21T13:41:15.638 INFO:teuthology.orchestra.run.smithi022.stderr:instructed osd(s) 1 to deep-scrub 2024-05-21T13:41:15.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.662+0000 7f4b2e31a640 1 -- 172.21.15.22:0/1873512839 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f4b1406f400 msgr2=0x7f4b140718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:15.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.662+0000 7f4b2e31a640 1 --2- 172.21.15.22:0/1873512839 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f4b1406f400 0x7f4b140718c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f4b180b3000 tx=0x7f4b180ac000 comp rx=0 tx=0).stop 2024-05-21T13:41:15.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.662+0000 7f4b2e31a640 1 -- 172.21.15.22:0/1873512839 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4b28072ed0 msgr2=0x7f4b2815a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:15.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.662+0000 7f4b2e31a640 1 --2- 172.21.15.22:0/1873512839 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4b28072ed0 0x7f4b2815a4d0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f4b1c00c500 tx=0x7f4b1c00c9c0 comp rx=0 tx=0).stop 2024-05-21T13:41:15.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.662+0000 7f4b2e31a640 1 -- 172.21.15.22:0/1873512839 shutdown_connections 2024-05-21T13:41:15.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.662+0000 7f4b2e31a640 1 --2- 172.21.15.22:0/1873512839 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f4b1406f400 0x7f4b140718c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:15.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.662+0000 7f4b2e31a640 1 --2- 172.21.15.22:0/1873512839 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f4b28158be0 0x7f4b28157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:15.641 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.662+0000 7f4b2e31a640 1 --2- 172.21.15.22:0/1873512839 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f4b28072ed0 0x7f4b2815a4d0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:15.641 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.662+0000 7f4b2e31a640 1 --2- 172.21.15.22:0/1873512839 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f4b28072360 0x7f4b280cc4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:15.641 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.662+0000 7f4b2e31a640 1 -- 172.21.15.22:0/1873512839 >> 172.21.15.22:0/1873512839 conn(0x7f4b2806ce70 msgr2=0x7f4b280c6cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:41:15.641 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.662+0000 7f4b2e31a640 1 -- 172.21.15.22:0/1873512839 shutdown_connections 2024-05-21T13:41:15.641 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.662+0000 7f4b2e31a640 1 -- 172.21.15.22:0/1873512839 wait complete. 2024-05-21T13:41:15.657 INFO:tasks.ceph:Scrubbing osd.2 2024-05-21T13:41:15.657 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-05-21T13:41:15.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.802+0000 7fe356355640 1 Processor -- start 2024-05-21T13:41:15.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.802+0000 7fe356355640 1 -- start start 2024-05-21T13:41:15.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.802+0000 7fe356355640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe35015fd90 0x7fe3500cbe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:15.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.802+0000 7fe356355640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe350152da0 con 0x7fe3500ccc40 2024-05-21T13:41:15.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.802+0000 7fe356355640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe35015ca40 con 0x7fe3500cd8e0 2024-05-21T13:41:15.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.802+0000 7fe356355640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7fe35015f1f0 con 0x7fe35015fd90 2024-05-21T13:41:15.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.802+0000 7fe34ffff640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fe3500ccc40 0x7fe35015f680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:58634/0 (socket says 172.21.15.22:58634) 2024-05-21T13:41:15.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.802+0000 7fe34ffff640 1 -- 172.21.15.22:0/2771063474 learned_addr learned my addr 172.21.15.22:0/2771063474 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-21T13:41:15.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.802+0000 7fe34f7fe640 1 --2- 172.21.15.22:0/2771063474 >> v2:172.21.15.115:3300/0 conn(0x7fe35015fd90 0x7fe3500cbe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:15.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.802+0000 7fe34effd640 1 -- 172.21.15.22:0/2771063474 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1291154205 0 0) 0x7fe3400014a0 con 0x7fe3500ccc40 2024-05-21T13:41:15.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.802+0000 7fe34effd640 1 -- 172.21.15.22:0/2771063474 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe338003530 con 0x7fe3500ccc40 2024-05-21T13:41:15.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.802+0000 7fe34effd640 1 -- 172.21.15.22:0/2771063474 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 957354678 0 0) 0x7fe338003530 con 0x7fe3500ccc40 2024-05-21T13:41:15.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.802+0000 7fe34effd640 1 -- 172.21.15.22:0/2771063474 >> v2:172.21.15.115:3300/0 conn(0x7fe35015fd90 msgr2=0x7fe3500cbe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:41:15.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.802+0000 7fe34effd640 1 --2- 172.21.15.22:0/2771063474 >> v2:172.21.15.115:3300/0 conn(0x7fe35015fd90 0x7fe3500cbe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:15.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.802+0000 7fe34effd640 1 -- 172.21.15.22:0/2771063474 >> v1:172.21.15.115:6789/0 conn(0x7fe3500cd8e0 legacy=0x7fe350166450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:15.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.802+0000 7fe34effd640 1 -- 172.21.15.22:0/2771063474 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe35015bec0 con 0x7fe3500ccc40 2024-05-21T13:41:15.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.802+0000 7fe34effd640 1 -- 172.21.15.22:0/2771063474 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2684847062 0 0) 0x7fe340001c50 con 0x7fe3500ccc40 2024-05-21T13:41:15.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.802+0000 7fe34effd640 1 -- 172.21.15.22:0/2771063474 >> v1:172.21.15.22:6789/0 conn(0x7fe3500ccc40 legacy=0x7fe35015f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:15.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.802+0000 7fe34effd640 1 --2- 172.21.15.22:0/2771063474 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe338003a60 0x7fe338003e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:15.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.802+0000 7fe34effd640 1 --2- 172.21.15.22:0/2771063474 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe338004810 0x7fe338004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:15.781 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.802+0000 7fe34effd640 1 --2- 172.21.15.22:0/2771063474 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe3380051d0 0x7fe33800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:15.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.802+0000 7fe34effd640 1 -- 172.21.15.22:0/2771063474 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe35015f1f0 con 0x7fe3380051d0 2024-05-21T13:41:15.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.802+0000 7fe34effd640 1 -- 172.21.15.22:0/2771063474 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fe33800c150 con 0x7fe338003a60 2024-05-21T13:41:15.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.802+0000 7fe34effd640 1 -- 172.21.15.22:0/2771063474 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7fe33800c350 con 0x7fe338004810 2024-05-21T13:41:15.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.802+0000 7fe3548f2640 1 --2- 172.21.15.22:0/2771063474 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe3380051d0 0x7fe33800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:15.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.802+0000 7fe34ffff640 1 --2- 172.21.15.22:0/2771063474 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe338003a60 0x7fe338003e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:15.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.802+0000 7fe34f7fe640 1 --2- 172.21.15.22:0/2771063474 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe338004810 0x7fe338004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:15.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.802+0000 7fe3548f2640 1 -- 172.21.15.22:0/2771063474 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe338004810 msgr2=0x7fe338004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:41:15.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.802+0000 7fe3548f2640 1 --2- 172.21.15.22:0/2771063474 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe338004810 0x7fe338004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:15.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.802+0000 7fe3548f2640 1 -- 172.21.15.22:0/2771063474 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe338003a60 msgr2=0x7fe338003e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:41:15.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.802+0000 7fe3548f2640 1 --2- 172.21.15.22:0/2771063474 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe338003a60 0x7fe338003e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:15.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.802+0000 7fe3548f2640 1 -- 172.21.15.22:0/2771063474 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe338003530 con 0x7fe3380051d0 2024-05-21T13:41:15.782 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.802+0000 7fe34f7fe640 1 --2- 172.21.15.22:0/2771063474 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe338004810 0x7fe338004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T13:41:15.783 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.806+0000 7fe3548f2640 1 -- 172.21.15.22:0/2771063474 reap_dead start 2024-05-21T13:41:15.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.806+0000 7fe3548f2640 1 --2- 172.21.15.22:0/2771063474 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe3380051d0 0x7fe33800b9d0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fe348001790 tx=0x7fe34801c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2707d5fa4ac37399 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:15.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.806+0000 7fe34effd640 1 -- 172.21.15.22:0/2771063474 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe3480013e0 con 0x7fe3380051d0 2024-05-21T13:41:15.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.806+0000 7fe34effd640 1 -- 172.21.15.22:0/2771063474 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3480052d0 con 0x7fe3380051d0 2024-05-21T13:41:15.784 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.806+0000 7fe34effd640 1 -- 172.21.15.22:0/2771063474 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe348003840 con 0x7fe3380051d0 2024-05-21T13:41:15.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.810+0000 7fe356355640 1 -- 172.21.15.22:0/2771063474 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe3380051d0 msgr2=0x7fe33800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:15.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.810+0000 7fe356355640 1 --2- 172.21.15.22:0/2771063474 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe3380051d0 0x7fe33800b9d0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fe348001790 tx=0x7fe34801c3f0 comp rx=0 tx=0).stop 2024-05-21T13:41:15.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.810+0000 7fe356355640 1 -- 172.21.15.22:0/2771063474 shutdown_connections 2024-05-21T13:41:15.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.810+0000 7fe356355640 1 --2- 172.21.15.22:0/2771063474 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe3380051d0 0x7fe33800b9d0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:15.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.810+0000 7fe356355640 1 -- 172.21.15.22:0/2771063474 >> 172.21.15.22:0/2771063474 conn(0x7fe350073c20 msgr2=0x7fe350068260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:41:15.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.810+0000 7fe356355640 1 -- 172.21.15.22:0/2771063474 shutdown_connections 2024-05-21T13:41:15.785 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.810+0000 7fe356355640 1 -- 172.21.15.22:0/2771063474 wait complete. 2024-05-21T13:41:15.787 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.810+0000 7fe356355640 1 Processor -- start 2024-05-21T13:41:15.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.810+0000 7fe356355640 1 -- start start 2024-05-21T13:41:15.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.810+0000 7fe356355640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe3380051d0 0x7fe350159c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:15.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.810+0000 7fe356355640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe35015a1d0 0x7fe35015b310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:15.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.810+0000 7fe356355640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe3501e4f20 0x7fe35015b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:15.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.810+0000 7fe356355640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe35015c090 con 0x7fe35015a1d0 2024-05-21T13:41:15.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.810+0000 7fe356355640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fe35015c760 con 0x7fe3501e4f20 2024-05-21T13:41:15.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.810+0000 7fe356355640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7fe35015c210 con 0x7fe3380051d0 2024-05-21T13:41:15.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.810+0000 7fe34f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe35015a1d0 0x7fe35015b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:15.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.810+0000 7fe34f7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe35015a1d0 0x7fe35015b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:32912/0 (socket says 172.21.15.22:32912) 2024-05-21T13:41:15.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.810+0000 7fe34f7fe640 1 -- 172.21.15.22:0/1777777412 learned_addr learned my addr 172.21.15.22:0/1777777412 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:41:15.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.810+0000 7fe34ffff640 1 --2- 172.21.15.22:0/1777777412 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe3380051d0 0x7fe350159c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:15.788 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.810+0000 7fe3548f2640 1 --2- 172.21.15.22:0/1777777412 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe3501e4f20 0x7fe35015b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:15.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.810+0000 7fe34f7fe640 1 -- 172.21.15.22:0/1777777412 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe3380051d0 msgr2=0x7fe350159c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:15.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.810+0000 7fe34f7fe640 1 --2- 172.21.15.22:0/1777777412 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe3380051d0 0x7fe350159c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:15.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.810+0000 7fe34f7fe640 1 -- 172.21.15.22:0/1777777412 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe3501e4f20 msgr2=0x7fe35015b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:15.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.810+0000 7fe34f7fe640 1 --2- 172.21.15.22:0/1777777412 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe3501e4f20 0x7fe35015b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:15.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.810+0000 7fe34f7fe640 1 -- 172.21.15.22:0/1777777412 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3501e6750 con 0x7fe35015a1d0 2024-05-21T13:41:15.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.810+0000 7fe3548f2640 1 --2- 172.21.15.22:0/1777777412 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe3501e4f20 0x7fe35015b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:41:15.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.810+0000 7fe34f7fe640 1 --2- 172.21.15.22:0/1777777412 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe35015a1d0 0x7fe35015b310 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fe344009fd0 tx=0x7fe344011a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:15.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.810+0000 7fe34cff9640 1 -- 172.21.15.22:0/1777777412 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe344004220 con 0x7fe35015a1d0 2024-05-21T13:41:15.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.810+0000 7fe34cff9640 1 -- 172.21.15.22:0/1777777412 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe3440043c0 con 0x7fe35015a1d0 2024-05-21T13:41:15.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.810+0000 7fe356355640 1 -- 172.21.15.22:0/1777777412 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe35014cea0 con 0x7fe35015a1d0 2024-05-21T13:41:15.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.810+0000 7fe34cff9640 1 -- 172.21.15.22:0/1777777412 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe344015890 con 0x7fe35015a1d0 2024-05-21T13:41:15.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.810+0000 7fe356355640 1 -- 172.21.15.22:0/1777777412 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe35014cbc0 con 0x7fe35015a1d0 2024-05-21T13:41:15.789 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.810+0000 7fe356355640 1 -- 172.21.15.22:0/1777777412 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe350077bb0 con 0x7fe35015a1d0 2024-05-21T13:41:15.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.814+0000 7fe34cff9640 1 -- 172.21.15.22:0/1777777412 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fe344015a30 con 0x7fe35015a1d0 2024-05-21T13:41:15.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.814+0000 7fe34cff9640 1 --2- 172.21.15.22:0/1777777412 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fe33c06f430 0x7fe33c0718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:15.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.814+0000 7fe34cff9640 1 -- 172.21.15.22:0/1777777412 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7fe3440900e0 con 0x7fe35015a1d0 2024-05-21T13:41:15.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.814+0000 7fe34cff9640 1 --2- 172.21.15.22:0/1777777412 >> [v2:172.21.15.22:6816/2092224336,v1:172.21.15.22:6817/2092224336] conn(0x7fe33c078be0 0x7fe33c07b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:15.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.814+0000 7fe34cff9640 1 -- 172.21.15.22:0/1777777412 --> [v2:172.21.15.22:6816/2092224336,v1:172.21.15.22:6817/2092224336] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe33c07b730 con 0x7fe33c078be0 2024-05-21T13:41:15.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.814+0000 7fe34cff9640 1 -- 172.21.15.22:0/1777777412 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fe344090570 con 0x7fe35015a1d0 2024-05-21T13:41:15.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.814+0000 7fe34ffff640 1 --2- 172.21.15.22:0/1777777412 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fe33c06f430 0x7fe33c0718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:15.791 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.814+0000 7fe3548f2640 1 --2- 172.21.15.22:0/1777777412 >> [v2:172.21.15.22:6816/2092224336,v1:172.21.15.22:6817/2092224336] conn(0x7fe33c078be0 0x7fe33c07b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:15.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.814+0000 7fe3548f2640 1 --2- 172.21.15.22:0/1777777412 >> [v2:172.21.15.22:6816/2092224336,v1:172.21.15.22:6817/2092224336] conn(0x7fe33c078be0 0x7fe33c07b060 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:15.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.814+0000 7fe34ffff640 1 --2- 172.21.15.22:0/1777777412 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fe33c06f430 0x7fe33c0718f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe340002240 tx=0x7fe340006040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:15.792 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.814+0000 7fe34cff9640 1 -- 172.21.15.22:0/1777777412 <== osd.2 v2:172.21.15.22:6816/2092224336 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe33c07b730 con 0x7fe33c078be0 2024-05-21T13:41:15.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.826+0000 7fe356355640 1 -- 172.21.15.22:0/1777777412 --> [v2:172.21.15.22:6816/2092224336,v1:172.21.15.22:6817/2092224336] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fe3500cc3a0 con 0x7fe33c078be0 2024-05-21T13:41:15.804 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.826+0000 7fe34cff9640 1 -- 172.21.15.22:0/1777777412 <== osd.2 v2:172.21.15.22:6816/2092224336 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fe3500cc3a0 con 0x7fe33c078be0 2024-05-21T13:41:15.804 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-05-21T13:41:15.804 INFO:teuthology.orchestra.run.smithi022.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-21T13:41:15.804 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-05-21T13:41:15.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.826+0000 7fe356355640 1 -- 172.21.15.22:0/1777777412 >> [v2:172.21.15.22:6816/2092224336,v1:172.21.15.22:6817/2092224336] conn(0x7fe33c078be0 msgr2=0x7fe33c07b060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:15.805 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.826+0000 7fe356355640 1 --2- 172.21.15.22:0/1777777412 >> [v2:172.21.15.22:6816/2092224336,v1:172.21.15.22:6817/2092224336] conn(0x7fe33c078be0 0x7fe33c07b060 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:15.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.830+0000 7fe356355640 1 -- 172.21.15.22:0/1777777412 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fe33c06f430 msgr2=0x7fe33c0718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:15.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.830+0000 7fe356355640 1 --2- 172.21.15.22:0/1777777412 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fe33c06f430 0x7fe33c0718f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe340002240 tx=0x7fe340006040 comp rx=0 tx=0).stop 2024-05-21T13:41:15.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.830+0000 7fe356355640 1 -- 172.21.15.22:0/1777777412 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe35015a1d0 msgr2=0x7fe35015b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:15.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.830+0000 7fe356355640 1 --2- 172.21.15.22:0/1777777412 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe35015a1d0 0x7fe35015b310 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fe344009fd0 tx=0x7fe344011a60 comp rx=0 tx=0).stop 2024-05-21T13:41:15.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.830+0000 7fe3548f2640 1 -- 172.21.15.22:0/1777777412 reap_dead start 2024-05-21T13:41:15.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.830+0000 7fe356355640 1 -- 172.21.15.22:0/1777777412 shutdown_connections 2024-05-21T13:41:15.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.830+0000 7fe356355640 1 -- 172.21.15.22:0/1777777412 >> 172.21.15.22:0/1777777412 conn(0x7fe350073c20 msgr2=0x7fe350150fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:41:15.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.830+0000 7fe356355640 1 -- 172.21.15.22:0/1777777412 shutdown_connections 2024-05-21T13:41:15.806 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.830+0000 7fe356355640 1 -- 172.21.15.22:0/1777777412 wait complete. 2024-05-21T13:41:15.819 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-05-21T13:41:15.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.962+0000 7f2188498640 1 Processor -- start 2024-05-21T13:41:15.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.962+0000 7f2188498640 1 -- start start 2024-05-21T13:41:15.939 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.962+0000 7f2188498640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2180155d70 0x7f21800cd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:15.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.962+0000 7f2188498640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f218015ba70 0x7f21800cbff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:15.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.962+0000 7f2188498640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2180156150 con 0x7f218015be90 2024-05-21T13:41:15.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.962+0000 7f2188498640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f21800cdf20 con 0x7f218015ba70 2024-05-21T13:41:15.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.962+0000 7f2188498640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f218015c3e0 con 0x7f2180155d70 2024-05-21T13:41:15.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.962+0000 7f2185a33640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f218015ba70 0x7f21800cbff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:15.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.962+0000 7f2185a33640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f218015ba70 0x7f21800cbff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:32926/0 (socket says 172.21.15.22:32926) 2024-05-21T13:41:15.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.962+0000 7f2185a33640 1 -- 172.21.15.22:0/1592519234 learned_addr learned my addr 172.21.15.22:0/1592519234 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:41:15.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.962+0000 7f2186234640 1 --2- 172.21.15.22:0/1592519234 >> v2:172.21.15.115:3300/0 conn(0x7f2180155d70 0x7f21800cd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:15.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.962+0000 7f2185a33640 1 -- 172.21.15.22:0/1592519234 >> v2:172.21.15.115:3300/0 conn(0x7f2180155d70 msgr2=0x7f21800cd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:41:15.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.962+0000 7f2185a33640 1 --2- 172.21.15.22:0/1592519234 >> v2:172.21.15.115:3300/0 conn(0x7f2180155d70 0x7f21800cd010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:15.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.962+0000 7f2185a33640 1 -- 172.21.15.22:0/1592519234 >> v1:172.21.15.115:6789/0 conn(0x7f218015be90 legacy=0x7f21800ce3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:15.940 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.962+0000 7f2185a33640 1 -- 172.21.15.22:0/1592519234 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f218015c6c0 con 0x7f218015ba70 2024-05-21T13:41:15.941 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.966+0000 7f2185a33640 1 --2- 172.21.15.22:0/1592519234 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f218015ba70 0x7f21800cbff0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f2180073ea0 tx=0x7f217001c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ec707b6be7d4e4f server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:15.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.966+0000 7f2185232640 1 -- 172.21.15.22:0/1592519234 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21700aa650 con 0x7f218015ba70 2024-05-21T13:41:15.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.966+0000 7f2185232640 1 -- 172.21.15.22:0/1592519234 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f21700af070 con 0x7f218015ba70 2024-05-21T13:41:15.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.966+0000 7f2185232640 1 -- 172.21.15.22:0/1592519234 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21700aaa10 con 0x7f218015ba70 2024-05-21T13:41:15.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.966+0000 7f2188498640 1 -- 172.21.15.22:0/1592519234 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f218015ba70 msgr2=0x7f21800cbff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:15.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.966+0000 7f2188498640 1 --2- 172.21.15.22:0/1592519234 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f218015ba70 0x7f21800cbff0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f2180073ea0 tx=0x7f217001c4f0 comp rx=0 tx=0).stop 2024-05-21T13:41:15.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.966+0000 7f2188498640 1 -- 172.21.15.22:0/1592519234 shutdown_connections 2024-05-21T13:41:15.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.966+0000 7f2188498640 1 --2- 172.21.15.22:0/1592519234 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f218015ba70 0x7f21800cbff0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:15.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.966+0000 7f2188498640 1 --2- 172.21.15.22:0/1592519234 >> v2:172.21.15.115:3300/0 conn(0x7f2180155d70 0x7f21800cd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:15.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.966+0000 7f2188498640 1 -- 172.21.15.22:0/1592519234 >> 172.21.15.22:0/1592519234 conn(0x7f218006f3b0 msgr2=0x7f218006d430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:41:15.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.966+0000 7f2188498640 1 -- 172.21.15.22:0/1592519234 shutdown_connections 2024-05-21T13:41:15.943 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.966+0000 7f2188498640 1 -- 172.21.15.22:0/1592519234 wait complete. 2024-05-21T13:41:15.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.966+0000 7f2188498640 1 Processor -- start 2024-05-21T13:41:15.944 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.966+0000 7f2188498640 1 -- start start 2024-05-21T13:41:15.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.970+0000 7f2188498640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2180155d70 0x7f218015ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:15.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.970+0000 7f2188498640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f218015ba70 0x7f21800b6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:15.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.970+0000 7f2188498640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f218015be90 0x7f21800b69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:15.946 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.970+0000 7f2188498640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f21800ceac0 con 0x7f2180155d70 2024-05-21T13:41:15.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.970+0000 7f2188498640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f21800cd550 con 0x7f218015be90 2024-05-21T13:41:15.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.970+0000 7f2188498640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f21800cec40 con 0x7f218015ba70 2024-05-21T13:41:15.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.970+0000 7f2186234640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2180155d70 0x7f218015ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:15.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.970+0000 7f2186234640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2180155d70 0x7f218015ea80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:32936/0 (socket says 172.21.15.22:32936) 2024-05-21T13:41:15.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.970+0000 7f2186234640 1 -- 172.21.15.22:0/2952200714 learned_addr learned my addr 172.21.15.22:0/2952200714 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:41:15.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.970+0000 7f2185a33640 1 --2- 172.21.15.22:0/2952200714 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f218015ba70 0x7f21800b6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:15.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.970+0000 7f2186a35640 1 --2- 172.21.15.22:0/2952200714 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f218015be90 0x7f21800b69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:15.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.970+0000 7f2186234640 1 -- 172.21.15.22:0/2952200714 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f218015ba70 msgr2=0x7f21800b6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:15.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.970+0000 7f2186234640 1 --2- 172.21.15.22:0/2952200714 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f218015ba70 0x7f21800b6470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:15.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.970+0000 7f2186234640 1 -- 172.21.15.22:0/2952200714 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f218015be90 msgr2=0x7f21800b69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:15.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.970+0000 7f2186234640 1 --2- 172.21.15.22:0/2952200714 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f218015be90 0x7f21800b69b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:15.947 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.970+0000 7f2186234640 1 -- 172.21.15.22:0/2952200714 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f218015efc0 con 0x7f2180155d70 2024-05-21T13:41:15.948 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.970+0000 7f2186a35640 1 --2- 172.21.15.22:0/2952200714 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f218015be90 0x7f21800b69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:41:15.948 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.970+0000 7f2186234640 1 --2- 172.21.15.22:0/2952200714 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2180155d70 0x7f218015ea80 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f217c00d830 tx=0x7f217c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:15.948 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.970+0000 7f2176ffd640 1 -- 172.21.15.22:0/2952200714 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f217c00b6c0 con 0x7f2180155d70 2024-05-21T13:41:15.948 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.970+0000 7f2176ffd640 1 -- 172.21.15.22:0/2952200714 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f217c019070 con 0x7f2180155d70 2024-05-21T13:41:15.948 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.970+0000 7f2188498640 1 -- 172.21.15.22:0/2952200714 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f218015f250 con 0x7f2180155d70 2024-05-21T13:41:15.948 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.970+0000 7f2176ffd640 1 -- 172.21.15.22:0/2952200714 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f217c00ba60 con 0x7f2180155d70 2024-05-21T13:41:15.948 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.970+0000 7f2188498640 1 -- 172.21.15.22:0/2952200714 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21800d0c70 con 0x7f2180155d70 2024-05-21T13:41:15.948 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.970+0000 7f2188498640 1 -- 172.21.15.22:0/2952200714 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2180077bb0 con 0x7f2180155d70 2024-05-21T13:41:15.949 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.970+0000 7f2176ffd640 1 -- 172.21.15.22:0/2952200714 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f217c01e460 con 0x7f2180155d70 2024-05-21T13:41:15.949 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.970+0000 7f2176ffd640 1 --2- 172.21.15.22:0/2952200714 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f216406f400 0x7f21640718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:15.949 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.970+0000 7f2176ffd640 1 -- 172.21.15.22:0/2952200714 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f217c08fce0 con 0x7f2180155d70 2024-05-21T13:41:15.949 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.970+0000 7f2185a33640 1 --2- 172.21.15.22:0/2952200714 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f216406f400 0x7f21640718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:15.949 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.974+0000 7f2185a33640 1 --2- 172.21.15.22:0/2952200714 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f216406f400 0x7f21640718c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f21700ae000 tx=0x7f21700a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:15.952 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:15.974+0000 7f2176ffd640 1 -- 172.21.15.22:0/2952200714 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f217c05c8f0 con 0x7f2180155d70 2024-05-21T13:41:16.116 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.142+0000 7f2188498640 1 -- 172.21.15.22:0/2952200714 --> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f218015fc50 con 0x7f216406f400 2024-05-21T13:41:16.117 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.142+0000 7f2176ffd640 1 -- 172.21.15.22:0/2952200714 <== mgr.4103 v2:172.21.15.115:6832/184591771 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f218015fc50 con 0x7f216406f400 2024-05-21T13:41:16.117 INFO:teuthology.orchestra.run.smithi022.stderr:instructed osd(s) 2 to deep-scrub 2024-05-21T13:41:16.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.142+0000 7f2188498640 1 -- 172.21.15.22:0/2952200714 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f216406f400 msgr2=0x7f21640718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:16.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.142+0000 7f2188498640 1 --2- 172.21.15.22:0/2952200714 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f216406f400 0x7f21640718c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f21700ae000 tx=0x7f21700a7000 comp rx=0 tx=0).stop 2024-05-21T13:41:16.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.142+0000 7f2188498640 1 -- 172.21.15.22:0/2952200714 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2180155d70 msgr2=0x7f218015ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:16.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.142+0000 7f2188498640 1 --2- 172.21.15.22:0/2952200714 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2180155d70 0x7f218015ea80 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f217c00d830 tx=0x7f217c00dcf0 comp rx=0 tx=0).stop 2024-05-21T13:41:16.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.142+0000 7f2188498640 1 -- 172.21.15.22:0/2952200714 shutdown_connections 2024-05-21T13:41:16.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.142+0000 7f2188498640 1 --2- 172.21.15.22:0/2952200714 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f216406f400 0x7f21640718c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:16.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.142+0000 7f2188498640 1 --2- 172.21.15.22:0/2952200714 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f218015be90 0x7f21800b69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:16.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.142+0000 7f2188498640 1 --2- 172.21.15.22:0/2952200714 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f218015ba70 0x7f21800b6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:16.120 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.142+0000 7f2188498640 1 --2- 172.21.15.22:0/2952200714 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2180155d70 0x7f218015ea80 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:16.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.142+0000 7f2188498640 1 -- 172.21.15.22:0/2952200714 >> 172.21.15.22:0/2952200714 conn(0x7f218006f3b0 msgr2=0x7f2180153c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:41:16.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.142+0000 7f2188498640 1 -- 172.21.15.22:0/2952200714 shutdown_connections 2024-05-21T13:41:16.121 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.142+0000 7f2188498640 1 -- 172.21.15.22:0/2952200714 wait complete. 2024-05-21T13:41:16.138 INFO:tasks.ceph:Scrubbing osd.3 2024-05-21T13:41:16.138 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-05-21T13:41:16.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.286+0000 7f6578a09640 1 Processor -- start 2024-05-21T13:41:16.263 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.286+0000 7f6578a09640 1 -- start start 2024-05-21T13:41:16.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.286+0000 7f6578a09640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f657415f230 0x7f65740c6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:16.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.286+0000 7f6578a09640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65741560e0 con 0x7f65740cc040 2024-05-21T13:41:16.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.286+0000 7f6578a09640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f657415f7a0 con 0x7f6574155d00 2024-05-21T13:41:16.264 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.286+0000 7f6578a09640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f657415fa80 con 0x7f657415f230 2024-05-21T13:41:16.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.290+0000 7f6572d9d640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f657415f230 0x7f65740c6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:16.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.290+0000 7f6571d9b640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f65740cc040 0x7f657406cdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:58648/0 (socket says 172.21.15.22:58648) 2024-05-21T13:41:16.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.290+0000 7f6571d9b640 1 -- 172.21.15.22:0/1597692190 learned_addr learned my addr 172.21.15.22:0/1597692190 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-21T13:41:16.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.290+0000 7f6572d9d640 1 -- 172.21.15.22:0/1597692190 >> v1:172.21.15.115:6789/0 conn(0x7f6574155d00 legacy=0x7f657415c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:16.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.290+0000 7f6572d9d640 1 -- 172.21.15.22:0/1597692190 >> v1:172.21.15.22:6789/0 conn(0x7f65740cc040 legacy=0x7f657406cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:16.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.290+0000 7f657159a640 1 -- 172.21.15.22:0/1597692190 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3832862875 0 0) 0x7f65741560e0 con 0x7f65740cc040 2024-05-21T13:41:16.265 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.290+0000 7f6572d9d640 1 -- 172.21.15.22:0/1597692190 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f657415fd60 con 0x7f657415f230 2024-05-21T13:41:16.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.290+0000 7f6572d9d640 1 --2- 172.21.15.22:0/1597692190 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f657415f230 0x7f65740c6c50 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f656c0097c0 tx=0x7f656c01ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3942be79b4edc66 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:16.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.290+0000 7f657159a640 1 -- 172.21.15.22:0/1597692190 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f656c0b5070 con 0x7f657415f230 2024-05-21T13:41:16.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.290+0000 7f657159a640 1 -- 172.21.15.22:0/1597692190 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f656c0a8990 con 0x7f657415f230 2024-05-21T13:41:16.267 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.290+0000 7f657159a640 1 -- 172.21.15.22:0/1597692190 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f656c0a8d60 con 0x7f657415f230 2024-05-21T13:41:16.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.290+0000 7f6578a09640 1 -- 172.21.15.22:0/1597692190 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f657415f230 msgr2=0x7f65740c6c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:16.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.290+0000 7f6578a09640 1 --2- 172.21.15.22:0/1597692190 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f657415f230 0x7f65740c6c50 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f656c0097c0 tx=0x7f656c01ec90 comp rx=0 tx=0).stop 2024-05-21T13:41:16.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.290+0000 7f6578a09640 1 -- 172.21.15.22:0/1597692190 shutdown_connections 2024-05-21T13:41:16.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.290+0000 7f6578a09640 1 --2- 172.21.15.22:0/1597692190 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f657415f230 0x7f65740c6c50 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:16.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.290+0000 7f6578a09640 1 -- 172.21.15.22:0/1597692190 >> 172.21.15.22:0/1597692190 conn(0x7f6574074020 msgr2=0x7f657406df30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:41:16.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.290+0000 7f6578a09640 1 -- 172.21.15.22:0/1597692190 shutdown_connections 2024-05-21T13:41:16.268 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.290+0000 7f6578a09640 1 -- 172.21.15.22:0/1597692190 wait complete. 2024-05-21T13:41:16.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.294+0000 7f6578a09640 1 Processor -- start 2024-05-21T13:41:16.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.294+0000 7f6578a09640 1 -- start start 2024-05-21T13:41:16.271 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.294+0000 7f6578a09640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f65740cc040 0x7f657414e990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:16.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.294+0000 7f6578a09640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6574155d00 0x7f65740d1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:16.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.294+0000 7f6578a09640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f657415f230 0x7f65740d1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:16.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.294+0000 7f6578a09640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f65740c6730 con 0x7f657415f230 2024-05-21T13:41:16.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.294+0000 7f6578a09640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f65740c6450 con 0x7f6574155d00 2024-05-21T13:41:16.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.294+0000 7f6578a09640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f657406d500 con 0x7f65740cc040 2024-05-21T13:41:16.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.294+0000 7f6572d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f657415f230 0x7f65740d1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:16.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.294+0000 7f6572d9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f657415f230 0x7f65740d1a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:32954/0 (socket says 172.21.15.22:32954) 2024-05-21T13:41:16.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.294+0000 7f6572d9d640 1 -- 172.21.15.22:0/3375689498 learned_addr learned my addr 172.21.15.22:0/3375689498 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:41:16.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.294+0000 7f6571d9b640 1 --2- 172.21.15.22:0/3375689498 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6574155d00 0x7f65740d1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:16.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.294+0000 7f657259c640 1 --2- 172.21.15.22:0/3375689498 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f65740cc040 0x7f657414e990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:16.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.294+0000 7f6572d9d640 1 -- 172.21.15.22:0/3375689498 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f65740cc040 msgr2=0x7f657414e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:16.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.294+0000 7f6572d9d640 1 --2- 172.21.15.22:0/3375689498 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f65740cc040 0x7f657414e990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:16.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.294+0000 7f6572d9d640 1 -- 172.21.15.22:0/3375689498 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6574155d00 msgr2=0x7f65740d1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:16.272 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.294+0000 7f6572d9d640 1 --2- 172.21.15.22:0/3375689498 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6574155d00 0x7f65740d1500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:16.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.294+0000 7f6572d9d640 1 -- 172.21.15.22:0/3375689498 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65741f1860 con 0x7f657415f230 2024-05-21T13:41:16.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.294+0000 7f6571d9b640 1 --2- 172.21.15.22:0/3375689498 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f6574155d00 0x7f65740d1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T13:41:16.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.294+0000 7f6572d9d640 1 --2- 172.21.15.22:0/3375689498 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f657415f230 0x7f65740d1a40 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f656c0b3040 tx=0x7f656c01ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:16.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.294+0000 7f6562ffd640 1 -- 172.21.15.22:0/3375689498 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f656c0b5040 con 0x7f657415f230 2024-05-21T13:41:16.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.294+0000 7f6562ffd640 1 -- 172.21.15.22:0/3375689498 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f656c0bf070 con 0x7f657415f230 2024-05-21T13:41:16.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.294+0000 7f6578a09640 1 -- 172.21.15.22:0/3375689498 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f657415e750 con 0x7f657415f230 2024-05-21T13:41:16.273 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.294+0000 7f6562ffd640 1 -- 172.21.15.22:0/3375689498 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f656c0b09e0 con 0x7f657415f230 2024-05-21T13:41:16.274 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.294+0000 7f6578a09640 1 -- 172.21.15.22:0/3375689498 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65741f1e00 con 0x7f657415f230 2024-05-21T13:41:16.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.294+0000 7f6578a09640 1 -- 172.21.15.22:0/3375689498 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6574077bb0 con 0x7f657415f230 2024-05-21T13:41:16.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.298+0000 7f6562ffd640 1 -- 172.21.15.22:0/3375689498 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f656c0b0b80 con 0x7f657415f230 2024-05-21T13:41:16.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.298+0000 7f6562ffd640 1 --2- 172.21.15.22:0/3375689498 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f655406f400 0x7f65540718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:16.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.298+0000 7f6562ffd640 1 -- 172.21.15.22:0/3375689498 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f656c12cb80 con 0x7f657415f230 2024-05-21T13:41:16.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.298+0000 7f6562ffd640 1 --2- 172.21.15.22:0/3375689498 >> [v2:172.21.15.22:6824/1232311110,v1:172.21.15.22:6825/1232311110] conn(0x7f6554078bc0 0x7f655407b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:16.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.298+0000 7f6562ffd640 1 -- 172.21.15.22:0/3375689498 --> [v2:172.21.15.22:6824/1232311110,v1:172.21.15.22:6825/1232311110] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f656c0bae50 con 0x7f6554078bc0 2024-05-21T13:41:16.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.298+0000 7f6562ffd640 1 -- 172.21.15.22:0/3375689498 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f656c1312a0 con 0x7f657415f230 2024-05-21T13:41:16.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.298+0000 7f657259c640 1 --2- 172.21.15.22:0/3375689498 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f655406f400 0x7f65540718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:16.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.298+0000 7f6571d9b640 1 --2- 172.21.15.22:0/3375689498 >> [v2:172.21.15.22:6824/1232311110,v1:172.21.15.22:6825/1232311110] conn(0x7f6554078bc0 0x7f655407b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:16.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.298+0000 7f6571d9b640 1 --2- 172.21.15.22:0/3375689498 >> [v2:172.21.15.22:6824/1232311110,v1:172.21.15.22:6825/1232311110] conn(0x7f6554078bc0 0x7f655407b040 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:16.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.298+0000 7f657259c640 1 --2- 172.21.15.22:0/3375689498 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f655406f400 0x7f65540718c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f65640012f0 tx=0x7f6564009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:16.275 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.298+0000 7f6562ffd640 1 -- 172.21.15.22:0/3375689498 <== osd.3 v2:172.21.15.22:6824/1232311110 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f656c0bae50 con 0x7f6554078bc0 2024-05-21T13:41:16.288 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.310+0000 7f6578a09640 1 -- 172.21.15.22:0/3375689498 --> [v2:172.21.15.22:6824/1232311110,v1:172.21.15.22:6825/1232311110] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f65740cc460 con 0x7f6554078bc0 2024-05-21T13:41:16.288 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.310+0000 7f6562ffd640 1 -- 172.21.15.22:0/3375689498 <== osd.3 v2:172.21.15.22:6824/1232311110 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f65740cc460 con 0x7f6554078bc0 2024-05-21T13:41:16.288 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-05-21T13:41:16.288 INFO:teuthology.orchestra.run.smithi022.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-21T13:41:16.289 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-05-21T13:41:16.289 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.314+0000 7f6578a09640 1 -- 172.21.15.22:0/3375689498 >> [v2:172.21.15.22:6824/1232311110,v1:172.21.15.22:6825/1232311110] conn(0x7f6554078bc0 msgr2=0x7f655407b040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:16.289 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.314+0000 7f6578a09640 1 --2- 172.21.15.22:0/3375689498 >> [v2:172.21.15.22:6824/1232311110,v1:172.21.15.22:6825/1232311110] conn(0x7f6554078bc0 0x7f655407b040 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:16.290 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.314+0000 7f6578a09640 1 -- 172.21.15.22:0/3375689498 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f655406f400 msgr2=0x7f65540718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:16.290 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.314+0000 7f6578a09640 1 --2- 172.21.15.22:0/3375689498 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f655406f400 0x7f65540718c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f65640012f0 tx=0x7f6564009040 comp rx=0 tx=0).stop 2024-05-21T13:41:16.290 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.314+0000 7f6578a09640 1 -- 172.21.15.22:0/3375689498 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f657415f230 msgr2=0x7f65740d1a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:16.290 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.314+0000 7f6578a09640 1 --2- 172.21.15.22:0/3375689498 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f657415f230 0x7f65740d1a40 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f656c0b3040 tx=0x7f656c01ba30 comp rx=0 tx=0).stop 2024-05-21T13:41:16.290 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.314+0000 7f6572d9d640 1 -- 172.21.15.22:0/3375689498 reap_dead start 2024-05-21T13:41:16.290 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.314+0000 7f6578a09640 1 -- 172.21.15.22:0/3375689498 shutdown_connections 2024-05-21T13:41:16.290 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.314+0000 7f6578a09640 1 -- 172.21.15.22:0/3375689498 >> 172.21.15.22:0/3375689498 conn(0x7f6574074020 msgr2=0x7f65740d0360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:41:16.290 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.314+0000 7f6578a09640 1 -- 172.21.15.22:0/3375689498 shutdown_connections 2024-05-21T13:41:16.290 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.314+0000 7f6578a09640 1 -- 172.21.15.22:0/3375689498 wait complete. 2024-05-21T13:41:16.305 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-05-21T13:41:16.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.442+0000 7f30f4c54640 1 Processor -- start 2024-05-21T13:41:16.417 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.442+0000 7f30f4c54640 1 -- start start 2024-05-21T13:41:16.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.442+0000 7f30f4c54640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f30f006e1b0 0x7f30f0073080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:16.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.442+0000 7f30f4c54640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f30f0158f20 0x7f30f0159350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:16.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.442+0000 7f30f4c54640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30f0159890 con 0x7f30f006e590 2024-05-21T13:41:16.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.442+0000 7f30f4c54640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f30f0073da0 con 0x7f30f006e1b0 2024-05-21T13:41:16.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.442+0000 7f30f4c54640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f30f0074080 con 0x7f30f0158f20 2024-05-21T13:41:16.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.442+0000 7f30ee59c640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f30f006e1b0 0x7f30f0073080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:16.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.442+0000 7f30eed9d640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f30f0158f20 0x7f30f0159350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:16.419 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.442+0000 7f30edd9b640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7f30f006e590 0x7f30f00c4860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.22:60508/0 (socket says 172.21.15.22:60508) 2024-05-21T13:41:16.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.442+0000 7f30edd9b640 1 -- 172.21.15.22:0/1571501765 learned_addr learned my addr 172.21.15.22:0/1571501765 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-21T13:41:16.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.442+0000 7f30ee59c640 1 -- 172.21.15.22:0/1571501765 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f30f0158f20 msgr2=0x7f30f0159350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:41:16.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.442+0000 7f30ee59c640 1 --2- 172.21.15.22:0/1571501765 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f30f0158f20 0x7f30f0159350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:16.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.442+0000 7f30ee59c640 1 -- 172.21.15.22:0/1571501765 >> v1:172.21.15.115:6789/0 conn(0x7f30f006e590 legacy=0x7f30f00c4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:16.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.442+0000 7f30ee59c640 1 -- 172.21.15.22:0/1571501765 --> v2:172.21.15.115:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30f0074360 con 0x7f30f006e1b0 2024-05-21T13:41:16.420 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.442+0000 7f30eed9d640 1 --2- 172.21.15.22:0/1571501765 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f30f0158f20 0x7f30f0159350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-21T13:41:16.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.446+0000 7f30ee59c640 1 --2- 172.21.15.22:0/1571501765 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30f006e1b0 0x7f30f0073080 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f30e00097c0 tx=0x7f30e001c470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=81018a0214133a73 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:16.422 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.446+0000 7f30ed59a640 1 -- 172.21.15.22:0/1571501765 <== mon.1 v2:172.21.15.115:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30e00ab650 con 0x7f30f006e1b0 2024-05-21T13:41:16.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.446+0000 7f30ed59a640 1 -- 172.21.15.22:0/1571501765 <== mon.1 v2:172.21.15.115:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30e00b0070 con 0x7f30f006e1b0 2024-05-21T13:41:16.423 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.446+0000 7f30ed59a640 1 -- 172.21.15.22:0/1571501765 <== mon.1 v2:172.21.15.115:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30e00aba10 con 0x7f30f006e1b0 2024-05-21T13:41:16.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.446+0000 7f30f4c54640 1 -- 172.21.15.22:0/1571501765 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30f006e1b0 msgr2=0x7f30f0073080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:16.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.446+0000 7f30f4c54640 1 --2- 172.21.15.22:0/1571501765 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30f006e1b0 0x7f30f0073080 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f30e00097c0 tx=0x7f30e001c470 comp rx=0 tx=0).stop 2024-05-21T13:41:16.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.446+0000 7f30f4c54640 1 -- 172.21.15.22:0/1571501765 shutdown_connections 2024-05-21T13:41:16.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.446+0000 7f30f4c54640 1 --2- 172.21.15.22:0/1571501765 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f30f0158f20 0x7f30f0159350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:16.424 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.446+0000 7f30f4c54640 1 --2- 172.21.15.22:0/1571501765 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30f006e1b0 0x7f30f0073080 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:16.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.446+0000 7f30f4c54640 1 -- 172.21.15.22:0/1571501765 >> 172.21.15.22:0/1571501765 conn(0x7f30f006ce70 msgr2=0x7f30f00cd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:41:16.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.446+0000 7f30f4c54640 1 -- 172.21.15.22:0/1571501765 shutdown_connections 2024-05-21T13:41:16.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.446+0000 7f30f4c54640 1 -- 172.21.15.22:0/1571501765 wait complete. 2024-05-21T13:41:16.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.450+0000 7f30f4c54640 1 Processor -- start 2024-05-21T13:41:16.425 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.450+0000 7f30f4c54640 1 -- start start 2024-05-21T13:41:16.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.450+0000 7f30f4c54640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f30f006e1b0 0x7f30f00cbb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:16.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.450+0000 7f30f4c54640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30f006e590 0x7f30f01f86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:16.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.450+0000 7f30f4c54640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30f0158f20 0x7f30f015c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:16.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.450+0000 7f30f4c54640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f30f01530a0 con 0x7f30f006e590 2024-05-21T13:41:16.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.450+0000 7f30f4c54640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f30f0152f20 con 0x7f30f0158f20 2024-05-21T13:41:16.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.450+0000 7f30f4c54640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f30f0153220 con 0x7f30f006e1b0 2024-05-21T13:41:16.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.450+0000 7f30edd9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30f006e590 0x7f30f01f86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:16.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.450+0000 7f30edd9b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30f006e590 0x7f30f01f86d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:32964/0 (socket says 172.21.15.22:32964) 2024-05-21T13:41:16.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.450+0000 7f30edd9b640 1 -- 172.21.15.22:0/4157290835 learned_addr learned my addr 172.21.15.22:0/4157290835 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:41:16.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.450+0000 7f30eed9d640 1 --2- 172.21.15.22:0/4157290835 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30f0158f20 0x7f30f015c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:16.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.450+0000 7f30edd9b640 1 -- 172.21.15.22:0/4157290835 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f30f006e1b0 msgr2=0x7f30f00cbb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:16.428 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.450+0000 7f30ee59c640 1 --2- 172.21.15.22:0/4157290835 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f30f006e1b0 0x7f30f00cbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:16.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.450+0000 7f30edd9b640 1 --2- 172.21.15.22:0/4157290835 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f30f006e1b0 0x7f30f00cbb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:16.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.450+0000 7f30edd9b640 1 -- 172.21.15.22:0/4157290835 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30f0158f20 msgr2=0x7f30f015c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:16.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.450+0000 7f30edd9b640 1 --2- 172.21.15.22:0/4157290835 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30f0158f20 0x7f30f015c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:16.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.450+0000 7f30edd9b640 1 -- 172.21.15.22:0/4157290835 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30f00cc220 con 0x7f30f006e590 2024-05-21T13:41:16.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.450+0000 7f30ee59c640 1 --2- 172.21.15.22:0/4157290835 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f30f006e1b0 0x7f30f00cbb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:41:16.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.450+0000 7f30edd9b640 1 --2- 172.21.15.22:0/4157290835 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30f006e590 0x7f30f01f86d0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f30e400c4b0 tx=0x7f30e400c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:16.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.450+0000 7f30deffd640 1 -- 172.21.15.22:0/4157290835 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30e4017070 con 0x7f30f006e590 2024-05-21T13:41:16.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.450+0000 7f30deffd640 1 -- 172.21.15.22:0/4157290835 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f30e4005d10 con 0x7f30f006e590 2024-05-21T13:41:16.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.450+0000 7f30f4c54640 1 -- 172.21.15.22:0/4157290835 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30f00cc500 con 0x7f30f006e590 2024-05-21T13:41:16.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.450+0000 7f30deffd640 1 -- 172.21.15.22:0/4157290835 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30e40072b0 con 0x7f30f006e590 2024-05-21T13:41:16.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.450+0000 7f30f4c54640 1 -- 172.21.15.22:0/4157290835 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30f01f60f0 con 0x7f30f006e590 2024-05-21T13:41:16.429 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.450+0000 7f30f4c54640 1 -- 172.21.15.22:0/4157290835 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30f0077bb0 con 0x7f30f006e590 2024-05-21T13:41:16.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.454+0000 7f30deffd640 1 -- 172.21.15.22:0/4157290835 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f30e401a070 con 0x7f30f006e590 2024-05-21T13:41:16.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.454+0000 7f30deffd640 1 --2- 172.21.15.22:0/4157290835 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f30d006f430 0x7f30d00718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:16.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.454+0000 7f30deffd640 1 -- 172.21.15.22:0/4157290835 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f30e408e870 con 0x7f30f006e590 2024-05-21T13:41:16.430 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.454+0000 7f30ee59c640 1 --2- 172.21.15.22:0/4157290835 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f30d006f430 0x7f30d00718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:16.431 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.454+0000 7f30ee59c640 1 --2- 172.21.15.22:0/4157290835 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f30d006f430 0x7f30d00718f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f30e00af000 tx=0x7f30e0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:16.433 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.458+0000 7f30deffd640 1 -- 172.21.15.22:0/4157290835 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f30e405b510 con 0x7f30f006e590 2024-05-21T13:41:16.595 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.618+0000 7f30f4c54640 1 -- 172.21.15.22:0/4157290835 --> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f30f014ff80 con 0x7f30d006f430 2024-05-21T13:41:16.596 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.618+0000 7f30deffd640 1 -- 172.21.15.22:0/4157290835 <== mgr.4103 v2:172.21.15.115:6832/184591771 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f30f014ff80 con 0x7f30d006f430 2024-05-21T13:41:16.596 INFO:teuthology.orchestra.run.smithi022.stderr:instructed osd(s) 3 to deep-scrub 2024-05-21T13:41:16.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.622+0000 7f30f4c54640 1 -- 172.21.15.22:0/4157290835 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f30d006f430 msgr2=0x7f30d00718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:16.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.622+0000 7f30f4c54640 1 --2- 172.21.15.22:0/4157290835 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f30d006f430 0x7f30d00718f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f30e00af000 tx=0x7f30e0008040 comp rx=0 tx=0).stop 2024-05-21T13:41:16.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.622+0000 7f30f4c54640 1 -- 172.21.15.22:0/4157290835 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30f006e590 msgr2=0x7f30f01f86d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:16.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.622+0000 7f30f4c54640 1 --2- 172.21.15.22:0/4157290835 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30f006e590 0x7f30f01f86d0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f30e400c4b0 tx=0x7f30e400c970 comp rx=0 tx=0).stop 2024-05-21T13:41:16.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.622+0000 7f30f4c54640 1 -- 172.21.15.22:0/4157290835 shutdown_connections 2024-05-21T13:41:16.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.622+0000 7f30f4c54640 1 --2- 172.21.15.22:0/4157290835 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f30d006f430 0x7f30d00718f0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:16.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.622+0000 7f30f4c54640 1 --2- 172.21.15.22:0/4157290835 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f30f0158f20 0x7f30f015c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:16.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.622+0000 7f30f4c54640 1 --2- 172.21.15.22:0/4157290835 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f30f006e590 0x7f30f01f86d0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:16.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.622+0000 7f30f4c54640 1 --2- 172.21.15.22:0/4157290835 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f30f006e1b0 0x7f30f00cbb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:16.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.622+0000 7f30f4c54640 1 -- 172.21.15.22:0/4157290835 >> 172.21.15.22:0/4157290835 conn(0x7f30f006ce70 msgr2=0x7f30f00c8f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:41:16.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.622+0000 7f30f4c54640 1 -- 172.21.15.22:0/4157290835 shutdown_connections 2024-05-21T13:41:16.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.622+0000 7f30f4c54640 1 -- 172.21.15.22:0/4157290835 wait complete. 2024-05-21T13:41:16.615 INFO:tasks.ceph:Scrubbing osd.4 2024-05-21T13:41:16.616 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-05-21T13:41:16.748 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.774+0000 7f0a69cd3640 1 Processor -- start 2024-05-21T13:41:16.749 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.774+0000 7f0a69cd3640 1 -- start start 2024-05-21T13:41:16.750 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.774+0000 7f0a69cd3640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f0a64155e50 0x7f0a6415c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:16.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.774+0000 7f0a69cd3640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f0a640ce160 0x7f0a640ce570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:16.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.774+0000 7f0a69cd3640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a6415c970 con 0x7f0a640cf680 2024-05-21T13:41:16.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.774+0000 7f0a69cd3640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f0a640d2100 con 0x7f0a640ce160 2024-05-21T13:41:16.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.774+0000 7f0a69cd3640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f0a640d0090 con 0x7f0a64155e50 2024-05-21T13:41:16.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.774+0000 7f0a694d2640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f0a640ce160 0x7f0a640ce570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:16.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.774+0000 7f0a694d2640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f0a640ce160 0x7f0a640ce570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:32968/0 (socket says 172.21.15.22:32968) 2024-05-21T13:41:16.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.774+0000 7f0a694d2640 1 -- 172.21.15.22:0/1841052617 learned_addr learned my addr 172.21.15.22:0/1841052617 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:41:16.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.774+0000 7f0a68cd1640 1 --2- 172.21.15.22:0/1841052617 >> v2:172.21.15.115:3300/0 conn(0x7f0a64155e50 0x7f0a6415c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:16.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.774+0000 7f0a694d2640 1 -- 172.21.15.22:0/1841052617 >> v2:172.21.15.115:3300/0 conn(0x7f0a64155e50 msgr2=0x7f0a6415c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:41:16.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.774+0000 7f0a694d2640 1 --2- 172.21.15.22:0/1841052617 >> v2:172.21.15.115:3300/0 conn(0x7f0a64155e50 0x7f0a6415c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:16.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.774+0000 7f0a694d2640 1 -- 172.21.15.22:0/1841052617 >> v1:172.21.15.115:6789/0 conn(0x7f0a640cf680 legacy=0x7f0a640c6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:41:16.751 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.774+0000 7f0a694d2640 1 -- 172.21.15.22:0/1841052617 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a640d0d80 con 0x7f0a640ce160 2024-05-21T13:41:16.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.778+0000 7f0a694d2640 1 --2- 172.21.15.22:0/1841052617 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0a640ce160 0x7f0a640ce570 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f0a640cfe00 tx=0x7f0a5c01f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2087ccf8e55aa69 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:16.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.778+0000 7f0a637fe640 1 -- 172.21.15.22:0/1841052617 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a5c0b4070 con 0x7f0a640ce160 2024-05-21T13:41:16.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.778+0000 7f0a637fe640 1 -- 172.21.15.22:0/1841052617 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a5c0af400 con 0x7f0a640ce160 2024-05-21T13:41:16.753 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.778+0000 7f0a637fe640 1 -- 172.21.15.22:0/1841052617 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a5c0af7d0 con 0x7f0a640ce160 2024-05-21T13:41:16.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.778+0000 7f0a69cd3640 1 -- 172.21.15.22:0/1841052617 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0a640ce160 msgr2=0x7f0a640ce570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:16.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.778+0000 7f0a69cd3640 1 --2- 172.21.15.22:0/1841052617 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0a640ce160 0x7f0a640ce570 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f0a640cfe00 tx=0x7f0a5c01f1b0 comp rx=0 tx=0).stop 2024-05-21T13:41:16.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.778+0000 7f0a69cd3640 1 -- 172.21.15.22:0/1841052617 shutdown_connections 2024-05-21T13:41:16.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.778+0000 7f0a69cd3640 1 --2- 172.21.15.22:0/1841052617 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0a640ce160 0x7f0a640ce570 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:16.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.778+0000 7f0a69cd3640 1 --2- 172.21.15.22:0/1841052617 >> v2:172.21.15.115:3300/0 conn(0x7f0a64155e50 0x7f0a6415c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:16.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.778+0000 7f0a69cd3640 1 -- 172.21.15.22:0/1841052617 >> 172.21.15.22:0/1841052617 conn(0x7f0a64068430 msgr2=0x7f0a64068840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:41:16.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.778+0000 7f0a69cd3640 1 -- 172.21.15.22:0/1841052617 shutdown_connections 2024-05-21T13:41:16.754 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.778+0000 7f0a69cd3640 1 -- 172.21.15.22:0/1841052617 wait complete. 2024-05-21T13:41:16.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.778+0000 7f0a69cd3640 1 Processor -- start 2024-05-21T13:41:16.755 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.778+0000 7f0a69cd3640 1 -- start start 2024-05-21T13:41:16.756 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.778+0000 7f0a69cd3640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0a640ce160 0x7f0a641e5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:16.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.778+0000 7f0a69cd3640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a640cf680 0x7f0a6415a750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:16.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.778+0000 7f0a69cd3640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0a64155e50 0x7f0a6414bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:16.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.778+0000 7f0a69cd3640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f0a640d1620 con 0x7f0a640ce160 2024-05-21T13:41:16.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.778+0000 7f0a69cd3640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f0a640d1340 con 0x7f0a640cf680 2024-05-21T13:41:16.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.778+0000 7f0a69cd3640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f0a640d1900 con 0x7f0a64155e50 2024-05-21T13:41:16.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.778+0000 7f0a68cd1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0a640ce160 0x7f0a641e5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:16.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.778+0000 7f0a68cd1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0a640ce160 0x7f0a641e5400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:32976/0 (socket says 172.21.15.22:32976) 2024-05-21T13:41:16.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.778+0000 7f0a68cd1640 1 -- 172.21.15.22:0/623287560 learned_addr learned my addr 172.21.15.22:0/623287560 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:41:16.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.778+0000 7f0a63fff640 1 --2- 172.21.15.22:0/623287560 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a640cf680 0x7f0a6415a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:16.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.778+0000 7f0a694d2640 1 --2- 172.21.15.22:0/623287560 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0a64155e50 0x7f0a6414bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:16.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.778+0000 7f0a68cd1640 1 -- 172.21.15.22:0/623287560 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0a64155e50 msgr2=0x7f0a6414bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:16.757 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.778+0000 7f0a68cd1640 1 --2- 172.21.15.22:0/623287560 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f0a64155e50 0x7f0a6414bca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:16.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.778+0000 7f0a68cd1640 1 -- 172.21.15.22:0/623287560 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a640cf680 msgr2=0x7f0a6415a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:16.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.778+0000 7f0a68cd1640 1 --2- 172.21.15.22:0/623287560 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f0a640cf680 0x7f0a6415a750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:16.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.778+0000 7f0a68cd1640 1 -- 172.21.15.22:0/623287560 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a641f2850 con 0x7f0a640ce160 2024-05-21T13:41:16.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.782+0000 7f0a68cd1640 1 --2- 172.21.15.22:0/623287560 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0a640ce160 0x7f0a641e5400 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f0a5800d800 tx=0x7f0a5800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:16.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.782+0000 7f0a617fa640 1 -- 172.21.15.22:0/623287560 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a5800b660 con 0x7f0a640ce160 2024-05-21T13:41:16.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.782+0000 7f0a617fa640 1 -- 172.21.15.22:0/623287560 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a58019070 con 0x7f0a640ce160 2024-05-21T13:41:16.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.782+0000 7f0a617fa640 1 -- 172.21.15.22:0/623287560 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a5800ba00 con 0x7f0a640ce160 2024-05-21T13:41:16.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.782+0000 7f0a69cd3640 1 -- 172.21.15.22:0/623287560 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a64159990 con 0x7f0a640ce160 2024-05-21T13:41:16.758 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.782+0000 7f0a69cd3640 1 -- 172.21.15.22:0/623287560 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a64159f50 con 0x7f0a640ce160 2024-05-21T13:41:16.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.782+0000 7f0a69cd3640 1 -- 172.21.15.22:0/623287560 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0a64159740 con 0x7f0a640ce160 2024-05-21T13:41:16.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.782+0000 7f0a617fa640 1 -- 172.21.15.22:0/623287560 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f0a5800bba0 con 0x7f0a640ce160 2024-05-21T13:41:16.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.782+0000 7f0a617fa640 1 --2- 172.21.15.22:0/623287560 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f0a4806f400 0x7f0a480718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:16.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.782+0000 7f0a617fa640 1 -- 172.21.15.22:0/623287560 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f0a580904f0 con 0x7f0a640ce160 2024-05-21T13:41:16.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.782+0000 7f0a617fa640 1 --2- 172.21.15.22:0/623287560 >> [v2:172.21.15.115:6800/832695158,v1:172.21.15.115:6801/832695158] conn(0x7f0a48078bc0 0x7f0a4807b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:16.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.782+0000 7f0a617fa640 1 -- 172.21.15.22:0/623287560 --> [v2:172.21.15.115:6800/832695158,v1:172.21.15.115:6801/832695158] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0a5801ce50 con 0x7f0a48078bc0 2024-05-21T13:41:16.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.782+0000 7f0a617fa640 1 -- 172.21.15.22:0/623287560 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f0a58090980 con 0x7f0a640ce160 2024-05-21T13:41:16.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.782+0000 7f0a63fff640 1 --2- 172.21.15.22:0/623287560 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f0a4806f400 0x7f0a480718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:16.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.782+0000 7f0a694d2640 1 --2- 172.21.15.22:0/623287560 >> [v2:172.21.15.115:6800/832695158,v1:172.21.15.115:6801/832695158] conn(0x7f0a48078bc0 0x7f0a4807b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:16.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.782+0000 7f0a694d2640 1 -- 172.21.15.22:0/623287560 >> [v2:172.21.15.115:6800/832695158,v1:172.21.15.115:6801/832695158] conn(0x7f0a48078bc0 msgr2=0x7f0a4807b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 18 2024-05-21T13:41:16.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.782+0000 7f0a694d2640 1 -- 172.21.15.22:0/623287560 >> [v2:172.21.15.115:6800/832695158,v1:172.21.15.115:6801/832695158] conn(0x7f0a48078bc0 msgr2=0x7f0a4807b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-05-21T13:41:16.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.782+0000 7f0a694d2640 1 --2- 172.21.15.22:0/623287560 >> [v2:172.21.15.115:6800/832695158,v1:172.21.15.115:6801/832695158] conn(0x7f0a48078bc0 0x7f0a4807b040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-05-21T13:41:16.760 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.782+0000 7f0a694d2640 1 --2- 172.21.15.22:0/623287560 >> [v2:172.21.15.115:6800/832695158,v1:172.21.15.115:6801/832695158] conn(0x7f0a48078bc0 0x7f0a4807b040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-05-21T13:41:16.761 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.782+0000 7f0a63fff640 1 --2- 172.21.15.22:0/623287560 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f0a4806f400 0x7f0a480718c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0a50007fd0 tx=0x7f0a50009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:16.961 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.986+0000 7f0a694d2640 1 --2- 172.21.15.22:0/623287560 >> [v2:172.21.15.115:6800/832695158,v1:172.21.15.115:6801/832695158] conn(0x7f0a48078bc0 0x7f0a4807b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:16.962 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.986+0000 7f0a694d2640 1 --2- 172.21.15.22:0/623287560 >> [v2:172.21.15.115:6800/832695158,v1:172.21.15.115:6801/832695158] conn(0x7f0a48078bc0 0x7f0a4807b040 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:16.964 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:16.986+0000 7f0a617fa640 1 -- 172.21.15.22:0/623287560 <== osd.4 v2:172.21.15.115:6800/832695158 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0a5801ce50 con 0x7f0a48078bc0 2024-05-21T13:41:16.981 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.006+0000 7f0a69cd3640 1 -- 172.21.15.22:0/623287560 --> [v2:172.21.15.115:6800/832695158,v1:172.21.15.115:6801/832695158] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f0a64076e40 con 0x7f0a48078bc0 2024-05-21T13:41:16.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.006+0000 7f0a617fa640 1 -- 172.21.15.22:0/623287560 <== osd.4 v2:172.21.15.115:6800/832695158 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f0a64076e40 con 0x7f0a48078bc0 2024-05-21T13:41:16.982 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-05-21T13:41:16.982 INFO:teuthology.orchestra.run.smithi022.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-21T13:41:16.982 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-05-21T13:41:16.983 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.006+0000 7f0a69cd3640 1 -- 172.21.15.22:0/623287560 >> [v2:172.21.15.115:6800/832695158,v1:172.21.15.115:6801/832695158] conn(0x7f0a48078bc0 msgr2=0x7f0a4807b040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:16.983 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.006+0000 7f0a69cd3640 1 --2- 172.21.15.22:0/623287560 >> [v2:172.21.15.115:6800/832695158,v1:172.21.15.115:6801/832695158] conn(0x7f0a48078bc0 0x7f0a4807b040 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:16.983 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.006+0000 7f0a69cd3640 1 -- 172.21.15.22:0/623287560 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f0a4806f400 msgr2=0x7f0a480718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:16.983 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.006+0000 7f0a69cd3640 1 --2- 172.21.15.22:0/623287560 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f0a4806f400 0x7f0a480718c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f0a50007fd0 tx=0x7f0a50009040 comp rx=0 tx=0).stop 2024-05-21T13:41:16.983 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.006+0000 7f0a69cd3640 1 -- 172.21.15.22:0/623287560 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0a640ce160 msgr2=0x7f0a641e5400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:16.983 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.006+0000 7f0a69cd3640 1 --2- 172.21.15.22:0/623287560 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f0a640ce160 0x7f0a641e5400 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f0a5800d800 tx=0x7f0a5800dcc0 comp rx=0 tx=0).stop 2024-05-21T13:41:16.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.006+0000 7f0a694d2640 1 -- 172.21.15.22:0/623287560 reap_dead start 2024-05-21T13:41:16.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.006+0000 7f0a69cd3640 1 -- 172.21.15.22:0/623287560 shutdown_connections 2024-05-21T13:41:16.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.006+0000 7f0a69cd3640 1 -- 172.21.15.22:0/623287560 >> 172.21.15.22:0/623287560 conn(0x7f0a64068430 msgr2=0x7f0a641507c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:41:16.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.006+0000 7f0a69cd3640 1 -- 172.21.15.22:0/623287560 shutdown_connections 2024-05-21T13:41:16.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.006+0000 7f0a69cd3640 1 -- 172.21.15.22:0/623287560 wait complete. 2024-05-21T13:41:17.008 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-05-21T13:41:17.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.166+0000 7fa5c81c0640 1 Processor -- start 2024-05-21T13:41:17.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.166+0000 7fa5c81c0640 1 -- start start 2024-05-21T13:41:17.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.166+0000 7fa5c81c0640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fa5c0152f10 0x7fa5c0073860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:17.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.166+0000 7fa5c81c0640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa5c00c91e0 0x7fa5c0158e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:17.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.166+0000 7fa5c81c0640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5c00c47f0 con 0x7fa5c0152b30 2024-05-21T13:41:17.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.166+0000 7fa5c81c0640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7fa5c0073da0 con 0x7fa5c0152f10 2024-05-21T13:41:17.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.166+0000 7fa5c81c0640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7fa5c00c5030 con 0x7fa5c00c91e0 2024-05-21T13:41:17.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.166+0000 7fa5c5f5c640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fa5c0152b30 0x7fa5c006df50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:58658/0 (socket says 172.21.15.22:58658) 2024-05-21T13:41:17.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.166+0000 7fa5c5f5c640 1 -- 172.21.15.22:0/3471824092 learned_addr learned my addr 172.21.15.22:0/3471824092 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-21T13:41:17.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.166+0000 7fa5c675d640 1 --2- 172.21.15.22:0/3471824092 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa5c00c91e0 0x7fa5c0158e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:17.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.166+0000 7fa5c575b640 1 --2- 172.21.15.22:0/3471824092 >> v2:172.21.15.115:3300/0 conn(0x7fa5c0152f10 0x7fa5c0073860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:17.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.166+0000 7fa5c4f5a640 1 -- 172.21.15.22:0/3471824092 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1869354145 0 0) 0x7fa5c00c47f0 con 0x7fa5c0152b30 2024-05-21T13:41:17.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.166+0000 7fa5c4f5a640 1 -- 172.21.15.22:0/3471824092 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa5ac003530 con 0x7fa5c0152b30 2024-05-21T13:41:17.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.166+0000 7fa5c4f5a640 1 -- 172.21.15.22:0/3471824092 <== mon.0 v1:172.21.15.22:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1732974811 0 0) 0x7fa5ac003530 con 0x7fa5c0152b30 2024-05-21T13:41:17.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.166+0000 7fa5c4f5a640 1 -- 172.21.15.22:0/3471824092 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa5c00c91e0 msgr2=0x7fa5c0158e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:41:17.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.166+0000 7fa5c4f5a640 1 --2- 172.21.15.22:0/3471824092 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa5c00c91e0 0x7fa5c0158e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:17.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.166+0000 7fa5c4f5a640 1 -- 172.21.15.22:0/3471824092 >> v2:172.21.15.115:3300/0 conn(0x7fa5c0152f10 msgr2=0x7fa5c0073860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:41:17.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.166+0000 7fa5c4f5a640 1 --2- 172.21.15.22:0/3471824092 >> v2:172.21.15.115:3300/0 conn(0x7fa5c0152f10 0x7fa5c0073860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:17.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.166+0000 7fa5c4f5a640 1 -- 172.21.15.22:0/3471824092 --> v1:172.21.15.22:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5c00c4a90 con 0x7fa5c0152b30 2024-05-21T13:41:17.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.166+0000 7fa5c4f5a640 1 -- 172.21.15.22:0/3471824092 <== mon.0 v1:172.21.15.22:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 2684847062 0 0) 0x7fa5bc001720 con 0x7fa5c0152b30 2024-05-21T13:41:17.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.166+0000 7fa5c4f5a640 1 -- 172.21.15.22:0/3471824092 >> v1:172.21.15.22:6789/0 conn(0x7fa5c0152b30 legacy=0x7fa5c006df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:17.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.166+0000 7fa5c4f5a640 1 --2- 172.21.15.22:0/3471824092 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa5ac003a10 0x7fa5ac003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:17.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.166+0000 7fa5c4f5a640 1 --2- 172.21.15.22:0/3471824092 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa5ac004810 0x7fa5ac004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:17.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.166+0000 7fa5c4f5a640 1 --2- 172.21.15.22:0/3471824092 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa5c00c91e0 0x7fa5ac0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:17.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.166+0000 7fa5c4f5a640 1 -- 172.21.15.22:0/3471824092 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa5c0073da0 con 0x7fa5ac003a10 2024-05-21T13:41:17.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.166+0000 7fa5c4f5a640 1 -- 172.21.15.22:0/3471824092 --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fa5ac00ba00 con 0x7fa5ac004810 2024-05-21T13:41:17.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.166+0000 7fa5c4f5a640 1 -- 172.21.15.22:0/3471824092 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7fa5ac00bc00 con 0x7fa5c00c91e0 2024-05-21T13:41:17.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.166+0000 7fa5c5f5c640 1 --2- 172.21.15.22:0/3471824092 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa5ac003a10 0x7fa5ac003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:17.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.166+0000 7fa5c575b640 1 --2- 172.21.15.22:0/3471824092 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa5ac004810 0x7fa5ac004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:17.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.166+0000 7fa5c675d640 1 --2- 172.21.15.22:0/3471824092 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa5c00c91e0 0x7fa5ac0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:17.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.166+0000 7fa5c5f5c640 1 -- 172.21.15.22:0/3471824092 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa5c00c91e0 msgr2=0x7fa5ac0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:41:17.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.166+0000 7fa5c5f5c640 1 --2- 172.21.15.22:0/3471824092 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa5c00c91e0 0x7fa5ac0051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:17.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.170+0000 7fa5c5f5c640 1 -- 172.21.15.22:0/3471824092 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa5ac004810 msgr2=0x7fa5ac004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:41:17.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.170+0000 7fa5c5f5c640 1 --2- 172.21.15.22:0/3471824092 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa5ac004810 0x7fa5ac004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:17.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.170+0000 7fa5c5f5c640 1 -- 172.21.15.22:0/3471824092 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5ac003530 con 0x7fa5ac003a10 2024-05-21T13:41:17.147 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.170+0000 7fa5c575b640 1 --2- 172.21.15.22:0/3471824092 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa5ac004810 0x7fa5ac004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:41:17.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.170+0000 7fa5c5f5c640 1 --2- 172.21.15.22:0/3471824092 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa5ac003a10 0x7fa5ac003e30 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc00c210 tx=0x7fa5bc01f350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a63077cd57533fea server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:17.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.170+0000 7fa5c4f5a640 1 -- 172.21.15.22:0/3471824092 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5bc007d70 con 0x7fa5ac003a10 2024-05-21T13:41:17.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.170+0000 7fa5c4f5a640 1 -- 172.21.15.22:0/3471824092 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5bc005ae0 con 0x7fa5ac003a10 2024-05-21T13:41:17.150 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.170+0000 7fa5c4f5a640 1 -- 172.21.15.22:0/3471824092 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5bc007070 con 0x7fa5ac003a10 2024-05-21T13:41:17.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.170+0000 7fa5c81c0640 1 -- 172.21.15.22:0/3471824092 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa5ac003a10 msgr2=0x7fa5ac003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:17.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.170+0000 7fa5c81c0640 1 --2- 172.21.15.22:0/3471824092 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa5ac003a10 0x7fa5ac003e30 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc00c210 tx=0x7fa5bc01f350 comp rx=0 tx=0).stop 2024-05-21T13:41:17.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.170+0000 7fa5c675d640 1 -- 172.21.15.22:0/3471824092 reap_dead start 2024-05-21T13:41:17.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.170+0000 7fa5c81c0640 1 -- 172.21.15.22:0/3471824092 shutdown_connections 2024-05-21T13:41:17.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.170+0000 7fa5c81c0640 1 -- 172.21.15.22:0/3471824092 >> 172.21.15.22:0/3471824092 conn(0x7fa5c006ce70 msgr2=0x7fa5c00cd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:41:17.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.170+0000 7fa5c81c0640 1 -- 172.21.15.22:0/3471824092 shutdown_connections 2024-05-21T13:41:17.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.170+0000 7fa5c81c0640 1 -- 172.21.15.22:0/3471824092 wait complete. 2024-05-21T13:41:17.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.174+0000 7fa5c81c0640 1 Processor -- start 2024-05-21T13:41:17.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.174+0000 7fa5c81c0640 1 -- start start 2024-05-21T13:41:17.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.174+0000 7fa5c81c0640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa5ac003a10 0x7fa5c013f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:17.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.174+0000 7fa5c81c0640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa5c0159ea0 0x7fa5c015a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:17.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.174+0000 7fa5c81c0640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa5c013e9b0 0x7fa5c013ee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:17.151 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.174+0000 7fa5c81c0640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fa5c00741f0 con 0x7fa5ac003a10 2024-05-21T13:41:17.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.174+0000 7fa5c81c0640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fa5c0073fa0 con 0x7fa5c0159ea0 2024-05-21T13:41:17.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.174+0000 7fa5c81c0640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7fa5c00744d0 con 0x7fa5c013e9b0 2024-05-21T13:41:17.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.174+0000 7fa5c5f5c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa5ac003a10 0x7fa5c013f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:17.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.174+0000 7fa5c5f5c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa5ac003a10 0x7fa5c013f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:32992/0 (socket says 172.21.15.22:32992) 2024-05-21T13:41:17.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.174+0000 7fa5c5f5c640 1 -- 172.21.15.22:0/705405732 learned_addr learned my addr 172.21.15.22:0/705405732 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:41:17.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.174+0000 7fa5c675d640 1 --2- 172.21.15.22:0/705405732 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa5c013e9b0 0x7fa5c013ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:17.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.174+0000 7fa5c575b640 1 --2- 172.21.15.22:0/705405732 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa5c0159ea0 0x7fa5c015a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:17.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.174+0000 7fa5c5f5c640 1 -- 172.21.15.22:0/705405732 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa5c013e9b0 msgr2=0x7fa5c013ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:17.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.174+0000 7fa5c5f5c640 1 --2- 172.21.15.22:0/705405732 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa5c013e9b0 0x7fa5c013ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:17.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.174+0000 7fa5c5f5c640 1 -- 172.21.15.22:0/705405732 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa5c0159ea0 msgr2=0x7fa5c015a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:17.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.174+0000 7fa5c5f5c640 1 --2- 172.21.15.22:0/705405732 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa5c0159ea0 0x7fa5c015a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:17.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.174+0000 7fa5c5f5c640 1 -- 172.21.15.22:0/705405732 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5c015a860 con 0x7fa5ac003a10 2024-05-21T13:41:17.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.174+0000 7fa5c575b640 1 --2- 172.21.15.22:0/705405732 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa5c0159ea0 0x7fa5c015a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:41:17.152 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.174+0000 7fa5c5f5c640 1 --2- 172.21.15.22:0/705405732 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa5ac003a10 0x7fa5c013f9d0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc09ba40 tx=0x7fa5ac005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:17.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.174+0000 7fa5b67fc640 1 -- 172.21.15.22:0/705405732 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5bc007d70 con 0x7fa5ac003a10 2024-05-21T13:41:17.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.174+0000 7fa5b67fc640 1 -- 172.21.15.22:0/705405732 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa5bc0b6040 con 0x7fa5ac003a10 2024-05-21T13:41:17.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.174+0000 7fa5c81c0640 1 -- 172.21.15.22:0/705405732 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5c006ed10 con 0x7fa5ac003a10 2024-05-21T13:41:17.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.174+0000 7fa5b67fc640 1 -- 172.21.15.22:0/705405732 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5bc0049f0 con 0x7fa5ac003a10 2024-05-21T13:41:17.153 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.174+0000 7fa5c81c0640 1 -- 172.21.15.22:0/705405732 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5c01574e0 con 0x7fa5ac003a10 2024-05-21T13:41:17.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.174+0000 7fa5c81c0640 1 -- 172.21.15.22:0/705405732 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5c0077bb0 con 0x7fa5ac003a10 2024-05-21T13:41:17.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.174+0000 7fa5b67fc640 1 -- 172.21.15.22:0/705405732 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fa5bc004b90 con 0x7fa5ac003a10 2024-05-21T13:41:17.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.174+0000 7fa5b67fc640 1 --2- 172.21.15.22:0/705405732 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fa5a406f400 0x7fa5a40718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:17.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.178+0000 7fa5b67fc640 1 -- 172.21.15.22:0/705405732 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7fa5bc12c8a0 con 0x7fa5ac003a10 2024-05-21T13:41:17.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.178+0000 7fa5c575b640 1 --2- 172.21.15.22:0/705405732 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fa5a406f400 0x7fa5a40718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:17.154 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.178+0000 7fa5c575b640 1 --2- 172.21.15.22:0/705405732 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fa5a406f400 0x7fa5a40718c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa5b0006e90 tx=0x7fa5b0008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:17.157 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.182+0000 7fa5b67fc640 1 -- 172.21.15.22:0/705405732 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fa5bc0c1060 con 0x7fa5ac003a10 2024-05-21T13:41:17.322 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.346+0000 7fa5c81c0640 1 -- 172.21.15.22:0/705405732 --> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7fa5c00cd690 con 0x7fa5a406f400 2024-05-21T13:41:17.323 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.346+0000 7fa5b67fc640 1 -- 172.21.15.22:0/705405732 <== mgr.4103 v2:172.21.15.115:6832/184591771 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fa5c00cd690 con 0x7fa5a406f400 2024-05-21T13:41:17.323 INFO:teuthology.orchestra.run.smithi022.stderr:instructed osd(s) 4 to deep-scrub 2024-05-21T13:41:17.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.350+0000 7fa5c81c0640 1 -- 172.21.15.22:0/705405732 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fa5a406f400 msgr2=0x7fa5a40718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:17.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.350+0000 7fa5c81c0640 1 --2- 172.21.15.22:0/705405732 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fa5a406f400 0x7fa5a40718c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fa5b0006e90 tx=0x7fa5b0008040 comp rx=0 tx=0).stop 2024-05-21T13:41:17.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.350+0000 7fa5c81c0640 1 -- 172.21.15.22:0/705405732 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa5ac003a10 msgr2=0x7fa5c013f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:17.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.350+0000 7fa5c81c0640 1 --2- 172.21.15.22:0/705405732 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa5ac003a10 0x7fa5c013f9d0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fa5bc09ba40 tx=0x7fa5ac005840 comp rx=0 tx=0).stop 2024-05-21T13:41:17.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.350+0000 7fa5c81c0640 1 -- 172.21.15.22:0/705405732 shutdown_connections 2024-05-21T13:41:17.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.350+0000 7fa5c81c0640 1 --2- 172.21.15.22:0/705405732 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fa5a406f400 0x7fa5a40718c0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:17.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.350+0000 7fa5c81c0640 1 --2- 172.21.15.22:0/705405732 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fa5c013e9b0 0x7fa5c013ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:17.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.350+0000 7fa5c81c0640 1 --2- 172.21.15.22:0/705405732 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fa5c0159ea0 0x7fa5c015a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:17.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.350+0000 7fa5c81c0640 1 --2- 172.21.15.22:0/705405732 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fa5ac003a10 0x7fa5c013f9d0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:17.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.350+0000 7fa5c81c0640 1 -- 172.21.15.22:0/705405732 >> 172.21.15.22:0/705405732 conn(0x7fa5c006ce70 msgr2=0x7fa5c0159160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:41:17.326 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.350+0000 7fa5c81c0640 1 -- 172.21.15.22:0/705405732 shutdown_connections 2024-05-21T13:41:17.327 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.350+0000 7fa5c81c0640 1 -- 172.21.15.22:0/705405732 wait complete. 2024-05-21T13:41:17.344 INFO:tasks.ceph:Scrubbing osd.5 2024-05-21T13:41:17.344 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-05-21T13:41:17.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.498+0000 7fdf9c6cc640 1 Processor -- start 2024-05-21T13:41:17.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.498+0000 7fdf9c6cc640 1 -- start start 2024-05-21T13:41:17.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.498+0000 7fdf9c6cc640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fdf9415c750 0x7fdf9415bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:17.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.498+0000 7fdf9c6cc640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdf940cc220 0x7fdf940cdac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:17.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.498+0000 7fdf9c6cc640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf940b70e0 con 0x7fdf9415bbe0 2024-05-21T13:41:17.475 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.498+0000 7fdf9c6cc640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7fdf940cc7b0 con 0x7fdf9415c750 2024-05-21T13:41:17.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.498+0000 7fdf9c6cc640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7fdf940b73c0 con 0x7fdf940cc220 2024-05-21T13:41:17.476 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.498+0000 7fdf9ac69640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdf940cc220 0x7fdf940cdac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:17.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.498+0000 7fdf9ac69640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdf940cc220 0x7fdf940cdac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.22:53466/0 (socket says 172.21.15.22:53466) 2024-05-21T13:41:17.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.498+0000 7fdf9ac69640 1 -- 172.21.15.22:0/2667106518 learned_addr learned my addr 172.21.15.22:0/2667106518 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:41:17.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.498+0000 7fdf99c67640 1 --2- 172.21.15.22:0/2667106518 >> v2:172.21.15.115:3300/0 conn(0x7fdf9415c750 0x7fdf9415bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:17.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.502+0000 7fdf9ac69640 1 -- 172.21.15.22:0/2667106518 >> v2:172.21.15.115:3300/0 conn(0x7fdf9415c750 msgr2=0x7fdf9415bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:41:17.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.502+0000 7fdf9ac69640 1 --2- 172.21.15.22:0/2667106518 >> v2:172.21.15.115:3300/0 conn(0x7fdf9415c750 0x7fdf9415bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:17.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.502+0000 7fdf9ac69640 1 -- 172.21.15.22:0/2667106518 >> v1:172.21.15.115:6789/0 conn(0x7fdf9415bbe0 legacy=0x7fdf9415faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:17.477 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.502+0000 7fdf9ac69640 1 -- 172.21.15.22:0/2667106518 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf940cd120 con 0x7fdf940cc220 2024-05-21T13:41:17.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.502+0000 7fdf9ac69640 1 --2- 172.21.15.22:0/2667106518 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdf940cc220 0x7fdf940cdac0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c009870 tx=0x7fdf8c01c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df18977692a122bb server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:17.479 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.502+0000 7fdf99466640 1 -- 172.21.15.22:0/2667106518 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf8c0b2070 con 0x7fdf940cc220 2024-05-21T13:41:17.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.502+0000 7fdf99466640 1 -- 172.21.15.22:0/2667106518 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf8c0a9070 con 0x7fdf940cc220 2024-05-21T13:41:17.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.502+0000 7fdf99466640 1 -- 172.21.15.22:0/2667106518 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf8c0ad880 con 0x7fdf940cc220 2024-05-21T13:41:17.480 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.506+0000 7fdf9c6cc640 1 -- 172.21.15.22:0/2667106518 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdf940cc220 msgr2=0x7fdf940cdac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:17.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.506+0000 7fdf9c6cc640 1 --2- 172.21.15.22:0/2667106518 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdf940cc220 0x7fdf940cdac0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fdf8c009870 tx=0x7fdf8c01c560 comp rx=0 tx=0).stop 2024-05-21T13:41:17.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.506+0000 7fdf9c6cc640 1 -- 172.21.15.22:0/2667106518 shutdown_connections 2024-05-21T13:41:17.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.506+0000 7fdf9c6cc640 1 --2- 172.21.15.22:0/2667106518 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdf940cc220 0x7fdf940cdac0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:17.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.506+0000 7fdf9c6cc640 1 --2- 172.21.15.22:0/2667106518 >> v2:172.21.15.115:3300/0 conn(0x7fdf9415c750 0x7fdf9415bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:17.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.506+0000 7fdf9c6cc640 1 -- 172.21.15.22:0/2667106518 >> 172.21.15.22:0/2667106518 conn(0x7fdf94074330 msgr2=0x7fdf94068260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:41:17.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.506+0000 7fdf9c6cc640 1 -- 172.21.15.22:0/2667106518 shutdown_connections 2024-05-21T13:41:17.481 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.506+0000 7fdf9c6cc640 1 -- 172.21.15.22:0/2667106518 wait complete. 2024-05-21T13:41:17.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.506+0000 7fdf9c6cc640 1 Processor -- start 2024-05-21T13:41:17.482 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.506+0000 7fdf9c6cc640 1 -- start start 2024-05-21T13:41:17.483 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.506+0000 7fdf9c6cc640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdf940cc220 0x7fdf9415a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:17.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.506+0000 7fdf9c6cc640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdf9415bbe0 0x7fdf941f82b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:17.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.506+0000 7fdf9c6cc640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdf9415c750 0x7fdf941f87f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:17.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.506+0000 7fdf9c6cc640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fdf94168df0 con 0x7fdf940cc220 2024-05-21T13:41:17.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.506+0000 7fdf9c6cc640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fdf94168c70 con 0x7fdf9415bbe0 2024-05-21T13:41:17.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.506+0000 7fdf9c6cc640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7fdf94168f70 con 0x7fdf9415c750 2024-05-21T13:41:17.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.506+0000 7fdf9a468640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdf940cc220 0x7fdf9415a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:17.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.506+0000 7fdf9a468640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdf940cc220 0x7fdf9415a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33008/0 (socket says 172.21.15.22:33008) 2024-05-21T13:41:17.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.506+0000 7fdf9a468640 1 -- 172.21.15.22:0/1328026165 learned_addr learned my addr 172.21.15.22:0/1328026165 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:41:17.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.506+0000 7fdf99c67640 1 --2- 172.21.15.22:0/1328026165 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdf9415bbe0 0x7fdf941f82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:17.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.506+0000 7fdf9ac69640 1 --2- 172.21.15.22:0/1328026165 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdf9415c750 0x7fdf941f87f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:17.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.506+0000 7fdf9a468640 1 -- 172.21.15.22:0/1328026165 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdf9415c750 msgr2=0x7fdf941f87f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:17.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.506+0000 7fdf9a468640 1 --2- 172.21.15.22:0/1328026165 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fdf9415c750 0x7fdf941f87f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:17.484 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.506+0000 7fdf9a468640 1 -- 172.21.15.22:0/1328026165 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdf9415bbe0 msgr2=0x7fdf941f82b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:17.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.506+0000 7fdf9a468640 1 --2- 172.21.15.22:0/1328026165 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fdf9415bbe0 0x7fdf941f82b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:17.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.506+0000 7fdf9a468640 1 -- 172.21.15.22:0/1328026165 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf9414b760 con 0x7fdf940cc220 2024-05-21T13:41:17.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.506+0000 7fdf9a468640 1 --2- 172.21.15.22:0/1328026165 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdf940cc220 0x7fdf9415a4e0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fdf8400c400 tx=0x7fdf8400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:17.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.506+0000 7fdf92ffd640 1 -- 172.21.15.22:0/1328026165 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf84017070 con 0x7fdf940cc220 2024-05-21T13:41:17.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.506+0000 7fdf92ffd640 1 -- 172.21.15.22:0/1328026165 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf840052d0 con 0x7fdf940cc220 2024-05-21T13:41:17.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.506+0000 7fdf92ffd640 1 -- 172.21.15.22:0/1328026165 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf84003860 con 0x7fdf940cc220 2024-05-21T13:41:17.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.506+0000 7fdf9c6cc640 1 -- 172.21.15.22:0/1328026165 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf9414ba40 con 0x7fdf940cc220 2024-05-21T13:41:17.485 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.506+0000 7fdf9c6cc640 1 -- 172.21.15.22:0/1328026165 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf94165c70 con 0x7fdf940cc220 2024-05-21T13:41:17.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.510+0000 7fdf9c6cc640 1 -- 172.21.15.22:0/1328026165 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdf94165a20 con 0x7fdf940cc220 2024-05-21T13:41:17.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.510+0000 7fdf92ffd640 1 -- 172.21.15.22:0/1328026165 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fdf8401a070 con 0x7fdf940cc220 2024-05-21T13:41:17.486 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.510+0000 7fdf92ffd640 1 --2- 172.21.15.22:0/1328026165 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fdf8006f430 0x7fdf800718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:17.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.510+0000 7fdf92ffd640 1 -- 172.21.15.22:0/1328026165 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7fdf8408ed30 con 0x7fdf940cc220 2024-05-21T13:41:17.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.510+0000 7fdf92ffd640 1 --2- 172.21.15.22:0/1328026165 >> [v2:172.21.15.115:6812/1504764223,v1:172.21.15.115:6815/1504764223] conn(0x7fdf80078be0 0x7fdf8007b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:17.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.510+0000 7fdf92ffd640 1 -- 172.21.15.22:0/1328026165 --> [v2:172.21.15.115:6812/1504764223,v1:172.21.15.115:6815/1504764223] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdf8007b730 con 0x7fdf80078be0 2024-05-21T13:41:17.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.510+0000 7fdf92ffd640 1 -- 172.21.15.22:0/1328026165 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fdf8408f1c0 con 0x7fdf940cc220 2024-05-21T13:41:17.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.510+0000 7fdf99c67640 1 --2- 172.21.15.22:0/1328026165 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fdf8006f430 0x7fdf800718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:17.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.510+0000 7fdf9ac69640 1 --2- 172.21.15.22:0/1328026165 >> [v2:172.21.15.115:6812/1504764223,v1:172.21.15.115:6815/1504764223] conn(0x7fdf80078be0 0x7fdf8007b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:17.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.510+0000 7fdf99c67640 1 --2- 172.21.15.22:0/1328026165 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fdf8006f430 0x7fdf800718f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fdf941660c0 tx=0x7fdf8800b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:17.487 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.510+0000 7fdf9ac69640 1 --2- 172.21.15.22:0/1328026165 >> [v2:172.21.15.115:6812/1504764223,v1:172.21.15.115:6815/1504764223] conn(0x7fdf80078be0 0x7fdf8007b060 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:17.489 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.514+0000 7fdf92ffd640 1 -- 172.21.15.22:0/1328026165 <== osd.5 v2:172.21.15.115:6812/1504764223 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdf8007b730 con 0x7fdf80078be0 2024-05-21T13:41:17.503 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.526+0000 7fdf9c6cc640 1 -- 172.21.15.22:0/1328026165 --> [v2:172.21.15.115:6812/1504764223,v1:172.21.15.115:6815/1504764223] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fdf94154170 con 0x7fdf80078be0 2024-05-21T13:41:17.504 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.526+0000 7fdf92ffd640 1 -- 172.21.15.22:0/1328026165 <== osd.5 v2:172.21.15.115:6812/1504764223 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fdf94154170 con 0x7fdf80078be0 2024-05-21T13:41:17.504 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-05-21T13:41:17.504 INFO:teuthology.orchestra.run.smithi022.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-21T13:41:17.504 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-05-21T13:41:17.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.530+0000 7fdf9c6cc640 1 -- 172.21.15.22:0/1328026165 >> [v2:172.21.15.115:6812/1504764223,v1:172.21.15.115:6815/1504764223] conn(0x7fdf80078be0 msgr2=0x7fdf8007b060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:17.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.530+0000 7fdf9c6cc640 1 --2- 172.21.15.22:0/1328026165 >> [v2:172.21.15.115:6812/1504764223,v1:172.21.15.115:6815/1504764223] conn(0x7fdf80078be0 0x7fdf8007b060 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:17.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.530+0000 7fdf9c6cc640 1 -- 172.21.15.22:0/1328026165 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fdf8006f430 msgr2=0x7fdf800718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:17.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.530+0000 7fdf9c6cc640 1 --2- 172.21.15.22:0/1328026165 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fdf8006f430 0x7fdf800718f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fdf941660c0 tx=0x7fdf8800b040 comp rx=0 tx=0).stop 2024-05-21T13:41:17.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.530+0000 7fdf9c6cc640 1 -- 172.21.15.22:0/1328026165 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdf940cc220 msgr2=0x7fdf9415a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:17.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.530+0000 7fdf9c6cc640 1 --2- 172.21.15.22:0/1328026165 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fdf940cc220 0x7fdf9415a4e0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fdf8400c400 tx=0x7fdf8400c8c0 comp rx=0 tx=0).stop 2024-05-21T13:41:17.505 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.530+0000 7fdf9ac69640 1 -- 172.21.15.22:0/1328026165 reap_dead start 2024-05-21T13:41:17.506 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.530+0000 7fdf9c6cc640 1 -- 172.21.15.22:0/1328026165 shutdown_connections 2024-05-21T13:41:17.506 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.530+0000 7fdf9c6cc640 1 -- 172.21.15.22:0/1328026165 >> 172.21.15.22:0/1328026165 conn(0x7fdf94074330 msgr2=0x7fdf94156320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:41:17.506 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.530+0000 7fdf9c6cc640 1 -- 172.21.15.22:0/1328026165 shutdown_connections 2024-05-21T13:41:17.506 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.530+0000 7fdf9c6cc640 1 -- 172.21.15.22:0/1328026165 wait complete. 2024-05-21T13:41:17.521 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-05-21T13:41:17.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.662+0000 7f257033e640 1 Processor -- start 2024-05-21T13:41:17.638 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.662+0000 7f257033e640 1 -- start start 2024-05-21T13:41:17.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.662+0000 7f257033e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2568152f10 0x7f2568073860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:17.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.662+0000 7f257033e640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f25680c91e0 0x7f2568158e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:17.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.662+0000 7f257033e640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25680c47f0 con 0x7f2568152b30 2024-05-21T13:41:17.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.662+0000 7f257033e640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f2568073da0 con 0x7f25680c91e0 2024-05-21T13:41:17.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.662+0000 7f257033e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f25680c5030 con 0x7f2568152f10 2024-05-21T13:41:17.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.662+0000 7f256e8db640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f25680c91e0 0x7f2568158e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:17.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.662+0000 7f256e8db640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f25680c91e0 0x7f2568158e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33018/0 (socket says 172.21.15.22:33018) 2024-05-21T13:41:17.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.662+0000 7f256e8db640 1 -- 172.21.15.22:0/1089605453 learned_addr learned my addr 172.21.15.22:0/1089605453 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:41:17.640 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.662+0000 7f256d8d9640 1 --2- 172.21.15.22:0/1089605453 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2568152f10 0x7f2568073860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:17.641 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.662+0000 7f256e8db640 1 -- 172.21.15.22:0/1089605453 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2568152f10 msgr2=0x7f2568073860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:41:17.641 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.662+0000 7f256e8db640 1 --2- 172.21.15.22:0/1089605453 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2568152f10 0x7f2568073860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:17.641 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.662+0000 7f256e8db640 1 -- 172.21.15.22:0/1089605453 >> v1:172.21.15.115:6789/0 conn(0x7f2568152b30 legacy=0x7f256806df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:17.641 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.662+0000 7f256e8db640 1 -- 172.21.15.22:0/1089605453 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25680c4a90 con 0x7f25680c91e0 2024-05-21T13:41:17.643 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.666+0000 7f256e8db640 1 --2- 172.21.15.22:0/1089605453 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25680c91e0 0x7f2568158e30 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f2560009e50 tx=0x7f256001f210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f549f7e1c15a0ec server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:17.643 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.666+0000 7f256d0d8640 1 -- 172.21.15.22:0/1089605453 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25600b4070 con 0x7f25680c91e0 2024-05-21T13:41:17.643 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.666+0000 7f256d0d8640 1 -- 172.21.15.22:0/1089605453 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25600af400 con 0x7f25680c91e0 2024-05-21T13:41:17.643 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.666+0000 7f256d0d8640 1 -- 172.21.15.22:0/1089605453 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25600af7d0 con 0x7f25680c91e0 2024-05-21T13:41:17.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.666+0000 7f257033e640 1 -- 172.21.15.22:0/1089605453 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25680c91e0 msgr2=0x7f2568158e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:17.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.666+0000 7f257033e640 1 --2- 172.21.15.22:0/1089605453 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25680c91e0 0x7f2568158e30 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f2560009e50 tx=0x7f256001f210 comp rx=0 tx=0).stop 2024-05-21T13:41:17.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.666+0000 7f257033e640 1 -- 172.21.15.22:0/1089605453 shutdown_connections 2024-05-21T13:41:17.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.666+0000 7f257033e640 1 --2- 172.21.15.22:0/1089605453 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f25680c91e0 0x7f2568158e30 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:17.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.666+0000 7f257033e640 1 --2- 172.21.15.22:0/1089605453 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2568152f10 0x7f2568073860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:17.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.666+0000 7f257033e640 1 -- 172.21.15.22:0/1089605453 >> 172.21.15.22:0/1089605453 conn(0x7f256806ce70 msgr2=0x7f25680cd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:41:17.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.666+0000 7f257033e640 1 -- 172.21.15.22:0/1089605453 shutdown_connections 2024-05-21T13:41:17.644 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.666+0000 7f257033e640 1 -- 172.21.15.22:0/1089605453 wait complete. 2024-05-21T13:41:17.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.670+0000 7f257033e640 1 Processor -- start 2024-05-21T13:41:17.645 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.670+0000 7f257033e640 1 -- start start 2024-05-21T13:41:17.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.670+0000 7f257033e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25680c91e0 0x7f25681f3020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:17.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.670+0000 7f257033e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2568152b30 0x7f2568145f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:17.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.670+0000 7f257033e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2568152f10 0x7f25681efbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:17.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.670+0000 7f257033e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f25680741f0 con 0x7f2568152b30 2024-05-21T13:41:17.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.670+0000 7f257033e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f2568073fa0 con 0x7f25680c91e0 2024-05-21T13:41:17.647 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.670+0000 7f257033e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f25680744d0 con 0x7f2568152f10 2024-05-21T13:41:17.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.670+0000 7f256d8d9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2568152b30 0x7f2568145f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:17.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.670+0000 7f256d8d9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2568152b30 0x7f2568145f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33020/0 (socket says 172.21.15.22:33020) 2024-05-21T13:41:17.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.670+0000 7f256d8d9640 1 -- 172.21.15.22:0/1291718994 learned_addr learned my addr 172.21.15.22:0/1291718994 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:41:17.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.670+0000 7f256e0da640 1 --2- 172.21.15.22:0/1291718994 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25680c91e0 0x7f25681f3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:17.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.670+0000 7f256e8db640 1 --2- 172.21.15.22:0/1291718994 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2568152f10 0x7f25681efbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:17.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.670+0000 7f256d8d9640 1 -- 172.21.15.22:0/1291718994 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2568152f10 msgr2=0x7f25681efbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:17.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.670+0000 7f256d8d9640 1 --2- 172.21.15.22:0/1291718994 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2568152f10 0x7f25681efbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:17.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.670+0000 7f256d8d9640 1 -- 172.21.15.22:0/1291718994 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25680c91e0 msgr2=0x7f25681f3020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:17.648 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.670+0000 7f256d8d9640 1 --2- 172.21.15.22:0/1291718994 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25680c91e0 0x7f25681f3020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:17.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.670+0000 7f256d8d9640 1 -- 172.21.15.22:0/1291718994 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25681ef0f0 con 0x7f2568152b30 2024-05-21T13:41:17.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.670+0000 7f256d8d9640 1 --2- 172.21.15.22:0/1291718994 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2568152b30 0x7f2568145f30 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f255800e870 tx=0x7f255800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:17.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.670+0000 7f255effd640 1 -- 172.21.15.22:0/1291718994 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2558017070 con 0x7f2568152b30 2024-05-21T13:41:17.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.670+0000 7f255effd640 1 -- 172.21.15.22:0/1291718994 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f255800ee60 con 0x7f2568152b30 2024-05-21T13:41:17.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.670+0000 7f257033e640 1 -- 172.21.15.22:0/1291718994 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25680cd3a0 con 0x7f2568152b30 2024-05-21T13:41:17.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.670+0000 7f255effd640 1 -- 172.21.15.22:0/1291718994 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f255800cae0 con 0x7f2568152b30 2024-05-21T13:41:17.649 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.670+0000 7f257033e640 1 -- 172.21.15.22:0/1291718994 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25681ef3b0 con 0x7f2568152b30 2024-05-21T13:41:17.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.670+0000 7f257033e640 1 -- 172.21.15.22:0/1291718994 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2568077bb0 con 0x7f2568152b30 2024-05-21T13:41:17.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.674+0000 7f255effd640 1 -- 172.21.15.22:0/1291718994 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f255801a070 con 0x7f2568152b30 2024-05-21T13:41:17.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.674+0000 7f255effd640 1 --2- 172.21.15.22:0/1291718994 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f254c06f430 0x7f254c0718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:17.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.674+0000 7f255effd640 1 -- 172.21.15.22:0/1291718994 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f255808f6c0 con 0x7f2568152b30 2024-05-21T13:41:17.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.674+0000 7f256e0da640 1 --2- 172.21.15.22:0/1291718994 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f254c06f430 0x7f254c0718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:17.650 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.674+0000 7f256e0da640 1 --2- 172.21.15.22:0/1291718994 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f254c06f430 0x7f254c0718f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f25680c49c0 tx=0x7f2564009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:17.654 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.678+0000 7f255effd640 1 -- 172.21.15.22:0/1291718994 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f255805c360 con 0x7f2568152b30 2024-05-21T13:41:17.826 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.850+0000 7f257033e640 1 -- 172.21.15.22:0/1291718994 --> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f25680cc580 con 0x7f254c06f430 2024-05-21T13:41:17.827 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.850+0000 7f255effd640 1 -- 172.21.15.22:0/1291718994 <== mgr.4103 v2:172.21.15.115:6832/184591771 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f25680cc580 con 0x7f254c06f430 2024-05-21T13:41:17.827 INFO:teuthology.orchestra.run.smithi022.stderr:instructed osd(s) 5 to deep-scrub 2024-05-21T13:41:17.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.854+0000 7f257033e640 1 -- 172.21.15.22:0/1291718994 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f254c06f430 msgr2=0x7f254c0718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:17.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.854+0000 7f257033e640 1 --2- 172.21.15.22:0/1291718994 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f254c06f430 0x7f254c0718f0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f25680c49c0 tx=0x7f2564009040 comp rx=0 tx=0).stop 2024-05-21T13:41:17.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.854+0000 7f257033e640 1 -- 172.21.15.22:0/1291718994 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2568152b30 msgr2=0x7f2568145f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:17.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.854+0000 7f257033e640 1 --2- 172.21.15.22:0/1291718994 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2568152b30 0x7f2568145f30 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f255800e870 tx=0x7f255800ec70 comp rx=0 tx=0).stop 2024-05-21T13:41:17.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.854+0000 7f257033e640 1 -- 172.21.15.22:0/1291718994 shutdown_connections 2024-05-21T13:41:17.830 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.854+0000 7f257033e640 1 --2- 172.21.15.22:0/1291718994 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f254c06f430 0x7f254c0718f0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:17.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.854+0000 7f257033e640 1 --2- 172.21.15.22:0/1291718994 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2568152f10 0x7f25681efbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:17.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.854+0000 7f257033e640 1 --2- 172.21.15.22:0/1291718994 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2568152b30 0x7f2568145f30 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:17.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.854+0000 7f257033e640 1 --2- 172.21.15.22:0/1291718994 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f25680c91e0 0x7f25681f3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:17.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.854+0000 7f257033e640 1 -- 172.21.15.22:0/1291718994 >> 172.21.15.22:0/1291718994 conn(0x7f256806ce70 msgr2=0x7f2568070710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:41:17.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.854+0000 7f257033e640 1 -- 172.21.15.22:0/1291718994 shutdown_connections 2024-05-21T13:41:17.831 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.854+0000 7f257033e640 1 -- 172.21.15.22:0/1291718994 wait complete. 2024-05-21T13:41:17.848 INFO:tasks.ceph:Scrubbing osd.6 2024-05-21T13:41:17.848 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-05-21T13:41:17.971 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.994+0000 7f47727e1640 1 Processor -- start 2024-05-21T13:41:17.971 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.994+0000 7f47727e1640 1 -- start start 2024-05-21T13:41:17.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.994+0000 7f47727e1640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f476c159270 0x7f476c0cbec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:17.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.994+0000 7f47727e1640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f476c06dad0 con 0x7f476c06d600 2024-05-21T13:41:17.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.994+0000 7f47727e1640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f476c0cb060 con 0x7f476c0c9ea0 2024-05-21T13:41:17.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.994+0000 7f47727e1640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f476c0cb340 con 0x7f476c159270 2024-05-21T13:41:17.972 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.994+0000 7f476bfff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f476c159270 0x7f476c0cbec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:17.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.994+0000 7f4770d7e640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f476c06d600 0x7f476c166570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:58662/0 (socket says 172.21.15.22:58662) 2024-05-21T13:41:17.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.994+0000 7f476bfff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f476c159270 0x7f476c0cbec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33022/0 (socket says 172.21.15.22:33022) 2024-05-21T13:41:17.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.994+0000 7f4770d7e640 1 -- 172.21.15.22:0/272832243 learned_addr learned my addr 172.21.15.22:0/272832243 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-21T13:41:17.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.998+0000 7f476bfff640 1 -- 172.21.15.22:0/272832243 >> v1:172.21.15.115:6789/0 conn(0x7f476c0c9ea0 legacy=0x7f476c15bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:41:17.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.998+0000 7f476bfff640 1 -- 172.21.15.22:0/272832243 >> v1:172.21.15.22:6789/0 conn(0x7f476c06d600 legacy=0x7f476c166570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:17.973 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.998+0000 7f476bfff640 1 -- 172.21.15.22:0/272832243 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f476c0cb620 con 0x7f476c159270 2024-05-21T13:41:17.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.998+0000 7f476bfff640 1 --2- 172.21.15.22:0/272832243 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f476c159270 0x7f476c0cbec0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f475c0097c0 tx=0x7f475c01c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3587eff08914273a server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:17.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.998+0000 7f476b7fe640 1 -- 172.21.15.22:0/272832243 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f475c0a7070 con 0x7f476c159270 2024-05-21T13:41:17.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.998+0000 7f476b7fe640 1 -- 172.21.15.22:0/272832243 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f475c0b0070 con 0x7f476c159270 2024-05-21T13:41:17.975 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.998+0000 7f476b7fe640 1 -- 172.21.15.22:0/272832243 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f475c0ab890 con 0x7f476c159270 2024-05-21T13:41:17.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.998+0000 7f47727e1640 1 -- 172.21.15.22:0/272832243 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f476c159270 msgr2=0x7f476c0cbec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:17.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.998+0000 7f47727e1640 1 --2- 172.21.15.22:0/272832243 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f476c159270 0x7f476c0cbec0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f475c0097c0 tx=0x7f475c01c470 comp rx=0 tx=0).stop 2024-05-21T13:41:17.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.998+0000 7f47727e1640 1 -- 172.21.15.22:0/272832243 shutdown_connections 2024-05-21T13:41:17.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.998+0000 7f47727e1640 1 --2- 172.21.15.22:0/272832243 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f476c159270 0x7f476c0cbec0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:17.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.998+0000 7f47727e1640 1 -- 172.21.15.22:0/272832243 >> 172.21.15.22:0/272832243 conn(0x7f476c072240 msgr2=0x7f476c072650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:41:17.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.998+0000 7f47727e1640 1 -- 172.21.15.22:0/272832243 shutdown_connections 2024-05-21T13:41:17.976 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:17.998+0000 7f47727e1640 1 -- 172.21.15.22:0/272832243 wait complete. 2024-05-21T13:41:17.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.002+0000 7f47727e1640 1 Processor -- start 2024-05-21T13:41:17.977 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.002+0000 7f47727e1640 1 -- start start 2024-05-21T13:41:17.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.002+0000 7f47727e1640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f476c06d600 0x7f476c149ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:17.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.002+0000 7f47727e1640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f476c0c9ea0 0x7f476c0ce5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:17.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.002+0000 7f47727e1640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f476c159270 0x7f476c0ceb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:17.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.002+0000 7f47727e1640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f476c06ebc0 con 0x7f476c159270 2024-05-21T13:41:17.979 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.002+0000 7f47727e1640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f476c06ea40 con 0x7f476c0c9ea0 2024-05-21T13:41:17.980 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.002+0000 7f47727e1640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f476c0cc400 con 0x7f476c06d600 2024-05-21T13:41:17.980 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.002+0000 7f4770d7e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f476c159270 0x7f476c0ceb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:17.980 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.002+0000 7f4770d7e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f476c159270 0x7f476c0ceb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33038/0 (socket says 172.21.15.22:33038) 2024-05-21T13:41:17.980 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.002+0000 7f4770d7e640 1 -- 172.21.15.22:0/2933458277 learned_addr learned my addr 172.21.15.22:0/2933458277 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:41:17.980 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.002+0000 7f476bfff640 1 --2- 172.21.15.22:0/2933458277 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f476c06d600 0x7f476c149ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:17.980 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.002+0000 7f4763fff640 1 --2- 172.21.15.22:0/2933458277 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f476c0c9ea0 0x7f476c0ce5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:17.980 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.002+0000 7f4770d7e640 1 -- 172.21.15.22:0/2933458277 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f476c06d600 msgr2=0x7f476c149ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:17.980 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.002+0000 7f4770d7e640 1 --2- 172.21.15.22:0/2933458277 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f476c06d600 0x7f476c149ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:17.980 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.002+0000 7f4770d7e640 1 -- 172.21.15.22:0/2933458277 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f476c0c9ea0 msgr2=0x7f476c0ce5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:17.980 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.002+0000 7f4770d7e640 1 --2- 172.21.15.22:0/2933458277 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f476c0c9ea0 0x7f476c0ce5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:17.980 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.002+0000 7f4770d7e640 1 -- 172.21.15.22:0/2933458277 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f476c147b70 con 0x7f476c159270 2024-05-21T13:41:17.980 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.002+0000 7f4770d7e640 1 --2- 172.21.15.22:0/2933458277 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f476c159270 0x7f476c0ceb20 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f476400caa0 tx=0x7f476400cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:17.980 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.002+0000 7f47697fa640 1 -- 172.21.15.22:0/2933458277 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4764017070 con 0x7f476c159270 2024-05-21T13:41:17.980 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.002+0000 7f47697fa640 1 -- 172.21.15.22:0/2933458277 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f476400ac00 con 0x7f476c159270 2024-05-21T13:41:17.981 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.002+0000 7f47727e1640 1 -- 172.21.15.22:0/2933458277 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f476c146410 con 0x7f476c159270 2024-05-21T13:41:17.981 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.002+0000 7f47697fa640 1 -- 172.21.15.22:0/2933458277 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4764012400 con 0x7f476c159270 2024-05-21T13:41:17.981 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.002+0000 7f47727e1640 1 -- 172.21.15.22:0/2933458277 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f476c0cdde0 con 0x7f476c159270 2024-05-21T13:41:17.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.002+0000 7f47727e1640 1 -- 172.21.15.22:0/2933458277 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f476c0cdbd0 con 0x7f476c159270 2024-05-21T13:41:17.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.006+0000 7f47697fa640 1 -- 172.21.15.22:0/2933458277 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f476401a070 con 0x7f476c159270 2024-05-21T13:41:17.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.006+0000 7f47697fa640 1 --2- 172.21.15.22:0/2933458277 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f474c06f400 0x7f474c0718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:17.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.006+0000 7f47697fa640 1 -- 172.21.15.22:0/2933458277 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f476408f210 con 0x7f476c159270 2024-05-21T13:41:17.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.006+0000 7f47697fa640 1 --2- 172.21.15.22:0/2933458277 >> [v2:172.21.15.115:6808/959292720,v1:172.21.15.115:6809/959292720] conn(0x7f474c078bc0 0x7f474c07b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:17.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.006+0000 7f47697fa640 1 -- 172.21.15.22:0/2933458277 --> [v2:172.21.15.115:6808/959292720,v1:172.21.15.115:6809/959292720] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f476401de80 con 0x7f474c078bc0 2024-05-21T13:41:17.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.006+0000 7f47697fa640 1 -- 172.21.15.22:0/2933458277 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f4764096050 con 0x7f476c159270 2024-05-21T13:41:17.982 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.006+0000 7f476bfff640 1 --2- 172.21.15.22:0/2933458277 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f474c06f400 0x7f474c0718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:17.983 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.006+0000 7f4763fff640 1 --2- 172.21.15.22:0/2933458277 >> [v2:172.21.15.115:6808/959292720,v1:172.21.15.115:6809/959292720] conn(0x7f474c078bc0 0x7f474c07b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:17.983 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.006+0000 7f4763fff640 1 --2- 172.21.15.22:0/2933458277 >> [v2:172.21.15.115:6808/959292720,v1:172.21.15.115:6809/959292720] conn(0x7f474c078bc0 0x7f474c07b040 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:17.983 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.006+0000 7f476bfff640 1 --2- 172.21.15.22:0/2933458277 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f474c06f400 0x7f474c0718c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f475c0af000 tx=0x7f475c0a7000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:17.984 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.006+0000 7f47697fa640 1 -- 172.21.15.22:0/2933458277 <== osd.6 v2:172.21.15.115:6808/959292720 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f476401de80 con 0x7f474c078bc0 2024-05-21T13:41:17.997 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.022+0000 7f47727e1640 1 -- 172.21.15.22:0/2933458277 --> [v2:172.21.15.115:6808/959292720,v1:172.21.15.115:6809/959292720] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f476c0697d0 con 0x7f474c078bc0 2024-05-21T13:41:17.998 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.022+0000 7f47697fa640 1 -- 172.21.15.22:0/2933458277 <== osd.6 v2:172.21.15.115:6808/959292720 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f476c0697d0 con 0x7f474c078bc0 2024-05-21T13:41:17.998 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-05-21T13:41:17.998 INFO:teuthology.orchestra.run.smithi022.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-21T13:41:17.998 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-05-21T13:41:17.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.022+0000 7f47727e1640 1 -- 172.21.15.22:0/2933458277 >> [v2:172.21.15.115:6808/959292720,v1:172.21.15.115:6809/959292720] conn(0x7f474c078bc0 msgr2=0x7f474c07b040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:17.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.022+0000 7f47727e1640 1 --2- 172.21.15.22:0/2933458277 >> [v2:172.21.15.115:6808/959292720,v1:172.21.15.115:6809/959292720] conn(0x7f474c078bc0 0x7f474c07b040 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:17.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.022+0000 7f47727e1640 1 -- 172.21.15.22:0/2933458277 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f474c06f400 msgr2=0x7f474c0718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:17.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.022+0000 7f47727e1640 1 --2- 172.21.15.22:0/2933458277 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f474c06f400 0x7f474c0718c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f475c0af000 tx=0x7f475c0a7000 comp rx=0 tx=0).stop 2024-05-21T13:41:17.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.022+0000 7f47727e1640 1 -- 172.21.15.22:0/2933458277 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f476c159270 msgr2=0x7f476c0ceb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:17.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.022+0000 7f47727e1640 1 --2- 172.21.15.22:0/2933458277 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f476c159270 0x7f476c0ceb20 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f476400caa0 tx=0x7f476400cf60 comp rx=0 tx=0).stop 2024-05-21T13:41:17.999 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.022+0000 7f4770d7e640 1 -- 172.21.15.22:0/2933458277 reap_dead start 2024-05-21T13:41:18.000 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.022+0000 7f47727e1640 1 -- 172.21.15.22:0/2933458277 shutdown_connections 2024-05-21T13:41:18.000 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.022+0000 7f47727e1640 1 -- 172.21.15.22:0/2933458277 >> 172.21.15.22:0/2933458277 conn(0x7f476c072240 msgr2=0x7f476c072620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:41:18.000 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.022+0000 7f47727e1640 1 -- 172.21.15.22:0/2933458277 shutdown_connections 2024-05-21T13:41:18.000 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.022+0000 7f47727e1640 1 -- 172.21.15.22:0/2933458277 wait complete. 2024-05-21T13:41:18.014 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-05-21T13:41:18.126 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.150+0000 7f09619f4640 1 Processor -- start 2024-05-21T13:41:18.126 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.150+0000 7f09619f4640 1 -- start start 2024-05-21T13:41:18.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.150+0000 7f09619f4640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f095c06e590 0x7f095c0c4860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:18.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.150+0000 7f09619f4640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f095c073da0 con 0x7f095c06e1b0 2024-05-21T13:41:18.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.150+0000 7f09619f4640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f095c074080 con 0x7f095c0c4da0 2024-05-21T13:41:18.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.150+0000 7f09619f4640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f095c074360 con 0x7f095c06e590 2024-05-21T13:41:18.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.150+0000 7f095affd640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f095c06e1b0 0x7f095c073080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:58666/0 (socket says 172.21.15.22:58666) 2024-05-21T13:41:18.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.150+0000 7f095affd640 1 -- 172.21.15.22:0/284994021 learned_addr learned my addr 172.21.15.22:0/284994021 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-21T13:41:18.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.150+0000 7f095a7fc640 1 --2- 172.21.15.22:0/284994021 >> v2:172.21.15.22:3300/0 conn(0x7f095c06e590 0x7f095c0c4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:18.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.150+0000 7f095a7fc640 1 -- 172.21.15.22:0/284994021 >> v1:172.21.15.115:6789/0 conn(0x7f095c0c4da0 legacy=0x7f095c158f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:41:18.127 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.150+0000 7f095a7fc640 1 -- 172.21.15.22:0/284994021 >> v1:172.21.15.22:6789/0 conn(0x7f095c06e1b0 legacy=0x7f095c073080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:18.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.150+0000 7f0959ffb640 1 -- 172.21.15.22:0/284994021 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1588188721 0 0) 0x7f095c073da0 con 0x7f095c06e1b0 2024-05-21T13:41:18.128 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.150+0000 7f095a7fc640 1 -- 172.21.15.22:0/284994021 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f095c074640 con 0x7f095c06e590 2024-05-21T13:41:18.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.154+0000 7f095a7fc640 1 --2- 172.21.15.22:0/284994021 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f095c06e590 0x7f095c0c4860 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f09500097c0 tx=0x7f095001c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b5c267dd0565a9c server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:18.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.154+0000 7f0959ffb640 1 -- 172.21.15.22:0/284994021 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09500ab430 con 0x7f095c06e590 2024-05-21T13:41:18.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.154+0000 7f0959ffb640 1 -- 172.21.15.22:0/284994021 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f09500b0070 con 0x7f095c06e590 2024-05-21T13:41:18.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.154+0000 7f0959ffb640 1 -- 172.21.15.22:0/284994021 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09500ab7f0 con 0x7f095c06e590 2024-05-21T13:41:18.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.154+0000 7f09619f4640 1 -- 172.21.15.22:0/284994021 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f095c06e590 msgr2=0x7f095c0c4860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:18.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.154+0000 7f09619f4640 1 --2- 172.21.15.22:0/284994021 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f095c06e590 0x7f095c0c4860 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f09500097c0 tx=0x7f095001c410 comp rx=0 tx=0).stop 2024-05-21T13:41:18.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.154+0000 7f09619f4640 1 -- 172.21.15.22:0/284994021 shutdown_connections 2024-05-21T13:41:18.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.154+0000 7f09619f4640 1 --2- 172.21.15.22:0/284994021 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f095c06e590 0x7f095c0c4860 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:18.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.154+0000 7f09619f4640 1 -- 172.21.15.22:0/284994021 >> 172.21.15.22:0/284994021 conn(0x7f095c06ce70 msgr2=0x7f095c0cd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:41:18.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.154+0000 7f09619f4640 1 -- 172.21.15.22:0/284994021 shutdown_connections 2024-05-21T13:41:18.130 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.154+0000 7f09619f4640 1 -- 172.21.15.22:0/284994021 wait complete. 2024-05-21T13:41:18.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.154+0000 7f09619f4640 1 Processor -- start 2024-05-21T13:41:18.131 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.154+0000 7f09619f4640 1 -- start start 2024-05-21T13:41:18.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.154+0000 7f09619f4640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f095c06e1b0 0x7f095c167500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:18.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.154+0000 7f09619f4640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f095c06e590 0x7f095c1618d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:18.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.154+0000 7f09619f4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f095c0c4da0 0x7f095c161e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:18.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.154+0000 7f09619f4640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f095c1532b0 con 0x7f095c0c4da0 2024-05-21T13:41:18.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.154+0000 7f09619f4640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f095c153130 con 0x7f095c06e590 2024-05-21T13:41:18.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.154+0000 7f09619f4640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f095c06fde0 con 0x7f095c06e1b0 2024-05-21T13:41:18.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.154+0000 7f095b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f095c0c4da0 0x7f095c161e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:18.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.154+0000 7f095b7fe640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f095c0c4da0 0x7f095c161e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33052/0 (socket says 172.21.15.22:33052) 2024-05-21T13:41:18.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.154+0000 7f095b7fe640 1 -- 172.21.15.22:0/3853760563 learned_addr learned my addr 172.21.15.22:0/3853760563 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:41:18.133 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.154+0000 7f095b7fe640 1 -- 172.21.15.22:0/3853760563 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f095c06e1b0 msgr2=0x7f095c167500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:18.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.154+0000 7f095b7fe640 1 --2- 172.21.15.22:0/3853760563 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f095c06e1b0 0x7f095c167500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:18.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.154+0000 7f095b7fe640 1 -- 172.21.15.22:0/3853760563 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f095c06e590 msgr2=0x7f095c1618d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:18.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.154+0000 7f095b7fe640 1 --2- 172.21.15.22:0/3853760563 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f095c06e590 0x7f095c1618d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:18.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.154+0000 7f095b7fe640 1 -- 172.21.15.22:0/3853760563 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f095c163e00 con 0x7f095c0c4da0 2024-05-21T13:41:18.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.158+0000 7f095b7fe640 1 --2- 172.21.15.22:0/3853760563 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f095c0c4da0 0x7f095c161e10 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f095400b9a0 tx=0x7f095400be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:18.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.158+0000 7f0943fff640 1 -- 172.21.15.22:0/3853760563 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0954019070 con 0x7f095c0c4da0 2024-05-21T13:41:18.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.158+0000 7f0943fff640 1 -- 172.21.15.22:0/3853760563 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f095400cba0 con 0x7f095c0c4da0 2024-05-21T13:41:18.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.158+0000 7f0943fff640 1 -- 172.21.15.22:0/3853760563 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0954014440 con 0x7f095c0c4da0 2024-05-21T13:41:18.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.158+0000 7f09619f4640 1 -- 172.21.15.22:0/3853760563 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f095c1669b0 con 0x7f095c0c4da0 2024-05-21T13:41:18.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.158+0000 7f09619f4640 1 -- 172.21.15.22:0/3853760563 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f095c0c7020 con 0x7f095c0c4da0 2024-05-21T13:41:18.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.158+0000 7f09619f4640 1 -- 172.21.15.22:0/3853760563 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f095c1f5370 con 0x7f095c0c4da0 2024-05-21T13:41:18.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.158+0000 7f0943fff640 1 -- 172.21.15.22:0/3853760563 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f095401c070 con 0x7f095c0c4da0 2024-05-21T13:41:18.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.158+0000 7f0943fff640 1 --2- 172.21.15.22:0/3853760563 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f094806f430 0x7f09480718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:18.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.158+0000 7f0943fff640 1 -- 172.21.15.22:0/3853760563 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f095408f180 con 0x7f095c0c4da0 2024-05-21T13:41:18.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.158+0000 7f095affd640 1 --2- 172.21.15.22:0/3853760563 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f094806f430 0x7f09480718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:18.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.158+0000 7f095affd640 1 --2- 172.21.15.22:0/3853760563 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f094806f430 0x7f09480718f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f094c007fd0 tx=0x7f094c0078e0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:18.139 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.162+0000 7f0943fff640 1 -- 172.21.15.22:0/3853760563 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f095405be20 con 0x7f095c0c4da0 2024-05-21T13:41:18.295 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.318+0000 7f09619f4640 1 -- 172.21.15.22:0/3853760563 --> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f095c077bb0 con 0x7f094806f430 2024-05-21T13:41:18.297 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.322+0000 7f0943fff640 1 -- 172.21.15.22:0/3853760563 <== mgr.4103 v2:172.21.15.115:6832/184591771 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f095c077bb0 con 0x7f094806f430 2024-05-21T13:41:18.297 INFO:teuthology.orchestra.run.smithi022.stderr:instructed osd(s) 6 to deep-scrub 2024-05-21T13:41:18.299 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.322+0000 7f09619f4640 1 -- 172.21.15.22:0/3853760563 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f094806f430 msgr2=0x7f09480718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:18.299 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.322+0000 7f09619f4640 1 --2- 172.21.15.22:0/3853760563 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f094806f430 0x7f09480718f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f094c007fd0 tx=0x7f094c0078e0 comp rx=0 tx=0).stop 2024-05-21T13:41:18.299 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.322+0000 7f09619f4640 1 -- 172.21.15.22:0/3853760563 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f095c0c4da0 msgr2=0x7f095c161e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:18.299 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.322+0000 7f09619f4640 1 --2- 172.21.15.22:0/3853760563 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f095c0c4da0 0x7f095c161e10 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f095400b9a0 tx=0x7f095400be60 comp rx=0 tx=0).stop 2024-05-21T13:41:18.299 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.322+0000 7f09619f4640 1 -- 172.21.15.22:0/3853760563 shutdown_connections 2024-05-21T13:41:18.299 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.322+0000 7f09619f4640 1 --2- 172.21.15.22:0/3853760563 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f094806f430 0x7f09480718f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:18.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.322+0000 7f09619f4640 1 --2- 172.21.15.22:0/3853760563 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f095c0c4da0 0x7f095c161e10 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:18.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.322+0000 7f09619f4640 1 --2- 172.21.15.22:0/3853760563 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f095c06e590 0x7f095c1618d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:18.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.322+0000 7f09619f4640 1 --2- 172.21.15.22:0/3853760563 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f095c06e1b0 0x7f095c167500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:18.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.322+0000 7f09619f4640 1 -- 172.21.15.22:0/3853760563 >> 172.21.15.22:0/3853760563 conn(0x7f095c06ce70 msgr2=0x7f095c0cba90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:41:18.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.322+0000 7f09619f4640 1 -- 172.21.15.22:0/3853760563 shutdown_connections 2024-05-21T13:41:18.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.322+0000 7f09619f4640 1 -- 172.21.15.22:0/3853760563 wait complete. 2024-05-21T13:41:18.315 INFO:tasks.ceph:Scrubbing osd.7 2024-05-21T13:41:18.316 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-05-21T13:41:18.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.458+0000 7efc43e9f640 1 Processor -- start 2024-05-21T13:41:18.434 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.458+0000 7efc43e9f640 1 -- start start 2024-05-21T13:41:18.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.458+0000 7efc43e9f640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc3c152bc0 0x7efc3c0c6380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:18.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.458+0000 7efc43e9f640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7efc3c0c91e0 0x7efc3c15c750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:18.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.458+0000 7efc43e9f640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc3c152fa0 con 0x7efc3c1594b0 2024-05-21T13:41:18.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.458+0000 7efc43e9f640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7efc3c0c9c70 con 0x7efc3c0c91e0 2024-05-21T13:41:18.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.458+0000 7efc43e9f640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7efc3c074790 con 0x7efc3c152bc0 2024-05-21T13:41:18.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.458+0000 7efc41c3b640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc3c152bc0 0x7efc3c0c6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:18.435 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.458+0000 7efc4143a640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7efc3c0c91e0 0x7efc3c15c750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:18.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.458+0000 7efc41c3b640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc3c152bc0 0x7efc3c0c6380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.115:3301/0 says I am v2:172.21.15.22:53512/0 (socket says 172.21.15.22:53512) 2024-05-21T13:41:18.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.458+0000 7efc41c3b640 1 -- 172.21.15.22:0/4214687181 learned_addr learned my addr 172.21.15.22:0/4214687181 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:41:18.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.458+0000 7efc41c3b640 1 -- 172.21.15.22:0/4214687181 >> v2:172.21.15.115:3300/0 conn(0x7efc3c0c91e0 msgr2=0x7efc3c15c750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:41:18.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.458+0000 7efc41c3b640 1 --2- 172.21.15.22:0/4214687181 >> v2:172.21.15.115:3300/0 conn(0x7efc3c0c91e0 0x7efc3c15c750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:18.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.458+0000 7efc41c3b640 1 -- 172.21.15.22:0/4214687181 >> v1:172.21.15.115:6789/0 conn(0x7efc3c1594b0 legacy=0x7efc3c06fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:18.436 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.458+0000 7efc41c3b640 1 -- 172.21.15.22:0/4214687181 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc3c15cc90 con 0x7efc3c152bc0 2024-05-21T13:41:18.437 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.458+0000 7efc4143a640 1 --2- 172.21.15.22:0/4214687181 >> v2:172.21.15.115:3300/0 conn(0x7efc3c0c91e0 0x7efc3c15c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-05-21T13:41:18.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.462+0000 7efc41c3b640 1 --2- 172.21.15.22:0/4214687181 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc3c152bc0 0x7efc3c0c6380 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7efc3800bb10 tx=0x7efc38021420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e239a710e532a4a server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:18.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.462+0000 7efc40c39640 1 -- 172.21.15.22:0/4214687181 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc380b6070 con 0x7efc3c152bc0 2024-05-21T13:41:18.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.462+0000 7efc40c39640 1 -- 172.21.15.22:0/4214687181 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc380b1600 con 0x7efc3c152bc0 2024-05-21T13:41:18.438 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.462+0000 7efc40c39640 1 -- 172.21.15.22:0/4214687181 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc380b19d0 con 0x7efc3c152bc0 2024-05-21T13:41:18.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.462+0000 7efc43e9f640 1 -- 172.21.15.22:0/4214687181 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc3c152bc0 msgr2=0x7efc3c0c6380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:18.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.462+0000 7efc43e9f640 1 --2- 172.21.15.22:0/4214687181 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc3c152bc0 0x7efc3c0c6380 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7efc3800bb10 tx=0x7efc38021420 comp rx=0 tx=0).stop 2024-05-21T13:41:18.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.462+0000 7efc43e9f640 1 -- 172.21.15.22:0/4214687181 shutdown_connections 2024-05-21T13:41:18.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.462+0000 7efc43e9f640 1 --2- 172.21.15.22:0/4214687181 >> v2:172.21.15.115:3300/0 conn(0x7efc3c0c91e0 0x7efc3c15c750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:18.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.462+0000 7efc43e9f640 1 --2- 172.21.15.22:0/4214687181 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc3c152bc0 0x7efc3c0c6380 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:18.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.462+0000 7efc43e9f640 1 -- 172.21.15.22:0/4214687181 >> 172.21.15.22:0/4214687181 conn(0x7efc3c06cc50 msgr2=0x7efc3c0cd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:41:18.439 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.462+0000 7efc43e9f640 1 -- 172.21.15.22:0/4214687181 shutdown_connections 2024-05-21T13:41:18.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.462+0000 7efc43e9f640 1 -- 172.21.15.22:0/4214687181 wait complete. 2024-05-21T13:41:18.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.462+0000 7efc43e9f640 1 Processor -- start 2024-05-21T13:41:18.440 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.462+0000 7efc43e9f640 1 -- start start 2024-05-21T13:41:18.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.466+0000 7efc43e9f640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc3c0c91e0 0x7efc3c06e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:18.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.466+0000 7efc43e9f640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc3c152bc0 0x7efc3c14ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:18.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.466+0000 7efc43e9f640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc3c1594b0 0x7efc3c14f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:18.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.466+0000 7efc43e9f640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7efc3c158a10 con 0x7efc3c1594b0 2024-05-21T13:41:18.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.466+0000 7efc43e9f640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7efc3c159020 con 0x7efc3c152bc0 2024-05-21T13:41:18.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.466+0000 7efc43e9f640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7efc3c0c9990 con 0x7efc3c0c91e0 2024-05-21T13:41:18.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.466+0000 7efc4243c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc3c1594b0 0x7efc3c14f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:18.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.466+0000 7efc4243c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc3c1594b0 0x7efc3c14f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33064/0 (socket says 172.21.15.22:33064) 2024-05-21T13:41:18.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.466+0000 7efc4243c640 1 -- 172.21.15.22:0/2852631469 learned_addr learned my addr 172.21.15.22:0/2852631469 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:41:18.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.466+0000 7efc41c3b640 1 --2- 172.21.15.22:0/2852631469 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc3c0c91e0 0x7efc3c06e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:18.442 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.466+0000 7efc4143a640 1 --2- 172.21.15.22:0/2852631469 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc3c152bc0 0x7efc3c14ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:18.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.466+0000 7efc4243c640 1 -- 172.21.15.22:0/2852631469 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc3c0c91e0 msgr2=0x7efc3c06e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:18.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.466+0000 7efc4243c640 1 --2- 172.21.15.22:0/2852631469 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7efc3c0c91e0 0x7efc3c06e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:18.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.466+0000 7efc4243c640 1 -- 172.21.15.22:0/2852631469 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc3c152bc0 msgr2=0x7efc3c14ee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:18.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.466+0000 7efc4243c640 1 --2- 172.21.15.22:0/2852631469 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7efc3c152bc0 0x7efc3c14ee40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:18.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.466+0000 7efc4243c640 1 -- 172.21.15.22:0/2852631469 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc3c0c68c0 con 0x7efc3c1594b0 2024-05-21T13:41:18.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.466+0000 7efc4243c640 1 --2- 172.21.15.22:0/2852631469 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc3c1594b0 0x7efc3c14f380 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7efc3400c6b0 tx=0x7efc3400cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:18.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.466+0000 7efc327fc640 1 -- 172.21.15.22:0/2852631469 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc34003b80 con 0x7efc3c1594b0 2024-05-21T13:41:18.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.466+0000 7efc327fc640 1 -- 172.21.15.22:0/2852631469 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc34003d40 con 0x7efc3c1594b0 2024-05-21T13:41:18.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.466+0000 7efc43e9f640 1 -- 172.21.15.22:0/2852631469 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc3c14fa80 con 0x7efc3c1594b0 2024-05-21T13:41:18.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.466+0000 7efc327fc640 1 -- 172.21.15.22:0/2852631469 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc34005310 con 0x7efc3c1594b0 2024-05-21T13:41:18.443 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.466+0000 7efc43e9f640 1 -- 172.21.15.22:0/2852631469 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc3c1edd20 con 0x7efc3c1594b0 2024-05-21T13:41:18.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.466+0000 7efc43e9f640 1 -- 172.21.15.22:0/2852631469 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7efc3c077bb0 con 0x7efc3c1594b0 2024-05-21T13:41:18.444 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.466+0000 7efc327fc640 1 -- 172.21.15.22:0/2852631469 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7efc340054b0 con 0x7efc3c1594b0 2024-05-21T13:41:18.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.466+0000 7efc327fc640 1 --2- 172.21.15.22:0/2852631469 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7efc2006f400 0x7efc200718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:18.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.466+0000 7efc327fc640 1 -- 172.21.15.22:0/2852631469 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7efc3408f320 con 0x7efc3c1594b0 2024-05-21T13:41:18.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.466+0000 7efc327fc640 1 --2- 172.21.15.22:0/2852631469 >> [v2:172.21.15.115:6811/20268513,v1:172.21.15.115:6814/20268513] conn(0x7efc20078b40 0x7efc2007afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:18.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.466+0000 7efc327fc640 1 -- 172.21.15.22:0/2852631469 --> [v2:172.21.15.115:6811/20268513,v1:172.21.15.115:6814/20268513] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efc34009eb0 con 0x7efc20078b40 2024-05-21T13:41:18.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.466+0000 7efc327fc640 1 -- 172.21.15.22:0/2852631469 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7efc34096050 con 0x7efc3c1594b0 2024-05-21T13:41:18.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.470+0000 7efc41c3b640 1 --2- 172.21.15.22:0/2852631469 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7efc2006f400 0x7efc200718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:18.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.470+0000 7efc4143a640 1 --2- 172.21.15.22:0/2852631469 >> [v2:172.21.15.115:6811/20268513,v1:172.21.15.115:6814/20268513] conn(0x7efc20078b40 0x7efc2007afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:18.445 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.470+0000 7efc41c3b640 1 --2- 172.21.15.22:0/2852631469 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7efc2006f400 0x7efc200718c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7efc380b3000 tx=0x7efc380ac000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:18.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.470+0000 7efc4143a640 1 --2- 172.21.15.22:0/2852631469 >> [v2:172.21.15.115:6811/20268513,v1:172.21.15.115:6814/20268513] conn(0x7efc20078b40 0x7efc2007afc0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:18.446 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.470+0000 7efc327fc640 1 -- 172.21.15.22:0/2852631469 <== osd.7 v2:172.21.15.115:6811/20268513 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7efc34009eb0 con 0x7efc20078b40 2024-05-21T13:41:18.459 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.482+0000 7efc43e9f640 1 -- 172.21.15.22:0/2852631469 --> [v2:172.21.15.115:6811/20268513,v1:172.21.15.115:6814/20268513] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7efc3c0c8020 con 0x7efc20078b40 2024-05-21T13:41:18.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.486+0000 7efc327fc640 1 -- 172.21.15.22:0/2852631469 <== osd.7 v2:172.21.15.115:6811/20268513 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7efc3c0c8020 con 0x7efc20078b40 2024-05-21T13:41:18.460 INFO:teuthology.orchestra.run.smithi022.stdout:{ 2024-05-21T13:41:18.460 INFO:teuthology.orchestra.run.smithi022.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-05-21T13:41:18.460 INFO:teuthology.orchestra.run.smithi022.stdout:} 2024-05-21T13:41:18.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.486+0000 7efc43e9f640 1 -- 172.21.15.22:0/2852631469 >> [v2:172.21.15.115:6811/20268513,v1:172.21.15.115:6814/20268513] conn(0x7efc20078b40 msgr2=0x7efc2007afc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:18.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.486+0000 7efc43e9f640 1 --2- 172.21.15.22:0/2852631469 >> [v2:172.21.15.115:6811/20268513,v1:172.21.15.115:6814/20268513] conn(0x7efc20078b40 0x7efc2007afc0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:18.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.486+0000 7efc43e9f640 1 -- 172.21.15.22:0/2852631469 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7efc2006f400 msgr2=0x7efc200718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:18.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.486+0000 7efc43e9f640 1 --2- 172.21.15.22:0/2852631469 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7efc2006f400 0x7efc200718c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7efc380b3000 tx=0x7efc380ac000 comp rx=0 tx=0).stop 2024-05-21T13:41:18.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.486+0000 7efc43e9f640 1 -- 172.21.15.22:0/2852631469 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc3c1594b0 msgr2=0x7efc3c14f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:18.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.486+0000 7efc43e9f640 1 --2- 172.21.15.22:0/2852631469 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7efc3c1594b0 0x7efc3c14f380 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7efc3400c6b0 tx=0x7efc3400cb70 comp rx=0 tx=0).stop 2024-05-21T13:41:18.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.486+0000 7efc4243c640 1 -- 172.21.15.22:0/2852631469 reap_dead start 2024-05-21T13:41:18.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.486+0000 7efc43e9f640 1 -- 172.21.15.22:0/2852631469 shutdown_connections 2024-05-21T13:41:18.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.486+0000 7efc43e9f640 1 -- 172.21.15.22:0/2852631469 >> 172.21.15.22:0/2852631469 conn(0x7efc3c06cc50 msgr2=0x7efc3c0cbf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:41:18.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.486+0000 7efc43e9f640 1 -- 172.21.15.22:0/2852631469 shutdown_connections 2024-05-21T13:41:18.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.486+0000 7efc43e9f640 1 -- 172.21.15.22:0/2852631469 wait complete. 2024-05-21T13:41:18.476 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-05-21T13:41:18.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.622+0000 7f264a7a9640 1 Processor -- start 2024-05-21T13:41:18.597 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.622+0000 7f264a7a9640 1 -- start start 2024-05-21T13:41:18.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.622+0000 7f264a7a9640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f264415fd40 0x7f26440c9f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:18.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.622+0000 7f264a7a9640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f26440702c0 0x7f2644070710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:18.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.622+0000 7f264a7a9640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26440cf440 con 0x7f26440cb590 2024-05-21T13:41:18.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.622+0000 7f264a7a9640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f26440ca680 con 0x7f26440702c0 2024-05-21T13:41:18.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.622+0000 7f264a7a9640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f26440ca960 con 0x7f264415fd40 2024-05-21T13:41:18.598 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.622+0000 7f2648d46640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f26440702c0 0x7f2644070710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:18.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.622+0000 7f2648d46640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f26440702c0 0x7f2644070710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33068/0 (socket says 172.21.15.22:33068) 2024-05-21T13:41:18.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.622+0000 7f2648d46640 1 -- 172.21.15.22:0/3632958682 learned_addr learned my addr 172.21.15.22:0/3632958682 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:41:18.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.622+0000 7f2643fff640 1 --2- 172.21.15.22:0/3632958682 >> v2:172.21.15.115:3300/0 conn(0x7f264415fd40 0x7f26440c9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:18.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.622+0000 7f2648d46640 1 -- 172.21.15.22:0/3632958682 >> v2:172.21.15.115:3300/0 conn(0x7f264415fd40 msgr2=0x7f26440c9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:41:18.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.622+0000 7f2648d46640 1 --2- 172.21.15.22:0/3632958682 >> v2:172.21.15.115:3300/0 conn(0x7f264415fd40 0x7f26440c9f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:18.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.622+0000 7f2648d46640 1 -- 172.21.15.22:0/3632958682 >> v1:172.21.15.115:6789/0 conn(0x7f26440cb590 legacy=0x7f26440cf920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:41:18.599 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.622+0000 7f2648d46640 1 -- 172.21.15.22:0/3632958682 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26440cac40 con 0x7f26440702c0 2024-05-21T13:41:18.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.622+0000 7f2648d46640 1 --2- 172.21.15.22:0/3632958682 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26440702c0 0x7f2644070710 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f263c009e50 tx=0x7f263c01f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b38d3a5f2bb441d3 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:18.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.626+0000 7f2642ffd640 1 -- 172.21.15.22:0/3632958682 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f263c0b4070 con 0x7f26440702c0 2024-05-21T13:41:18.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.626+0000 7f2642ffd640 1 -- 172.21.15.22:0/3632958682 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f263c0af400 con 0x7f26440702c0 2024-05-21T13:41:18.600 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.626+0000 7f2642ffd640 1 -- 172.21.15.22:0/3632958682 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f263c0af7d0 con 0x7f26440702c0 2024-05-21T13:41:18.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.626+0000 7f264a7a9640 1 -- 172.21.15.22:0/3632958682 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26440702c0 msgr2=0x7f2644070710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:18.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.626+0000 7f264a7a9640 1 --2- 172.21.15.22:0/3632958682 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26440702c0 0x7f2644070710 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f263c009e50 tx=0x7f263c01f1e0 comp rx=0 tx=0).stop 2024-05-21T13:41:18.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.626+0000 7f264a7a9640 1 -- 172.21.15.22:0/3632958682 shutdown_connections 2024-05-21T13:41:18.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.626+0000 7f264a7a9640 1 --2- 172.21.15.22:0/3632958682 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f26440702c0 0x7f2644070710 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:18.601 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.626+0000 7f264a7a9640 1 --2- 172.21.15.22:0/3632958682 >> v2:172.21.15.115:3300/0 conn(0x7f264415fd40 0x7f26440c9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:18.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.626+0000 7f264a7a9640 1 -- 172.21.15.22:0/3632958682 >> 172.21.15.22:0/3632958682 conn(0x7f264406caf0 msgr2=0x7f2644068260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:41:18.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.626+0000 7f264a7a9640 1 -- 172.21.15.22:0/3632958682 shutdown_connections 2024-05-21T13:41:18.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.626+0000 7f264a7a9640 1 -- 172.21.15.22:0/3632958682 wait complete. 2024-05-21T13:41:18.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.626+0000 7f264a7a9640 1 Processor -- start 2024-05-21T13:41:18.602 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.626+0000 7f264a7a9640 1 -- start start 2024-05-21T13:41:18.604 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.626+0000 7f264a7a9640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f26440702c0 0x7f26441f5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:18.604 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.626+0000 7f264a7a9640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26440cb590 0x7f26441f2140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:18.604 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.626+0000 7f264a7a9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f264415fd40 0x7f26440721e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:18.604 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.626+0000 7f264a7a9640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f26440cb9e0 con 0x7f264415fd40 2024-05-21T13:41:18.604 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.626+0000 7f264a7a9640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f26440ccd50 con 0x7f26440cb590 2024-05-21T13:41:18.604 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.626+0000 7f264a7a9640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f2644160120 con 0x7f26440702c0 2024-05-21T13:41:18.604 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.626+0000 7f2648d46640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f264415fd40 0x7f26440721e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:18.604 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.626+0000 7f2648d46640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f264415fd40 0x7f26440721e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33080/0 (socket says 172.21.15.22:33080) 2024-05-21T13:41:18.604 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.626+0000 7f2648d46640 1 -- 172.21.15.22:0/2409894815 learned_addr learned my addr 172.21.15.22:0/2409894815 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:41:18.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.626+0000 7f2643fff640 1 --2- 172.21.15.22:0/2409894815 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f26440702c0 0x7f26441f5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:18.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.626+0000 7f26437fe640 1 --2- 172.21.15.22:0/2409894815 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26440cb590 0x7f26441f2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:18.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.626+0000 7f2648d46640 1 -- 172.21.15.22:0/2409894815 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f26440702c0 msgr2=0x7f26441f5740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:18.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.626+0000 7f2648d46640 1 --2- 172.21.15.22:0/2409894815 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f26440702c0 0x7f26441f5740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:18.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.626+0000 7f2648d46640 1 -- 172.21.15.22:0/2409894815 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26440cb590 msgr2=0x7f26441f2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:18.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.626+0000 7f2648d46640 1 --2- 172.21.15.22:0/2409894815 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26440cb590 0x7f26441f2140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:18.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.626+0000 7f2648d46640 1 -- 172.21.15.22:0/2409894815 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f264415eba0 con 0x7f264415fd40 2024-05-21T13:41:18.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.626+0000 7f26437fe640 1 --2- 172.21.15.22:0/2409894815 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26440cb590 0x7f26441f2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:41:18.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.626+0000 7f2648d46640 1 --2- 172.21.15.22:0/2409894815 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f264415fd40 0x7f26440721e0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f263c009e50 tx=0x7f263c01bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:18.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.626+0000 7f2640ff9640 1 -- 172.21.15.22:0/2409894815 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f263c0b4040 con 0x7f264415fd40 2024-05-21T13:41:18.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.626+0000 7f2640ff9640 1 -- 172.21.15.22:0/2409894815 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f263c0c0070 con 0x7f264415fd40 2024-05-21T13:41:18.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.626+0000 7f264a7a9640 1 -- 172.21.15.22:0/2409894815 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f264415e300 con 0x7f264415fd40 2024-05-21T13:41:18.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.626+0000 7f2640ff9640 1 -- 172.21.15.22:0/2409894815 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f263c009510 con 0x7f264415fd40 2024-05-21T13:41:18.605 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.626+0000 7f264a7a9640 1 -- 172.21.15.22:0/2409894815 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f264415e8c0 con 0x7f264415fd40 2024-05-21T13:41:18.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.630+0000 7f264a7a9640 1 -- 172.21.15.22:0/2409894815 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26441f1c70 con 0x7f264415fd40 2024-05-21T13:41:18.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.630+0000 7f2640ff9640 1 -- 172.21.15.22:0/2409894815 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f263c0c5460 con 0x7f264415fd40 2024-05-21T13:41:18.606 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.630+0000 7f2640ff9640 1 --2- 172.21.15.22:0/2409894815 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f263006f430 0x7f26300718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:18.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.630+0000 7f2640ff9640 1 -- 172.21.15.22:0/2409894815 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f263c12d940 con 0x7f264415fd40 2024-05-21T13:41:18.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.630+0000 7f2643fff640 1 --2- 172.21.15.22:0/2409894815 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f263006f430 0x7f26300718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:18.607 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.630+0000 7f2643fff640 1 --2- 172.21.15.22:0/2409894815 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f263006f430 0x7f26300718f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2634009790 tx=0x7f2634008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:18.610 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.634+0000 7f2640ff9640 1 -- 172.21.15.22:0/2409894815 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f263c018d40 con 0x7f264415fd40 2024-05-21T13:41:18.776 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.798+0000 7f264a7a9640 1 -- 172.21.15.22:0/2409894815 --> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f2644070d80 con 0x7f263006f430 2024-05-21T13:41:18.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.802+0000 7f2640ff9640 1 -- 172.21.15.22:0/2409894815 <== mgr.4103 v2:172.21.15.115:6832/184591771 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f2644070d80 con 0x7f263006f430 2024-05-21T13:41:18.777 INFO:teuthology.orchestra.run.smithi022.stderr:instructed osd(s) 7 to deep-scrub 2024-05-21T13:41:18.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.802+0000 7f264a7a9640 1 -- 172.21.15.22:0/2409894815 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f263006f430 msgr2=0x7f26300718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:18.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.802+0000 7f264a7a9640 1 --2- 172.21.15.22:0/2409894815 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f263006f430 0x7f26300718f0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f2634009790 tx=0x7f2634008040 comp rx=0 tx=0).stop 2024-05-21T13:41:18.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.802+0000 7f264a7a9640 1 -- 172.21.15.22:0/2409894815 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f264415fd40 msgr2=0x7f26440721e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:18.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.802+0000 7f264a7a9640 1 --2- 172.21.15.22:0/2409894815 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f264415fd40 0x7f26440721e0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f263c009e50 tx=0x7f263c01bf80 comp rx=0 tx=0).stop 2024-05-21T13:41:18.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.802+0000 7f264a7a9640 1 -- 172.21.15.22:0/2409894815 shutdown_connections 2024-05-21T13:41:18.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.802+0000 7f264a7a9640 1 --2- 172.21.15.22:0/2409894815 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f263006f430 0x7f26300718f0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:18.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.802+0000 7f264a7a9640 1 --2- 172.21.15.22:0/2409894815 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f264415fd40 0x7f26440721e0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:18.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.802+0000 7f264a7a9640 1 --2- 172.21.15.22:0/2409894815 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f26440cb590 0x7f26441f2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:18.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.802+0000 7f264a7a9640 1 --2- 172.21.15.22:0/2409894815 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f26440702c0 0x7f26441f5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:18.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.802+0000 7f264a7a9640 1 -- 172.21.15.22:0/2409894815 >> 172.21.15.22:0/2409894815 conn(0x7f264406caf0 msgr2=0x7f26440ceb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:41:18.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.802+0000 7f264a7a9640 1 -- 172.21.15.22:0/2409894815 shutdown_connections 2024-05-21T13:41:18.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.802+0000 7f264a7a9640 1 -- 172.21.15.22:0/2409894815 wait complete. 2024-05-21T13:41:18.797 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-21T13:41:18.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.950+0000 7fe6afeb9640 1 Processor -- start 2024-05-21T13:41:18.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.950+0000 7fe6afeb9640 1 -- start start 2024-05-21T13:41:18.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.950+0000 7fe6afeb9640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe6a8155d80 0x7fe6a815b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:18.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.950+0000 7fe6afeb9640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fe6a80cd1c0 0x7fe6a80d1420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:18.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.950+0000 7fe6afeb9640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6a8156160 con 0x7fe6a815bf30 2024-05-21T13:41:18.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.950+0000 7fe6afeb9640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fe6a80ccfc0 con 0x7fe6a8155d80 2024-05-21T13:41:18.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.950+0000 7fe6afeb9640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7fe6a80c6560 con 0x7fe6a80cd1c0 2024-05-21T13:41:18.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.950+0000 7fe6adc55640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe6a8155d80 0x7fe6a815b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:18.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.950+0000 7fe6adc55640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fe6a8155d80 0x7fe6a815b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33084/0 (socket says 172.21.15.22:33084) 2024-05-21T13:41:18.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.950+0000 7fe6adc55640 1 -- 172.21.15.22:0/3700186635 learned_addr learned my addr 172.21.15.22:0/3700186635 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:41:18.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.950+0000 7fe6ad454640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fe6a815bf30 0x7fe6a80ce510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:58678/0 (socket says 172.21.15.22:58678) 2024-05-21T13:41:18.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.950+0000 7fe6ae456640 1 --2- 172.21.15.22:0/3700186635 >> v2:172.21.15.115:3300/0 conn(0x7fe6a80cd1c0 0x7fe6a80d1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:18.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.950+0000 7fe6adc55640 1 -- 172.21.15.22:0/3700186635 >> v2:172.21.15.115:3300/0 conn(0x7fe6a80cd1c0 msgr2=0x7fe6a80d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:41:18.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.950+0000 7fe6adc55640 1 --2- 172.21.15.22:0/3700186635 >> v2:172.21.15.115:3300/0 conn(0x7fe6a80cd1c0 0x7fe6a80d1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:18.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.950+0000 7fe6adc55640 1 -- 172.21.15.22:0/3700186635 >> v1:172.21.15.22:6789/0 conn(0x7fe6a815bf30 legacy=0x7fe6a80ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:18.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.950+0000 7fe6acc53640 1 -- 172.21.15.22:0/3700186635 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 254930062 0 0) 0x7fe6a8156160 con 0x7fe6a815bf30 2024-05-21T13:41:18.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.950+0000 7fe6adc55640 1 -- 172.21.15.22:0/3700186635 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6a815c4a0 con 0x7fe6a8155d80 2024-05-21T13:41:18.928 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.954+0000 7fe6adc55640 1 --2- 172.21.15.22:0/3700186635 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe6a8155d80 0x7fe6a815b9f0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fe6a815c380 tx=0x7fe6a401c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=562e3cdf9285561a server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:18.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.954+0000 7fe6acc53640 1 -- 172.21.15.22:0/3700186635 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a40b0070 con 0x7fe6a8155d80 2024-05-21T13:41:18.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.954+0000 7fe6acc53640 1 -- 172.21.15.22:0/3700186635 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6a40ab600 con 0x7fe6a8155d80 2024-05-21T13:41:18.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.954+0000 7fe6acc53640 1 -- 172.21.15.22:0/3700186635 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a40ab9d0 con 0x7fe6a8155d80 2024-05-21T13:41:18.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.954+0000 7fe6afeb9640 1 -- 172.21.15.22:0/3700186635 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe6a8155d80 msgr2=0x7fe6a815b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:18.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.954+0000 7fe6afeb9640 1 --2- 172.21.15.22:0/3700186635 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe6a8155d80 0x7fe6a815b9f0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fe6a815c380 tx=0x7fe6a401c460 comp rx=0 tx=0).stop 2024-05-21T13:41:18.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.954+0000 7fe6afeb9640 1 -- 172.21.15.22:0/3700186635 shutdown_connections 2024-05-21T13:41:18.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.954+0000 7fe6afeb9640 1 --2- 172.21.15.22:0/3700186635 >> v2:172.21.15.115:3300/0 conn(0x7fe6a80cd1c0 0x7fe6a80d1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:18.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.954+0000 7fe6afeb9640 1 --2- 172.21.15.22:0/3700186635 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe6a8155d80 0x7fe6a815b9f0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:18.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.954+0000 7fe6afeb9640 1 -- 172.21.15.22:0/3700186635 >> 172.21.15.22:0/3700186635 conn(0x7fe6a806f3b0 msgr2=0x7fe6a806d430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:41:18.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.954+0000 7fe6afeb9640 1 -- 172.21.15.22:0/3700186635 shutdown_connections 2024-05-21T13:41:18.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.954+0000 7fe6afeb9640 1 -- 172.21.15.22:0/3700186635 wait complete. 2024-05-21T13:41:18.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.954+0000 7fe6afeb9640 1 Processor -- start 2024-05-21T13:41:18.931 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.954+0000 7fe6afeb9640 1 -- start start 2024-05-21T13:41:18.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.954+0000 7fe6afeb9640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6a80cd1c0 0x7fe6a814b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:18.932 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.954+0000 7fe6afeb9640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe6a815bf30 0x7fe6a813be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:18.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.954+0000 7fe6afeb9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe6a81450c0 0x7fe6a813c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:18.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.954+0000 7fe6afeb9640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a80cec20 con 0x7fe6a81450c0 2024-05-21T13:41:18.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.954+0000 7fe6afeb9640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fe6a80cdff0 con 0x7fe6a80cd1c0 2024-05-21T13:41:18.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.954+0000 7fe6afeb9640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7fe6a80ceda0 con 0x7fe6a815bf30 2024-05-21T13:41:18.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.954+0000 7fe6ae456640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe6a81450c0 0x7fe6a813c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:18.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.954+0000 7fe6ae456640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe6a81450c0 0x7fe6a813c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:33098/0 (socket says 172.21.15.22:33098) 2024-05-21T13:41:18.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.954+0000 7fe6ae456640 1 -- 172.21.15.22:0/497558126 learned_addr learned my addr 172.21.15.22:0/497558126 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:41:18.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.954+0000 7fe6ad454640 1 --2- 172.21.15.22:0/497558126 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe6a815bf30 0x7fe6a813be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:18.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.954+0000 7fe6adc55640 1 --2- 172.21.15.22:0/497558126 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6a80cd1c0 0x7fe6a814b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:18.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.954+0000 7fe6ae456640 1 -- 172.21.15.22:0/497558126 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe6a815bf30 msgr2=0x7fe6a813be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:18.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.954+0000 7fe6ae456640 1 --2- 172.21.15.22:0/497558126 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe6a815bf30 0x7fe6a813be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:18.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.954+0000 7fe6ae456640 1 -- 172.21.15.22:0/497558126 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6a80cd1c0 msgr2=0x7fe6a814b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:18.933 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.954+0000 7fe6ae456640 1 --2- 172.21.15.22:0/497558126 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6a80cd1c0 0x7fe6a814b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:18.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.954+0000 7fe6ae456640 1 -- 172.21.15.22:0/497558126 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6a81f8fe0 con 0x7fe6a81450c0 2024-05-21T13:41:18.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.954+0000 7fe6ad454640 1 --2- 172.21.15.22:0/497558126 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe6a815bf30 0x7fe6a813be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T13:41:18.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.958+0000 7fe6ae456640 1 --2- 172.21.15.22:0/497558126 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe6a81450c0 0x7fe6a813c340 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fe6a0007e70 tx=0x7fe6a000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:18.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.958+0000 7fe69e7fc640 1 -- 172.21.15.22:0/497558126 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a0014620 con 0x7fe6a81450c0 2024-05-21T13:41:18.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.958+0000 7fe69e7fc640 1 -- 172.21.15.22:0/497558126 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6a0019070 con 0x7fe6a81450c0 2024-05-21T13:41:18.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.958+0000 7fe6afeb9640 1 -- 172.21.15.22:0/497558126 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6a81f8180 con 0x7fe6a81450c0 2024-05-21T13:41:18.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.958+0000 7fe69e7fc640 1 -- 172.21.15.22:0/497558126 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6a0014a20 con 0x7fe6a81450c0 2024-05-21T13:41:18.934 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.958+0000 7fe6afeb9640 1 -- 172.21.15.22:0/497558126 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6a81f8740 con 0x7fe6a81450c0 2024-05-21T13:41:18.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.958+0000 7fe6afeb9640 1 -- 172.21.15.22:0/497558126 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6a8077bb0 con 0x7fe6a81450c0 2024-05-21T13:41:18.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.958+0000 7fe69e7fc640 1 -- 172.21.15.22:0/497558126 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fe6a0014bc0 con 0x7fe6a81450c0 2024-05-21T13:41:18.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.958+0000 7fe69e7fc640 1 --2- 172.21.15.22:0/497558126 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fe68c06f400 0x7fe68c0718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:18.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.958+0000 7fe69e7fc640 1 -- 172.21.15.22:0/497558126 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7fe6a008ffc0 con 0x7fe6a81450c0 2024-05-21T13:41:18.935 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.958+0000 7fe6adc55640 1 --2- 172.21.15.22:0/497558126 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fe68c06f400 0x7fe68c0718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:18.936 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.958+0000 7fe6adc55640 1 --2- 172.21.15.22:0/497558126 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fe68c06f400 0x7fe68c0718c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe6a40ad000 tx=0x7fe6a4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:18.938 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:18.962+0000 7fe69e7fc640 1 -- 172.21.15.22:0/497558126 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fe6a005cb40 con 0x7fe6a81450c0 2024-05-21T13:41:19.092 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:19.114+0000 7fe6afeb9640 1 -- 172.21.15.22:0/497558126 --> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe6a8166130 con 0x7fe68c06f400 2024-05-21T13:41:19.115 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:19.138+0000 7fe69e7fc640 1 -- 172.21.15.22:0/497558126 <== mgr.4103 v2:172.21.15.115:6832/184591771 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332100 (secure 0 0 0) 0x7fe6a8166130 con 0x7fe68c06f400 2024-05-21T13:41:19.118 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-21T13:41:19.120 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-05-21T13:41:19.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:19.142+0000 7fe6afeb9640 1 -- 172.21.15.22:0/497558126 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fe68c06f400 msgr2=0x7fe68c0718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:19.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:19.142+0000 7fe6afeb9640 1 --2- 172.21.15.22:0/497558126 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fe68c06f400 0x7fe68c0718c0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe6a40ad000 tx=0x7fe6a4008040 comp rx=0 tx=0).stop 2024-05-21T13:41:19.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:19.142+0000 7fe6afeb9640 1 -- 172.21.15.22:0/497558126 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe6a81450c0 msgr2=0x7fe6a813c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:19.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:19.142+0000 7fe6afeb9640 1 --2- 172.21.15.22:0/497558126 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe6a81450c0 0x7fe6a813c340 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fe6a0007e70 tx=0x7fe6a000e4b0 comp rx=0 tx=0).stop 2024-05-21T13:41:19.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:19.142+0000 7fe6afeb9640 1 -- 172.21.15.22:0/497558126 shutdown_connections 2024-05-21T13:41:19.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:19.142+0000 7fe6afeb9640 1 --2- 172.21.15.22:0/497558126 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fe68c06f400 0x7fe68c0718c0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:19.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:19.142+0000 7fe6afeb9640 1 --2- 172.21.15.22:0/497558126 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fe6a81450c0 0x7fe6a813c340 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:19.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:19.142+0000 7fe6afeb9640 1 --2- 172.21.15.22:0/497558126 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fe6a815bf30 0x7fe6a813be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:19.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:19.142+0000 7fe6afeb9640 1 --2- 172.21.15.22:0/497558126 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fe6a80cd1c0 0x7fe6a814b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:19.122 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:19.142+0000 7fe6afeb9640 1 -- 172.21.15.22:0/497558126 >> 172.21.15.22:0/497558126 conn(0x7fe6a806f3b0 msgr2=0x7fe6a80d0460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:41:19.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:19.142+0000 7fe6afeb9640 1 -- 172.21.15.22:0/497558126 shutdown_connections 2024-05-21T13:41:19.123 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:19.142+0000 7fe6afeb9640 1 -- 172.21.15.22:0/497558126 wait complete. 2024-05-21T13:41:19.136 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":188,"stamp":"2024-05-21T13:41:18.627918+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":804964,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":70,"num_read_kb":59,"num_write":9589,"num_write_kb":25167758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10034,"ondisk_log_size":10034,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":364768,"kb_used_data":2912,"kb_used_omap":12,"kb_used_meta":361779,"kb_avail":754609952,"statfs":{"total":773094113280,"available":772720590848,"internally_reserved":0,"allocated":2981888,"data_stored":2531184,"data_compressed":66916,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":370462256},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-8501847322,"num_objects":-2027,"num_object_clones":0,"num_object_copies":-8108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2027,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2048,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004606"},"pg_stats":[{"pgid":"2.1f","version":"25'9","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:40:08.554048+0000","last_change":"2024-05-21T13:35:56.739488+0000","last_active":"2024-05-21T13:40:08.554048+0000","last_peered":"2024-05-21T13:40:08.554048+0000","last_clean":"2024-05-21T13:40:08.554048+0000","last_became_active":"2024-05-21T13:35:56.738481+0000","last_became_peered":"2024-05-21T13:35:56.738481+0000","last_unstale":"2024-05-21T13:40:08.554048+0000","last_undegraded":"2024-05-21T13:40:08.554048+0000","last_fullsized":"2024-05-21T13:40:08.554048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"27'5","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.810535+0000","last_change":"2024-05-21T13:35:57.779462+0000","last_active":"2024-05-21T13:41:05.810535+0000","last_peered":"2024-05-21T13:41:05.810535+0000","last_clean":"2024-05-21T13:41:05.810535+0000","last_became_active":"2024-05-21T13:35:57.778721+0000","last_became_peered":"2024-05-21T13:35:57.778721+0000","last_unstale":"2024-05-21T13:41:05.810535+0000","last_undegraded":"2024-05-21T13:41:05.810535+0000","last_fullsized":"2024-05-21T13:41:05.810535+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:13:05.005747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"27'306","reported_seq":320,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.347124+0000","last_change":"2024-05-21T13:36:39.721406+0000","last_active":"2024-05-21T13:41:07.347124+0000","last_peered":"2024-05-21T13:41:07.347124+0000","last_clean":"2024-05-21T13:41:07.347124+0000","last_became_active":"2024-05-21T13:36:39.720879+0000","last_became_peered":"2024-05-21T13:36:39.720879+0000","last_unstale":"2024-05-21T13:41:07.347124+0000","last_undegraded":"2024-05-21T13:41:07.347124+0000","last_fullsized":"2024-05-21T13:41:07.347124+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":306,"log_dups_size":0,"ondisk_log_size":306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":306,"num_write_kb":835584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4,1],"acting":[0,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"25'2","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:37:59.540059+0000","last_change":"2024-05-21T13:35:56.775054+0000","last_active":"2024-05-21T13:37:59.540059+0000","last_peered":"2024-05-21T13:37:59.540059+0000","last_clean":"2024-05-21T13:37:59.540059+0000","last_became_active":"2024-05-21T13:35:56.770566+0000","last_became_peered":"2024-05-21T13:35:56.770566+0000","last_unstale":"2024-05-21T13:37:59.540059+0000","last_undegraded":"2024-05-21T13:37:59.540059+0000","last_fullsized":"2024-05-21T13:37:59.540059+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:05:11.539201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"27'6","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.810509+0000","last_change":"2024-05-21T13:35:57.782094+0000","last_active":"2024-05-21T13:41:05.810509+0000","last_peered":"2024-05-21T13:41:05.810509+0000","last_clean":"2024-05-21T13:41:05.810509+0000","last_became_active":"2024-05-21T13:35:57.780590+0000","last_became_peered":"2024-05-21T13:35:57.780590+0000","last_unstale":"2024-05-21T13:41:05.810509+0000","last_undegraded":"2024-05-21T13:41:05.810509+0000","last_fullsized":"2024-05-21T13:41:05.810509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:30:50.929103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"27'339","reported_seq":359,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.400325+0000","last_change":"2024-05-21T13:36:01.852092+0000","last_active":"2024-05-21T13:41:07.400325+0000","last_peered":"2024-05-21T13:41:07.400325+0000","last_clean":"2024-05-21T13:41:07.400325+0000","last_became_active":"2024-05-21T13:36:01.851745+0000","last_became_peered":"2024-05-21T13:36:01.851745+0000","last_unstale":"2024-05-21T13:41:07.400325+0000","last_undegraded":"2024-05-21T13:41:07.400325+0000","last_fullsized":"2024-05-21T13:41:07.400325+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:57:21.599860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":339,"num_write_kb":925696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"27'5","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:00.572334+0000","last_change":"2024-05-21T13:35:56.731106+0000","last_active":"2024-05-21T13:41:00.572334+0000","last_peered":"2024-05-21T13:41:00.572334+0000","last_clean":"2024-05-21T13:41:00.572334+0000","last_became_active":"2024-05-21T13:35:56.730746+0000","last_became_peered":"2024-05-21T13:35:56.730746+0000","last_unstale":"2024-05-21T13:41:00.572334+0000","last_undegraded":"2024-05-21T13:41:00.572334+0000","last_fullsized":"2024-05-21T13:41:00.572334+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"27'9","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.817410+0000","last_change":"2024-05-21T13:35:57.771371+0000","last_active":"2024-05-21T13:41:05.817410+0000","last_peered":"2024-05-21T13:41:05.817410+0000","last_clean":"2024-05-21T13:41:05.817410+0000","last_became_active":"2024-05-21T13:35:57.770595+0000","last_became_peered":"2024-05-21T13:35:57.770595+0000","last_unstale":"2024-05-21T13:41:05.817410+0000","last_undegraded":"2024-05-21T13:41:05.817410+0000","last_fullsized":"2024-05-21T13:41:05.817410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:53:17.771310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"27'273","reported_seq":293,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.380074+0000","last_change":"2024-05-21T13:36:01.849638+0000","last_active":"2024-05-21T13:41:07.380074+0000","last_peered":"2024-05-21T13:41:07.380074+0000","last_clean":"2024-05-21T13:41:07.380074+0000","last_became_active":"2024-05-21T13:36:01.848996+0000","last_became_peered":"2024-05-21T13:36:01.848996+0000","last_unstale":"2024-05-21T13:41:07.380074+0000","last_undegraded":"2024-05-21T13:41:07.380074+0000","last_fullsized":"2024-05-21T13:41:07.380074+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:24:31.613874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"24'2","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:00.572286+0000","last_change":"2024-05-21T13:35:56.737279+0000","last_active":"2024-05-21T13:41:00.572286+0000","last_peered":"2024-05-21T13:41:00.572286+0000","last_clean":"2024-05-21T13:41:00.572286+0000","last_became_active":"2024-05-21T13:35:56.731150+0000","last_became_peered":"2024-05-21T13:35:56.731150+0000","last_unstale":"2024-05-21T13:41:00.572286+0000","last_undegraded":"2024-05-21T13:41:00.572286+0000","last_fullsized":"2024-05-21T13:41:00.572286+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"27'15","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.830064+0000","last_change":"2024-05-21T13:35:57.799803+0000","last_active":"2024-05-21T13:41:05.830064+0000","last_peered":"2024-05-21T13:41:05.830064+0000","last_clean":"2024-05-21T13:41:05.830064+0000","last_became_active":"2024-05-21T13:35:57.799043+0000","last_became_peered":"2024-05-21T13:35:57.799043+0000","last_unstale":"2024-05-21T13:41:05.830064+0000","last_undegraded":"2024-05-21T13:41:05.830064+0000","last_fullsized":"2024-05-21T13:41:05.830064+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:22:48.607953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"27'252","reported_seq":272,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.370027+0000","last_change":"2024-05-21T13:36:01.852469+0000","last_active":"2024-05-21T13:41:07.370027+0000","last_peered":"2024-05-21T13:41:07.370027+0000","last_clean":"2024-05-21T13:41:07.370027+0000","last_became_active":"2024-05-21T13:36:01.851913+0000","last_became_peered":"2024-05-21T13:36:01.851913+0000","last_unstale":"2024-05-21T13:41:07.370027+0000","last_undegraded":"2024-05-21T13:41:07.370027+0000","last_fullsized":"2024-05-21T13:41:07.370027+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":252,"log_dups_size":0,"ondisk_log_size":252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:42:58.062540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":252,"num_write_kb":688128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"27'5","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.818127+0000","last_change":"2024-05-21T13:35:57.796516+0000","last_active":"2024-05-21T13:41:05.818127+0000","last_peered":"2024-05-21T13:41:05.818127+0000","last_clean":"2024-05-21T13:41:05.818127+0000","last_became_active":"2024-05-21T13:35:57.795638+0000","last_became_peered":"2024-05-21T13:35:57.795638+0000","last_unstale":"2024-05-21T13:41:05.818127+0000","last_undegraded":"2024-05-21T13:41:05.818127+0000","last_fullsized":"2024-05-21T13:41:05.818127+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:46:40.541835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"27'5","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:39:00.706951+0000","last_change":"2024-05-21T13:35:56.748046+0000","last_active":"2024-05-21T13:39:00.706951+0000","last_peered":"2024-05-21T13:39:00.706951+0000","last_clean":"2024-05-21T13:39:00.706951+0000","last_became_active":"2024-05-21T13:35:56.747635+0000","last_became_peered":"2024-05-21T13:35:56.747635+0000","last_unstale":"2024-05-21T13:39:00.706951+0000","last_undegraded":"2024-05-21T13:39:00.706951+0000","last_fullsized":"2024-05-21T13:39:00.706951+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:52:28.665244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"27'309","reported_seq":329,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.399148+0000","last_change":"2024-05-21T13:36:01.862153+0000","last_active":"2024-05-21T13:41:07.399148+0000","last_peered":"2024-05-21T13:41:07.399148+0000","last_clean":"2024-05-21T13:41:07.399148+0000","last_became_active":"2024-05-21T13:36:01.861520+0000","last_became_peered":"2024-05-21T13:36:01.861520+0000","last_unstale":"2024-05-21T13:41:07.399148+0000","last_undegraded":"2024-05-21T13:41:07.399148+0000","last_fullsized":"2024-05-21T13:41:07.399148+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":309,"log_dups_size":0,"ondisk_log_size":309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:04:37.306132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":309,"num_write_kb":843776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"27'8","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.790220+0000","last_change":"2024-05-21T13:35:57.786463+0000","last_active":"2024-05-21T13:41:05.790220+0000","last_peered":"2024-05-21T13:41:05.790220+0000","last_clean":"2024-05-21T13:41:05.790220+0000","last_became_active":"2024-05-21T13:35:57.786126+0000","last_became_peered":"2024-05-21T13:35:57.786126+0000","last_unstale":"2024-05-21T13:41:05.790220+0000","last_undegraded":"2024-05-21T13:41:05.790220+0000","last_fullsized":"2024-05-21T13:41:05.790220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:39:32.076464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"27'3","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:40:20.575038+0000","last_change":"2024-05-21T13:35:56.765178+0000","last_active":"2024-05-21T13:40:20.575038+0000","last_peered":"2024-05-21T13:40:20.575038+0000","last_clean":"2024-05-21T13:40:20.575038+0000","last_became_active":"2024-05-21T13:35:56.764551+0000","last_became_peered":"2024-05-21T13:35:56.764551+0000","last_unstale":"2024-05-21T13:40:20.575038+0000","last_undegraded":"2024-05-21T13:40:20.575038+0000","last_fullsized":"2024-05-21T13:40:20.575038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:34:28.955222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"27'291","reported_seq":312,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.374137+0000","last_change":"2024-05-21T13:36:01.854410+0000","last_active":"2024-05-21T13:41:07.374137+0000","last_peered":"2024-05-21T13:41:07.374137+0000","last_clean":"2024-05-21T13:41:07.374137+0000","last_became_active":"2024-05-21T13:36:01.853975+0000","last_became_peered":"2024-05-21T13:36:01.853975+0000","last_unstale":"2024-05-21T13:41:07.374137+0000","last_undegraded":"2024-05-21T13:41:07.374137+0000","last_fullsized":"2024-05-21T13:41:07.374137+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":291,"num_write_kb":794624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"27'9","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.798098+0000","last_change":"2024-05-21T13:35:57.762509+0000","last_active":"2024-05-21T13:41:05.798098+0000","last_peered":"2024-05-21T13:41:05.798098+0000","last_clean":"2024-05-21T13:41:05.798098+0000","last_became_active":"2024-05-21T13:35:57.761739+0000","last_became_peered":"2024-05-21T13:35:57.761739+0000","last_unstale":"2024-05-21T13:41:05.798098+0000","last_undegraded":"2024-05-21T13:41:05.798098+0000","last_fullsized":"2024-05-21T13:41:05.798098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"25'3","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:40:18.555310+0000","last_change":"2024-05-21T13:35:56.734017+0000","last_active":"2024-05-21T13:40:18.555310+0000","last_peered":"2024-05-21T13:40:18.555310+0000","last_clean":"2024-05-21T13:40:18.555310+0000","last_became_active":"2024-05-21T13:35:56.733249+0000","last_became_peered":"2024-05-21T13:35:56.733249+0000","last_unstale":"2024-05-21T13:40:18.555310+0000","last_undegraded":"2024-05-21T13:40:18.555310+0000","last_fullsized":"2024-05-21T13:40:18.555310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"27'267","reported_seq":287,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.357200+0000","last_change":"2024-05-21T13:36:01.868669+0000","last_active":"2024-05-21T13:41:07.357200+0000","last_peered":"2024-05-21T13:41:07.357200+0000","last_clean":"2024-05-21T13:41:07.357200+0000","last_became_active":"2024-05-21T13:36:01.867701+0000","last_became_peered":"2024-05-21T13:36:01.867701+0000","last_unstale":"2024-05-21T13:41:07.357200+0000","last_undegraded":"2024-05-21T13:41:07.357200+0000","last_fullsized":"2024-05-21T13:41:07.357200+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":267,"log_dups_size":0,"ondisk_log_size":267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:09:21.615570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":267,"num_write_kb":729088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"27'2","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.777072+0000","last_change":"2024-05-21T13:35:57.789966+0000","last_active":"2024-05-21T13:41:05.777072+0000","last_peered":"2024-05-21T13:41:05.777072+0000","last_clean":"2024-05-21T13:41:05.777072+0000","last_became_active":"2024-05-21T13:35:57.789213+0000","last_became_peered":"2024-05-21T13:35:57.789213+0000","last_unstale":"2024-05-21T13:41:05.777072+0000","last_undegraded":"2024-05-21T13:41:05.777072+0000","last_fullsized":"2024-05-21T13:41:05.777072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:33:24.183958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"25'2","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:40:20.565341+0000","last_change":"2024-05-21T13:35:56.746878+0000","last_active":"2024-05-21T13:40:20.565341+0000","last_peered":"2024-05-21T13:40:20.565341+0000","last_clean":"2024-05-21T13:40:20.565341+0000","last_became_active":"2024-05-21T13:35:56.746534+0000","last_became_peered":"2024-05-21T13:35:56.746534+0000","last_unstale":"2024-05-21T13:40:20.565341+0000","last_undegraded":"2024-05-21T13:40:20.565341+0000","last_fullsized":"2024-05-21T13:40:20.565341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"27'288","reported_seq":308,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.420341+0000","last_change":"2024-05-21T13:36:01.841632+0000","last_active":"2024-05-21T13:41:07.420341+0000","last_peered":"2024-05-21T13:41:07.420341+0000","last_clean":"2024-05-21T13:41:07.420341+0000","last_became_active":"2024-05-21T13:36:01.841216+0000","last_became_peered":"2024-05-21T13:36:01.841216+0000","last_unstale":"2024-05-21T13:41:07.420341+0000","last_undegraded":"2024-05-21T13:41:07.420341+0000","last_fullsized":"2024-05-21T13:41:07.420341+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:49:05.576221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":288,"num_write_kb":786432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"27'7","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.798871+0000","last_change":"2024-05-21T13:35:57.764793+0000","last_active":"2024-05-21T13:41:05.798871+0000","last_peered":"2024-05-21T13:41:05.798871+0000","last_clean":"2024-05-21T13:41:05.798871+0000","last_became_active":"2024-05-21T13:35:57.764017+0000","last_became_peered":"2024-05-21T13:35:57.764017+0000","last_unstale":"2024-05-21T13:41:05.798871+0000","last_undegraded":"2024-05-21T13:41:05.798871+0000","last_fullsized":"2024-05-21T13:41:05.798871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"27'5","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:40:20.578707+0000","last_change":"2024-05-21T13:35:56.752278+0000","last_active":"2024-05-21T13:40:20.578707+0000","last_peered":"2024-05-21T13:40:20.578707+0000","last_clean":"2024-05-21T13:40:20.578707+0000","last_became_active":"2024-05-21T13:35:56.751883+0000","last_became_peered":"2024-05-21T13:35:56.751883+0000","last_unstale":"2024-05-21T13:40:20.578707+0000","last_undegraded":"2024-05-21T13:40:20.578707+0000","last_fullsized":"2024-05-21T13:40:20.578707+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:08:05.279701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"27'249","reported_seq":269,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.413059+0000","last_change":"2024-05-21T13:36:01.832621+0000","last_active":"2024-05-21T13:41:07.413059+0000","last_peered":"2024-05-21T13:41:07.413059+0000","last_clean":"2024-05-21T13:41:07.413059+0000","last_became_active":"2024-05-21T13:36:01.831609+0000","last_became_peered":"2024-05-21T13:36:01.831609+0000","last_unstale":"2024-05-21T13:41:07.413059+0000","last_undegraded":"2024-05-21T13:41:07.413059+0000","last_fullsized":"2024-05-21T13:41:07.413059+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:26:43.075259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":249,"num_write_kb":679936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"27'5","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.794956+0000","last_change":"2024-05-21T13:35:57.783487+0000","last_active":"2024-05-21T13:41:05.794956+0000","last_peered":"2024-05-21T13:41:05.794956+0000","last_clean":"2024-05-21T13:41:05.794956+0000","last_became_active":"2024-05-21T13:35:57.783150+0000","last_became_peered":"2024-05-21T13:35:57.783150+0000","last_unstale":"2024-05-21T13:41:05.794956+0000","last_undegraded":"2024-05-21T13:41:05.794956+0000","last_fullsized":"2024-05-21T13:41:05.794956+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"27'22","reported_seq":51,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:06.618565+0000","last_change":"2024-05-21T13:35:56.745122+0000","last_active":"2024-05-21T13:41:06.618565+0000","last_peered":"2024-05-21T13:41:06.618565+0000","last_clean":"2024-05-21T13:41:06.618565+0000","last_became_active":"2024-05-21T13:35:56.744218+0000","last_became_peered":"2024-05-21T13:35:56.744218+0000","last_unstale":"2024-05-21T13:41:06.618565+0000","last_undegraded":"2024-05-21T13:41:06.618565+0000","last_fullsized":"2024-05-21T13:41:06.618565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"27'264","reported_seq":285,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.477276+0000","last_change":"2024-05-21T13:36:01.838971+0000","last_active":"2024-05-21T13:41:07.477276+0000","last_peered":"2024-05-21T13:41:07.477276+0000","last_clean":"2024-05-21T13:41:07.477276+0000","last_became_active":"2024-05-21T13:36:01.837401+0000","last_became_peered":"2024-05-21T13:36:01.837401+0000","last_unstale":"2024-05-21T13:41:07.477276+0000","last_undegraded":"2024-05-21T13:41:07.477276+0000","last_fullsized":"2024-05-21T13:41:07.477276+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":720896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"27'9","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.801162+0000","last_change":"2024-05-21T13:35:57.784993+0000","last_active":"2024-05-21T13:41:05.801162+0000","last_peered":"2024-05-21T13:41:05.801162+0000","last_clean":"2024-05-21T13:41:05.801162+0000","last_became_active":"2024-05-21T13:35:57.784664+0000","last_became_peered":"2024-05-21T13:35:57.784664+0000","last_unstale":"2024-05-21T13:41:05.801162+0000","last_undegraded":"2024-05-21T13:41:05.801162+0000","last_fullsized":"2024-05-21T13:41:05.801162+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:58:20.045901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"25'1","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:38:05.553882+0000","last_change":"2024-05-21T13:35:56.741285+0000","last_active":"2024-05-21T13:38:05.553882+0000","last_peered":"2024-05-21T13:38:05.553882+0000","last_clean":"2024-05-21T13:38:05.553882+0000","last_became_active":"2024-05-21T13:35:56.740846+0000","last_became_peered":"2024-05-21T13:35:56.740846+0000","last_unstale":"2024-05-21T13:38:05.553882+0000","last_undegraded":"2024-05-21T13:38:05.553882+0000","last_fullsized":"2024-05-21T13:38:05.553882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:34:17.960870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"27'249","reported_seq":269,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.372636+0000","last_change":"2024-05-21T13:36:01.873172+0000","last_active":"2024-05-21T13:41:07.372636+0000","last_peered":"2024-05-21T13:41:07.372636+0000","last_clean":"2024-05-21T13:41:07.372636+0000","last_became_active":"2024-05-21T13:36:01.872085+0000","last_became_peered":"2024-05-21T13:36:01.872085+0000","last_unstale":"2024-05-21T13:41:07.372636+0000","last_undegraded":"2024-05-21T13:41:07.372636+0000","last_fullsized":"2024-05-21T13:41:07.372636+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:24:57.031323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":249,"num_write_kb":679936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"27'5","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.803329+0000","last_change":"2024-05-21T13:35:57.783176+0000","last_active":"2024-05-21T13:41:05.803329+0000","last_peered":"2024-05-21T13:41:05.803329+0000","last_clean":"2024-05-21T13:41:05.803329+0000","last_became_active":"2024-05-21T13:35:57.782517+0000","last_became_peered":"2024-05-21T13:35:57.782517+0000","last_unstale":"2024-05-21T13:41:05.803329+0000","last_undegraded":"2024-05-21T13:41:05.803329+0000","last_fullsized":"2024-05-21T13:41:05.803329+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:06:58.203996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:38:04.540828+0000","last_change":"2024-05-21T13:35:56.767544+0000","last_active":"2024-05-21T13:38:04.540828+0000","last_peered":"2024-05-21T13:38:04.540828+0000","last_clean":"2024-05-21T13:38:04.540828+0000","last_became_active":"2024-05-21T13:35:56.764987+0000","last_became_peered":"2024-05-21T13:35:56.764987+0000","last_unstale":"2024-05-21T13:38:04.540828+0000","last_undegraded":"2024-05-21T13:38:04.540828+0000","last_fullsized":"2024-05-21T13:38:04.540828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:12:46.828769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"27'273","reported_seq":293,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.388266+0000","last_change":"2024-05-21T13:36:01.872215+0000","last_active":"2024-05-21T13:41:07.388266+0000","last_peered":"2024-05-21T13:41:07.388266+0000","last_clean":"2024-05-21T13:41:07.388266+0000","last_became_active":"2024-05-21T13:36:01.870831+0000","last_became_peered":"2024-05-21T13:36:01.870831+0000","last_unstale":"2024-05-21T13:41:07.388266+0000","last_undegraded":"2024-05-21T13:41:07.388266+0000","last_fullsized":"2024-05-21T13:41:07.388266+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:04:09.689206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"27'7","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.828507+0000","last_change":"2024-05-21T13:35:57.783616+0000","last_active":"2024-05-21T13:41:05.828507+0000","last_peered":"2024-05-21T13:41:05.828507+0000","last_clean":"2024-05-21T13:41:05.828507+0000","last_became_active":"2024-05-21T13:35:57.780521+0000","last_became_peered":"2024-05-21T13:35:57.780521+0000","last_unstale":"2024-05-21T13:41:05.828507+0000","last_undegraded":"2024-05-21T13:41:05.828507+0000","last_fullsized":"2024-05-21T13:41:05.828507+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"25'1","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:38:05.553834+0000","last_change":"2024-05-21T13:35:56.750341+0000","last_active":"2024-05-21T13:38:05.553834+0000","last_peered":"2024-05-21T13:38:05.553834+0000","last_clean":"2024-05-21T13:38:05.553834+0000","last_became_active":"2024-05-21T13:35:56.750006+0000","last_became_peered":"2024-05-21T13:35:56.750006+0000","last_unstale":"2024-05-21T13:38:05.553834+0000","last_undegraded":"2024-05-21T13:38:05.553834+0000","last_fullsized":"2024-05-21T13:38:05.553834+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:15:21.416234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"27'264","reported_seq":284,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.398103+0000","last_change":"2024-05-21T13:36:01.873693+0000","last_active":"2024-05-21T13:41:07.398103+0000","last_peered":"2024-05-21T13:41:07.398103+0000","last_clean":"2024-05-21T13:41:07.398103+0000","last_became_active":"2024-05-21T13:36:01.872363+0000","last_became_peered":"2024-05-21T13:36:01.872363+0000","last_unstale":"2024-05-21T13:41:07.398103+0000","last_undegraded":"2024-05-21T13:41:07.398103+0000","last_fullsized":"2024-05-21T13:41:07.398103+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:27:25.974289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":720896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"27'8","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.803951+0000","last_change":"2024-05-21T13:35:57.780809+0000","last_active":"2024-05-21T13:41:05.803951+0000","last_peered":"2024-05-21T13:41:05.803951+0000","last_clean":"2024-05-21T13:41:05.803951+0000","last_became_active":"2024-05-21T13:35:57.780313+0000","last_became_peered":"2024-05-21T13:35:57.780313+0000","last_unstale":"2024-05-21T13:41:05.803951+0000","last_undegraded":"2024-05-21T13:41:05.803951+0000","last_fullsized":"2024-05-21T13:41:05.803951+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:43:11.778238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"27'9","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:06.810080+0000","last_change":"2024-05-21T13:35:56.771138+0000","last_active":"2024-05-21T13:41:06.810080+0000","last_peered":"2024-05-21T13:41:06.810080+0000","last_clean":"2024-05-21T13:41:06.810080+0000","last_became_active":"2024-05-21T13:35:56.770465+0000","last_became_peered":"2024-05-21T13:35:56.770465+0000","last_unstale":"2024-05-21T13:41:06.810080+0000","last_undegraded":"2024-05-21T13:41:06.810080+0000","last_fullsized":"2024-05-21T13:41:06.810080+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:21:16.702309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":619,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"27'270","reported_seq":290,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.403240+0000","last_change":"2024-05-21T13:36:01.871328+0000","last_active":"2024-05-21T13:41:07.403240+0000","last_peered":"2024-05-21T13:41:07.403240+0000","last_clean":"2024-05-21T13:41:07.403240+0000","last_became_active":"2024-05-21T13:36:01.870678+0000","last_became_peered":"2024-05-21T13:36:01.870678+0000","last_unstale":"2024-05-21T13:41:07.403240+0000","last_undegraded":"2024-05-21T13:41:07.403240+0000","last_fullsized":"2024-05-21T13:41:07.403240+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:22:47.393065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":737280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"27'5","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.809299+0000","last_change":"2024-05-21T13:35:57.782665+0000","last_active":"2024-05-21T13:41:05.809299+0000","last_peered":"2024-05-21T13:41:05.809299+0000","last_clean":"2024-05-21T13:41:05.809299+0000","last_became_active":"2024-05-21T13:35:57.781299+0000","last_became_peered":"2024-05-21T13:35:57.781299+0000","last_unstale":"2024-05-21T13:41:05.809299+0000","last_undegraded":"2024-05-21T13:41:05.809299+0000","last_fullsized":"2024-05-21T13:41:05.809299+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:21:22.721124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"25'3","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:38:00.553325+0000","last_change":"2024-05-21T13:35:56.768193+0000","last_active":"2024-05-21T13:38:00.553325+0000","last_peered":"2024-05-21T13:38:00.553325+0000","last_clean":"2024-05-21T13:38:00.553325+0000","last_became_active":"2024-05-21T13:35:56.767788+0000","last_became_peered":"2024-05-21T13:35:56.767788+0000","last_unstale":"2024-05-21T13:38:00.553325+0000","last_undegraded":"2024-05-21T13:38:00.553325+0000","last_fullsized":"2024-05-21T13:38:00.553325+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:12:52.911816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"27'339","reported_seq":359,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.377321+0000","last_change":"2024-05-21T13:36:01.860305+0000","last_active":"2024-05-21T13:41:07.377321+0000","last_peered":"2024-05-21T13:41:07.377321+0000","last_clean":"2024-05-21T13:41:07.377321+0000","last_became_active":"2024-05-21T13:36:01.859141+0000","last_became_peered":"2024-05-21T13:36:01.859141+0000","last_unstale":"2024-05-21T13:41:07.377321+0000","last_undegraded":"2024-05-21T13:41:07.377321+0000","last_fullsized":"2024-05-21T13:41:07.377321+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:05:45.203241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":339,"num_write_kb":925696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"27'8","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.809993+0000","last_change":"2024-05-21T13:35:57.775523+0000","last_active":"2024-05-21T13:41:05.809993+0000","last_peered":"2024-05-21T13:41:05.809993+0000","last_clean":"2024-05-21T13:41:05.809993+0000","last_became_active":"2024-05-21T13:35:57.774322+0000","last_became_peered":"2024-05-21T13:35:57.774322+0000","last_unstale":"2024-05-21T13:41:05.809993+0000","last_undegraded":"2024-05-21T13:41:05.809993+0000","last_fullsized":"2024-05-21T13:41:05.809993+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"25'3","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:38:05.553854+0000","last_change":"2024-05-21T13:35:56.748185+0000","last_active":"2024-05-21T13:38:05.553854+0000","last_peered":"2024-05-21T13:38:05.553854+0000","last_clean":"2024-05-21T13:38:05.553854+0000","last_became_active":"2024-05-21T13:35:56.747823+0000","last_became_peered":"2024-05-21T13:35:56.747823+0000","last_unstale":"2024-05-21T13:38:05.553854+0000","last_undegraded":"2024-05-21T13:38:05.553854+0000","last_fullsized":"2024-05-21T13:38:05.553854+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:38:00.235330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'72","reported_seq":123,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:37:45.542454+0000","last_change":"2024-05-21T13:35:45.682484+0000","last_active":"2024-05-21T13:37:45.542454+0000","last_peered":"2024-05-21T13:37:45.542454+0000","last_clean":"2024-05-21T13:37:45.542454+0000","last_became_active":"2024-05-21T13:35:45.680732+0000","last_became_peered":"2024-05-21T13:35:45.680732+0000","last_unstale":"2024-05-21T13:37:45.542454+0000","last_undegraded":"2024-05-21T13:37:45.542454+0000","last_fullsized":"2024-05-21T13:37:45.542454+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:44.542324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:44.542324+0000","last_clean_scrub_stamp":"2024-05-21T13:35:44.542324+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:16:05.034161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"27'276","reported_seq":296,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.403558+0000","last_change":"2024-05-21T13:36:01.830034+0000","last_active":"2024-05-21T13:41:07.403558+0000","last_peered":"2024-05-21T13:41:07.403558+0000","last_clean":"2024-05-21T13:41:07.403558+0000","last_became_active":"2024-05-21T13:36:01.828957+0000","last_became_peered":"2024-05-21T13:36:01.828957+0000","last_unstale":"2024-05-21T13:41:07.403558+0000","last_undegraded":"2024-05-21T13:41:07.403558+0000","last_fullsized":"2024-05-21T13:41:07.403558+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:21:59.514268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":276,"num_write_kb":753664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"27'7","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.824727+0000","last_change":"2024-05-21T13:35:57.796419+0000","last_active":"2024-05-21T13:41:05.824727+0000","last_peered":"2024-05-21T13:41:05.824727+0000","last_clean":"2024-05-21T13:41:05.824727+0000","last_became_active":"2024-05-21T13:35:57.796050+0000","last_became_peered":"2024-05-21T13:35:57.796050+0000","last_unstale":"2024-05-21T13:41:05.824727+0000","last_undegraded":"2024-05-21T13:41:05.824727+0000","last_fullsized":"2024-05-21T13:41:05.824727+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:56:07.121391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"25'3","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:38:15.541313+0000","last_change":"2024-05-21T13:35:56.751619+0000","last_active":"2024-05-21T13:38:15.541313+0000","last_peered":"2024-05-21T13:38:15.541313+0000","last_clean":"2024-05-21T13:38:15.541313+0000","last_became_active":"2024-05-21T13:35:56.748604+0000","last_became_peered":"2024-05-21T13:35:56.748604+0000","last_unstale":"2024-05-21T13:38:15.541313+0000","last_undegraded":"2024-05-21T13:38:15.541313+0000","last_fullsized":"2024-05-21T13:38:15.541313+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:19:03.052434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"27'280","reported_seq":300,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.378299+0000","last_change":"2024-05-21T13:36:01.825464+0000","last_active":"2024-05-21T13:41:07.378299+0000","last_peered":"2024-05-21T13:41:07.378299+0000","last_clean":"2024-05-21T13:41:07.378299+0000","last_became_active":"2024-05-21T13:36:01.824653+0000","last_became_peered":"2024-05-21T13:36:01.824653+0000","last_unstale":"2024-05-21T13:41:07.378299+0000","last_undegraded":"2024-05-21T13:41:07.378299+0000","last_fullsized":"2024-05-21T13:41:07.378299+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:29:32.830052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":280,"num_write_kb":761856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"27'6","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.828907+0000","last_change":"2024-05-21T13:35:57.784031+0000","last_active":"2024-05-21T13:41:05.828907+0000","last_peered":"2024-05-21T13:41:05.828907+0000","last_clean":"2024-05-21T13:41:05.828907+0000","last_became_active":"2024-05-21T13:35:57.771695+0000","last_became_peered":"2024-05-21T13:35:57.771695+0000","last_unstale":"2024-05-21T13:41:05.828907+0000","last_undegraded":"2024-05-21T13:41:05.828907+0000","last_fullsized":"2024-05-21T13:41:05.828907+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"24'1","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:38:14.542410+0000","last_change":"2024-05-21T13:35:56.768166+0000","last_active":"2024-05-21T13:38:14.542410+0000","last_peered":"2024-05-21T13:38:14.542410+0000","last_clean":"2024-05-21T13:38:14.542410+0000","last_became_active":"2024-05-21T13:35:56.767053+0000","last_became_peered":"2024-05-21T13:35:56.767053+0000","last_unstale":"2024-05-21T13:38:14.542410+0000","last_undegraded":"2024-05-21T13:38:14.542410+0000","last_fullsized":"2024-05-21T13:38:14.542410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:10:16.639491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"27'261","reported_seq":281,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.410654+0000","last_change":"2024-05-21T13:36:01.834253+0000","last_active":"2024-05-21T13:41:07.410654+0000","last_peered":"2024-05-21T13:41:07.410654+0000","last_clean":"2024-05-21T13:41:07.410654+0000","last_became_active":"2024-05-21T13:36:01.832972+0000","last_became_peered":"2024-05-21T13:36:01.832972+0000","last_unstale":"2024-05-21T13:41:07.410654+0000","last_undegraded":"2024-05-21T13:41:07.410654+0000","last_fullsized":"2024-05-21T13:41:07.410654+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":261,"log_dups_size":0,"ondisk_log_size":261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:52:05.576063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":261,"num_write_kb":712704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"27'9","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.829044+0000","last_change":"2024-05-21T13:35:57.766504+0000","last_active":"2024-05-21T13:41:05.829044+0000","last_peered":"2024-05-21T13:41:05.829044+0000","last_clean":"2024-05-21T13:41:05.829044+0000","last_became_active":"2024-05-21T13:35:57.765756+0000","last_became_peered":"2024-05-21T13:35:57.765756+0000","last_unstale":"2024-05-21T13:41:05.829044+0000","last_undegraded":"2024-05-21T13:41:05.829044+0000","last_fullsized":"2024-05-21T13:41:05.829044+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"24'2","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:40:28.562643+0000","last_change":"2024-05-21T13:35:56.770347+0000","last_active":"2024-05-21T13:40:28.562643+0000","last_peered":"2024-05-21T13:40:28.562643+0000","last_clean":"2024-05-21T13:40:28.562643+0000","last_became_active":"2024-05-21T13:35:56.769767+0000","last_became_peered":"2024-05-21T13:35:56.769767+0000","last_unstale":"2024-05-21T13:40:28.562643+0000","last_undegraded":"2024-05-21T13:40:28.562643+0000","last_fullsized":"2024-05-21T13:40:28.562643+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"27'318","reported_seq":338,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.383172+0000","last_change":"2024-05-21T13:36:01.827091+0000","last_active":"2024-05-21T13:41:07.383172+0000","last_peered":"2024-05-21T13:41:07.383172+0000","last_clean":"2024-05-21T13:41:07.383172+0000","last_became_active":"2024-05-21T13:36:01.826686+0000","last_became_peered":"2024-05-21T13:36:01.826686+0000","last_unstale":"2024-05-21T13:41:07.383172+0000","last_undegraded":"2024-05-21T13:41:07.383172+0000","last_fullsized":"2024-05-21T13:41:07.383172+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":318,"log_dups_size":0,"ondisk_log_size":318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:42:47.638921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":318,"num_write_kb":868352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"27'5","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.816970+0000","last_change":"2024-05-21T13:35:57.781528+0000","last_active":"2024-05-21T13:41:05.816970+0000","last_peered":"2024-05-21T13:41:05.816970+0000","last_clean":"2024-05-21T13:41:05.816970+0000","last_became_active":"2024-05-21T13:35:57.781111+0000","last_became_peered":"2024-05-21T13:35:57.781111+0000","last_unstale":"2024-05-21T13:41:05.816970+0000","last_undegraded":"2024-05-21T13:41:05.816970+0000","last_fullsized":"2024-05-21T13:41:05.816970+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:15:43.847640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"25'2","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:40:30.567267+0000","last_change":"2024-05-21T13:35:56.755413+0000","last_active":"2024-05-21T13:40:30.567267+0000","last_peered":"2024-05-21T13:40:30.567267+0000","last_clean":"2024-05-21T13:40:30.567267+0000","last_became_active":"2024-05-21T13:35:56.755158+0000","last_became_peered":"2024-05-21T13:35:56.755158+0000","last_unstale":"2024-05-21T13:40:30.567267+0000","last_undegraded":"2024-05-21T13:40:30.567267+0000","last_fullsized":"2024-05-21T13:40:30.567267+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"27'258","reported_seq":278,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.275439+0000","last_change":"2024-05-21T13:36:01.827237+0000","last_active":"2024-05-21T13:41:07.275439+0000","last_peered":"2024-05-21T13:41:07.275439+0000","last_clean":"2024-05-21T13:41:07.275439+0000","last_became_active":"2024-05-21T13:36:01.826374+0000","last_became_peered":"2024-05-21T13:36:01.826374+0000","last_unstale":"2024-05-21T13:41:07.275439+0000","last_undegraded":"2024-05-21T13:41:07.275439+0000","last_fullsized":"2024-05-21T13:41:07.275439+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":258,"log_dups_size":0,"ondisk_log_size":258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:12:33.528068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":258,"num_write_kb":704512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"27'6","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.815755+0000","last_change":"2024-05-21T13:35:57.787940+0000","last_active":"2024-05-21T13:41:05.815755+0000","last_peered":"2024-05-21T13:41:05.815755+0000","last_clean":"2024-05-21T13:41:05.815755+0000","last_became_active":"2024-05-21T13:35:57.787544+0000","last_became_peered":"2024-05-21T13:35:57.787544+0000","last_unstale":"2024-05-21T13:41:05.815755+0000","last_undegraded":"2024-05-21T13:41:05.815755+0000","last_fullsized":"2024-05-21T13:41:05.815755+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:46:20.335316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"27'16","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:08.321174+0000","last_change":"2024-05-21T13:35:56.756262+0000","last_active":"2024-05-21T13:41:08.321174+0000","last_peered":"2024-05-21T13:41:08.321174+0000","last_clean":"2024-05-21T13:41:08.321174+0000","last_became_active":"2024-05-21T13:35:56.752342+0000","last_became_peered":"2024-05-21T13:35:56.752342+0000","last_unstale":"2024-05-21T13:41:08.321174+0000","last_undegraded":"2024-05-21T13:41:08.321174+0000","last_fullsized":"2024-05-21T13:41:08.321174+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"27'360","reported_seq":380,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.427307+0000","last_change":"2024-05-21T13:36:01.859498+0000","last_active":"2024-05-21T13:41:07.427307+0000","last_peered":"2024-05-21T13:41:07.427307+0000","last_clean":"2024-05-21T13:41:07.427307+0000","last_became_active":"2024-05-21T13:36:01.857707+0000","last_became_peered":"2024-05-21T13:36:01.857707+0000","last_unstale":"2024-05-21T13:41:07.427307+0000","last_undegraded":"2024-05-21T13:41:07.427307+0000","last_fullsized":"2024-05-21T13:41:07.427307+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:38:06.966814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":360,"num_write_kb":983040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"27'6","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.806663+0000","last_change":"2024-05-21T13:35:57.783007+0000","last_active":"2024-05-21T13:41:05.806663+0000","last_peered":"2024-05-21T13:41:05.806663+0000","last_clean":"2024-05-21T13:41:05.806663+0000","last_became_active":"2024-05-21T13:35:57.782330+0000","last_became_peered":"2024-05-21T13:35:57.782330+0000","last_unstale":"2024-05-21T13:41:05.806663+0000","last_undegraded":"2024-05-21T13:41:05.806663+0000","last_fullsized":"2024-05-21T13:41:05.806663+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:26:14.697766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"25'3","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:40:40.568853+0000","last_change":"2024-05-21T13:35:56.745787+0000","last_active":"2024-05-21T13:40:40.568853+0000","last_peered":"2024-05-21T13:40:40.568853+0000","last_clean":"2024-05-21T13:40:40.568853+0000","last_became_active":"2024-05-21T13:35:56.745202+0000","last_became_peered":"2024-05-21T13:35:56.745202+0000","last_unstale":"2024-05-21T13:40:40.568853+0000","last_undegraded":"2024-05-21T13:40:40.568853+0000","last_fullsized":"2024-05-21T13:40:40.568853+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"27'273","reported_seq":293,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.415841+0000","last_change":"2024-05-21T13:36:01.858550+0000","last_active":"2024-05-21T13:41:07.415841+0000","last_peered":"2024-05-21T13:41:07.415841+0000","last_clean":"2024-05-21T13:41:07.415841+0000","last_became_active":"2024-05-21T13:36:01.857716+0000","last_became_peered":"2024-05-21T13:36:01.857716+0000","last_unstale":"2024-05-21T13:41:07.415841+0000","last_undegraded":"2024-05-21T13:41:07.415841+0000","last_fullsized":"2024-05-21T13:41:07.415841+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:48:32.490678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"27'15","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.824416+0000","last_change":"2024-05-21T13:35:57.799702+0000","last_active":"2024-05-21T13:41:05.824416+0000","last_peered":"2024-05-21T13:41:05.824416+0000","last_clean":"2024-05-21T13:41:05.824416+0000","last_became_active":"2024-05-21T13:35:57.799225+0000","last_became_peered":"2024-05-21T13:35:57.799225+0000","last_unstale":"2024-05-21T13:41:05.824416+0000","last_undegraded":"2024-05-21T13:41:05.824416+0000","last_fullsized":"2024-05-21T13:41:05.824416+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:29:54.094448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"25'3","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:38:20.556128+0000","last_change":"2024-05-21T13:35:56.742650+0000","last_active":"2024-05-21T13:38:20.556128+0000","last_peered":"2024-05-21T13:38:20.556128+0000","last_clean":"2024-05-21T13:38:20.556128+0000","last_became_active":"2024-05-21T13:35:56.742296+0000","last_became_peered":"2024-05-21T13:35:56.742296+0000","last_unstale":"2024-05-21T13:38:20.556128+0000","last_undegraded":"2024-05-21T13:38:20.556128+0000","last_fullsized":"2024-05-21T13:38:20.556128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:18:55.514845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"27'273","reported_seq":293,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.341060+0000","last_change":"2024-05-21T13:36:01.873708+0000","last_active":"2024-05-21T13:41:07.341060+0000","last_peered":"2024-05-21T13:41:07.341060+0000","last_clean":"2024-05-21T13:41:07.341060+0000","last_became_active":"2024-05-21T13:36:01.872320+0000","last_became_peered":"2024-05-21T13:36:01.872320+0000","last_unstale":"2024-05-21T13:41:07.341060+0000","last_undegraded":"2024-05-21T13:41:07.341060+0000","last_fullsized":"2024-05-21T13:41:07.341060+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:01:15.545756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"27'10","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.819407+0000","last_change":"2024-05-21T13:35:57.802763+0000","last_active":"2024-05-21T13:41:05.819407+0000","last_peered":"2024-05-21T13:41:05.819407+0000","last_clean":"2024-05-21T13:41:05.819407+0000","last_became_active":"2024-05-21T13:35:57.802433+0000","last_became_peered":"2024-05-21T13:35:57.802433+0000","last_unstale":"2024-05-21T13:41:05.819407+0000","last_undegraded":"2024-05-21T13:41:05.819407+0000","last_fullsized":"2024-05-21T13:41:05.819407+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:09:48.463186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"25'6","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:38:20.545542+0000","last_change":"2024-05-21T13:35:56.754087+0000","last_active":"2024-05-21T13:38:20.545542+0000","last_peered":"2024-05-21T13:38:20.545542+0000","last_clean":"2024-05-21T13:38:20.545542+0000","last_became_active":"2024-05-21T13:35:56.753319+0000","last_became_peered":"2024-05-21T13:35:56.753319+0000","last_unstale":"2024-05-21T13:38:20.545542+0000","last_undegraded":"2024-05-21T13:38:20.545542+0000","last_fullsized":"2024-05-21T13:38:20.545542+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:19:21.276993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"27'327","reported_seq":347,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.315452+0000","last_change":"2024-05-21T13:36:01.836017+0000","last_active":"2024-05-21T13:41:07.315452+0000","last_peered":"2024-05-21T13:41:07.315452+0000","last_clean":"2024-05-21T13:41:07.315452+0000","last_became_active":"2024-05-21T13:36:01.835450+0000","last_became_peered":"2024-05-21T13:36:01.835450+0000","last_unstale":"2024-05-21T13:41:07.315452+0000","last_undegraded":"2024-05-21T13:41:07.315452+0000","last_fullsized":"2024-05-21T13:41:07.315452+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:05:56.077605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":327,"num_write_kb":892928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"27'6","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.828782+0000","last_change":"2024-05-21T13:35:57.787177+0000","last_active":"2024-05-21T13:41:05.828782+0000","last_peered":"2024-05-21T13:41:05.828782+0000","last_clean":"2024-05-21T13:41:05.828782+0000","last_became_active":"2024-05-21T13:35:57.786401+0000","last_became_peered":"2024-05-21T13:35:57.786401+0000","last_unstale":"2024-05-21T13:41:05.828782+0000","last_undegraded":"2024-05-21T13:41:05.828782+0000","last_fullsized":"2024-05-21T13:41:05.828782+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'100","reported_seq":128,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:08.568085+0000","last_change":"2024-05-21T13:35:56.751229+0000","last_active":"2024-05-21T13:41:08.568085+0000","last_peered":"2024-05-21T13:41:08.568085+0000","last_clean":"2024-05-21T13:41:08.568085+0000","last_became_active":"2024-05-21T13:35:56.750831+0000","last_became_peered":"2024-05-21T13:35:56.750831+0000","last_unstale":"2024-05-21T13:41:08.568085+0000","last_undegraded":"2024-05-21T13:41:08.568085+0000","last_fullsized":"2024-05-21T13:41:08.568085+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":0,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:03:40.186241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209875,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":100,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"27'289","reported_seq":310,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.412001+0000","last_change":"2024-05-21T13:36:01.832691+0000","last_active":"2024-05-21T13:41:07.412001+0000","last_peered":"2024-05-21T13:41:07.412001+0000","last_clean":"2024-05-21T13:41:07.412001+0000","last_became_active":"2024-05-21T13:36:01.831476+0000","last_became_peered":"2024-05-21T13:36:01.831476+0000","last_unstale":"2024-05-21T13:41:07.412001+0000","last_undegraded":"2024-05-21T13:41:07.412001+0000","last_fullsized":"2024-05-21T13:41:07.412001+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":289,"log_dups_size":0,"ondisk_log_size":289,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":288,"num_write_kb":786432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"27'11","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.817770+0000","last_change":"2024-05-21T13:35:57.788547+0000","last_active":"2024-05-21T13:41:05.817770+0000","last_peered":"2024-05-21T13:41:05.817770+0000","last_clean":"2024-05-21T13:41:05.817770+0000","last_became_active":"2024-05-21T13:35:57.787785+0000","last_became_peered":"2024-05-21T13:35:57.787785+0000","last_unstale":"2024-05-21T13:41:05.817770+0000","last_undegraded":"2024-05-21T13:41:05.817770+0000","last_fullsized":"2024-05-21T13:41:05.817770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:51:08.781399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"27'10","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:08.320430+0000","last_change":"2024-05-21T13:35:56.760557+0000","last_active":"2024-05-21T13:41:08.320430+0000","last_peered":"2024-05-21T13:41:08.320430+0000","last_clean":"2024-05-21T13:41:08.320430+0000","last_became_active":"2024-05-21T13:35:56.759728+0000","last_became_peered":"2024-05-21T13:35:56.759728+0000","last_unstale":"2024-05-21T13:41:08.320430+0000","last_undegraded":"2024-05-21T13:41:08.320430+0000","last_fullsized":"2024-05-21T13:41:08.320430+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:56:19.754940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"27'297","reported_seq":317,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.383028+0000","last_change":"2024-05-21T13:36:01.861622+0000","last_active":"2024-05-21T13:41:07.383028+0000","last_peered":"2024-05-21T13:41:07.383028+0000","last_clean":"2024-05-21T13:41:07.383028+0000","last_became_active":"2024-05-21T13:36:01.861172+0000","last_became_peered":"2024-05-21T13:36:01.861172+0000","last_unstale":"2024-05-21T13:41:07.383028+0000","last_undegraded":"2024-05-21T13:41:07.383028+0000","last_fullsized":"2024-05-21T13:41:07.383028+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:39:53.211812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":297,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"27'9","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.819358+0000","last_change":"2024-05-21T13:35:57.804520+0000","last_active":"2024-05-21T13:41:05.819358+0000","last_peered":"2024-05-21T13:41:05.819358+0000","last_clean":"2024-05-21T13:41:05.819358+0000","last_became_active":"2024-05-21T13:35:57.804139+0000","last_became_peered":"2024-05-21T13:35:57.804139+0000","last_unstale":"2024-05-21T13:41:05.819358+0000","last_undegraded":"2024-05-21T13:41:05.819358+0000","last_fullsized":"2024-05-21T13:41:05.819358+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:21:52.433019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"25'2","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:40:50.570670+0000","last_change":"2024-05-21T13:35:56.733821+0000","last_active":"2024-05-21T13:40:50.570670+0000","last_peered":"2024-05-21T13:40:50.570670+0000","last_clean":"2024-05-21T13:40:50.570670+0000","last_became_active":"2024-05-21T13:35:56.732488+0000","last_became_peered":"2024-05-21T13:35:56.732488+0000","last_unstale":"2024-05-21T13:40:50.570670+0000","last_undegraded":"2024-05-21T13:40:50.570670+0000","last_fullsized":"2024-05-21T13:40:50.570670+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"27'297","reported_seq":317,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.370538+0000","last_change":"2024-05-21T13:36:01.868781+0000","last_active":"2024-05-21T13:41:07.370538+0000","last_peered":"2024-05-21T13:41:07.370538+0000","last_clean":"2024-05-21T13:41:07.370538+0000","last_became_active":"2024-05-21T13:36:01.864254+0000","last_became_peered":"2024-05-21T13:36:01.864254+0000","last_unstale":"2024-05-21T13:41:07.370538+0000","last_undegraded":"2024-05-21T13:41:07.370538+0000","last_fullsized":"2024-05-21T13:41:07.370538+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:34:12.632333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":297,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"27'10","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.820694+0000","last_change":"2024-05-21T13:35:57.788313+0000","last_active":"2024-05-21T13:41:05.820694+0000","last_peered":"2024-05-21T13:41:05.820694+0000","last_clean":"2024-05-21T13:41:05.820694+0000","last_became_active":"2024-05-21T13:35:57.787963+0000","last_became_peered":"2024-05-21T13:35:57.787963+0000","last_unstale":"2024-05-21T13:41:05.820694+0000","last_undegraded":"2024-05-21T13:41:05.820694+0000","last_fullsized":"2024-05-21T13:41:05.820694+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:16:21.586571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"27'5","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:40:50.568172+0000","last_change":"2024-05-21T13:35:56.748334+0000","last_active":"2024-05-21T13:40:50.568172+0000","last_peered":"2024-05-21T13:40:50.568172+0000","last_clean":"2024-05-21T13:40:50.568172+0000","last_became_active":"2024-05-21T13:35:56.748049+0000","last_became_peered":"2024-05-21T13:35:56.748049+0000","last_unstale":"2024-05-21T13:40:50.568172+0000","last_undegraded":"2024-05-21T13:40:50.568172+0000","last_fullsized":"2024-05-21T13:40:50.568172+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:59:02.802905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"27'327","reported_seq":348,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.408747+0000","last_change":"2024-05-21T13:36:01.856216+0000","last_active":"2024-05-21T13:41:07.408747+0000","last_peered":"2024-05-21T13:41:07.408747+0000","last_clean":"2024-05-21T13:41:07.408747+0000","last_became_active":"2024-05-21T13:36:01.855417+0000","last_became_peered":"2024-05-21T13:36:01.855417+0000","last_unstale":"2024-05-21T13:41:07.408747+0000","last_undegraded":"2024-05-21T13:41:07.408747+0000","last_fullsized":"2024-05-21T13:41:07.408747+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":327,"num_write_kb":892928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"27'273","reported_seq":294,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.420924+0000","last_change":"2024-05-21T13:36:01.838966+0000","last_active":"2024-05-21T13:41:07.420924+0000","last_peered":"2024-05-21T13:41:07.420924+0000","last_clean":"2024-05-21T13:41:07.420924+0000","last_became_active":"2024-05-21T13:36:01.837777+0000","last_became_peered":"2024-05-21T13:36:01.837777+0000","last_unstale":"2024-05-21T13:41:07.420924+0000","last_undegraded":"2024-05-21T13:41:07.420924+0000","last_fullsized":"2024-05-21T13:41:07.420924+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"27'11","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.798288+0000","last_change":"2024-05-21T13:35:57.762719+0000","last_active":"2024-05-21T13:41:05.798288+0000","last_peered":"2024-05-21T13:41:05.798288+0000","last_clean":"2024-05-21T13:41:05.798288+0000","last_became_active":"2024-05-21T13:35:57.762071+0000","last_became_peered":"2024-05-21T13:35:57.762071+0000","last_unstale":"2024-05-21T13:41:05.798288+0000","last_undegraded":"2024-05-21T13:41:05.798288+0000","last_fullsized":"2024-05-21T13:41:05.798288+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"25'1","reported_seq":28,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:38:25.556862+0000","last_change":"2024-05-21T13:35:56.751481+0000","last_active":"2024-05-21T13:38:25.556862+0000","last_peered":"2024-05-21T13:38:25.556862+0000","last_clean":"2024-05-21T13:38:25.556862+0000","last_became_active":"2024-05-21T13:35:56.751201+0000","last_became_peered":"2024-05-21T13:35:56.751201+0000","last_unstale":"2024-05-21T13:38:25.556862+0000","last_undegraded":"2024-05-21T13:38:25.556862+0000","last_fullsized":"2024-05-21T13:38:25.556862+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:33:28.720246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"27'267","reported_seq":287,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.412161+0000","last_change":"2024-05-21T13:36:01.837042+0000","last_active":"2024-05-21T13:41:07.412161+0000","last_peered":"2024-05-21T13:41:07.412161+0000","last_clean":"2024-05-21T13:41:07.412161+0000","last_became_active":"2024-05-21T13:36:01.836194+0000","last_became_peered":"2024-05-21T13:36:01.836194+0000","last_unstale":"2024-05-21T13:41:07.412161+0000","last_undegraded":"2024-05-21T13:41:07.412161+0000","last_fullsized":"2024-05-21T13:41:07.412161+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":267,"log_dups_size":0,"ondisk_log_size":267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:15:50.751693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":267,"num_write_kb":729088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"27'8","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.804092+0000","last_change":"2024-05-21T13:35:57.788838+0000","last_active":"2024-05-21T13:41:05.804092+0000","last_peered":"2024-05-21T13:41:05.804092+0000","last_clean":"2024-05-21T13:41:05.804092+0000","last_became_active":"2024-05-21T13:35:57.786307+0000","last_became_peered":"2024-05-21T13:35:57.786307+0000","last_unstale":"2024-05-21T13:41:05.804092+0000","last_undegraded":"2024-05-21T13:41:05.804092+0000","last_fullsized":"2024-05-21T13:41:05.804092+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:52:09.086807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"25'2","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:38:25.543227+0000","last_change":"2024-05-21T13:35:56.746564+0000","last_active":"2024-05-21T13:38:25.543227+0000","last_peered":"2024-05-21T13:38:25.543227+0000","last_clean":"2024-05-21T13:38:25.543227+0000","last_became_active":"2024-05-21T13:35:56.745884+0000","last_became_peered":"2024-05-21T13:35:56.745884+0000","last_unstale":"2024-05-21T13:38:25.543227+0000","last_undegraded":"2024-05-21T13:38:25.543227+0000","last_fullsized":"2024-05-21T13:38:25.543227+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:01:44.738607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"25'3","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:38:30.557677+0000","last_change":"2024-05-21T13:35:56.753930+0000","last_active":"2024-05-21T13:38:30.557677+0000","last_peered":"2024-05-21T13:38:30.557677+0000","last_clean":"2024-05-21T13:38:30.557677+0000","last_became_active":"2024-05-21T13:35:56.753499+0000","last_became_peered":"2024-05-21T13:35:56.753499+0000","last_unstale":"2024-05-21T13:38:30.557677+0000","last_undegraded":"2024-05-21T13:38:30.557677+0000","last_fullsized":"2024-05-21T13:38:30.557677+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:40:51.516544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"27'8","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.799398+0000","last_change":"2024-05-21T13:36:39.802963+0000","last_active":"2024-05-21T13:41:05.799398+0000","last_peered":"2024-05-21T13:41:05.799398+0000","last_clean":"2024-05-21T13:41:05.799398+0000","last_became_active":"2024-05-21T13:36:39.802110+0000","last_became_peered":"2024-05-21T13:36:39.802110+0000","last_unstale":"2024-05-21T13:41:05.799398+0000","last_undegraded":"2024-05-21T13:41:05.799398+0000","last_fullsized":"2024-05-21T13:41:05.799398+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"27'297","reported_seq":318,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.423046+0000","last_change":"2024-05-21T13:36:01.844240+0000","last_active":"2024-05-21T13:41:07.423046+0000","last_peered":"2024-05-21T13:41:07.423046+0000","last_clean":"2024-05-21T13:41:07.423046+0000","last_became_active":"2024-05-21T13:36:01.842792+0000","last_became_peered":"2024-05-21T13:36:01.842792+0000","last_unstale":"2024-05-21T13:41:07.423046+0000","last_undegraded":"2024-05-21T13:41:07.423046+0000","last_fullsized":"2024-05-21T13:41:07.423046+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":297,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"27'7","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:40:59.597142+0000","last_change":"2024-05-21T13:35:56.770864+0000","last_active":"2024-05-21T13:40:59.597142+0000","last_peered":"2024-05-21T13:40:59.597142+0000","last_clean":"2024-05-21T13:40:59.597142+0000","last_became_active":"2024-05-21T13:35:56.766873+0000","last_became_peered":"2024-05-21T13:35:56.766873+0000","last_unstale":"2024-05-21T13:40:59.597142+0000","last_undegraded":"2024-05-21T13:40:59.597142+0000","last_fullsized":"2024-05-21T13:40:59.597142+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:55.707568+0000","last_clean_scrub_stamp":"2024-05-21T13:35:55.707568+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:13:02.633858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"27'7","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.807437+0000","last_change":"2024-05-21T13:35:57.787563+0000","last_active":"2024-05-21T13:41:05.807437+0000","last_peered":"2024-05-21T13:41:05.807437+0000","last_clean":"2024-05-21T13:41:05.807437+0000","last_became_active":"2024-05-21T13:35:57.787255+0000","last_became_peered":"2024-05-21T13:35:57.787255+0000","last_unstale":"2024-05-21T13:41:05.807437+0000","last_undegraded":"2024-05-21T13:41:05.807437+0000","last_fullsized":"2024-05-21T13:41:05.807437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:32:49.325049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"27'312","reported_seq":332,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.373780+0000","last_change":"2024-05-21T13:36:01.868514+0000","last_active":"2024-05-21T13:41:07.373780+0000","last_peered":"2024-05-21T13:41:07.373780+0000","last_clean":"2024-05-21T13:41:07.373780+0000","last_became_active":"2024-05-21T13:36:01.867522+0000","last_became_peered":"2024-05-21T13:36:01.867522+0000","last_unstale":"2024-05-21T13:41:07.373780+0000","last_undegraded":"2024-05-21T13:41:07.373780+0000","last_fullsized":"2024-05-21T13:41:07.373780+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:19:13.533784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":312,"num_write_kb":851968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"27'9","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.809025+0000","last_change":"2024-05-21T13:35:57.782641+0000","last_active":"2024-05-21T13:41:05.809025+0000","last_peered":"2024-05-21T13:41:05.809025+0000","last_clean":"2024-05-21T13:41:05.809025+0000","last_became_active":"2024-05-21T13:35:57.782233+0000","last_became_peered":"2024-05-21T13:35:57.782233+0000","last_unstale":"2024-05-21T13:41:05.809025+0000","last_undegraded":"2024-05-21T13:41:05.809025+0000","last_fullsized":"2024-05-21T13:41:05.809025+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:55:18.808229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"27'12","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.792142+0000","last_change":"2024-05-21T13:35:57.770591+0000","last_active":"2024-05-21T13:41:05.792142+0000","last_peered":"2024-05-21T13:41:05.792142+0000","last_clean":"2024-05-21T13:41:05.792142+0000","last_became_active":"2024-05-21T13:35:57.769785+0000","last_became_peered":"2024-05-21T13:35:57.769785+0000","last_unstale":"2024-05-21T13:41:05.792142+0000","last_undegraded":"2024-05-21T13:41:05.792142+0000","last_fullsized":"2024-05-21T13:41:05.792142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:18:28.168393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"27'8","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.817815+0000","last_change":"2024-05-21T13:35:57.799153+0000","last_active":"2024-05-21T13:41:05.817815+0000","last_peered":"2024-05-21T13:41:05.817815+0000","last_clean":"2024-05-21T13:41:05.817815+0000","last_became_active":"2024-05-21T13:35:57.796495+0000","last_became_peered":"2024-05-21T13:35:57.796495+0000","last_unstale":"2024-05-21T13:41:05.817815+0000","last_undegraded":"2024-05-21T13:41:05.817815+0000","last_fullsized":"2024-05-21T13:41:05.817815+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:53:04.109036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"27'7","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.800426+0000","last_change":"2024-05-21T13:35:57.784335+0000","last_active":"2024-05-21T13:41:05.800426+0000","last_peered":"2024-05-21T13:41:05.800426+0000","last_clean":"2024-05-21T13:41:05.800426+0000","last_became_active":"2024-05-21T13:35:57.783968+0000","last_became_peered":"2024-05-21T13:35:57.783968+0000","last_unstale":"2024-05-21T13:41:05.800426+0000","last_undegraded":"2024-05-21T13:41:05.800426+0000","last_fullsized":"2024-05-21T13:41:05.800426+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:57:20.832617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"27'4","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.818581+0000","last_change":"2024-05-21T13:35:57.795153+0000","last_active":"2024-05-21T13:41:05.818581+0000","last_peered":"2024-05-21T13:41:05.818581+0000","last_clean":"2024-05-21T13:41:05.818581+0000","last_became_active":"2024-05-21T13:35:57.794885+0000","last_became_peered":"2024-05-21T13:35:57.794885+0000","last_unstale":"2024-05-21T13:41:05.818581+0000","last_undegraded":"2024-05-21T13:41:05.818581+0000","last_fullsized":"2024-05-21T13:41:05.818581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:17:00.454371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"27'6","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.789707+0000","last_change":"2024-05-21T13:35:57.778916+0000","last_active":"2024-05-21T13:41:05.789707+0000","last_peered":"2024-05-21T13:41:05.789707+0000","last_clean":"2024-05-21T13:41:05.789707+0000","last_became_active":"2024-05-21T13:35:57.778171+0000","last_became_peered":"2024-05-21T13:35:57.778171+0000","last_unstale":"2024-05-21T13:41:05.789707+0000","last_undegraded":"2024-05-21T13:41:05.789707+0000","last_fullsized":"2024-05-21T13:41:05.789707+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:15:37.425836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"27'15","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.820287+0000","last_change":"2024-05-21T13:35:57.791367+0000","last_active":"2024-05-21T13:41:05.820287+0000","last_peered":"2024-05-21T13:41:05.820287+0000","last_clean":"2024-05-21T13:41:05.820287+0000","last_became_active":"2024-05-21T13:35:57.790971+0000","last_became_peered":"2024-05-21T13:35:57.790971+0000","last_unstale":"2024-05-21T13:41:05.820287+0000","last_undegraded":"2024-05-21T13:41:05.820287+0000","last_fullsized":"2024-05-21T13:41:05.820287+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:14:47.428631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"27'2","reported_seq":27,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.810357+0000","last_change":"2024-05-21T13:35:57.785257+0000","last_active":"2024-05-21T13:41:05.810357+0000","last_peered":"2024-05-21T13:41:05.810357+0000","last_clean":"2024-05-21T13:41:05.810357+0000","last_became_active":"2024-05-21T13:35:57.781533+0000","last_became_peered":"2024-05-21T13:35:57.781533+0000","last_unstale":"2024-05-21T13:41:05.810357+0000","last_undegraded":"2024-05-21T13:41:05.810357+0000","last_fullsized":"2024-05-21T13:41:05.810357+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:18:32.591803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"27'6","reported_seq":31,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.815829+0000","last_change":"2024-05-21T13:35:57.799128+0000","last_active":"2024-05-21T13:41:05.815829+0000","last_peered":"2024-05-21T13:41:05.815829+0000","last_clean":"2024-05-21T13:41:05.815829+0000","last_became_active":"2024-05-21T13:35:57.797044+0000","last_became_peered":"2024-05-21T13:35:57.797044+0000","last_unstale":"2024-05-21T13:41:05.815829+0000","last_undegraded":"2024-05-21T13:41:05.815829+0000","last_fullsized":"2024-05-21T13:41:05.815829+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:57:13.472309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"27'8","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.810610+0000","last_change":"2024-05-21T13:35:57.789768+0000","last_active":"2024-05-21T13:41:05.810610+0000","last_peered":"2024-05-21T13:41:05.810610+0000","last_clean":"2024-05-21T13:41:05.810610+0000","last_became_active":"2024-05-21T13:35:57.789474+0000","last_became_peered":"2024-05-21T13:35:57.789474+0000","last_unstale":"2024-05-21T13:41:05.810610+0000","last_undegraded":"2024-05-21T13:41:05.810610+0000","last_fullsized":"2024-05-21T13:41:05.810610+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:42:53.993281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"27'10","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.817266+0000","last_change":"2024-05-21T13:35:57.756607+0000","last_active":"2024-05-21T13:41:05.817266+0000","last_peered":"2024-05-21T13:41:05.817266+0000","last_clean":"2024-05-21T13:41:05.817266+0000","last_became_active":"2024-05-21T13:35:57.755889+0000","last_became_peered":"2024-05-21T13:35:57.755889+0000","last_unstale":"2024-05-21T13:41:05.817266+0000","last_undegraded":"2024-05-21T13:41:05.817266+0000","last_fullsized":"2024-05-21T13:41:05.817266+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:16:19.541597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"27'11","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:17.717050+0000","last_change":"2024-05-21T13:41:17.717113+0000","last_active":"2024-05-21T13:41:17.717050+0000","last_peered":"2024-05-21T13:41:17.717050+0000","last_clean":"2024-05-21T13:41:17.717050+0000","last_became_active":"2024-05-21T13:35:57.774386+0000","last_became_peered":"2024-05-21T13:35:57.774386+0000","last_unstale":"2024-05-21T13:41:17.717050+0000","last_undegraded":"2024-05-21T13:41:17.717050+0000","last_fullsized":"2024-05-21T13:41:17.717050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'11","last_scrub_stamp":"2024-05-21T13:41:17.716879+0000","last_deep_scrub":"27'11","last_deep_scrub_stamp":"2024-05-21T13:41:17.716879+0000","last_clean_scrub_stamp":"2024-05-21T13:41:17.716879+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:34:15.346123+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"27'8","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.831140+0000","last_change":"2024-05-21T13:35:57.769931+0000","last_active":"2024-05-21T13:41:05.831140+0000","last_peered":"2024-05-21T13:41:05.831140+0000","last_clean":"2024-05-21T13:41:05.831140+0000","last_became_active":"2024-05-21T13:35:57.769149+0000","last_became_peered":"2024-05-21T13:35:57.769149+0000","last_unstale":"2024-05-21T13:41:05.831140+0000","last_undegraded":"2024-05-21T13:41:05.831140+0000","last_fullsized":"2024-05-21T13:41:05.831140+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"27'7","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.824572+0000","last_change":"2024-05-21T13:35:57.796153+0000","last_active":"2024-05-21T13:41:05.824572+0000","last_peered":"2024-05-21T13:41:05.824572+0000","last_clean":"2024-05-21T13:41:05.824572+0000","last_became_active":"2024-05-21T13:35:57.795799+0000","last_became_peered":"2024-05-21T13:35:57.795799+0000","last_unstale":"2024-05-21T13:41:05.824572+0000","last_undegraded":"2024-05-21T13:41:05.824572+0000","last_fullsized":"2024-05-21T13:41:05.824572+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:52:04.794391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"27'10","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.796637+0000","last_change":"2024-05-21T13:35:57.776414+0000","last_active":"2024-05-21T13:41:05.796637+0000","last_peered":"2024-05-21T13:41:05.796637+0000","last_clean":"2024-05-21T13:41:05.796637+0000","last_became_active":"2024-05-21T13:35:57.775573+0000","last_became_peered":"2024-05-21T13:35:57.775573+0000","last_unstale":"2024-05-21T13:41:05.796637+0000","last_undegraded":"2024-05-21T13:41:05.796637+0000","last_fullsized":"2024-05-21T13:41:05.796637+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:47:47.624662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"27'8","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.823028+0000","last_change":"2024-05-21T13:35:57.799673+0000","last_active":"2024-05-21T13:41:05.823028+0000","last_peered":"2024-05-21T13:41:05.823028+0000","last_clean":"2024-05-21T13:41:05.823028+0000","last_became_active":"2024-05-21T13:35:57.799313+0000","last_became_peered":"2024-05-21T13:35:57.799313+0000","last_unstale":"2024-05-21T13:41:05.823028+0000","last_undegraded":"2024-05-21T13:41:05.823028+0000","last_fullsized":"2024-05-21T13:41:05.823028+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:40:52.516216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"27'9","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.815899+0000","last_change":"2024-05-21T13:35:57.790705+0000","last_active":"2024-05-21T13:41:05.815899+0000","last_peered":"2024-05-21T13:41:05.815899+0000","last_clean":"2024-05-21T13:41:05.815899+0000","last_became_active":"2024-05-21T13:35:57.787735+0000","last_became_peered":"2024-05-21T13:35:57.787735+0000","last_unstale":"2024-05-21T13:41:05.815899+0000","last_undegraded":"2024-05-21T13:41:05.815899+0000","last_fullsized":"2024-05-21T13:41:05.815899+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:17:24.376182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"27'7","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.825286+0000","last_change":"2024-05-21T13:35:57.786838+0000","last_active":"2024-05-21T13:41:05.825286+0000","last_peered":"2024-05-21T13:41:05.825286+0000","last_clean":"2024-05-21T13:41:05.825286+0000","last_became_active":"2024-05-21T13:35:57.786403+0000","last_became_peered":"2024-05-21T13:35:57.786403+0000","last_unstale":"2024-05-21T13:41:05.825286+0000","last_undegraded":"2024-05-21T13:41:05.825286+0000","last_fullsized":"2024-05-21T13:41:05.825286+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:29:28.760793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"27'8","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.791110+0000","last_change":"2024-05-21T13:35:57.783561+0000","last_active":"2024-05-21T13:41:05.791110+0000","last_peered":"2024-05-21T13:41:05.791110+0000","last_clean":"2024-05-21T13:41:05.791110+0000","last_became_active":"2024-05-21T13:35:57.783060+0000","last_became_peered":"2024-05-21T13:35:57.783060+0000","last_unstale":"2024-05-21T13:41:05.791110+0000","last_undegraded":"2024-05-21T13:41:05.791110+0000","last_fullsized":"2024-05-21T13:41:05.791110+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:27:27.261449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"27'10","reported_seq":35,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.817817+0000","last_change":"2024-05-21T13:35:57.788210+0000","last_active":"2024-05-21T13:41:05.817817+0000","last_peered":"2024-05-21T13:41:05.817817+0000","last_clean":"2024-05-21T13:41:05.817817+0000","last_became_active":"2024-05-21T13:35:57.787508+0000","last_became_peered":"2024-05-21T13:35:57.787508+0000","last_unstale":"2024-05-21T13:41:05.817817+0000","last_undegraded":"2024-05-21T13:41:05.817817+0000","last_fullsized":"2024-05-21T13:41:05.817817+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:12:56.914580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"27'7","reported_seq":33,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.829623+0000","last_change":"2024-05-21T13:35:57.787335+0000","last_active":"2024-05-21T13:41:05.829623+0000","last_peered":"2024-05-21T13:41:05.829623+0000","last_clean":"2024-05-21T13:41:05.829623+0000","last_became_active":"2024-05-21T13:35:57.786292+0000","last_became_peered":"2024-05-21T13:35:57.786292+0000","last_unstale":"2024-05-21T13:41:05.829623+0000","last_undegraded":"2024-05-21T13:41:05.829623+0000","last_fullsized":"2024-05-21T13:41:05.829623+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"27'6","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.830878+0000","last_change":"2024-05-21T13:35:57.801121+0000","last_active":"2024-05-21T13:41:05.830878+0000","last_peered":"2024-05-21T13:41:05.830878+0000","last_clean":"2024-05-21T13:41:05.830878+0000","last_became_active":"2024-05-21T13:35:57.800858+0000","last_became_peered":"2024-05-21T13:35:57.800858+0000","last_unstale":"2024-05-21T13:41:05.830878+0000","last_undegraded":"2024-05-21T13:41:05.830878+0000","last_fullsized":"2024-05-21T13:41:05.830878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"27'16","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.828713+0000","last_change":"2024-05-21T13:35:57.778753+0000","last_active":"2024-05-21T13:41:05.828713+0000","last_peered":"2024-05-21T13:41:05.828713+0000","last_clean":"2024-05-21T13:41:05.828713+0000","last_became_active":"2024-05-21T13:35:57.777962+0000","last_became_peered":"2024-05-21T13:35:57.777962+0000","last_unstale":"2024-05-21T13:41:05.828713+0000","last_undegraded":"2024-05-21T13:41:05.828713+0000","last_fullsized":"2024-05-21T13:41:05.828713+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"27'11","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.819045+0000","last_change":"2024-05-21T13:35:57.798312+0000","last_active":"2024-05-21T13:41:05.819045+0000","last_peered":"2024-05-21T13:41:05.819045+0000","last_clean":"2024-05-21T13:41:05.819045+0000","last_became_active":"2024-05-21T13:35:57.797793+0000","last_became_peered":"2024-05-21T13:35:57.797793+0000","last_unstale":"2024-05-21T13:41:05.819045+0000","last_undegraded":"2024-05-21T13:41:05.819045+0000","last_fullsized":"2024-05-21T13:41:05.819045+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:28:47.276868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"27'9","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.825487+0000","last_change":"2024-05-21T13:35:57.782412+0000","last_active":"2024-05-21T13:41:05.825487+0000","last_peered":"2024-05-21T13:41:05.825487+0000","last_clean":"2024-05-21T13:41:05.825487+0000","last_became_active":"2024-05-21T13:35:57.782058+0000","last_became_peered":"2024-05-21T13:35:57.782058+0000","last_unstale":"2024-05-21T13:41:05.825487+0000","last_undegraded":"2024-05-21T13:41:05.825487+0000","last_fullsized":"2024-05-21T13:41:05.825487+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:39:49.142554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"27'5","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:15.455032+0000","last_change":"2024-05-21T13:41:15.455065+0000","last_active":"2024-05-21T13:41:15.455032+0000","last_peered":"2024-05-21T13:41:15.455032+0000","last_clean":"2024-05-21T13:41:15.455032+0000","last_became_active":"2024-05-21T13:35:57.779168+0000","last_became_peered":"2024-05-21T13:35:57.779168+0000","last_unstale":"2024-05-21T13:41:15.455032+0000","last_undegraded":"2024-05-21T13:41:15.455032+0000","last_fullsized":"2024-05-21T13:41:15.455032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-05-21T13:41:15.454935+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-05-21T13:41:15.454935+0000","last_clean_scrub_stamp":"2024-05-21T13:41:15.454935+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:10:30.165895+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"27'6","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.806310+0000","last_change":"2024-05-21T13:35:57.773098+0000","last_active":"2024-05-21T13:41:05.806310+0000","last_peered":"2024-05-21T13:41:05.806310+0000","last_clean":"2024-05-21T13:41:05.806310+0000","last_became_active":"2024-05-21T13:35:57.772268+0000","last_became_peered":"2024-05-21T13:35:57.772268+0000","last_unstale":"2024-05-21T13:41:05.806310+0000","last_undegraded":"2024-05-21T13:41:05.806310+0000","last_fullsized":"2024-05-21T13:41:05.806310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:05:25.482434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"27'4","reported_seq":30,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.829528+0000","last_change":"2024-05-21T13:35:57.788980+0000","last_active":"2024-05-21T13:41:05.829528+0000","last_peered":"2024-05-21T13:41:05.829528+0000","last_clean":"2024-05-21T13:41:05.829528+0000","last_became_active":"2024-05-21T13:35:57.788689+0000","last_became_peered":"2024-05-21T13:35:57.788689+0000","last_unstale":"2024-05-21T13:41:05.829528+0000","last_undegraded":"2024-05-21T13:41:05.829528+0000","last_fullsized":"2024-05-21T13:41:05.829528+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"27'8","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.809482+0000","last_change":"2024-05-21T13:35:57.772867+0000","last_active":"2024-05-21T13:41:05.809482+0000","last_peered":"2024-05-21T13:41:05.809482+0000","last_clean":"2024-05-21T13:41:05.809482+0000","last_became_active":"2024-05-21T13:35:57.772160+0000","last_became_peered":"2024-05-21T13:35:57.772160+0000","last_unstale":"2024-05-21T13:41:05.809482+0000","last_undegraded":"2024-05-21T13:41:05.809482+0000","last_fullsized":"2024-05-21T13:41:05.809482+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:11:24.428796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"27'7","reported_seq":32,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.805509+0000","last_change":"2024-05-21T13:35:57.785297+0000","last_active":"2024-05-21T13:41:05.805509+0000","last_peered":"2024-05-21T13:41:05.805509+0000","last_clean":"2024-05-21T13:41:05.805509+0000","last_became_active":"2024-05-21T13:35:57.784741+0000","last_became_peered":"2024-05-21T13:35:57.784741+0000","last_unstale":"2024-05-21T13:41:05.805509+0000","last_undegraded":"2024-05-21T13:41:05.805509+0000","last_fullsized":"2024-05-21T13:41:05.805509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:45:08.507286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"27'4","reported_seq":29,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.800168+0000","last_change":"2024-05-21T13:35:57.788875+0000","last_active":"2024-05-21T13:41:05.800168+0000","last_peered":"2024-05-21T13:41:05.800168+0000","last_clean":"2024-05-21T13:41:05.800168+0000","last_became_active":"2024-05-21T13:35:57.786629+0000","last_became_peered":"2024-05-21T13:35:57.786629+0000","last_unstale":"2024-05-21T13:41:05.800168+0000","last_undegraded":"2024-05-21T13:41:05.800168+0000","last_fullsized":"2024-05-21T13:41:05.800168+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:40:07.549210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"27'8","reported_seq":34,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.829139+0000","last_change":"2024-05-21T13:35:57.803316+0000","last_active":"2024-05-21T13:41:05.829139+0000","last_peered":"2024-05-21T13:41:05.829139+0000","last_clean":"2024-05-21T13:41:05.829139+0000","last_became_active":"2024-05-21T13:35:57.802925+0000","last_became_peered":"2024-05-21T13:35:57.802925+0000","last_unstale":"2024-05-21T13:41:05.829139+0000","last_undegraded":"2024-05-21T13:41:05.829139+0000","last_fullsized":"2024-05-21T13:41:05.829139+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9217,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9218,"ondisk_log_size":9218,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":503,"ondisk_log_size":503,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":214596,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":271,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":589824,"data_stored":429192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":241,"ondisk_log_size":241,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66916,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509510,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49528,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94322312,"statfs":{"total":96636764160,"available":96586047488,"internally_reserved":0,"allocated":311296,"data_stored":116594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509510,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45352,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326488,"statfs":{"total":96636764160,"available":96590323712,"internally_reserved":0,"allocated":294912,"data_stored":116943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":46135750},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509509,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53676,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94318164,"statfs":{"total":96636764160,"available":96581799936,"internally_reserved":0,"allocated":299008,"data_stored":116383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509510,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27512,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":507904,"data_stored":325066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509510,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57892,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313948,"statfs":{"total":96636764160,"available":96577482752,"internally_reserved":0,"allocated":356352,"data_stored":705685,"data_compressed":33458,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509509,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39792,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94332048,"statfs":{"total":96636764160,"available":96596017152,"internally_reserved":0,"allocated":303104,"data_stored":116473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542212,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45428,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326412,"statfs":{"total":96636764160,"available":96590245888,"internally_reserved":0,"allocated":372736,"data_stored":707440,"data_compressed":33458,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574917,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45588,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326252,"statfs":{"total":96636764160,"available":96590082048,"internally_reserved":0,"allocated":536576,"data_stored":326600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33458,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33458,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":225280,"data_stored":209909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":253952,"data_stored":211443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-21T13:41:19.144 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2024-05-21T13:35:55.707568+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=55, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.144 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-05-21T13:35:56.710999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=56, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.144 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-05-21T13:36:00.780258+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=36, tm_sec=0, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.144 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-05-21T13:35:55.707568+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=55, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.144 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-05-21T13:35:56.710999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=56, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.145 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-05-21T13:36:00.780258+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=36, tm_sec=0, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.145 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-05-21T13:35:55.707568+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=55, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.145 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-05-21T13:35:56.710999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=56, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.145 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-05-21T13:36:00.780258+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=36, tm_sec=0, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.145 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-05-21T13:35:55.707568+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=55, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.145 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-05-21T13:35:56.710999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=56, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.145 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-05-21T13:36:00.780258+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=36, tm_sec=0, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.145 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-05-21T13:35:56.710999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=56, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.145 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-05-21T13:35:55.707568+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=55, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.146 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-05-21T13:36:00.780258+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=36, tm_sec=0, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.146 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-05-21T13:35:56.710999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=56, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.146 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-05-21T13:35:55.707568+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=55, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.146 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-05-21T13:36:00.780258+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=36, tm_sec=0, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.146 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-05-21T13:35:56.710999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=56, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.146 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-05-21T13:35:55.707568+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=55, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.146 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-05-21T13:36:00.780258+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=36, tm_sec=0, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.146 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-05-21T13:35:56.710999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=56, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.146 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-05-21T13:35:55.707568+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=55, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.147 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-05-21T13:36:00.780258+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=36, tm_sec=0, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.147 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-05-21T13:35:56.710999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=56, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.147 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-05-21T13:35:55.707568+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=55, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.147 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-05-21T13:36:00.780258+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=36, tm_sec=0, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.147 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-05-21T13:35:56.710999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=56, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.147 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-05-21T13:35:55.707568+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=55, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.147 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-05-21T13:36:00.780258+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=36, tm_sec=0, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.147 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-05-21T13:35:56.710999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=56, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.147 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-05-21T13:35:55.707568+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=55, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.148 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-05-21T13:36:00.780258+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=36, tm_sec=0, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.148 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-05-21T13:35:56.710999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=56, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.148 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-05-21T13:35:55.707568+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=55, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.148 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-05-21T13:36:00.780258+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=36, tm_sec=0, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.148 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-05-21T13:35:56.710999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=56, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.148 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-05-21T13:35:55.707568+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=55, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.148 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-05-21T13:36:00.780258+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=36, tm_sec=0, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.148 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-05-21T13:35:56.710999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=56, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.149 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-05-21T13:35:55.707568+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=55, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.149 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-05-21T13:36:00.780258+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=36, tm_sec=0, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.149 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-05-21T13:35:56.710999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=56, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.149 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-05-21T13:35:55.707568+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=55, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.149 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-05-21T13:36:00.780258+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=36, tm_sec=0, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.149 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-05-21T13:35:56.710999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=56, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.149 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-05-21T13:35:55.707568+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=55, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.149 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-05-21T13:35:44.542324+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=44, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.150 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-05-21T13:36:00.780258+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=36, tm_sec=0, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.150 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-05-21T13:35:56.710999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=56, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.150 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-05-21T13:35:55.707568+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=55, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.150 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-05-21T13:36:00.780258+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=36, tm_sec=0, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.150 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-05-21T13:35:56.710999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=56, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.150 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-05-21T13:35:55.707568+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=55, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.150 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-05-21T13:36:00.780258+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=36, tm_sec=0, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.150 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-05-21T13:35:56.710999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=56, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.150 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-05-21T13:35:55.707568+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=55, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.151 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-05-21T13:36:00.780258+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=36, tm_sec=0, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.151 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-05-21T13:35:56.710999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=56, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.151 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-05-21T13:35:55.707568+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=55, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.151 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-05-21T13:36:00.780258+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=36, tm_sec=0, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.151 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-05-21T13:35:56.710999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=56, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.151 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-05-21T13:35:55.707568+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=55, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.151 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-05-21T13:36:00.780258+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=36, tm_sec=0, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.151 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-05-21T13:35:56.710999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=56, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.151 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-05-21T13:35:55.707568+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=55, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.152 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-05-21T13:36:00.780258+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=36, tm_sec=0, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.152 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-05-21T13:35:56.710999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=56, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.152 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-05-21T13:35:55.707568+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=55, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.152 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-05-21T13:36:00.780258+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=36, tm_sec=0, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.152 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-05-21T13:35:56.710999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=56, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.152 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2024-05-21T13:35:55.707568+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=55, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.152 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-05-21T13:36:00.780258+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=36, tm_sec=0, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.152 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-05-21T13:35:56.710999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=56, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.152 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-05-21T13:35:55.707568+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=55, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.153 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-05-21T13:36:00.780258+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=36, tm_sec=0, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.153 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-05-21T13:35:56.710999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=56, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.153 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-05-21T13:35:55.707568+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=55, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.153 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-05-21T13:36:00.780258+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=36, tm_sec=0, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.153 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-05-21T13:35:56.710999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=56, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.153 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-05-21T13:35:55.707568+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=55, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.153 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-05-21T13:36:00.780258+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=36, tm_sec=0, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.153 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-05-21T13:35:56.710999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=56, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.153 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-05-21T13:35:55.707568+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=55, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.153 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-05-21T13:36:00.780258+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=36, tm_sec=0, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.154 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-05-21T13:36:00.780258+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=36, tm_sec=0, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.154 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-05-21T13:35:56.710999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=56, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.154 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-05-21T13:35:55.707568+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=55, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.154 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-05-21T13:36:00.780258+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=36, tm_sec=0, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.154 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-05-21T13:35:56.710999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=56, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.154 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-05-21T13:35:55.707568+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=55, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.154 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-05-21T13:35:55.707568+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=55, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.154 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-05-21T13:35:56.710999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=56, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.154 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-05-21T13:36:00.780258+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=36, tm_sec=0, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.155 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-05-21T13:35:55.707568+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=55, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.155 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-05-21T13:35:56.710999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=56, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.155 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-05-21T13:36:00.780258+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=36, tm_sec=0, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.155 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-05-21T13:35:56.710999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=56, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.155 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-05-21T13:35:56.710999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=56, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.155 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-05-21T13:35:56.710999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=56, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.155 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-05-21T13:35:56.710999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=56, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.155 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-05-21T13:35:56.710999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=56, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.155 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-05-21T13:35:56.710999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=56, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.155 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-05-21T13:35:56.710999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=56, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.156 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-05-21T13:35:56.710999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=56, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.156 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-05-21T13:35:56.710999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=56, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.156 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-05-21T13:35:56.710999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=56, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.156 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-05-21T13:35:56.710999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=56, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.156 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-05-21T13:35:56.710999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=56, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.156 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-05-21T13:35:56.710999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=56, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.156 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-05-21T13:35:56.710999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=56, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.156 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-05-21T13:35:56.710999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=56, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.156 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-05-21T13:35:56.710999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=56, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.157 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-05-21T13:35:56.710999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=56, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.157 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-05-21T13:35:56.710999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=56, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.157 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-05-21T13:35:56.710999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=56, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.157 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-05-21T13:35:56.710999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=56, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.157 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-05-21T13:35:56.710999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=56, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.157 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-05-21T13:35:56.710999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=56, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.157 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-05-21T13:35:56.710999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=56, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.157 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-05-21T13:35:56.710999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=56, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.157 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-05-21T13:35:56.710999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=56, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.157 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-05-21T13:35:56.710999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=56, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.158 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-05-21T13:35:56.710999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=56, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.158 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-05-21T13:35:56.710999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=56, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.158 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-05-21T13:35:56.710999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=56, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.158 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-05-21T13:35:56.710999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=56, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:19.158 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-21T13:41:30.587 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-21T13:41:30.589 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-21T13:41:39.158 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-21T13:41:39.293 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:39.318+0000 7fb6b7b17640 1 Processor -- start 2024-05-21T13:41:39.293 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:39.318+0000 7fb6b7b17640 1 -- start start 2024-05-21T13:41:39.295 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:39.318+0000 7fb6b7b17640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb6b0155d80 0x7fb6b015b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:39.295 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:39.318+0000 7fb6b7b17640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb6b015bf30 0x7fb6b00ce510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:39.295 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:39.318+0000 7fb6b7b17640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6b0156160 con 0x7fb6b00cea50 2024-05-21T13:41:39.295 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:39.318+0000 7fb6b7b17640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7fb6b00ccfc0 con 0x7fb6b0155d80 2024-05-21T13:41:39.295 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:39.318+0000 7fb6b7b17640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7fb6b00c6560 con 0x7fb6b015bf30 2024-05-21T13:41:39.295 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:39.318+0000 7fb6b58b3640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7fb6b0155d80 0x7fb6b015b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:39.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:39.318+0000 7fb6b60b4640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7fb6b00cea50 0x7fb6b00d1420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:45914/0 (socket says 172.21.15.22:45914) 2024-05-21T13:41:39.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:39.318+0000 7fb6b60b4640 1 -- 172.21.15.22:0/2015466134 learned_addr learned my addr 172.21.15.22:0/2015466134 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-21T13:41:39.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:39.318+0000 7fb6b50b2640 1 --2- 172.21.15.22:0/2015466134 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb6b015bf30 0x7fb6b00ce510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:39.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:39.318+0000 7fb6b58b3640 1 -- 172.21.15.22:0/2015466134 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb6b015bf30 msgr2=0x7fb6b00ce510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:41:39.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:39.318+0000 7fb6b58b3640 1 --2- 172.21.15.22:0/2015466134 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb6b015bf30 0x7fb6b00ce510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:39.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:39.318+0000 7fb6b58b3640 1 -- 172.21.15.22:0/2015466134 >> v1:172.21.15.22:6789/0 conn(0x7fb6b00cea50 legacy=0x7fb6b00d1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:39.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:39.318+0000 7fb6b48b1640 1 -- 172.21.15.22:0/2015466134 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 10079235 0 0) 0x7fb6b0156160 con 0x7fb6b00cea50 2024-05-21T13:41:39.296 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:39.318+0000 7fb6b58b3640 1 -- 172.21.15.22:0/2015466134 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6b015c4a0 con 0x7fb6b0155d80 2024-05-21T13:41:39.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:39.322+0000 7fb6b58b3640 1 --2- 172.21.15.22:0/2015466134 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6b0155d80 0x7fb6b015b9f0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fb6a8009d90 tx=0x7fb6a801c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef3b1c8766b35d32 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:39.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:39.322+0000 7fb6b48b1640 1 -- 172.21.15.22:0/2015466134 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6a80b2070 con 0x7fb6b0155d80 2024-05-21T13:41:39.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:39.322+0000 7fb6b48b1640 1 -- 172.21.15.22:0/2015466134 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6a80a5970 con 0x7fb6b0155d80 2024-05-21T13:41:39.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:39.322+0000 7fb6b48b1640 1 -- 172.21.15.22:0/2015466134 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6a80a5d40 con 0x7fb6b0155d80 2024-05-21T13:41:39.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:39.322+0000 7fb6b7b17640 1 -- 172.21.15.22:0/2015466134 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6b0155d80 msgr2=0x7fb6b015b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:39.298 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:39.322+0000 7fb6b7b17640 1 --2- 172.21.15.22:0/2015466134 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6b0155d80 0x7fb6b015b9f0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fb6a8009d90 tx=0x7fb6a801c8b0 comp rx=0 tx=0).stop 2024-05-21T13:41:39.299 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:39.322+0000 7fb6b7b17640 1 -- 172.21.15.22:0/2015466134 shutdown_connections 2024-05-21T13:41:39.299 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:39.322+0000 7fb6b7b17640 1 --2- 172.21.15.22:0/2015466134 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb6b015bf30 0x7fb6b00ce510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:39.299 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:39.322+0000 7fb6b7b17640 1 --2- 172.21.15.22:0/2015466134 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6b0155d80 0x7fb6b015b9f0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:39.299 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:39.322+0000 7fb6b7b17640 1 -- 172.21.15.22:0/2015466134 >> 172.21.15.22:0/2015466134 conn(0x7fb6b006f3b0 msgr2=0x7fb6b006d430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:41:39.299 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:39.322+0000 7fb6b7b17640 1 -- 172.21.15.22:0/2015466134 shutdown_connections 2024-05-21T13:41:39.299 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:39.322+0000 7fb6b7b17640 1 -- 172.21.15.22:0/2015466134 wait complete. 2024-05-21T13:41:39.299 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:39.322+0000 7fb6b7b17640 1 Processor -- start 2024-05-21T13:41:39.300 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:39.322+0000 7fb6b7b17640 1 -- start start 2024-05-21T13:41:39.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:39.326+0000 7fb6b7b17640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb6b00cea50 0x7fb6b00b5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:39.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:39.326+0000 7fb6b7b17640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb6b015bf30 0x7fb6b00b5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:39.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:39.326+0000 7fb6b7b17640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6b015cb90 0x7fb6b014a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:39.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:39.326+0000 7fb6b7b17640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fb6b00d1b30 con 0x7fb6b015cb90 2024-05-21T13:41:39.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:39.326+0000 7fb6b7b17640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fb6b00cdff0 con 0x7fb6b00cea50 2024-05-21T13:41:39.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:39.326+0000 7fb6b7b17640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7fb6b00d1cb0 con 0x7fb6b015bf30 2024-05-21T13:41:39.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:39.326+0000 7fb6b60b4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6b015cb90 0x7fb6b014a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:39.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:39.326+0000 7fb6b60b4640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6b015cb90 0x7fb6b014a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:54336/0 (socket says 172.21.15.22:54336) 2024-05-21T13:41:39.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:39.326+0000 7fb6b60b4640 1 -- 172.21.15.22:0/2095457645 learned_addr learned my addr 172.21.15.22:0/2095457645 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:41:39.302 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:39.326+0000 7fb6b58b3640 1 --2- 172.21.15.22:0/2095457645 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb6b00cea50 0x7fb6b00b5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:39.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:39.326+0000 7fb6b50b2640 1 --2- 172.21.15.22:0/2095457645 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb6b015bf30 0x7fb6b00b5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:39.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:39.326+0000 7fb6b60b4640 1 -- 172.21.15.22:0/2095457645 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb6b015bf30 msgr2=0x7fb6b00b5840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:39.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:39.326+0000 7fb6b60b4640 1 --2- 172.21.15.22:0/2095457645 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb6b015bf30 0x7fb6b00b5840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:39.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:39.326+0000 7fb6b60b4640 1 -- 172.21.15.22:0/2095457645 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb6b00cea50 msgr2=0x7fb6b00b5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:39.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:39.326+0000 7fb6b60b4640 1 --2- 172.21.15.22:0/2095457645 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb6b00cea50 0x7fb6b00b5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:39.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:39.326+0000 7fb6b60b4640 1 -- 172.21.15.22:0/2095457645 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6b015d430 con 0x7fb6b015cb90 2024-05-21T13:41:39.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:39.326+0000 7fb6b50b2640 1 --2- 172.21.15.22:0/2095457645 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb6b015bf30 0x7fb6b00b5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:41:39.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:39.326+0000 7fb6b60b4640 1 --2- 172.21.15.22:0/2095457645 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6b015cb90 0x7fb6b014a7b0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fb6a000c3d0 tx=0x7fb6a000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:39.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:39.326+0000 7fb6ae7fc640 1 -- 172.21.15.22:0/2095457645 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6a0017070 con 0x7fb6b015cb90 2024-05-21T13:41:39.303 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:39.326+0000 7fb6ae7fc640 1 -- 172.21.15.22:0/2095457645 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6a0005cf0 con 0x7fb6b015cb90 2024-05-21T13:41:39.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:39.326+0000 7fb6b7b17640 1 -- 172.21.15.22:0/2095457645 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6b015d6d0 con 0x7fb6b015cb90 2024-05-21T13:41:39.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:39.326+0000 7fb6ae7fc640 1 -- 172.21.15.22:0/2095457645 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6a0007310 con 0x7fb6b015cb90 2024-05-21T13:41:39.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:39.326+0000 7fb6b7b17640 1 -- 172.21.15.22:0/2095457645 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6b015dc90 con 0x7fb6b015cb90 2024-05-21T13:41:39.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:39.326+0000 7fb6b7b17640 1 -- 172.21.15.22:0/2095457645 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6b015e470 con 0x7fb6b015cb90 2024-05-21T13:41:39.304 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:39.326+0000 7fb6ae7fc640 1 -- 172.21.15.22:0/2095457645 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fb6a001a070 con 0x7fb6b015cb90 2024-05-21T13:41:39.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:39.326+0000 7fb6ae7fc640 1 --2- 172.21.15.22:0/2095457645 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fb69c06f430 0x7fb69c0718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:39.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:39.326+0000 7fb6ae7fc640 1 -- 172.21.15.22:0/2095457645 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7fb6a008e980 con 0x7fb6b015cb90 2024-05-21T13:41:39.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:39.326+0000 7fb6b58b3640 1 --2- 172.21.15.22:0/2095457645 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fb69c06f430 0x7fb69c0718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:39.305 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:39.330+0000 7fb6b58b3640 1 --2- 172.21.15.22:0/2095457645 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fb69c06f430 0x7fb69c0718f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb6a80af000 tx=0x7fb6a80a7070 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:39.308 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:39.330+0000 7fb6ae7fc640 1 -- 172.21.15.22:0/2095457645 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fb6a005b500 con 0x7fb6b015cb90 2024-05-21T13:41:39.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:39.494+0000 7fb6b7b17640 1 -- 172.21.15.22:0/2095457645 --> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb6b0077bb0 con 0x7fb69c06f430 2024-05-21T13:41:39.494 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:39.518+0000 7fb6ae7fc640 1 -- 172.21.15.22:0/2095457645 <== mgr.4103 v2:172.21.15.115:6832/184591771 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+333343 (secure 0 0 0) 0x7fb6b0077bb0 con 0x7fb69c06f430 2024-05-21T13:41:39.498 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-21T13:41:39.500 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-05-21T13:41:39.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:39.522+0000 7fb6b7b17640 1 -- 172.21.15.22:0/2095457645 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fb69c06f430 msgr2=0x7fb69c0718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:39.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:39.522+0000 7fb6b7b17640 1 --2- 172.21.15.22:0/2095457645 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fb69c06f430 0x7fb69c0718f0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb6a80af000 tx=0x7fb6a80a7070 comp rx=0 tx=0).stop 2024-05-21T13:41:39.501 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:39.522+0000 7fb6b7b17640 1 -- 172.21.15.22:0/2095457645 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6b015cb90 msgr2=0x7fb6b014a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:39.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:39.522+0000 7fb6b7b17640 1 --2- 172.21.15.22:0/2095457645 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6b015cb90 0x7fb6b014a7b0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7fb6a000c3d0 tx=0x7fb6a000c890 comp rx=0 tx=0).stop 2024-05-21T13:41:39.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:39.522+0000 7fb6b7b17640 1 -- 172.21.15.22:0/2095457645 shutdown_connections 2024-05-21T13:41:39.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:39.522+0000 7fb6b7b17640 1 --2- 172.21.15.22:0/2095457645 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fb69c06f430 0x7fb69c0718f0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:39.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:39.522+0000 7fb6b7b17640 1 --2- 172.21.15.22:0/2095457645 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fb6b015cb90 0x7fb6b014a7b0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:39.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:39.522+0000 7fb6b7b17640 1 --2- 172.21.15.22:0/2095457645 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fb6b015bf30 0x7fb6b00b5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:39.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:39.522+0000 7fb6b7b17640 1 --2- 172.21.15.22:0/2095457645 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fb6b00cea50 0x7fb6b00b5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:39.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:39.522+0000 7fb6b7b17640 1 -- 172.21.15.22:0/2095457645 >> 172.21.15.22:0/2095457645 conn(0x7fb6b006f3b0 msgr2=0x7fb6b006d430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:41:39.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:39.522+0000 7fb6b7b17640 1 -- 172.21.15.22:0/2095457645 shutdown_connections 2024-05-21T13:41:39.502 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:39.522+0000 7fb6b7b17640 1 -- 172.21.15.22:0/2095457645 wait complete. 2024-05-21T13:41:39.522 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":198,"stamp":"2024-05-21T13:41:38.635905+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":804964,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":70,"num_read_kb":59,"num_write":9589,"num_write_kb":25167758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15000,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10089,"ondisk_log_size":10089,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":368928,"kb_used_data":2912,"kb_used_omap":12,"kb_used_meta":365939,"kb_avail":754605792,"statfs":{"total":773094113280,"available":772716331008,"internally_reserved":0,"allocated":2981888,"data_stored":2531184,"data_compressed":66916,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":374722096},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004780"},"pg_stats":[{"pgid":"2.1f","version":"27'13","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:19.772416+0000","last_change":"2024-05-21T13:41:19.772551+0000","last_active":"2024-05-21T13:41:19.772416+0000","last_peered":"2024-05-21T13:41:19.772416+0000","last_clean":"2024-05-21T13:41:19.772416+0000","last_became_active":"2024-05-21T13:35:56.738481+0000","last_became_peered":"2024-05-21T13:35:56.738481+0000","last_unstale":"2024-05-21T13:41:19.772416+0000","last_undegraded":"2024-05-21T13:41:19.772416+0000","last_fullsized":"2024-05-21T13:41:19.772416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'13","last_scrub_stamp":"2024-05-21T13:41:19.772153+0000","last_deep_scrub":"27'13","last_deep_scrub_stamp":"2024-05-21T13:41:19.772153+0000","last_clean_scrub_stamp":"2024-05-21T13:41:19.772153+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:20:53.783478+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"27'5","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:25.913722+0000","last_change":"2024-05-21T13:41:25.913781+0000","last_active":"2024-05-21T13:41:25.913722+0000","last_peered":"2024-05-21T13:41:25.913722+0000","last_clean":"2024-05-21T13:41:25.913722+0000","last_became_active":"2024-05-21T13:35:57.778721+0000","last_became_peered":"2024-05-21T13:35:57.778721+0000","last_unstale":"2024-05-21T13:41:25.913722+0000","last_undegraded":"2024-05-21T13:41:25.913722+0000","last_fullsized":"2024-05-21T13:41:25.913722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-05-21T13:41:25.913538+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-05-21T13:41:25.913538+0000","last_clean_scrub_stamp":"2024-05-21T13:41:25.913538+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:13:31.570624+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"27'306","reported_seq":329,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:33.514154+0000","last_change":"2024-05-21T13:41:33.514276+0000","last_active":"2024-05-21T13:41:33.514154+0000","last_peered":"2024-05-21T13:41:33.514154+0000","last_clean":"2024-05-21T13:41:33.514154+0000","last_became_active":"2024-05-21T13:36:39.720879+0000","last_became_peered":"2024-05-21T13:36:39.720879+0000","last_unstale":"2024-05-21T13:41:33.514154+0000","last_undegraded":"2024-05-21T13:41:33.514154+0000","last_fullsized":"2024-05-21T13:41:33.514154+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'306","last_scrub_stamp":"2024-05-21T13:41:33.513949+0000","last_deep_scrub":"27'306","last_deep_scrub_stamp":"2024-05-21T13:41:33.513949+0000","last_clean_scrub_stamp":"2024-05-21T13:41:33.513949+0000","objects_scrubbed":0,"log_size":306,"log_dups_size":0,"ondisk_log_size":306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:42:11.573855+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":306,"num_write_kb":835584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4,1],"acting":[0,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"25'2","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:24.891341+0000","last_change":"2024-05-21T13:41:24.891403+0000","last_active":"2024-05-21T13:41:24.891341+0000","last_peered":"2024-05-21T13:41:24.891341+0000","last_clean":"2024-05-21T13:41:24.891341+0000","last_became_active":"2024-05-21T13:35:56.770566+0000","last_became_peered":"2024-05-21T13:35:56.770566+0000","last_unstale":"2024-05-21T13:41:24.891341+0000","last_undegraded":"2024-05-21T13:41:24.891341+0000","last_fullsized":"2024-05-21T13:41:24.891341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2024-05-21T13:41:24.891160+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2024-05-21T13:41:24.891160+0000","last_clean_scrub_stamp":"2024-05-21T13:41:24.891160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:05:24.530831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"27'6","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:27.924151+0000","last_change":"2024-05-21T13:41:27.924210+0000","last_active":"2024-05-21T13:41:27.924151+0000","last_peered":"2024-05-21T13:41:27.924151+0000","last_clean":"2024-05-21T13:41:27.924151+0000","last_became_active":"2024-05-21T13:35:57.780590+0000","last_became_peered":"2024-05-21T13:35:57.780590+0000","last_unstale":"2024-05-21T13:41:27.924151+0000","last_undegraded":"2024-05-21T13:41:27.924151+0000","last_fullsized":"2024-05-21T13:41:27.924151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-21T13:41:27.923980+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-21T13:41:27.923980+0000","last_clean_scrub_stamp":"2024-05-21T13:41:27.923980+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:53:17.469379+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"27'339","reported_seq":368,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:28.578856+0000","last_change":"2024-05-21T13:41:28.578918+0000","last_active":"2024-05-21T13:41:28.578856+0000","last_peered":"2024-05-21T13:41:28.578856+0000","last_clean":"2024-05-21T13:41:28.578856+0000","last_became_active":"2024-05-21T13:36:01.851745+0000","last_became_peered":"2024-05-21T13:36:01.851745+0000","last_unstale":"2024-05-21T13:41:28.578856+0000","last_undegraded":"2024-05-21T13:41:28.578856+0000","last_fullsized":"2024-05-21T13:41:28.578856+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'339","last_scrub_stamp":"2024-05-21T13:41:28.578662+0000","last_deep_scrub":"27'339","last_deep_scrub_stamp":"2024-05-21T13:41:28.578662+0000","last_clean_scrub_stamp":"2024-05-21T13:41:28.578662+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:37:59.196317+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":339,"num_write_kb":925696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"27'7","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:18.552474+0000","last_change":"2024-05-21T13:41:18.552500+0000","last_active":"2024-05-21T13:41:18.552474+0000","last_peered":"2024-05-21T13:41:18.552474+0000","last_clean":"2024-05-21T13:41:18.552474+0000","last_became_active":"2024-05-21T13:35:56.730746+0000","last_became_peered":"2024-05-21T13:35:56.730746+0000","last_unstale":"2024-05-21T13:41:18.552474+0000","last_undegraded":"2024-05-21T13:41:18.552474+0000","last_fullsized":"2024-05-21T13:41:18.552474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-05-21T13:41:18.552412+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-05-21T13:41:18.552412+0000","last_clean_scrub_stamp":"2024-05-21T13:41:18.552412+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:34:33.224857+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"27'9","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:19.558975+0000","last_change":"2024-05-21T13:41:19.559097+0000","last_active":"2024-05-21T13:41:19.558975+0000","last_peered":"2024-05-21T13:41:19.558975+0000","last_clean":"2024-05-21T13:41:19.558975+0000","last_became_active":"2024-05-21T13:35:57.770595+0000","last_became_peered":"2024-05-21T13:35:57.770595+0000","last_unstale":"2024-05-21T13:41:19.558975+0000","last_undegraded":"2024-05-21T13:41:19.558975+0000","last_fullsized":"2024-05-21T13:41:19.558975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-05-21T13:41:19.558765+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-05-21T13:41:19.558765+0000","last_clean_scrub_stamp":"2024-05-21T13:41:19.558765+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:09:31.112330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"27'273","reported_seq":302,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:27.574407+0000","last_change":"2024-05-21T13:41:27.574477+0000","last_active":"2024-05-21T13:41:27.574407+0000","last_peered":"2024-05-21T13:41:27.574407+0000","last_clean":"2024-05-21T13:41:27.574407+0000","last_became_active":"2024-05-21T13:36:01.848996+0000","last_became_peered":"2024-05-21T13:36:01.848996+0000","last_unstale":"2024-05-21T13:41:27.574407+0000","last_undegraded":"2024-05-21T13:41:27.574407+0000","last_fullsized":"2024-05-21T13:41:27.574407+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'273","last_scrub_stamp":"2024-05-21T13:41:27.574227+0000","last_deep_scrub":"27'273","last_deep_scrub_stamp":"2024-05-21T13:41:27.574227+0000","last_clean_scrub_stamp":"2024-05-21T13:41:27.574227+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:56:01.431575+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"27'3","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:20.609201+0000","last_change":"2024-05-21T13:41:20.609269+0000","last_active":"2024-05-21T13:41:20.609201+0000","last_peered":"2024-05-21T13:41:20.609201+0000","last_clean":"2024-05-21T13:41:20.609201+0000","last_became_active":"2024-05-21T13:35:56.731150+0000","last_became_peered":"2024-05-21T13:35:56.731150+0000","last_unstale":"2024-05-21T13:41:20.609201+0000","last_undegraded":"2024-05-21T13:41:20.609201+0000","last_fullsized":"2024-05-21T13:41:20.609201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-05-21T13:41:20.609030+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-05-21T13:41:20.609030+0000","last_clean_scrub_stamp":"2024-05-21T13:41:20.609030+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:26:24.329746+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"27'15","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.831310+0000","last_change":"2024-05-21T13:35:57.799803+0000","last_active":"2024-05-21T13:41:05.831310+0000","last_peered":"2024-05-21T13:41:05.831310+0000","last_clean":"2024-05-21T13:41:05.831310+0000","last_became_active":"2024-05-21T13:35:57.799043+0000","last_became_peered":"2024-05-21T13:35:57.799043+0000","last_unstale":"2024-05-21T13:41:05.831310+0000","last_undegraded":"2024-05-21T13:41:05.831310+0000","last_fullsized":"2024-05-21T13:41:05.831310+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"27'252","reported_seq":281,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:29.616197+0000","last_change":"2024-05-21T13:41:29.616274+0000","last_active":"2024-05-21T13:41:29.616197+0000","last_peered":"2024-05-21T13:41:29.616197+0000","last_clean":"2024-05-21T13:41:29.616197+0000","last_became_active":"2024-05-21T13:36:01.851913+0000","last_became_peered":"2024-05-21T13:36:01.851913+0000","last_unstale":"2024-05-21T13:41:29.616197+0000","last_undegraded":"2024-05-21T13:41:29.616197+0000","last_fullsized":"2024-05-21T13:41:29.616197+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'252","last_scrub_stamp":"2024-05-21T13:41:29.616017+0000","last_deep_scrub":"27'252","last_deep_scrub_stamp":"2024-05-21T13:41:29.616017+0000","last_clean_scrub_stamp":"2024-05-21T13:41:29.616017+0000","objects_scrubbed":0,"log_size":252,"log_dups_size":0,"ondisk_log_size":252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:05:45.291541+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":252,"num_write_kb":688128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"27'5","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:21.544881+0000","last_change":"2024-05-21T13:41:21.544939+0000","last_active":"2024-05-21T13:41:21.544881+0000","last_peered":"2024-05-21T13:41:21.544881+0000","last_clean":"2024-05-21T13:41:21.544881+0000","last_became_active":"2024-05-21T13:35:57.795638+0000","last_became_peered":"2024-05-21T13:35:57.795638+0000","last_unstale":"2024-05-21T13:41:21.544881+0000","last_undegraded":"2024-05-21T13:41:21.544881+0000","last_fullsized":"2024-05-21T13:41:21.544881+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-05-21T13:41:21.544701+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-05-21T13:41:21.544701+0000","last_clean_scrub_stamp":"2024-05-21T13:41:21.544701+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:04:51.516014+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"27'7","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:29.574589+0000","last_change":"2024-05-21T13:41:29.574662+0000","last_active":"2024-05-21T13:41:29.574589+0000","last_peered":"2024-05-21T13:41:29.574589+0000","last_clean":"2024-05-21T13:41:29.574589+0000","last_became_active":"2024-05-21T13:35:56.747635+0000","last_became_peered":"2024-05-21T13:35:56.747635+0000","last_unstale":"2024-05-21T13:41:29.574589+0000","last_undegraded":"2024-05-21T13:41:29.574589+0000","last_fullsized":"2024-05-21T13:41:29.574589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-05-21T13:41:29.574416+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-05-21T13:41:29.574416+0000","last_clean_scrub_stamp":"2024-05-21T13:41:29.574416+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:03:58.441948+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"27'309","reported_seq":330,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.407929+0000","last_change":"2024-05-21T13:36:01.862153+0000","last_active":"2024-05-21T13:41:07.407929+0000","last_peered":"2024-05-21T13:41:07.407929+0000","last_clean":"2024-05-21T13:41:07.407929+0000","last_became_active":"2024-05-21T13:36:01.861520+0000","last_became_peered":"2024-05-21T13:36:01.861520+0000","last_unstale":"2024-05-21T13:41:07.407929+0000","last_undegraded":"2024-05-21T13:41:07.407929+0000","last_fullsized":"2024-05-21T13:41:07.407929+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":309,"log_dups_size":0,"ondisk_log_size":309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":309,"num_write_kb":843776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"27'8","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:23.788591+0000","last_change":"2024-05-21T13:41:23.788656+0000","last_active":"2024-05-21T13:41:23.788591+0000","last_peered":"2024-05-21T13:41:23.788591+0000","last_clean":"2024-05-21T13:41:23.788591+0000","last_became_active":"2024-05-21T13:35:57.786126+0000","last_became_peered":"2024-05-21T13:35:57.786126+0000","last_unstale":"2024-05-21T13:41:23.788591+0000","last_undegraded":"2024-05-21T13:41:23.788591+0000","last_fullsized":"2024-05-21T13:41:23.788591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-21T13:41:23.788412+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-21T13:41:23.788412+0000","last_clean_scrub_stamp":"2024-05-21T13:41:23.788412+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:03:44.708204+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"27'3","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:20.844402+0000","last_change":"2024-05-21T13:41:20.844518+0000","last_active":"2024-05-21T13:41:20.844402+0000","last_peered":"2024-05-21T13:41:20.844402+0000","last_clean":"2024-05-21T13:41:20.844402+0000","last_became_active":"2024-05-21T13:35:56.764551+0000","last_became_peered":"2024-05-21T13:35:56.764551+0000","last_unstale":"2024-05-21T13:41:20.844402+0000","last_undegraded":"2024-05-21T13:41:20.844402+0000","last_fullsized":"2024-05-21T13:41:20.844402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-05-21T13:41:20.844121+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-05-21T13:41:20.844121+0000","last_clean_scrub_stamp":"2024-05-21T13:41:20.844121+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:18:08.574389+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"27'291","reported_seq":320,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:32.527963+0000","last_change":"2024-05-21T13:41:32.528082+0000","last_active":"2024-05-21T13:41:32.527963+0000","last_peered":"2024-05-21T13:41:32.527963+0000","last_clean":"2024-05-21T13:41:32.527963+0000","last_became_active":"2024-05-21T13:36:01.853975+0000","last_became_peered":"2024-05-21T13:36:01.853975+0000","last_unstale":"2024-05-21T13:41:32.527963+0000","last_undegraded":"2024-05-21T13:41:32.527963+0000","last_fullsized":"2024-05-21T13:41:32.527963+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'291","last_scrub_stamp":"2024-05-21T13:41:32.527752+0000","last_deep_scrub":"27'291","last_deep_scrub_stamp":"2024-05-21T13:41:32.527752+0000","last_clean_scrub_stamp":"2024-05-21T13:41:32.527752+0000","objects_scrubbed":0,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:18:29.421742+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":291,"num_write_kb":794624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"27'9","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:23.742569+0000","last_change":"2024-05-21T13:41:23.742632+0000","last_active":"2024-05-21T13:41:23.742569+0000","last_peered":"2024-05-21T13:41:23.742569+0000","last_clean":"2024-05-21T13:41:23.742569+0000","last_became_active":"2024-05-21T13:35:57.761739+0000","last_became_peered":"2024-05-21T13:35:57.761739+0000","last_unstale":"2024-05-21T13:41:23.742569+0000","last_undegraded":"2024-05-21T13:41:23.742569+0000","last_fullsized":"2024-05-21T13:41:23.742569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-05-21T13:41:23.742405+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-05-21T13:41:23.742405+0000","last_clean_scrub_stamp":"2024-05-21T13:41:23.742405+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:08:06.216018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"27'5","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:18.746029+0000","last_change":"2024-05-21T13:41:18.746095+0000","last_active":"2024-05-21T13:41:18.746029+0000","last_peered":"2024-05-21T13:41:18.746029+0000","last_clean":"2024-05-21T13:41:18.746029+0000","last_became_active":"2024-05-21T13:35:56.733249+0000","last_became_peered":"2024-05-21T13:35:56.733249+0000","last_unstale":"2024-05-21T13:41:18.746029+0000","last_undegraded":"2024-05-21T13:41:18.746029+0000","last_fullsized":"2024-05-21T13:41:18.746029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-05-21T13:41:18.745865+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-05-21T13:41:18.745865+0000","last_clean_scrub_stamp":"2024-05-21T13:41:18.745865+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:20:17.861741+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"27'267","reported_seq":296,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:25.798369+0000","last_change":"2024-05-21T13:41:25.798481+0000","last_active":"2024-05-21T13:41:25.798369+0000","last_peered":"2024-05-21T13:41:25.798369+0000","last_clean":"2024-05-21T13:41:25.798369+0000","last_became_active":"2024-05-21T13:36:01.867701+0000","last_became_peered":"2024-05-21T13:36:01.867701+0000","last_unstale":"2024-05-21T13:41:25.798369+0000","last_undegraded":"2024-05-21T13:41:25.798369+0000","last_fullsized":"2024-05-21T13:41:25.798369+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'267","last_scrub_stamp":"2024-05-21T13:41:25.798088+0000","last_deep_scrub":"27'267","last_deep_scrub_stamp":"2024-05-21T13:41:25.798088+0000","last_clean_scrub_stamp":"2024-05-21T13:41:25.798088+0000","objects_scrubbed":0,"log_size":267,"log_dups_size":0,"ondisk_log_size":267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:51:23.705597+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":267,"num_write_kb":729088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"27'2","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:20.503491+0000","last_change":"2024-05-21T13:41:20.503552+0000","last_active":"2024-05-21T13:41:20.503491+0000","last_peered":"2024-05-21T13:41:20.503491+0000","last_clean":"2024-05-21T13:41:20.503491+0000","last_became_active":"2024-05-21T13:35:57.789213+0000","last_became_peered":"2024-05-21T13:35:57.789213+0000","last_unstale":"2024-05-21T13:41:20.503491+0000","last_undegraded":"2024-05-21T13:41:20.503491+0000","last_fullsized":"2024-05-21T13:41:20.503491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-21T13:41:20.503312+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-21T13:41:20.503312+0000","last_clean_scrub_stamp":"2024-05-21T13:41:20.503312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:56:40.705560+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"27'3","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:22.593062+0000","last_change":"2024-05-21T13:41:22.593135+0000","last_active":"2024-05-21T13:41:22.593062+0000","last_peered":"2024-05-21T13:41:22.593062+0000","last_clean":"2024-05-21T13:41:22.593062+0000","last_became_active":"2024-05-21T13:35:56.746534+0000","last_became_peered":"2024-05-21T13:35:56.746534+0000","last_unstale":"2024-05-21T13:41:22.593062+0000","last_undegraded":"2024-05-21T13:41:22.593062+0000","last_fullsized":"2024-05-21T13:41:22.593062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-05-21T13:41:22.592894+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-05-21T13:41:22.592894+0000","last_clean_scrub_stamp":"2024-05-21T13:41:22.592894+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:23:11.862335+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"27'288","reported_seq":317,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:26.586701+0000","last_change":"2024-05-21T13:41:26.586767+0000","last_active":"2024-05-21T13:41:26.586701+0000","last_peered":"2024-05-21T13:41:26.586701+0000","last_clean":"2024-05-21T13:41:26.586701+0000","last_became_active":"2024-05-21T13:36:01.841216+0000","last_became_peered":"2024-05-21T13:36:01.841216+0000","last_unstale":"2024-05-21T13:41:26.586701+0000","last_undegraded":"2024-05-21T13:41:26.586701+0000","last_fullsized":"2024-05-21T13:41:26.586701+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'288","last_scrub_stamp":"2024-05-21T13:41:26.586502+0000","last_deep_scrub":"27'288","last_deep_scrub_stamp":"2024-05-21T13:41:26.586502+0000","last_clean_scrub_stamp":"2024-05-21T13:41:26.586502+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:50:44.427142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":288,"num_write_kb":786432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"27'7","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:25.737666+0000","last_change":"2024-05-21T13:41:25.737732+0000","last_active":"2024-05-21T13:41:25.737666+0000","last_peered":"2024-05-21T13:41:25.737666+0000","last_clean":"2024-05-21T13:41:25.737666+0000","last_became_active":"2024-05-21T13:35:57.764017+0000","last_became_peered":"2024-05-21T13:35:57.764017+0000","last_unstale":"2024-05-21T13:41:25.737666+0000","last_undegraded":"2024-05-21T13:41:25.737666+0000","last_fullsized":"2024-05-21T13:41:25.737666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-05-21T13:41:25.737489+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-05-21T13:41:25.737489+0000","last_clean_scrub_stamp":"2024-05-21T13:41:25.737489+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:56:51.866661+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"27'7","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:33.517246+0000","last_change":"2024-05-21T13:41:33.517315+0000","last_active":"2024-05-21T13:41:33.517246+0000","last_peered":"2024-05-21T13:41:33.517246+0000","last_clean":"2024-05-21T13:41:33.517246+0000","last_became_active":"2024-05-21T13:35:56.751883+0000","last_became_peered":"2024-05-21T13:35:56.751883+0000","last_unstale":"2024-05-21T13:41:33.517246+0000","last_undegraded":"2024-05-21T13:41:33.517246+0000","last_fullsized":"2024-05-21T13:41:33.517246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-05-21T13:41:33.517080+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-05-21T13:41:33.517080+0000","last_clean_scrub_stamp":"2024-05-21T13:41:33.517080+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T13:45:48.671440+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"27'249","reported_seq":278,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:25.564412+0000","last_change":"2024-05-21T13:41:25.564475+0000","last_active":"2024-05-21T13:41:25.564412+0000","last_peered":"2024-05-21T13:41:25.564412+0000","last_clean":"2024-05-21T13:41:25.564412+0000","last_became_active":"2024-05-21T13:36:01.831609+0000","last_became_peered":"2024-05-21T13:36:01.831609+0000","last_unstale":"2024-05-21T13:41:25.564412+0000","last_undegraded":"2024-05-21T13:41:25.564412+0000","last_fullsized":"2024-05-21T13:41:25.564412+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'249","last_scrub_stamp":"2024-05-21T13:41:25.564206+0000","last_deep_scrub":"27'249","last_deep_scrub_stamp":"2024-05-21T13:41:25.564206+0000","last_clean_scrub_stamp":"2024-05-21T13:41:25.564206+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:40:25.414919+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":249,"num_write_kb":679936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"27'5","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:27.710256+0000","last_change":"2024-05-21T13:41:27.710319+0000","last_active":"2024-05-21T13:41:27.710256+0000","last_peered":"2024-05-21T13:41:27.710256+0000","last_clean":"2024-05-21T13:41:27.710256+0000","last_became_active":"2024-05-21T13:35:57.783150+0000","last_became_peered":"2024-05-21T13:35:57.783150+0000","last_unstale":"2024-05-21T13:41:27.710256+0000","last_undegraded":"2024-05-21T13:41:27.710256+0000","last_fullsized":"2024-05-21T13:41:27.710256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-05-21T13:41:27.710084+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-05-21T13:41:27.710084+0000","last_clean_scrub_stamp":"2024-05-21T13:41:27.710084+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:01:59.363343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"27'23","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:20.731984+0000","last_change":"2024-05-21T13:41:20.732102+0000","last_active":"2024-05-21T13:41:20.731984+0000","last_peered":"2024-05-21T13:41:20.731984+0000","last_clean":"2024-05-21T13:41:20.731984+0000","last_became_active":"2024-05-21T13:35:56.744218+0000","last_became_peered":"2024-05-21T13:35:56.744218+0000","last_unstale":"2024-05-21T13:41:20.731984+0000","last_undegraded":"2024-05-21T13:41:20.731984+0000","last_fullsized":"2024-05-21T13:41:20.731984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'23","last_scrub_stamp":"2024-05-21T13:41:20.731763+0000","last_deep_scrub":"27'23","last_deep_scrub_stamp":"2024-05-21T13:41:20.731763+0000","last_clean_scrub_stamp":"2024-05-21T13:41:20.731763+0000","objects_scrubbed":2,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:07:46.373267+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"27'264","reported_seq":293,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:30.673066+0000","last_change":"2024-05-21T13:41:30.673140+0000","last_active":"2024-05-21T13:41:30.673066+0000","last_peered":"2024-05-21T13:41:30.673066+0000","last_clean":"2024-05-21T13:41:30.673066+0000","last_became_active":"2024-05-21T13:36:01.837401+0000","last_became_peered":"2024-05-21T13:36:01.837401+0000","last_unstale":"2024-05-21T13:41:30.673066+0000","last_undegraded":"2024-05-21T13:41:30.673066+0000","last_fullsized":"2024-05-21T13:41:30.673066+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'264","last_scrub_stamp":"2024-05-21T13:41:30.672817+0000","last_deep_scrub":"27'264","last_deep_scrub_stamp":"2024-05-21T13:41:30.672817+0000","last_clean_scrub_stamp":"2024-05-21T13:41:30.672817+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:43:54.376810+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":720896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"27'9","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:24.816934+0000","last_change":"2024-05-21T13:41:24.816992+0000","last_active":"2024-05-21T13:41:24.816934+0000","last_peered":"2024-05-21T13:41:24.816934+0000","last_clean":"2024-05-21T13:41:24.816934+0000","last_became_active":"2024-05-21T13:35:57.784664+0000","last_became_peered":"2024-05-21T13:35:57.784664+0000","last_unstale":"2024-05-21T13:41:24.816934+0000","last_undegraded":"2024-05-21T13:41:24.816934+0000","last_fullsized":"2024-05-21T13:41:24.816934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-05-21T13:41:24.816767+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-05-21T13:41:24.816767+0000","last_clean_scrub_stamp":"2024-05-21T13:41:24.816767+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:54:06.253493+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"27'2","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:27.625040+0000","last_change":"2024-05-21T13:41:27.625109+0000","last_active":"2024-05-21T13:41:27.625040+0000","last_peered":"2024-05-21T13:41:27.625040+0000","last_clean":"2024-05-21T13:41:27.625040+0000","last_became_active":"2024-05-21T13:35:56.740846+0000","last_became_peered":"2024-05-21T13:35:56.740846+0000","last_unstale":"2024-05-21T13:41:27.625040+0000","last_undegraded":"2024-05-21T13:41:27.625040+0000","last_fullsized":"2024-05-21T13:41:27.625040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-21T13:41:27.624850+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-21T13:41:27.624850+0000","last_clean_scrub_stamp":"2024-05-21T13:41:27.624850+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:18:01.374661+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"27'249","reported_seq":278,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:30.767147+0000","last_change":"2024-05-21T13:41:30.767208+0000","last_active":"2024-05-21T13:41:30.767147+0000","last_peered":"2024-05-21T13:41:30.767147+0000","last_clean":"2024-05-21T13:41:30.767147+0000","last_became_active":"2024-05-21T13:36:01.872085+0000","last_became_peered":"2024-05-21T13:36:01.872085+0000","last_unstale":"2024-05-21T13:41:30.767147+0000","last_undegraded":"2024-05-21T13:41:30.767147+0000","last_fullsized":"2024-05-21T13:41:30.767147+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'249","last_scrub_stamp":"2024-05-21T13:41:30.766975+0000","last_deep_scrub":"27'249","last_deep_scrub_stamp":"2024-05-21T13:41:30.766975+0000","last_clean_scrub_stamp":"2024-05-21T13:41:30.766975+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:07:20.839016+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":249,"num_write_kb":679936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"27'5","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:21.611629+0000","last_change":"2024-05-21T13:41:21.611687+0000","last_active":"2024-05-21T13:41:21.611629+0000","last_peered":"2024-05-21T13:41:21.611629+0000","last_clean":"2024-05-21T13:41:21.611629+0000","last_became_active":"2024-05-21T13:35:57.782517+0000","last_became_peered":"2024-05-21T13:35:57.782517+0000","last_unstale":"2024-05-21T13:41:21.611629+0000","last_undegraded":"2024-05-21T13:41:21.611629+0000","last_fullsized":"2024-05-21T13:41:21.611629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-05-21T13:41:21.611457+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-05-21T13:41:21.611457+0000","last_clean_scrub_stamp":"2024-05-21T13:41:21.611457+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:54:02.735762+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:21.895038+0000","last_change":"2024-05-21T13:41:21.895093+0000","last_active":"2024-05-21T13:41:21.895038+0000","last_peered":"2024-05-21T13:41:21.895038+0000","last_clean":"2024-05-21T13:41:21.895038+0000","last_became_active":"2024-05-21T13:35:56.764987+0000","last_became_peered":"2024-05-21T13:35:56.764987+0000","last_unstale":"2024-05-21T13:41:21.895038+0000","last_undegraded":"2024-05-21T13:41:21.895038+0000","last_fullsized":"2024-05-21T13:41:21.895038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:41:21.894834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:41:21.894834+0000","last_clean_scrub_stamp":"2024-05-21T13:41:21.894834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:54:37.619072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"27'273","reported_seq":302,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:29.784127+0000","last_change":"2024-05-21T13:41:29.784188+0000","last_active":"2024-05-21T13:41:29.784127+0000","last_peered":"2024-05-21T13:41:29.784127+0000","last_clean":"2024-05-21T13:41:29.784127+0000","last_became_active":"2024-05-21T13:36:01.870831+0000","last_became_peered":"2024-05-21T13:36:01.870831+0000","last_unstale":"2024-05-21T13:41:29.784127+0000","last_undegraded":"2024-05-21T13:41:29.784127+0000","last_fullsized":"2024-05-21T13:41:29.784127+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'273","last_scrub_stamp":"2024-05-21T13:41:29.783948+0000","last_deep_scrub":"27'273","last_deep_scrub_stamp":"2024-05-21T13:41:29.783948+0000","last_clean_scrub_stamp":"2024-05-21T13:41:29.783948+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:01:41.972359+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"27'7","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:16.500325+0000","last_change":"2024-05-21T13:41:16.500380+0000","last_active":"2024-05-21T13:41:16.500325+0000","last_peered":"2024-05-21T13:41:16.500325+0000","last_clean":"2024-05-21T13:41:16.500325+0000","last_became_active":"2024-05-21T13:35:57.780521+0000","last_became_peered":"2024-05-21T13:35:57.780521+0000","last_unstale":"2024-05-21T13:41:16.500325+0000","last_undegraded":"2024-05-21T13:41:16.500325+0000","last_fullsized":"2024-05-21T13:41:16.500325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-05-21T13:41:16.500162+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-05-21T13:41:16.500162+0000","last_clean_scrub_stamp":"2024-05-21T13:41:16.500162+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:23:59.572265+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"25'1","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:31.528997+0000","last_change":"2024-05-21T13:41:31.529056+0000","last_active":"2024-05-21T13:41:31.528997+0000","last_peered":"2024-05-21T13:41:31.528997+0000","last_clean":"2024-05-21T13:41:31.528997+0000","last_became_active":"2024-05-21T13:35:56.750006+0000","last_became_peered":"2024-05-21T13:35:56.750006+0000","last_unstale":"2024-05-21T13:41:31.528997+0000","last_undegraded":"2024-05-21T13:41:31.528997+0000","last_fullsized":"2024-05-21T13:41:31.528997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2024-05-21T13:41:31.528808+0000","last_deep_scrub":"25'1","last_deep_scrub_stamp":"2024-05-21T13:41:31.528808+0000","last_clean_scrub_stamp":"2024-05-21T13:41:31.528808+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:21:09.844460+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"27'264","reported_seq":293,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:31.760159+0000","last_change":"2024-05-21T13:41:31.760225+0000","last_active":"2024-05-21T13:41:31.760159+0000","last_peered":"2024-05-21T13:41:31.760159+0000","last_clean":"2024-05-21T13:41:31.760159+0000","last_became_active":"2024-05-21T13:36:01.872363+0000","last_became_peered":"2024-05-21T13:36:01.872363+0000","last_unstale":"2024-05-21T13:41:31.760159+0000","last_undegraded":"2024-05-21T13:41:31.760159+0000","last_fullsized":"2024-05-21T13:41:31.760159+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'264","last_scrub_stamp":"2024-05-21T13:41:31.759973+0000","last_deep_scrub":"27'264","last_deep_scrub_stamp":"2024-05-21T13:41:31.759973+0000","last_clean_scrub_stamp":"2024-05-21T13:41:31.759973+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:08:27.285093+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":720896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"27'8","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:26.943599+0000","last_change":"2024-05-21T13:41:26.943662+0000","last_active":"2024-05-21T13:41:26.943599+0000","last_peered":"2024-05-21T13:41:26.943599+0000","last_clean":"2024-05-21T13:41:26.943599+0000","last_became_active":"2024-05-21T13:35:57.780313+0000","last_became_peered":"2024-05-21T13:35:57.780313+0000","last_unstale":"2024-05-21T13:41:26.943599+0000","last_undegraded":"2024-05-21T13:41:26.943599+0000","last_fullsized":"2024-05-21T13:41:26.943599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-21T13:41:26.943390+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-21T13:41:26.943390+0000","last_clean_scrub_stamp":"2024-05-21T13:41:26.943390+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:21:21.535402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"27'11","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:20.812086+0000","last_change":"2024-05-21T13:41:20.812173+0000","last_active":"2024-05-21T13:41:20.812086+0000","last_peered":"2024-05-21T13:41:20.812086+0000","last_clean":"2024-05-21T13:41:20.812086+0000","last_became_active":"2024-05-21T13:35:56.770465+0000","last_became_peered":"2024-05-21T13:35:56.770465+0000","last_unstale":"2024-05-21T13:41:20.812086+0000","last_undegraded":"2024-05-21T13:41:20.812086+0000","last_fullsized":"2024-05-21T13:41:20.812086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'11","last_scrub_stamp":"2024-05-21T13:41:20.811896+0000","last_deep_scrub":"27'11","last_deep_scrub_stamp":"2024-05-21T13:41:20.811896+0000","last_clean_scrub_stamp":"2024-05-21T13:41:20.811896+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:48:37.354019+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":619,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"27'270","reported_seq":299,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:28.768968+0000","last_change":"2024-05-21T13:41:28.769039+0000","last_active":"2024-05-21T13:41:28.768968+0000","last_peered":"2024-05-21T13:41:28.768968+0000","last_clean":"2024-05-21T13:41:28.768968+0000","last_became_active":"2024-05-21T13:36:01.870678+0000","last_became_peered":"2024-05-21T13:36:01.870678+0000","last_unstale":"2024-05-21T13:41:28.768968+0000","last_undegraded":"2024-05-21T13:41:28.768968+0000","last_fullsized":"2024-05-21T13:41:28.768968+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'270","last_scrub_stamp":"2024-05-21T13:41:28.768768+0000","last_deep_scrub":"27'270","last_deep_scrub_stamp":"2024-05-21T13:41:28.768768+0000","last_clean_scrub_stamp":"2024-05-21T13:41:28.768768+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:53:54.860452+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":737280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"27'5","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:22.883963+0000","last_change":"2024-05-21T13:41:22.884028+0000","last_active":"2024-05-21T13:41:22.883963+0000","last_peered":"2024-05-21T13:41:22.883963+0000","last_clean":"2024-05-21T13:41:22.883963+0000","last_became_active":"2024-05-21T13:35:57.781299+0000","last_became_peered":"2024-05-21T13:35:57.781299+0000","last_unstale":"2024-05-21T13:41:22.883963+0000","last_undegraded":"2024-05-21T13:41:22.883963+0000","last_fullsized":"2024-05-21T13:41:22.883963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-05-21T13:41:22.883770+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-05-21T13:41:22.883770+0000","last_clean_scrub_stamp":"2024-05-21T13:41:22.883770+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:52:42.893989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"27'4","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:26.614165+0000","last_change":"2024-05-21T13:41:26.614228+0000","last_active":"2024-05-21T13:41:26.614165+0000","last_peered":"2024-05-21T13:41:26.614165+0000","last_clean":"2024-05-21T13:41:26.614165+0000","last_became_active":"2024-05-21T13:35:56.767788+0000","last_became_peered":"2024-05-21T13:35:56.767788+0000","last_unstale":"2024-05-21T13:41:26.614165+0000","last_undegraded":"2024-05-21T13:41:26.614165+0000","last_fullsized":"2024-05-21T13:41:26.614165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-21T13:41:26.613996+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-21T13:41:26.613996+0000","last_clean_scrub_stamp":"2024-05-21T13:41:26.613996+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:41:42.484994+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"27'339","reported_seq":360,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.387775+0000","last_change":"2024-05-21T13:36:01.860305+0000","last_active":"2024-05-21T13:41:07.387775+0000","last_peered":"2024-05-21T13:41:07.387775+0000","last_clean":"2024-05-21T13:41:07.387775+0000","last_became_active":"2024-05-21T13:36:01.859141+0000","last_became_peered":"2024-05-21T13:36:01.859141+0000","last_unstale":"2024-05-21T13:41:07.387775+0000","last_undegraded":"2024-05-21T13:41:07.387775+0000","last_fullsized":"2024-05-21T13:41:07.387775+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":339,"num_write_kb":925696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"27'8","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:26.743732+0000","last_change":"2024-05-21T13:41:26.743790+0000","last_active":"2024-05-21T13:41:26.743732+0000","last_peered":"2024-05-21T13:41:26.743732+0000","last_clean":"2024-05-21T13:41:26.743732+0000","last_became_active":"2024-05-21T13:35:57.774322+0000","last_became_peered":"2024-05-21T13:35:57.774322+0000","last_unstale":"2024-05-21T13:41:26.743732+0000","last_undegraded":"2024-05-21T13:41:26.743732+0000","last_fullsized":"2024-05-21T13:41:26.743732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-21T13:41:26.743549+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-21T13:41:26.743549+0000","last_clean_scrub_stamp":"2024-05-21T13:41:26.743549+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:39:07.145642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"27'6","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:30.541102+0000","last_change":"2024-05-21T13:41:30.541187+0000","last_active":"2024-05-21T13:41:30.541102+0000","last_peered":"2024-05-21T13:41:30.541102+0000","last_clean":"2024-05-21T13:41:30.541102+0000","last_became_active":"2024-05-21T13:35:56.747823+0000","last_became_peered":"2024-05-21T13:35:56.747823+0000","last_unstale":"2024-05-21T13:41:30.541102+0000","last_undegraded":"2024-05-21T13:41:30.541102+0000","last_fullsized":"2024-05-21T13:41:30.541102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-21T13:41:30.540916+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-21T13:41:30.540916+0000","last_clean_scrub_stamp":"2024-05-21T13:41:30.540916+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:38:23.439604+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"27'74","reported_seq":134,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:16.572616+0000","last_change":"2024-05-21T13:41:16.572694+0000","last_active":"2024-05-21T13:41:16.572616+0000","last_peered":"2024-05-21T13:41:16.572616+0000","last_clean":"2024-05-21T13:41:16.572616+0000","last_became_active":"2024-05-21T13:35:45.680732+0000","last_became_peered":"2024-05-21T13:35:45.680732+0000","last_unstale":"2024-05-21T13:41:16.572616+0000","last_undegraded":"2024-05-21T13:41:16.572616+0000","last_fullsized":"2024-05-21T13:41:16.572616+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'74","last_scrub_stamp":"2024-05-21T13:41:16.572444+0000","last_deep_scrub":"27'74","last_deep_scrub_stamp":"2024-05-21T13:41:16.572444+0000","last_clean_scrub_stamp":"2024-05-21T13:41:16.572444+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T13:48:55.245032+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"27'276","reported_seq":297,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.470816+0000","last_change":"2024-05-21T13:36:01.830034+0000","last_active":"2024-05-21T13:41:07.470816+0000","last_peered":"2024-05-21T13:41:07.470816+0000","last_clean":"2024-05-21T13:41:07.470816+0000","last_became_active":"2024-05-21T13:36:01.828957+0000","last_became_peered":"2024-05-21T13:36:01.828957+0000","last_unstale":"2024-05-21T13:41:07.470816+0000","last_undegraded":"2024-05-21T13:41:07.470816+0000","last_fullsized":"2024-05-21T13:41:07.470816+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":276,"num_write_kb":753664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"27'7","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:19.461359+0000","last_change":"2024-05-21T13:41:19.461416+0000","last_active":"2024-05-21T13:41:19.461359+0000","last_peered":"2024-05-21T13:41:19.461359+0000","last_clean":"2024-05-21T13:41:19.461359+0000","last_became_active":"2024-05-21T13:35:57.796050+0000","last_became_peered":"2024-05-21T13:35:57.796050+0000","last_unstale":"2024-05-21T13:41:19.461359+0000","last_undegraded":"2024-05-21T13:41:19.461359+0000","last_fullsized":"2024-05-21T13:41:19.461359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-05-21T13:41:19.461188+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-05-21T13:41:19.461188+0000","last_clean_scrub_stamp":"2024-05-21T13:41:19.461188+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:58:27.743750+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"27'5","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:19.812608+0000","last_change":"2024-05-21T13:41:19.812724+0000","last_active":"2024-05-21T13:41:19.812608+0000","last_peered":"2024-05-21T13:41:19.812608+0000","last_clean":"2024-05-21T13:41:19.812608+0000","last_became_active":"2024-05-21T13:35:56.748604+0000","last_became_peered":"2024-05-21T13:35:56.748604+0000","last_unstale":"2024-05-21T13:41:19.812608+0000","last_undegraded":"2024-05-21T13:41:19.812608+0000","last_fullsized":"2024-05-21T13:41:19.812608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-05-21T13:41:19.812330+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-05-21T13:41:19.812330+0000","last_clean_scrub_stamp":"2024-05-21T13:41:19.812330+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:51:58.626541+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"27'280","reported_seq":309,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:24.551291+0000","last_change":"2024-05-21T13:41:24.551421+0000","last_active":"2024-05-21T13:41:24.551291+0000","last_peered":"2024-05-21T13:41:24.551291+0000","last_clean":"2024-05-21T13:41:24.551291+0000","last_became_active":"2024-05-21T13:36:01.824653+0000","last_became_peered":"2024-05-21T13:36:01.824653+0000","last_unstale":"2024-05-21T13:41:24.551291+0000","last_undegraded":"2024-05-21T13:41:24.551291+0000","last_fullsized":"2024-05-21T13:41:24.551291+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'280","last_scrub_stamp":"2024-05-21T13:41:24.551076+0000","last_deep_scrub":"27'280","last_deep_scrub_stamp":"2024-05-21T13:41:24.551076+0000","last_clean_scrub_stamp":"2024-05-21T13:41:24.551076+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:23:35.599181+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":280,"num_write_kb":761856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"27'6","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:26.546646+0000","last_change":"2024-05-21T13:41:26.546805+0000","last_active":"2024-05-21T13:41:26.546646+0000","last_peered":"2024-05-21T13:41:26.546646+0000","last_clean":"2024-05-21T13:41:26.546646+0000","last_became_active":"2024-05-21T13:35:57.771695+0000","last_became_peered":"2024-05-21T13:35:57.771695+0000","last_unstale":"2024-05-21T13:41:26.546646+0000","last_undegraded":"2024-05-21T13:41:26.546646+0000","last_fullsized":"2024-05-21T13:41:26.546646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-21T13:41:26.546432+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-21T13:41:26.546432+0000","last_clean_scrub_stamp":"2024-05-21T13:41:26.546432+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:59:41.501788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"27'2","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:22.853236+0000","last_change":"2024-05-21T13:41:22.853324+0000","last_active":"2024-05-21T13:41:22.853236+0000","last_peered":"2024-05-21T13:41:22.853236+0000","last_clean":"2024-05-21T13:41:22.853236+0000","last_became_active":"2024-05-21T13:35:56.767053+0000","last_became_peered":"2024-05-21T13:35:56.767053+0000","last_unstale":"2024-05-21T13:41:22.853236+0000","last_undegraded":"2024-05-21T13:41:22.853236+0000","last_fullsized":"2024-05-21T13:41:22.853236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-21T13:41:22.853060+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-21T13:41:22.853060+0000","last_clean_scrub_stamp":"2024-05-21T13:41:22.853060+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:58:34.468299+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"27'261","reported_seq":290,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:34.022244+0000","last_change":"2024-05-21T13:41:34.022309+0000","last_active":"2024-05-21T13:41:34.022244+0000","last_peered":"2024-05-21T13:41:34.022244+0000","last_clean":"2024-05-21T13:41:34.022244+0000","last_became_active":"2024-05-21T13:36:01.832972+0000","last_became_peered":"2024-05-21T13:36:01.832972+0000","last_unstale":"2024-05-21T13:41:34.022244+0000","last_undegraded":"2024-05-21T13:41:34.022244+0000","last_fullsized":"2024-05-21T13:41:34.022244+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'261","last_scrub_stamp":"2024-05-21T13:41:34.022053+0000","last_deep_scrub":"27'261","last_deep_scrub_stamp":"2024-05-21T13:41:34.022053+0000","last_clean_scrub_stamp":"2024-05-21T13:41:34.022053+0000","objects_scrubbed":0,"log_size":261,"log_dups_size":0,"ondisk_log_size":261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:57:42.236208+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":261,"num_write_kb":712704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"27'9","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:24.572519+0000","last_change":"2024-05-21T13:41:24.572576+0000","last_active":"2024-05-21T13:41:24.572519+0000","last_peered":"2024-05-21T13:41:24.572519+0000","last_clean":"2024-05-21T13:41:24.572519+0000","last_became_active":"2024-05-21T13:35:57.765756+0000","last_became_peered":"2024-05-21T13:35:57.765756+0000","last_unstale":"2024-05-21T13:41:24.572519+0000","last_undegraded":"2024-05-21T13:41:24.572519+0000","last_fullsized":"2024-05-21T13:41:24.572519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-05-21T13:41:24.572359+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-05-21T13:41:24.572359+0000","last_clean_scrub_stamp":"2024-05-21T13:41:24.572359+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:22:57.326653+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"27'3","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:22.700860+0000","last_change":"2024-05-21T13:41:22.700934+0000","last_active":"2024-05-21T13:41:22.700860+0000","last_peered":"2024-05-21T13:41:22.700860+0000","last_clean":"2024-05-21T13:41:22.700860+0000","last_became_active":"2024-05-21T13:35:56.769767+0000","last_became_peered":"2024-05-21T13:35:56.769767+0000","last_unstale":"2024-05-21T13:41:22.700860+0000","last_undegraded":"2024-05-21T13:41:22.700860+0000","last_fullsized":"2024-05-21T13:41:22.700860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-05-21T13:41:22.700668+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-05-21T13:41:22.700668+0000","last_clean_scrub_stamp":"2024-05-21T13:41:22.700668+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:24:21.267653+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"27'318","reported_seq":339,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.418290+0000","last_change":"2024-05-21T13:36:01.827091+0000","last_active":"2024-05-21T13:41:07.418290+0000","last_peered":"2024-05-21T13:41:07.418290+0000","last_clean":"2024-05-21T13:41:07.418290+0000","last_became_active":"2024-05-21T13:36:01.826686+0000","last_became_peered":"2024-05-21T13:36:01.826686+0000","last_unstale":"2024-05-21T13:41:07.418290+0000","last_undegraded":"2024-05-21T13:41:07.418290+0000","last_fullsized":"2024-05-21T13:41:07.418290+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":318,"log_dups_size":0,"ondisk_log_size":318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":318,"num_write_kb":868352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"27'5","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:19.643131+0000","last_change":"2024-05-21T13:41:19.643256+0000","last_active":"2024-05-21T13:41:19.643131+0000","last_peered":"2024-05-21T13:41:19.643131+0000","last_clean":"2024-05-21T13:41:19.643131+0000","last_became_active":"2024-05-21T13:35:57.781111+0000","last_became_peered":"2024-05-21T13:35:57.781111+0000","last_unstale":"2024-05-21T13:41:19.643131+0000","last_undegraded":"2024-05-21T13:41:19.643131+0000","last_fullsized":"2024-05-21T13:41:19.643131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-05-21T13:41:19.642928+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-05-21T13:41:19.642928+0000","last_clean_scrub_stamp":"2024-05-21T13:41:19.642928+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:01:31.321416+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"27'4","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:23.608852+0000","last_change":"2024-05-21T13:41:23.608917+0000","last_active":"2024-05-21T13:41:23.608852+0000","last_peered":"2024-05-21T13:41:23.608852+0000","last_clean":"2024-05-21T13:41:23.608852+0000","last_became_active":"2024-05-21T13:35:56.755158+0000","last_became_peered":"2024-05-21T13:35:56.755158+0000","last_unstale":"2024-05-21T13:41:23.608852+0000","last_undegraded":"2024-05-21T13:41:23.608852+0000","last_fullsized":"2024-05-21T13:41:23.608852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-21T13:41:23.608674+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-21T13:41:23.608674+0000","last_clean_scrub_stamp":"2024-05-21T13:41:23.608674+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:29:59.895796+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"27'258","reported_seq":287,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:23.599001+0000","last_change":"2024-05-21T13:41:23.599120+0000","last_active":"2024-05-21T13:41:23.599001+0000","last_peered":"2024-05-21T13:41:23.599001+0000","last_clean":"2024-05-21T13:41:23.599001+0000","last_became_active":"2024-05-21T13:36:01.826374+0000","last_became_peered":"2024-05-21T13:36:01.826374+0000","last_unstale":"2024-05-21T13:41:23.599001+0000","last_undegraded":"2024-05-21T13:41:23.599001+0000","last_fullsized":"2024-05-21T13:41:23.599001+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'258","last_scrub_stamp":"2024-05-21T13:41:23.598765+0000","last_deep_scrub":"27'258","last_deep_scrub_stamp":"2024-05-21T13:41:23.598765+0000","last_clean_scrub_stamp":"2024-05-21T13:41:23.598765+0000","objects_scrubbed":0,"log_size":258,"log_dups_size":0,"ondisk_log_size":258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:34:33.896882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":258,"num_write_kb":704512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"27'6","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:24.624918+0000","last_change":"2024-05-21T13:41:24.625007+0000","last_active":"2024-05-21T13:41:24.624918+0000","last_peered":"2024-05-21T13:41:24.624918+0000","last_clean":"2024-05-21T13:41:24.624918+0000","last_became_active":"2024-05-21T13:35:57.787544+0000","last_became_peered":"2024-05-21T13:35:57.787544+0000","last_unstale":"2024-05-21T13:41:24.624918+0000","last_undegraded":"2024-05-21T13:41:24.624918+0000","last_fullsized":"2024-05-21T13:41:24.624918+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-21T13:41:24.624727+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-21T13:41:24.624727+0000","last_clean_scrub_stamp":"2024-05-21T13:41:24.624727+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:34:25.994023+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"27'24","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:21.727952+0000","last_change":"2024-05-21T13:41:21.727998+0000","last_active":"2024-05-21T13:41:21.727952+0000","last_peered":"2024-05-21T13:41:21.727952+0000","last_clean":"2024-05-21T13:41:21.727952+0000","last_became_active":"2024-05-21T13:35:56.752342+0000","last_became_peered":"2024-05-21T13:35:56.752342+0000","last_unstale":"2024-05-21T13:41:21.727952+0000","last_undegraded":"2024-05-21T13:41:21.727952+0000","last_fullsized":"2024-05-21T13:41:21.727952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'24","last_scrub_stamp":"2024-05-21T13:41:21.727867+0000","last_deep_scrub":"27'24","last_deep_scrub_stamp":"2024-05-21T13:41:21.727867+0000","last_clean_scrub_stamp":"2024-05-21T13:41:21.727867+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:53:07.219186+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"27'360","reported_seq":381,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.430467+0000","last_change":"2024-05-21T13:36:01.859498+0000","last_active":"2024-05-21T13:41:07.430467+0000","last_peered":"2024-05-21T13:41:07.430467+0000","last_clean":"2024-05-21T13:41:07.430467+0000","last_became_active":"2024-05-21T13:36:01.857707+0000","last_became_peered":"2024-05-21T13:36:01.857707+0000","last_unstale":"2024-05-21T13:41:07.430467+0000","last_undegraded":"2024-05-21T13:41:07.430467+0000","last_fullsized":"2024-05-21T13:41:07.430467+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":360,"num_write_kb":983040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"27'6","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:20.562874+0000","last_change":"2024-05-21T13:41:20.562938+0000","last_active":"2024-05-21T13:41:20.562874+0000","last_peered":"2024-05-21T13:41:20.562874+0000","last_clean":"2024-05-21T13:41:20.562874+0000","last_became_active":"2024-05-21T13:35:57.782330+0000","last_became_peered":"2024-05-21T13:35:57.782330+0000","last_unstale":"2024-05-21T13:41:20.562874+0000","last_undegraded":"2024-05-21T13:41:20.562874+0000","last_fullsized":"2024-05-21T13:41:20.562874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-21T13:41:20.562656+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-21T13:41:20.562656+0000","last_clean_scrub_stamp":"2024-05-21T13:41:20.562656+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:29:18.178059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"27'5","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:21.580067+0000","last_change":"2024-05-21T13:41:21.580140+0000","last_active":"2024-05-21T13:41:21.580067+0000","last_peered":"2024-05-21T13:41:21.580067+0000","last_clean":"2024-05-21T13:41:21.580067+0000","last_became_active":"2024-05-21T13:35:56.745202+0000","last_became_peered":"2024-05-21T13:35:56.745202+0000","last_unstale":"2024-05-21T13:41:21.580067+0000","last_undegraded":"2024-05-21T13:41:21.580067+0000","last_fullsized":"2024-05-21T13:41:21.580067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-05-21T13:41:21.579880+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-05-21T13:41:21.579880+0000","last_clean_scrub_stamp":"2024-05-21T13:41:21.579880+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:13:16.241276+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"27'273","reported_seq":294,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.416910+0000","last_change":"2024-05-21T13:36:01.858550+0000","last_active":"2024-05-21T13:41:07.416910+0000","last_peered":"2024-05-21T13:41:07.416910+0000","last_clean":"2024-05-21T13:41:07.416910+0000","last_became_active":"2024-05-21T13:36:01.857716+0000","last_became_peered":"2024-05-21T13:36:01.857716+0000","last_unstale":"2024-05-21T13:41:07.416910+0000","last_undegraded":"2024-05-21T13:41:07.416910+0000","last_fullsized":"2024-05-21T13:41:07.416910+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"27'15","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:05.824509+0000","last_change":"2024-05-21T13:35:57.799702+0000","last_active":"2024-05-21T13:41:05.824509+0000","last_peered":"2024-05-21T13:41:05.824509+0000","last_clean":"2024-05-21T13:41:05.824509+0000","last_became_active":"2024-05-21T13:35:57.799225+0000","last_became_peered":"2024-05-21T13:35:57.799225+0000","last_unstale":"2024-05-21T13:41:05.824509+0000","last_undegraded":"2024-05-21T13:41:05.824509+0000","last_fullsized":"2024-05-21T13:41:05.824509+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:35:56.710999+0000","last_clean_scrub_stamp":"2024-05-21T13:35:56.710999+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"27'4","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:28.580187+0000","last_change":"2024-05-21T13:41:28.580256+0000","last_active":"2024-05-21T13:41:28.580187+0000","last_peered":"2024-05-21T13:41:28.580187+0000","last_clean":"2024-05-21T13:41:28.580187+0000","last_became_active":"2024-05-21T13:35:56.742296+0000","last_became_peered":"2024-05-21T13:35:56.742296+0000","last_unstale":"2024-05-21T13:41:28.580187+0000","last_undegraded":"2024-05-21T13:41:28.580187+0000","last_fullsized":"2024-05-21T13:41:28.580187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-21T13:41:28.580015+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-21T13:41:28.580015+0000","last_clean_scrub_stamp":"2024-05-21T13:41:28.580015+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:28:54.152803+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"27'273","reported_seq":302,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:32.745997+0000","last_change":"2024-05-21T13:41:32.746059+0000","last_active":"2024-05-21T13:41:32.745997+0000","last_peered":"2024-05-21T13:41:32.745997+0000","last_clean":"2024-05-21T13:41:32.745997+0000","last_became_active":"2024-05-21T13:36:01.872320+0000","last_became_peered":"2024-05-21T13:36:01.872320+0000","last_unstale":"2024-05-21T13:41:32.745997+0000","last_undegraded":"2024-05-21T13:41:32.745997+0000","last_fullsized":"2024-05-21T13:41:32.745997+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'273","last_scrub_stamp":"2024-05-21T13:41:32.745819+0000","last_deep_scrub":"27'273","last_deep_scrub_stamp":"2024-05-21T13:41:32.745819+0000","last_clean_scrub_stamp":"2024-05-21T13:41:32.745819+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:13:23.814137+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"27'10","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:27.804499+0000","last_change":"2024-05-21T13:41:27.804557+0000","last_active":"2024-05-21T13:41:27.804499+0000","last_peered":"2024-05-21T13:41:27.804499+0000","last_clean":"2024-05-21T13:41:27.804499+0000","last_became_active":"2024-05-21T13:35:57.802433+0000","last_became_peered":"2024-05-21T13:35:57.802433+0000","last_unstale":"2024-05-21T13:41:27.804499+0000","last_undegraded":"2024-05-21T13:41:27.804499+0000","last_fullsized":"2024-05-21T13:41:27.804499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-05-21T13:41:27.804326+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-05-21T13:41:27.804326+0000","last_clean_scrub_stamp":"2024-05-21T13:41:27.804326+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:11:31.962586+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"27'10","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:18.825729+0000","last_change":"2024-05-21T13:41:18.825802+0000","last_active":"2024-05-21T13:41:18.825729+0000","last_peered":"2024-05-21T13:41:18.825729+0000","last_clean":"2024-05-21T13:41:18.825729+0000","last_became_active":"2024-05-21T13:35:56.753319+0000","last_became_peered":"2024-05-21T13:35:56.753319+0000","last_unstale":"2024-05-21T13:41:18.825729+0000","last_undegraded":"2024-05-21T13:41:18.825729+0000","last_fullsized":"2024-05-21T13:41:18.825729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-05-21T13:41:18.825556+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-05-21T13:41:18.825556+0000","last_clean_scrub_stamp":"2024-05-21T13:41:18.825556+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:01:21.302956+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"27'327","reported_seq":348,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.387067+0000","last_change":"2024-05-21T13:36:01.836017+0000","last_active":"2024-05-21T13:41:07.387067+0000","last_peered":"2024-05-21T13:41:07.387067+0000","last_clean":"2024-05-21T13:41:07.387067+0000","last_became_active":"2024-05-21T13:36:01.835450+0000","last_became_peered":"2024-05-21T13:36:01.835450+0000","last_unstale":"2024-05-21T13:41:07.387067+0000","last_undegraded":"2024-05-21T13:41:07.387067+0000","last_fullsized":"2024-05-21T13:41:07.387067+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":327,"num_write_kb":892928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"27'6","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:27.509483+0000","last_change":"2024-05-21T13:41:27.509545+0000","last_active":"2024-05-21T13:41:27.509483+0000","last_peered":"2024-05-21T13:41:27.509483+0000","last_clean":"2024-05-21T13:41:27.509483+0000","last_became_active":"2024-05-21T13:35:57.786401+0000","last_became_peered":"2024-05-21T13:35:57.786401+0000","last_unstale":"2024-05-21T13:41:27.509483+0000","last_undegraded":"2024-05-21T13:41:27.509483+0000","last_fullsized":"2024-05-21T13:41:27.509483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-21T13:41:27.509298+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-21T13:41:27.509298+0000","last_clean_scrub_stamp":"2024-05-21T13:41:27.509298+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:58:50.520787+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'103","reported_seq":140,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:16.724866+0000","last_change":"2024-05-21T13:41:16.724931+0000","last_active":"2024-05-21T13:41:16.724866+0000","last_peered":"2024-05-21T13:41:16.724866+0000","last_clean":"2024-05-21T13:41:16.724866+0000","last_became_active":"2024-05-21T13:35:56.750831+0000","last_became_peered":"2024-05-21T13:35:56.750831+0000","last_unstale":"2024-05-21T13:41:16.724866+0000","last_undegraded":"2024-05-21T13:41:16.724866+0000","last_fullsized":"2024-05-21T13:41:16.724866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'103","last_scrub_stamp":"2024-05-21T13:41:16.724742+0000","last_deep_scrub":"27'103","last_deep_scrub_stamp":"2024-05-21T13:41:16.724742+0000","last_clean_scrub_stamp":"2024-05-21T13:41:16.724742+0000","objects_scrubbed":5,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:18:47.432591+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209875,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":100,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"27'289","reported_seq":318,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:28.747025+0000","last_change":"2024-05-21T13:41:28.747089+0000","last_active":"2024-05-21T13:41:28.747025+0000","last_peered":"2024-05-21T13:41:28.747025+0000","last_clean":"2024-05-21T13:41:28.747025+0000","last_became_active":"2024-05-21T13:36:01.831476+0000","last_became_peered":"2024-05-21T13:36:01.831476+0000","last_unstale":"2024-05-21T13:41:28.747025+0000","last_undegraded":"2024-05-21T13:41:28.747025+0000","last_fullsized":"2024-05-21T13:41:28.747025+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'289","last_scrub_stamp":"2024-05-21T13:41:28.746820+0000","last_deep_scrub":"27'289","last_deep_scrub_stamp":"2024-05-21T13:41:28.746820+0000","last_clean_scrub_stamp":"2024-05-21T13:41:28.746820+0000","objects_scrubbed":0,"log_size":289,"log_dups_size":0,"ondisk_log_size":289,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:17:47.177363+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":288,"num_write_kb":786432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"27'11","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:22.586238+0000","last_change":"2024-05-21T13:41:22.586301+0000","last_active":"2024-05-21T13:41:22.586238+0000","last_peered":"2024-05-21T13:41:22.586238+0000","last_clean":"2024-05-21T13:41:22.586238+0000","last_became_active":"2024-05-21T13:35:57.787785+0000","last_became_peered":"2024-05-21T13:35:57.787785+0000","last_unstale":"2024-05-21T13:41:22.586238+0000","last_undegraded":"2024-05-21T13:41:22.586238+0000","last_fullsized":"2024-05-21T13:41:22.586238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'11","last_scrub_stamp":"2024-05-21T13:41:22.586052+0000","last_deep_scrub":"27'11","last_deep_scrub_stamp":"2024-05-21T13:41:22.586052+0000","last_clean_scrub_stamp":"2024-05-21T13:41:22.586052+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:56:53.588119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"27'12","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:19.821151+0000","last_change":"2024-05-21T13:41:19.821223+0000","last_active":"2024-05-21T13:41:19.821151+0000","last_peered":"2024-05-21T13:41:19.821151+0000","last_clean":"2024-05-21T13:41:19.821151+0000","last_became_active":"2024-05-21T13:35:56.759728+0000","last_became_peered":"2024-05-21T13:35:56.759728+0000","last_unstale":"2024-05-21T13:41:19.821151+0000","last_undegraded":"2024-05-21T13:41:19.821151+0000","last_fullsized":"2024-05-21T13:41:19.821151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'12","last_scrub_stamp":"2024-05-21T13:41:19.820982+0000","last_deep_scrub":"27'12","last_deep_scrub_stamp":"2024-05-21T13:41:19.820982+0000","last_clean_scrub_stamp":"2024-05-21T13:41:19.820982+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:28:39.145141+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"27'297","reported_seq":326,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:30.566720+0000","last_change":"2024-05-21T13:41:30.566787+0000","last_active":"2024-05-21T13:41:30.566720+0000","last_peered":"2024-05-21T13:41:30.566720+0000","last_clean":"2024-05-21T13:41:30.566720+0000","last_became_active":"2024-05-21T13:36:01.861172+0000","last_became_peered":"2024-05-21T13:36:01.861172+0000","last_unstale":"2024-05-21T13:41:30.566720+0000","last_undegraded":"2024-05-21T13:41:30.566720+0000","last_fullsized":"2024-05-21T13:41:30.566720+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'297","last_scrub_stamp":"2024-05-21T13:41:30.566517+0000","last_deep_scrub":"27'297","last_deep_scrub_stamp":"2024-05-21T13:41:30.566517+0000","last_clean_scrub_stamp":"2024-05-21T13:41:30.566517+0000","objects_scrubbed":0,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:28:19.610249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":297,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"27'9","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:32.976891+0000","last_change":"2024-05-21T13:41:32.976950+0000","last_active":"2024-05-21T13:41:32.976891+0000","last_peered":"2024-05-21T13:41:32.976891+0000","last_clean":"2024-05-21T13:41:32.976891+0000","last_became_active":"2024-05-21T13:35:57.804139+0000","last_became_peered":"2024-05-21T13:35:57.804139+0000","last_unstale":"2024-05-21T13:41:32.976891+0000","last_undegraded":"2024-05-21T13:41:32.976891+0000","last_fullsized":"2024-05-21T13:41:32.976891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-05-21T13:41:32.976718+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-05-21T13:41:32.976718+0000","last_clean_scrub_stamp":"2024-05-21T13:41:32.976718+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:00:24.779936+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"27'3","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:19.589755+0000","last_change":"2024-05-21T13:41:19.589833+0000","last_active":"2024-05-21T13:41:19.589755+0000","last_peered":"2024-05-21T13:41:19.589755+0000","last_clean":"2024-05-21T13:41:19.589755+0000","last_became_active":"2024-05-21T13:35:56.732488+0000","last_became_peered":"2024-05-21T13:35:56.732488+0000","last_unstale":"2024-05-21T13:41:19.589755+0000","last_undegraded":"2024-05-21T13:41:19.589755+0000","last_fullsized":"2024-05-21T13:41:19.589755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-05-21T13:41:19.589546+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-05-21T13:41:19.589546+0000","last_clean_scrub_stamp":"2024-05-21T13:41:19.589546+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:32:35.644245+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"27'297","reported_seq":326,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:26.822514+0000","last_change":"2024-05-21T13:41:26.822576+0000","last_active":"2024-05-21T13:41:26.822514+0000","last_peered":"2024-05-21T13:41:26.822514+0000","last_clean":"2024-05-21T13:41:26.822514+0000","last_became_active":"2024-05-21T13:36:01.864254+0000","last_became_peered":"2024-05-21T13:36:01.864254+0000","last_unstale":"2024-05-21T13:41:26.822514+0000","last_undegraded":"2024-05-21T13:41:26.822514+0000","last_fullsized":"2024-05-21T13:41:26.822514+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'297","last_scrub_stamp":"2024-05-21T13:41:26.822339+0000","last_deep_scrub":"27'297","last_deep_scrub_stamp":"2024-05-21T13:41:26.822339+0000","last_clean_scrub_stamp":"2024-05-21T13:41:26.822339+0000","objects_scrubbed":0,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:37:47.236373+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":297,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"27'10","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:22.581198+0000","last_change":"2024-05-21T13:41:22.581255+0000","last_active":"2024-05-21T13:41:22.581198+0000","last_peered":"2024-05-21T13:41:22.581198+0000","last_clean":"2024-05-21T13:41:22.581198+0000","last_became_active":"2024-05-21T13:35:57.787963+0000","last_became_peered":"2024-05-21T13:35:57.787963+0000","last_unstale":"2024-05-21T13:41:22.581198+0000","last_undegraded":"2024-05-21T13:41:22.581198+0000","last_fullsized":"2024-05-21T13:41:22.581198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-05-21T13:41:22.581027+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-05-21T13:41:22.581027+0000","last_clean_scrub_stamp":"2024-05-21T13:41:22.581027+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:47:18.778141+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"27'6","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:17.528348+0000","last_change":"2024-05-21T13:41:17.528374+0000","last_active":"2024-05-21T13:41:17.528348+0000","last_peered":"2024-05-21T13:41:17.528348+0000","last_clean":"2024-05-21T13:41:17.528348+0000","last_became_active":"2024-05-21T13:35:56.748049+0000","last_became_peered":"2024-05-21T13:35:56.748049+0000","last_unstale":"2024-05-21T13:41:17.528348+0000","last_undegraded":"2024-05-21T13:41:17.528348+0000","last_fullsized":"2024-05-21T13:41:17.528348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-21T13:41:17.528281+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-21T13:41:17.528281+0000","last_clean_scrub_stamp":"2024-05-21T13:41:17.528281+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:23:26.743768+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"27'327","reported_seq":356,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:32.671675+0000","last_change":"2024-05-21T13:41:32.671741+0000","last_active":"2024-05-21T13:41:32.671675+0000","last_peered":"2024-05-21T13:41:32.671675+0000","last_clean":"2024-05-21T13:41:32.671675+0000","last_became_active":"2024-05-21T13:36:01.855417+0000","last_became_peered":"2024-05-21T13:36:01.855417+0000","last_unstale":"2024-05-21T13:41:32.671675+0000","last_undegraded":"2024-05-21T13:41:32.671675+0000","last_fullsized":"2024-05-21T13:41:32.671675+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'327","last_scrub_stamp":"2024-05-21T13:41:32.671497+0000","last_deep_scrub":"27'327","last_deep_scrub_stamp":"2024-05-21T13:41:32.671497+0000","last_clean_scrub_stamp":"2024-05-21T13:41:32.671497+0000","objects_scrubbed":0,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:29:27.422410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":327,"num_write_kb":892928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"27'273","reported_seq":302,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:29.714145+0000","last_change":"2024-05-21T13:41:29.714209+0000","last_active":"2024-05-21T13:41:29.714145+0000","last_peered":"2024-05-21T13:41:29.714145+0000","last_clean":"2024-05-21T13:41:29.714145+0000","last_became_active":"2024-05-21T13:36:01.837777+0000","last_became_peered":"2024-05-21T13:36:01.837777+0000","last_unstale":"2024-05-21T13:41:29.714145+0000","last_undegraded":"2024-05-21T13:41:29.714145+0000","last_fullsized":"2024-05-21T13:41:29.714145+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'273","last_scrub_stamp":"2024-05-21T13:41:29.713969+0000","last_deep_scrub":"27'273","last_deep_scrub_stamp":"2024-05-21T13:41:29.713969+0000","last_clean_scrub_stamp":"2024-05-21T13:41:29.713969+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:26:54.144477+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"27'11","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:24.755770+0000","last_change":"2024-05-21T13:41:24.755845+0000","last_active":"2024-05-21T13:41:24.755770+0000","last_peered":"2024-05-21T13:41:24.755770+0000","last_clean":"2024-05-21T13:41:24.755770+0000","last_became_active":"2024-05-21T13:35:57.762071+0000","last_became_peered":"2024-05-21T13:35:57.762071+0000","last_unstale":"2024-05-21T13:41:24.755770+0000","last_undegraded":"2024-05-21T13:41:24.755770+0000","last_fullsized":"2024-05-21T13:41:24.755770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'11","last_scrub_stamp":"2024-05-21T13:41:24.755581+0000","last_deep_scrub":"27'11","last_deep_scrub_stamp":"2024-05-21T13:41:24.755581+0000","last_clean_scrub_stamp":"2024-05-21T13:41:24.755581+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:00:19.747625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"25'1","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:32.496921+0000","last_change":"2024-05-21T13:41:32.497056+0000","last_active":"2024-05-21T13:41:32.496921+0000","last_peered":"2024-05-21T13:41:32.496921+0000","last_clean":"2024-05-21T13:41:32.496921+0000","last_became_active":"2024-05-21T13:35:56.751201+0000","last_became_peered":"2024-05-21T13:35:56.751201+0000","last_unstale":"2024-05-21T13:41:32.496921+0000","last_undegraded":"2024-05-21T13:41:32.496921+0000","last_fullsized":"2024-05-21T13:41:32.496921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2024-05-21T13:41:32.496675+0000","last_deep_scrub":"25'1","last_deep_scrub_stamp":"2024-05-21T13:41:32.496675+0000","last_clean_scrub_stamp":"2024-05-21T13:41:32.496675+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:22:39.182625+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"27'267","reported_seq":288,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:07.473428+0000","last_change":"2024-05-21T13:36:01.837042+0000","last_active":"2024-05-21T13:41:07.473428+0000","last_peered":"2024-05-21T13:41:07.473428+0000","last_clean":"2024-05-21T13:41:07.473428+0000","last_became_active":"2024-05-21T13:36:01.836194+0000","last_became_peered":"2024-05-21T13:36:01.836194+0000","last_unstale":"2024-05-21T13:41:07.473428+0000","last_undegraded":"2024-05-21T13:41:07.473428+0000","last_fullsized":"2024-05-21T13:41:07.473428+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:36:00.780258+0000","last_clean_scrub_stamp":"2024-05-21T13:36:00.780258+0000","objects_scrubbed":0,"log_size":267,"log_dups_size":0,"ondisk_log_size":267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":267,"num_write_kb":729088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"27'8","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:31.971186+0000","last_change":"2024-05-21T13:41:31.971251+0000","last_active":"2024-05-21T13:41:31.971186+0000","last_peered":"2024-05-21T13:41:31.971186+0000","last_clean":"2024-05-21T13:41:31.971186+0000","last_became_active":"2024-05-21T13:35:57.786307+0000","last_became_peered":"2024-05-21T13:35:57.786307+0000","last_unstale":"2024-05-21T13:41:31.971186+0000","last_undegraded":"2024-05-21T13:41:31.971186+0000","last_fullsized":"2024-05-21T13:41:31.971186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-21T13:41:31.971005+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-21T13:41:31.971005+0000","last_clean_scrub_stamp":"2024-05-21T13:41:31.971005+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:05:31.840234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"27'3","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:18.824970+0000","last_change":"2024-05-21T13:41:18.825038+0000","last_active":"2024-05-21T13:41:18.824970+0000","last_peered":"2024-05-21T13:41:18.824970+0000","last_clean":"2024-05-21T13:41:18.824970+0000","last_became_active":"2024-05-21T13:35:56.745884+0000","last_became_peered":"2024-05-21T13:35:56.745884+0000","last_unstale":"2024-05-21T13:41:18.824970+0000","last_undegraded":"2024-05-21T13:41:18.824970+0000","last_fullsized":"2024-05-21T13:41:18.824970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-05-21T13:41:18.824811+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-05-21T13:41:18.824811+0000","last_clean_scrub_stamp":"2024-05-21T13:41:18.824811+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:06:01.517837+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"27'4","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:34.467396+0000","last_change":"2024-05-21T13:41:34.467460+0000","last_active":"2024-05-21T13:41:34.467396+0000","last_peered":"2024-05-21T13:41:34.467396+0000","last_clean":"2024-05-21T13:41:34.467396+0000","last_became_active":"2024-05-21T13:35:56.753499+0000","last_became_peered":"2024-05-21T13:35:56.753499+0000","last_unstale":"2024-05-21T13:41:34.467396+0000","last_undegraded":"2024-05-21T13:41:34.467396+0000","last_fullsized":"2024-05-21T13:41:34.467396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-21T13:41:34.467230+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-21T13:41:34.467230+0000","last_clean_scrub_stamp":"2024-05-21T13:41:34.467230+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:09:46.555569+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"27'8","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:33.666211+0000","last_change":"2024-05-21T13:41:33.666272+0000","last_active":"2024-05-21T13:41:33.666211+0000","last_peered":"2024-05-21T13:41:33.666211+0000","last_clean":"2024-05-21T13:41:33.666211+0000","last_became_active":"2024-05-21T13:36:39.802110+0000","last_became_peered":"2024-05-21T13:36:39.802110+0000","last_unstale":"2024-05-21T13:41:33.666211+0000","last_undegraded":"2024-05-21T13:41:33.666211+0000","last_fullsized":"2024-05-21T13:41:33.666211+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-21T13:41:33.666040+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-21T13:41:33.666040+0000","last_clean_scrub_stamp":"2024-05-21T13:41:33.666040+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:35:54.695748+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"27'297","reported_seq":326,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:31.716726+0000","last_change":"2024-05-21T13:41:31.716797+0000","last_active":"2024-05-21T13:41:31.716726+0000","last_peered":"2024-05-21T13:41:31.716726+0000","last_clean":"2024-05-21T13:41:31.716726+0000","last_became_active":"2024-05-21T13:36:01.842792+0000","last_became_peered":"2024-05-21T13:36:01.842792+0000","last_unstale":"2024-05-21T13:41:31.716726+0000","last_undegraded":"2024-05-21T13:41:31.716726+0000","last_fullsized":"2024-05-21T13:41:31.716726+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'297","last_scrub_stamp":"2024-05-21T13:41:31.716520+0000","last_deep_scrub":"27'297","last_deep_scrub_stamp":"2024-05-21T13:41:31.716520+0000","last_clean_scrub_stamp":"2024-05-21T13:41:31.716520+0000","objects_scrubbed":0,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:03:19.554032+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":297,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"27'8","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:23.870260+0000","last_change":"2024-05-21T13:41:23.870325+0000","last_active":"2024-05-21T13:41:23.870260+0000","last_peered":"2024-05-21T13:41:23.870260+0000","last_clean":"2024-05-21T13:41:23.870260+0000","last_became_active":"2024-05-21T13:35:56.766873+0000","last_became_peered":"2024-05-21T13:35:56.766873+0000","last_unstale":"2024-05-21T13:41:23.870260+0000","last_undegraded":"2024-05-21T13:41:23.870260+0000","last_fullsized":"2024-05-21T13:41:23.870260+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-21T13:41:23.870087+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-21T13:41:23.870087+0000","last_clean_scrub_stamp":"2024-05-21T13:41:23.870087+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:44:53.961087+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"27'7","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:21.548601+0000","last_change":"2024-05-21T13:41:21.548665+0000","last_active":"2024-05-21T13:41:21.548601+0000","last_peered":"2024-05-21T13:41:21.548601+0000","last_clean":"2024-05-21T13:41:21.548601+0000","last_became_active":"2024-05-21T13:35:57.787255+0000","last_became_peered":"2024-05-21T13:35:57.787255+0000","last_unstale":"2024-05-21T13:41:21.548601+0000","last_undegraded":"2024-05-21T13:41:21.548601+0000","last_fullsized":"2024-05-21T13:41:21.548601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-05-21T13:41:21.548424+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-05-21T13:41:21.548424+0000","last_clean_scrub_stamp":"2024-05-21T13:41:21.548424+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:52:10.906473+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"27'312","reported_seq":341,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:24.781189+0000","last_change":"2024-05-21T13:41:24.781309+0000","last_active":"2024-05-21T13:41:24.781189+0000","last_peered":"2024-05-21T13:41:24.781189+0000","last_clean":"2024-05-21T13:41:24.781189+0000","last_became_active":"2024-05-21T13:36:01.867522+0000","last_became_peered":"2024-05-21T13:36:01.867522+0000","last_unstale":"2024-05-21T13:41:24.781189+0000","last_undegraded":"2024-05-21T13:41:24.781189+0000","last_fullsized":"2024-05-21T13:41:24.781189+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'312","last_scrub_stamp":"2024-05-21T13:41:24.780942+0000","last_deep_scrub":"27'312","last_deep_scrub_stamp":"2024-05-21T13:41:24.780942+0000","last_clean_scrub_stamp":"2024-05-21T13:41:24.780942+0000","objects_scrubbed":0,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:24:25.852913+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":312,"num_write_kb":851968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"27'9","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:20.645057+0000","last_change":"2024-05-21T13:41:20.645176+0000","last_active":"2024-05-21T13:41:20.645057+0000","last_peered":"2024-05-21T13:41:20.645057+0000","last_clean":"2024-05-21T13:41:20.645057+0000","last_became_active":"2024-05-21T13:35:57.782233+0000","last_became_peered":"2024-05-21T13:35:57.782233+0000","last_unstale":"2024-05-21T13:41:20.645057+0000","last_undegraded":"2024-05-21T13:41:20.645057+0000","last_fullsized":"2024-05-21T13:41:20.645057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-05-21T13:41:20.644840+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-05-21T13:41:20.644840+0000","last_clean_scrub_stamp":"2024-05-21T13:41:20.644840+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:06:51.552866+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"27'12","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:21.843551+0000","last_change":"2024-05-21T13:41:21.843609+0000","last_active":"2024-05-21T13:41:21.843551+0000","last_peered":"2024-05-21T13:41:21.843551+0000","last_clean":"2024-05-21T13:41:21.843551+0000","last_became_active":"2024-05-21T13:35:57.769785+0000","last_became_peered":"2024-05-21T13:35:57.769785+0000","last_unstale":"2024-05-21T13:41:21.843551+0000","last_undegraded":"2024-05-21T13:41:21.843551+0000","last_fullsized":"2024-05-21T13:41:21.843551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'12","last_scrub_stamp":"2024-05-21T13:41:21.843385+0000","last_deep_scrub":"27'12","last_deep_scrub_stamp":"2024-05-21T13:41:21.843385+0000","last_clean_scrub_stamp":"2024-05-21T13:41:21.843385+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:18:21.380351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"27'8","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:25.657986+0000","last_change":"2024-05-21T13:41:25.658047+0000","last_active":"2024-05-21T13:41:25.657986+0000","last_peered":"2024-05-21T13:41:25.657986+0000","last_clean":"2024-05-21T13:41:25.657986+0000","last_became_active":"2024-05-21T13:35:57.796495+0000","last_became_peered":"2024-05-21T13:35:57.796495+0000","last_unstale":"2024-05-21T13:41:25.657986+0000","last_undegraded":"2024-05-21T13:41:25.657986+0000","last_fullsized":"2024-05-21T13:41:25.657986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-21T13:41:25.657816+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-21T13:41:25.657816+0000","last_clean_scrub_stamp":"2024-05-21T13:41:25.657816+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:06:39.514502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"27'7","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:20.882525+0000","last_change":"2024-05-21T13:41:20.882589+0000","last_active":"2024-05-21T13:41:20.882525+0000","last_peered":"2024-05-21T13:41:20.882525+0000","last_clean":"2024-05-21T13:41:20.882525+0000","last_became_active":"2024-05-21T13:35:57.783968+0000","last_became_peered":"2024-05-21T13:35:57.783968+0000","last_unstale":"2024-05-21T13:41:20.882525+0000","last_undegraded":"2024-05-21T13:41:20.882525+0000","last_fullsized":"2024-05-21T13:41:20.882525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-05-21T13:41:20.882357+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-05-21T13:41:20.882357+0000","last_clean_scrub_stamp":"2024-05-21T13:41:20.882357+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:10:21.235554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"27'4","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:26.790860+0000","last_change":"2024-05-21T13:41:26.790921+0000","last_active":"2024-05-21T13:41:26.790860+0000","last_peered":"2024-05-21T13:41:26.790860+0000","last_clean":"2024-05-21T13:41:26.790860+0000","last_became_active":"2024-05-21T13:35:57.794885+0000","last_became_peered":"2024-05-21T13:35:57.794885+0000","last_unstale":"2024-05-21T13:41:26.790860+0000","last_undegraded":"2024-05-21T13:41:26.790860+0000","last_fullsized":"2024-05-21T13:41:26.790860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-21T13:41:26.790691+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-21T13:41:26.790691+0000","last_clean_scrub_stamp":"2024-05-21T13:41:26.790691+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:56:59.609576+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"27'6","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:21.861939+0000","last_change":"2024-05-21T13:41:21.861997+0000","last_active":"2024-05-21T13:41:21.861939+0000","last_peered":"2024-05-21T13:41:21.861939+0000","last_clean":"2024-05-21T13:41:21.861939+0000","last_became_active":"2024-05-21T13:35:57.778171+0000","last_became_peered":"2024-05-21T13:35:57.778171+0000","last_unstale":"2024-05-21T13:41:21.861939+0000","last_undegraded":"2024-05-21T13:41:21.861939+0000","last_fullsized":"2024-05-21T13:41:21.861939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-21T13:41:21.861766+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-21T13:41:21.861766+0000","last_clean_scrub_stamp":"2024-05-21T13:41:21.861766+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:59:31.342570+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"27'15","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:23.550449+0000","last_change":"2024-05-21T13:41:23.550509+0000","last_active":"2024-05-21T13:41:23.550449+0000","last_peered":"2024-05-21T13:41:23.550449+0000","last_clean":"2024-05-21T13:41:23.550449+0000","last_became_active":"2024-05-21T13:35:57.790971+0000","last_became_peered":"2024-05-21T13:35:57.790971+0000","last_unstale":"2024-05-21T13:41:23.550449+0000","last_undegraded":"2024-05-21T13:41:23.550449+0000","last_fullsized":"2024-05-21T13:41:23.550449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2024-05-21T13:41:23.550270+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2024-05-21T13:41:23.550270+0000","last_clean_scrub_stamp":"2024-05-21T13:41:23.550270+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:28:39.274264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"27'2","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:18.903684+0000","last_change":"2024-05-21T13:41:18.903745+0000","last_active":"2024-05-21T13:41:18.903684+0000","last_peered":"2024-05-21T13:41:18.903684+0000","last_clean":"2024-05-21T13:41:18.903684+0000","last_became_active":"2024-05-21T13:35:57.781533+0000","last_became_peered":"2024-05-21T13:35:57.781533+0000","last_unstale":"2024-05-21T13:41:18.903684+0000","last_undegraded":"2024-05-21T13:41:18.903684+0000","last_fullsized":"2024-05-21T13:41:18.903684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-21T13:41:18.903495+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-21T13:41:18.903495+0000","last_clean_scrub_stamp":"2024-05-21T13:41:18.903495+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:26:11.651388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"27'6","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:23.632341+0000","last_change":"2024-05-21T13:41:23.632401+0000","last_active":"2024-05-21T13:41:23.632341+0000","last_peered":"2024-05-21T13:41:23.632341+0000","last_clean":"2024-05-21T13:41:23.632341+0000","last_became_active":"2024-05-21T13:35:57.797044+0000","last_became_peered":"2024-05-21T13:35:57.797044+0000","last_unstale":"2024-05-21T13:41:23.632341+0000","last_undegraded":"2024-05-21T13:41:23.632341+0000","last_fullsized":"2024-05-21T13:41:23.632341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-21T13:41:23.632167+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-21T13:41:23.632167+0000","last_clean_scrub_stamp":"2024-05-21T13:41:23.632167+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:49:46.790341+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"27'8","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:29.953896+0000","last_change":"2024-05-21T13:41:29.953966+0000","last_active":"2024-05-21T13:41:29.953896+0000","last_peered":"2024-05-21T13:41:29.953896+0000","last_clean":"2024-05-21T13:41:29.953896+0000","last_became_active":"2024-05-21T13:35:57.789474+0000","last_became_peered":"2024-05-21T13:35:57.789474+0000","last_unstale":"2024-05-21T13:41:29.953896+0000","last_undegraded":"2024-05-21T13:41:29.953896+0000","last_fullsized":"2024-05-21T13:41:29.953896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-21T13:41:29.953680+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-21T13:41:29.953680+0000","last_clean_scrub_stamp":"2024-05-21T13:41:29.953680+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:49:30.790938+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"27'10","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:18.508464+0000","last_change":"2024-05-21T13:41:18.508532+0000","last_active":"2024-05-21T13:41:18.508464+0000","last_peered":"2024-05-21T13:41:18.508464+0000","last_clean":"2024-05-21T13:41:18.508464+0000","last_became_active":"2024-05-21T13:35:57.755889+0000","last_became_peered":"2024-05-21T13:35:57.755889+0000","last_unstale":"2024-05-21T13:41:18.508464+0000","last_undegraded":"2024-05-21T13:41:18.508464+0000","last_fullsized":"2024-05-21T13:41:18.508464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-05-21T13:41:18.508354+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-05-21T13:41:18.508354+0000","last_clean_scrub_stamp":"2024-05-21T13:41:18.508354+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:27:33.246162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"27'11","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:17.717050+0000","last_change":"2024-05-21T13:41:17.717113+0000","last_active":"2024-05-21T13:41:17.717050+0000","last_peered":"2024-05-21T13:41:17.717050+0000","last_clean":"2024-05-21T13:41:17.717050+0000","last_became_active":"2024-05-21T13:35:57.774386+0000","last_became_peered":"2024-05-21T13:35:57.774386+0000","last_unstale":"2024-05-21T13:41:17.717050+0000","last_undegraded":"2024-05-21T13:41:17.717050+0000","last_fullsized":"2024-05-21T13:41:17.717050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'11","last_scrub_stamp":"2024-05-21T13:41:17.716879+0000","last_deep_scrub":"27'11","last_deep_scrub_stamp":"2024-05-21T13:41:17.716879+0000","last_clean_scrub_stamp":"2024-05-21T13:41:17.716879+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:34:15.346123+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"27'8","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:25.548260+0000","last_change":"2024-05-21T13:41:25.548323+0000","last_active":"2024-05-21T13:41:25.548260+0000","last_peered":"2024-05-21T13:41:25.548260+0000","last_clean":"2024-05-21T13:41:25.548260+0000","last_became_active":"2024-05-21T13:35:57.769149+0000","last_became_peered":"2024-05-21T13:35:57.769149+0000","last_unstale":"2024-05-21T13:41:25.548260+0000","last_undegraded":"2024-05-21T13:41:25.548260+0000","last_fullsized":"2024-05-21T13:41:25.548260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-21T13:41:25.548045+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-21T13:41:25.548045+0000","last_clean_scrub_stamp":"2024-05-21T13:41:25.548045+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:26:42.943590+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"27'7","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:17.544048+0000","last_change":"2024-05-21T13:41:17.544103+0000","last_active":"2024-05-21T13:41:17.544048+0000","last_peered":"2024-05-21T13:41:17.544048+0000","last_clean":"2024-05-21T13:41:17.544048+0000","last_became_active":"2024-05-21T13:35:57.795799+0000","last_became_peered":"2024-05-21T13:35:57.795799+0000","last_unstale":"2024-05-21T13:41:17.544048+0000","last_undegraded":"2024-05-21T13:41:17.544048+0000","last_fullsized":"2024-05-21T13:41:17.544048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-05-21T13:41:17.543930+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-05-21T13:41:17.543930+0000","last_clean_scrub_stamp":"2024-05-21T13:41:17.543930+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:41:34.259266+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"27'10","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:22.797277+0000","last_change":"2024-05-21T13:41:22.797334+0000","last_active":"2024-05-21T13:41:22.797277+0000","last_peered":"2024-05-21T13:41:22.797277+0000","last_clean":"2024-05-21T13:41:22.797277+0000","last_became_active":"2024-05-21T13:35:57.775573+0000","last_became_peered":"2024-05-21T13:35:57.775573+0000","last_unstale":"2024-05-21T13:41:22.797277+0000","last_undegraded":"2024-05-21T13:41:22.797277+0000","last_fullsized":"2024-05-21T13:41:22.797277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-05-21T13:41:22.797113+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-05-21T13:41:22.797113+0000","last_clean_scrub_stamp":"2024-05-21T13:41:22.797113+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:00:08.767138+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"27'8","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:35.510975+0000","last_change":"2024-05-21T13:41:35.511038+0000","last_active":"2024-05-21T13:41:35.510975+0000","last_peered":"2024-05-21T13:41:35.510975+0000","last_clean":"2024-05-21T13:41:35.510975+0000","last_became_active":"2024-05-21T13:35:57.799313+0000","last_became_peered":"2024-05-21T13:35:57.799313+0000","last_unstale":"2024-05-21T13:41:35.510975+0000","last_undegraded":"2024-05-21T13:41:35.510975+0000","last_fullsized":"2024-05-21T13:41:35.510975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-21T13:41:35.510788+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-21T13:41:35.510788+0000","last_clean_scrub_stamp":"2024-05-21T13:41:35.510788+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:55:01.906223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"27'9","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:18.506055+0000","last_change":"2024-05-21T13:41:18.506076+0000","last_active":"2024-05-21T13:41:18.506055+0000","last_peered":"2024-05-21T13:41:18.506055+0000","last_clean":"2024-05-21T13:41:18.506055+0000","last_became_active":"2024-05-21T13:35:57.787735+0000","last_became_peered":"2024-05-21T13:35:57.787735+0000","last_unstale":"2024-05-21T13:41:18.506055+0000","last_undegraded":"2024-05-21T13:41:18.506055+0000","last_fullsized":"2024-05-21T13:41:18.506055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-05-21T13:41:18.505984+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-05-21T13:41:18.505984+0000","last_clean_scrub_stamp":"2024-05-21T13:41:18.505984+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:18:38.904067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"27'7","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:19.856000+0000","last_change":"2024-05-21T13:41:19.856060+0000","last_active":"2024-05-21T13:41:19.856000+0000","last_peered":"2024-05-21T13:41:19.856000+0000","last_clean":"2024-05-21T13:41:19.856000+0000","last_became_active":"2024-05-21T13:35:57.786403+0000","last_became_peered":"2024-05-21T13:35:57.786403+0000","last_unstale":"2024-05-21T13:41:19.856000+0000","last_undegraded":"2024-05-21T13:41:19.856000+0000","last_fullsized":"2024-05-21T13:41:19.856000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-05-21T13:41:19.855823+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-05-21T13:41:19.855823+0000","last_clean_scrub_stamp":"2024-05-21T13:41:19.855823+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:44:49.291164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"27'8","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:23.846775+0000","last_change":"2024-05-21T13:41:23.846836+0000","last_active":"2024-05-21T13:41:23.846775+0000","last_peered":"2024-05-21T13:41:23.846775+0000","last_clean":"2024-05-21T13:41:23.846775+0000","last_became_active":"2024-05-21T13:35:57.783060+0000","last_became_peered":"2024-05-21T13:35:57.783060+0000","last_unstale":"2024-05-21T13:41:23.846775+0000","last_undegraded":"2024-05-21T13:41:23.846775+0000","last_fullsized":"2024-05-21T13:41:23.846775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-21T13:41:23.846594+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-21T13:41:23.846594+0000","last_clean_scrub_stamp":"2024-05-21T13:41:23.846594+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:22:01.719599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"27'10","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:25.790785+0000","last_change":"2024-05-21T13:41:25.790898+0000","last_active":"2024-05-21T13:41:25.790785+0000","last_peered":"2024-05-21T13:41:25.790785+0000","last_clean":"2024-05-21T13:41:25.790785+0000","last_became_active":"2024-05-21T13:35:57.787508+0000","last_became_peered":"2024-05-21T13:35:57.787508+0000","last_unstale":"2024-05-21T13:41:25.790785+0000","last_undegraded":"2024-05-21T13:41:25.790785+0000","last_fullsized":"2024-05-21T13:41:25.790785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-05-21T13:41:25.790520+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-05-21T13:41:25.790520+0000","last_clean_scrub_stamp":"2024-05-21T13:41:25.790520+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:18:09.987430+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"27'7","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:28.537725+0000","last_change":"2024-05-21T13:41:28.537873+0000","last_active":"2024-05-21T13:41:28.537725+0000","last_peered":"2024-05-21T13:41:28.537725+0000","last_clean":"2024-05-21T13:41:28.537725+0000","last_became_active":"2024-05-21T13:35:57.786292+0000","last_became_peered":"2024-05-21T13:35:57.786292+0000","last_unstale":"2024-05-21T13:41:28.537725+0000","last_undegraded":"2024-05-21T13:41:28.537725+0000","last_fullsized":"2024-05-21T13:41:28.537725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-05-21T13:41:28.537501+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-05-21T13:41:28.537501+0000","last_clean_scrub_stamp":"2024-05-21T13:41:28.537501+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:18:26.588695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"27'6","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:30.592388+0000","last_change":"2024-05-21T13:41:30.592452+0000","last_active":"2024-05-21T13:41:30.592388+0000","last_peered":"2024-05-21T13:41:30.592388+0000","last_clean":"2024-05-21T13:41:30.592388+0000","last_became_active":"2024-05-21T13:35:57.800858+0000","last_became_peered":"2024-05-21T13:35:57.800858+0000","last_unstale":"2024-05-21T13:41:30.592388+0000","last_undegraded":"2024-05-21T13:41:30.592388+0000","last_fullsized":"2024-05-21T13:41:30.592388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-21T13:41:30.592210+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-21T13:41:30.592210+0000","last_clean_scrub_stamp":"2024-05-21T13:41:30.592210+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:57:42.313631+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"27'16","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:17.531736+0000","last_change":"2024-05-21T13:41:17.531763+0000","last_active":"2024-05-21T13:41:17.531736+0000","last_peered":"2024-05-21T13:41:17.531736+0000","last_clean":"2024-05-21T13:41:17.531736+0000","last_became_active":"2024-05-21T13:35:57.777962+0000","last_became_peered":"2024-05-21T13:35:57.777962+0000","last_unstale":"2024-05-21T13:41:17.531736+0000","last_undegraded":"2024-05-21T13:41:17.531736+0000","last_fullsized":"2024-05-21T13:41:17.531736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'16","last_scrub_stamp":"2024-05-21T13:41:17.531662+0000","last_deep_scrub":"27'16","last_deep_scrub_stamp":"2024-05-21T13:41:17.531662+0000","last_clean_scrub_stamp":"2024-05-21T13:41:17.531662+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:46:19.125770+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"27'11","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:22.567889+0000","last_change":"2024-05-21T13:41:22.568021+0000","last_active":"2024-05-21T13:41:22.567889+0000","last_peered":"2024-05-21T13:41:22.567889+0000","last_clean":"2024-05-21T13:41:22.567889+0000","last_became_active":"2024-05-21T13:35:57.797793+0000","last_became_peered":"2024-05-21T13:35:57.797793+0000","last_unstale":"2024-05-21T13:41:22.567889+0000","last_undegraded":"2024-05-21T13:41:22.567889+0000","last_fullsized":"2024-05-21T13:41:22.567889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'11","last_scrub_stamp":"2024-05-21T13:41:22.567679+0000","last_deep_scrub":"27'11","last_deep_scrub_stamp":"2024-05-21T13:41:22.567679+0000","last_clean_scrub_stamp":"2024-05-21T13:41:22.567679+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:30:01.741483+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"27'9","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:28.934474+0000","last_change":"2024-05-21T13:41:28.934540+0000","last_active":"2024-05-21T13:41:28.934474+0000","last_peered":"2024-05-21T13:41:28.934474+0000","last_clean":"2024-05-21T13:41:28.934474+0000","last_became_active":"2024-05-21T13:35:57.782058+0000","last_became_peered":"2024-05-21T13:35:57.782058+0000","last_unstale":"2024-05-21T13:41:28.934474+0000","last_undegraded":"2024-05-21T13:41:28.934474+0000","last_fullsized":"2024-05-21T13:41:28.934474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-05-21T13:41:28.934299+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-05-21T13:41:28.934299+0000","last_clean_scrub_stamp":"2024-05-21T13:41:28.934299+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:58:06.516166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"27'5","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:15.455032+0000","last_change":"2024-05-21T13:41:15.455065+0000","last_active":"2024-05-21T13:41:15.455032+0000","last_peered":"2024-05-21T13:41:15.455032+0000","last_clean":"2024-05-21T13:41:15.455032+0000","last_became_active":"2024-05-21T13:35:57.779168+0000","last_became_peered":"2024-05-21T13:35:57.779168+0000","last_unstale":"2024-05-21T13:41:15.455032+0000","last_undegraded":"2024-05-21T13:41:15.455032+0000","last_fullsized":"2024-05-21T13:41:15.455032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-05-21T13:41:15.454935+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-05-21T13:41:15.454935+0000","last_clean_scrub_stamp":"2024-05-21T13:41:15.454935+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:10:30.165895+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"27'6","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:18.681774+0000","last_change":"2024-05-21T13:41:18.681890+0000","last_active":"2024-05-21T13:41:18.681774+0000","last_peered":"2024-05-21T13:41:18.681774+0000","last_clean":"2024-05-21T13:41:18.681774+0000","last_became_active":"2024-05-21T13:35:57.772268+0000","last_became_peered":"2024-05-21T13:35:57.772268+0000","last_unstale":"2024-05-21T13:41:18.681774+0000","last_undegraded":"2024-05-21T13:41:18.681774+0000","last_fullsized":"2024-05-21T13:41:18.681774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-21T13:41:18.681569+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-21T13:41:18.681569+0000","last_clean_scrub_stamp":"2024-05-21T13:41:18.681569+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:53:40.763037+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"27'4","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:29.554454+0000","last_change":"2024-05-21T13:41:29.554514+0000","last_active":"2024-05-21T13:41:29.554454+0000","last_peered":"2024-05-21T13:41:29.554454+0000","last_clean":"2024-05-21T13:41:29.554454+0000","last_became_active":"2024-05-21T13:35:57.788689+0000","last_became_peered":"2024-05-21T13:35:57.788689+0000","last_unstale":"2024-05-21T13:41:29.554454+0000","last_undegraded":"2024-05-21T13:41:29.554454+0000","last_fullsized":"2024-05-21T13:41:29.554454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-21T13:41:29.554275+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-21T13:41:29.554275+0000","last_clean_scrub_stamp":"2024-05-21T13:41:29.554275+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:16:33.218753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"27'8","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:17.677305+0000","last_change":"2024-05-21T13:41:17.677329+0000","last_active":"2024-05-21T13:41:17.677305+0000","last_peered":"2024-05-21T13:41:17.677305+0000","last_clean":"2024-05-21T13:41:17.677305+0000","last_became_active":"2024-05-21T13:35:57.772160+0000","last_became_peered":"2024-05-21T13:35:57.772160+0000","last_unstale":"2024-05-21T13:41:17.677305+0000","last_undegraded":"2024-05-21T13:41:17.677305+0000","last_fullsized":"2024-05-21T13:41:17.677305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-21T13:41:17.677230+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-21T13:41:17.677230+0000","last_clean_scrub_stamp":"2024-05-21T13:41:17.677230+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:47:59.673206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"27'7","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:17.908253+0000","last_change":"2024-05-21T13:41:17.908316+0000","last_active":"2024-05-21T13:41:17.908253+0000","last_peered":"2024-05-21T13:41:17.908253+0000","last_clean":"2024-05-21T13:41:17.908253+0000","last_became_active":"2024-05-21T13:35:57.784741+0000","last_became_peered":"2024-05-21T13:35:57.784741+0000","last_unstale":"2024-05-21T13:41:17.908253+0000","last_undegraded":"2024-05-21T13:41:17.908253+0000","last_fullsized":"2024-05-21T13:41:17.908253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-05-21T13:41:17.908066+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-05-21T13:41:17.908066+0000","last_clean_scrub_stamp":"2024-05-21T13:41:17.908066+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:22:07.867092+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"27'4","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:30.952280+0000","last_change":"2024-05-21T13:41:30.952404+0000","last_active":"2024-05-21T13:41:30.952280+0000","last_peered":"2024-05-21T13:41:30.952280+0000","last_clean":"2024-05-21T13:41:30.952280+0000","last_became_active":"2024-05-21T13:35:57.786629+0000","last_became_peered":"2024-05-21T13:35:57.786629+0000","last_unstale":"2024-05-21T13:41:30.952280+0000","last_undegraded":"2024-05-21T13:41:30.952280+0000","last_fullsized":"2024-05-21T13:41:30.952280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-21T13:41:30.952072+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-21T13:41:30.952072+0000","last_clean_scrub_stamp":"2024-05-21T13:41:30.952072+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:23:44.848821+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"27'8","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:31.561029+0000","last_change":"2024-05-21T13:41:31.561158+0000","last_active":"2024-05-21T13:41:31.561029+0000","last_peered":"2024-05-21T13:41:31.561029+0000","last_clean":"2024-05-21T13:41:31.561029+0000","last_became_active":"2024-05-21T13:35:57.802925+0000","last_became_peered":"2024-05-21T13:35:57.802925+0000","last_unstale":"2024-05-21T13:41:31.561029+0000","last_undegraded":"2024-05-21T13:41:31.561029+0000","last_fullsized":"2024-05-21T13:41:31.561029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-21T13:41:31.560829+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-21T13:41:31.560829+0000","last_clean_scrub_stamp":"2024-05-21T13:41:31.560829+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:36:45.106646+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9217,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9218,"ondisk_log_size":9218,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":503,"ondisk_log_size":503,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":214596,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":271,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15000,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":589824,"data_stored":429192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":294,"ondisk_log_size":294,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66916,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509514,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49528,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94322312,"statfs":{"total":96636764160,"available":96586047488,"internally_reserved":0,"allocated":311296,"data_stored":116594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509514,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49512,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94322328,"statfs":{"total":96636764160,"available":96586063872,"internally_reserved":0,"allocated":294912,"data_stored":116943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509513,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53676,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94318164,"statfs":{"total":96636764160,"available":96581799936,"internally_reserved":0,"allocated":299008,"data_stored":116383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509514,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27512,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":507904,"data_stored":325066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509514,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57892,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313948,"statfs":{"total":96636764160,"available":96577482752,"internally_reserved":0,"allocated":356352,"data_stored":705685,"data_compressed":33458,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509513,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39792,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94332048,"statfs":{"total":96636764160,"available":96596017152,"internally_reserved":0,"allocated":303104,"data_stored":116473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542216,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45428,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326412,"statfs":{"total":96636764160,"available":96590245888,"internally_reserved":0,"allocated":372736,"data_stored":707440,"data_compressed":33458,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574921,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45588,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326252,"statfs":{"total":96636764160,"available":96590082048,"internally_reserved":0,"allocated":536576,"data_stored":326600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33458,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33458,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":225280,"data_stored":209909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":253952,"data_stored":211443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-21T13:41:39.532 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-05-21T13:35:56.710999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=56, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:39.533 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-05-21T13:36:00.780258+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=36, tm_sec=0, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:39.534 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-05-21T13:36:00.780258+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=36, tm_sec=0, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:39.534 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-05-21T13:36:00.780258+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=36, tm_sec=0, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:39.535 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-05-21T13:36:00.780258+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=36, tm_sec=0, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:39.535 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-05-21T13:36:00.780258+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=36, tm_sec=0, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:39.536 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-05-21T13:36:00.780258+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=36, tm_sec=0, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:39.536 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-05-21T13:35:56.710999+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=35, tm_sec=56, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:39.536 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-05-21T13:36:00.780258+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=36, tm_sec=0, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:39.538 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-05-21T13:36:00.780258+0000 time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=36, tm_sec=0, tm_wday=1, tm_yday=142, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=5, tm_mday=21, tm_hour=13, tm_min=41, tm_sec=13, tm_wday=1, tm_yday=142, tm_isdst=0) 2024-05-21T13:41:39.539 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-05-21T13:41:59.540 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-05-21T13:41:59.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:59.701+0000 7f3e8cf1c640 1 Processor -- start 2024-05-21T13:41:59.677 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:59.701+0000 7f3e8cf1c640 1 -- start start 2024-05-21T13:41:59.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:59.701+0000 7f3e8cf1c640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3e88153cb0 0x7f3e880c9440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:59.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:59.701+0000 7f3e8cf1c640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f3e880c4d00 0x7f3e8815d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:59.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:59.701+0000 7f3e8cf1c640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e88159cf0 con 0x7f3e880c48f0 2024-05-21T13:41:59.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:59.701+0000 7f3e8cf1c640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f3e880c9c60 con 0x7f3e88153cb0 2024-05-21T13:41:59.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:59.701+0000 7f3e8cf1c640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f3e88159fd0 con 0x7f3e880c4d00 2024-05-21T13:41:59.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:59.701+0000 7f3e8659c640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3e88153cb0 0x7f3e880c9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:59.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:59.701+0000 7f3e8659c640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f3e88153cb0 0x7f3e880c9440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34146/0 (socket says 172.21.15.22:34146) 2024-05-21T13:41:59.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:59.701+0000 7f3e8659c640 1 -- 172.21.15.22:0/3211205688 learned_addr learned my addr 172.21.15.22:0/3211205688 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:41:59.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:59.701+0000 7f3e86d9d640 1 --2- 172.21.15.22:0/3211205688 >> v2:172.21.15.115:3300/0 conn(0x7f3e880c4d00 0x7f3e8815d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:59.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:59.701+0000 7f3e8659c640 1 -- 172.21.15.22:0/3211205688 >> v2:172.21.15.115:3300/0 conn(0x7f3e880c4d00 msgr2=0x7f3e8815d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:41:59.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:59.701+0000 7f3e8659c640 1 --2- 172.21.15.22:0/3211205688 >> v2:172.21.15.115:3300/0 conn(0x7f3e880c4d00 0x7f3e8815d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:59.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:59.701+0000 7f3e8659c640 1 -- 172.21.15.22:0/3211205688 >> v1:172.21.15.115:6789/0 conn(0x7f3e880c48f0 legacy=0x7f3e880c7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:41:59.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:59.701+0000 7f3e8659c640 1 -- 172.21.15.22:0/3211205688 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e8815a2b0 con 0x7f3e88153cb0 2024-05-21T13:41:59.683 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:59.705+0000 7f3e8659c640 1 --2- 172.21.15.22:0/3211205688 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e88153cb0 0x7f3e880c9440 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f3e880c4770 tx=0x7f3e7801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a3c94c575a66aee server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:59.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:59.705+0000 7f3e8559a640 1 -- 172.21.15.22:0/3211205688 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e780a5670 con 0x7f3e88153cb0 2024-05-21T13:41:59.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:59.705+0000 7f3e8559a640 1 -- 172.21.15.22:0/3211205688 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e780a5810 con 0x7f3e88153cb0 2024-05-21T13:41:59.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:59.705+0000 7f3e8559a640 1 -- 172.21.15.22:0/3211205688 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e780a5be0 con 0x7f3e88153cb0 2024-05-21T13:41:59.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:59.705+0000 7f3e8cf1c640 1 -- 172.21.15.22:0/3211205688 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e88153cb0 msgr2=0x7f3e880c9440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:59.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:59.705+0000 7f3e8cf1c640 1 --2- 172.21.15.22:0/3211205688 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e88153cb0 0x7f3e880c9440 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f3e880c4770 tx=0x7f3e7801c9f0 comp rx=0 tx=0).stop 2024-05-21T13:41:59.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:59.705+0000 7f3e8cf1c640 1 -- 172.21.15.22:0/3211205688 shutdown_connections 2024-05-21T13:41:59.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:59.705+0000 7f3e8cf1c640 1 --2- 172.21.15.22:0/3211205688 >> v2:172.21.15.115:3300/0 conn(0x7f3e880c4d00 0x7f3e8815d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:59.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:59.705+0000 7f3e8cf1c640 1 --2- 172.21.15.22:0/3211205688 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e88153cb0 0x7f3e880c9440 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:59.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:59.705+0000 7f3e8cf1c640 1 -- 172.21.15.22:0/3211205688 >> 172.21.15.22:0/3211205688 conn(0x7f3e8806ea10 msgr2=0x7f3e8806ff50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:41:59.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:59.705+0000 7f3e8cf1c640 1 -- 172.21.15.22:0/3211205688 shutdown_connections 2024-05-21T13:41:59.684 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:59.705+0000 7f3e8cf1c640 1 -- 172.21.15.22:0/3211205688 wait complete. 2024-05-21T13:41:59.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:59.709+0000 7f3e8cf1c640 1 Processor -- start 2024-05-21T13:41:59.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:59.709+0000 7f3e8cf1c640 1 -- start start 2024-05-21T13:41:59.686 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:59.709+0000 7f3e8cf1c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e880c48f0 0x7f3e88144750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:59.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:59.709+0000 7f3e8cf1c640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3e880c4d00 0x7f3e881f46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:59.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:59.709+0000 7f3e8cf1c640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e88153cb0 0x7f3e881f4c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:59.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:59.709+0000 7f3e8cf1c640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f3e88154090 con 0x7f3e880c48f0 2024-05-21T13:41:59.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:59.709+0000 7f3e8cf1c640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f3e8815db00 con 0x7f3e88153cb0 2024-05-21T13:41:59.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:59.709+0000 7f3e8cf1c640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f3e88154210 con 0x7f3e880c4d00 2024-05-21T13:41:59.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:59.709+0000 7f3e8659c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e880c48f0 0x7f3e88144750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:59.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:59.709+0000 7f3e8659c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e880c48f0 0x7f3e88144750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34166/0 (socket says 172.21.15.22:34166) 2024-05-21T13:41:59.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:59.709+0000 7f3e8659c640 1 -- 172.21.15.22:0/4208445452 learned_addr learned my addr 172.21.15.22:0/4208445452 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:41:59.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:59.709+0000 7f3e86d9d640 1 --2- 172.21.15.22:0/4208445452 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e88153cb0 0x7f3e881f4c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:59.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:59.709+0000 7f3e85d9b640 1 --2- 172.21.15.22:0/4208445452 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3e880c4d00 0x7f3e881f46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:59.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:59.709+0000 7f3e8659c640 1 -- 172.21.15.22:0/4208445452 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3e880c4d00 msgr2=0x7f3e881f46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:59.687 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:59.709+0000 7f3e8659c640 1 --2- 172.21.15.22:0/4208445452 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3e880c4d00 0x7f3e881f46f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:59.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:59.709+0000 7f3e8659c640 1 -- 172.21.15.22:0/4208445452 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e88153cb0 msgr2=0x7f3e881f4c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:59.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:59.709+0000 7f3e8659c640 1 --2- 172.21.15.22:0/4208445452 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e88153cb0 0x7f3e881f4c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:59.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:59.709+0000 7f3e8659c640 1 -- 172.21.15.22:0/4208445452 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e881f88c0 con 0x7f3e880c48f0 2024-05-21T13:41:59.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:59.709+0000 7f3e8659c640 1 --2- 172.21.15.22:0/4208445452 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e880c48f0 0x7f3e88144750 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f3e780af040 tx=0x7f3e78019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:59.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:59.709+0000 7f3e7effd640 1 -- 172.21.15.22:0/4208445452 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e780b8670 con 0x7f3e880c48f0 2024-05-21T13:41:59.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:59.709+0000 7f3e7effd640 1 -- 172.21.15.22:0/4208445452 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e780be070 con 0x7f3e880c48f0 2024-05-21T13:41:59.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:59.709+0000 7f3e8cf1c640 1 -- 172.21.15.22:0/4208445452 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e88150fc0 con 0x7f3e880c48f0 2024-05-21T13:41:59.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:59.709+0000 7f3e7effd640 1 -- 172.21.15.22:0/4208445452 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e780b8a70 con 0x7f3e880c48f0 2024-05-21T13:41:59.688 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:59.709+0000 7f3e8cf1c640 1 -- 172.21.15.22:0/4208445452 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e8814eeb0 con 0x7f3e880c48f0 2024-05-21T13:41:59.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:59.709+0000 7f3e8cf1c640 1 -- 172.21.15.22:0/4208445452 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e8814eca0 con 0x7f3e880c48f0 2024-05-21T13:41:59.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:59.709+0000 7f3e7effd640 1 -- 172.21.15.22:0/4208445452 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f3e780b8c10 con 0x7f3e880c48f0 2024-05-21T13:41:59.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:59.713+0000 7f3e7effd640 1 --2- 172.21.15.22:0/4208445452 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f3e6806f430 0x7f3e680718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:41:59.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:59.713+0000 7f3e7effd640 1 -- 172.21.15.22:0/4208445452 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f3e7812a0b0 con 0x7f3e880c48f0 2024-05-21T13:41:59.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:59.713+0000 7f3e85d9b640 1 --2- 172.21.15.22:0/4208445452 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f3e6806f430 0x7f3e680718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:41:59.689 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:59.713+0000 7f3e85d9b640 1 --2- 172.21.15.22:0/4208445452 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f3e6806f430 0x7f3e680718f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3e8815d030 tx=0x7f3e70008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:41:59.693 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:59.717+0000 7f3e7effd640 1 -- 172.21.15.22:0/4208445452 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f3e780c7020 con 0x7f3e880c48f0 2024-05-21T13:41:59.853 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:59.877+0000 7f3e8cf1c640 1 -- 172.21.15.22:0/4208445452 --> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3e881f8670 con 0x7f3e6806f430 2024-05-21T13:41:59.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:59.901+0000 7f3e7effd640 1 -- 172.21.15.22:0/4208445452 <== mgr.4103 v2:172.21.15.115:6832/184591771 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+333765 (secure 0 0 0) 0x7f3e881f8670 con 0x7f3e6806f430 2024-05-21T13:41:59.880 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-21T13:41:59.882 INFO:teuthology.orchestra.run.smithi022.stderr:dumped all 2024-05-21T13:41:59.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:59.905+0000 7f3e8cf1c640 1 -- 172.21.15.22:0/4208445452 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f3e6806f430 msgr2=0x7f3e680718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:59.884 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:59.905+0000 7f3e8cf1c640 1 --2- 172.21.15.22:0/4208445452 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f3e6806f430 0x7f3e680718f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f3e8815d030 tx=0x7f3e70008040 comp rx=0 tx=0).stop 2024-05-21T13:41:59.884 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:59.905+0000 7f3e8cf1c640 1 -- 172.21.15.22:0/4208445452 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e880c48f0 msgr2=0x7f3e88144750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:41:59.884 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:59.905+0000 7f3e8cf1c640 1 --2- 172.21.15.22:0/4208445452 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e880c48f0 0x7f3e88144750 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f3e780af040 tx=0x7f3e78019790 comp rx=0 tx=0).stop 2024-05-21T13:41:59.884 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:59.905+0000 7f3e8cf1c640 1 -- 172.21.15.22:0/4208445452 shutdown_connections 2024-05-21T13:41:59.884 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:59.905+0000 7f3e8cf1c640 1 --2- 172.21.15.22:0/4208445452 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f3e6806f430 0x7f3e680718f0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:59.884 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:59.905+0000 7f3e8cf1c640 1 --2- 172.21.15.22:0/4208445452 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f3e88153cb0 0x7f3e881f4c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:59.884 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:59.905+0000 7f3e8cf1c640 1 --2- 172.21.15.22:0/4208445452 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f3e880c4d00 0x7f3e881f46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:59.884 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:59.905+0000 7f3e8cf1c640 1 --2- 172.21.15.22:0/4208445452 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f3e880c48f0 0x7f3e88144750 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:41:59.884 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:59.905+0000 7f3e8cf1c640 1 -- 172.21.15.22:0/4208445452 >> 172.21.15.22:0/4208445452 conn(0x7f3e8806ea10 msgr2=0x7f3e88157a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:41:59.884 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:59.905+0000 7f3e8cf1c640 1 -- 172.21.15.22:0/4208445452 shutdown_connections 2024-05-21T13:41:59.884 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:41:59.905+0000 7f3e8cf1c640 1 -- 172.21.15.22:0/4208445452 wait complete. 2024-05-21T13:41:59.899 INFO:teuthology.orchestra.run.smithi022.stdout:{"pg_ready":true,"pg_map":{"version":208,"stamp":"2024-05-21T13:41:58.644094+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":804964,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":0,"num_read":70,"num_read_kb":59,"num_write":9589,"num_write_kb":25167758,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15000,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10089,"ondisk_log_size":10089,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":368928,"kb_used_data":2912,"kb_used_omap":12,"kb_used_meta":365939,"kb_avail":754605792,"statfs":{"total":773094113280,"available":772716331008,"internally_reserved":0,"allocated":2981888,"data_stored":2531184,"data_compressed":66916,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":12752,"internal_metadata":374722096},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005123"},"pg_stats":[{"pgid":"2.1f","version":"27'13","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:19.772416+0000","last_change":"2024-05-21T13:41:19.772551+0000","last_active":"2024-05-21T13:41:19.772416+0000","last_peered":"2024-05-21T13:41:19.772416+0000","last_clean":"2024-05-21T13:41:19.772416+0000","last_became_active":"2024-05-21T13:35:56.738481+0000","last_became_peered":"2024-05-21T13:35:56.738481+0000","last_unstale":"2024-05-21T13:41:19.772416+0000","last_undegraded":"2024-05-21T13:41:19.772416+0000","last_fullsized":"2024-05-21T13:41:19.772416+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'13","last_scrub_stamp":"2024-05-21T13:41:19.772153+0000","last_deep_scrub":"27'13","last_deep_scrub_stamp":"2024-05-21T13:41:19.772153+0000","last_clean_scrub_stamp":"2024-05-21T13:41:19.772153+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:20:53.783478+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1e","version":"27'5","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:25.913722+0000","last_change":"2024-05-21T13:41:25.913781+0000","last_active":"2024-05-21T13:41:25.913722+0000","last_peered":"2024-05-21T13:41:25.913722+0000","last_clean":"2024-05-21T13:41:25.913722+0000","last_became_active":"2024-05-21T13:35:57.778721+0000","last_became_peered":"2024-05-21T13:35:57.778721+0000","last_unstale":"2024-05-21T13:41:25.913722+0000","last_undegraded":"2024-05-21T13:41:25.913722+0000","last_fullsized":"2024-05-21T13:41:25.913722+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-05-21T13:41:25.913538+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-05-21T13:41:25.913538+0000","last_clean_scrub_stamp":"2024-05-21T13:41:25.913538+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:13:31.570624+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"27'306","reported_seq":329,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:33.514154+0000","last_change":"2024-05-21T13:41:33.514276+0000","last_active":"2024-05-21T13:41:33.514154+0000","last_peered":"2024-05-21T13:41:33.514154+0000","last_clean":"2024-05-21T13:41:33.514154+0000","last_became_active":"2024-05-21T13:36:39.720879+0000","last_became_peered":"2024-05-21T13:36:39.720879+0000","last_unstale":"2024-05-21T13:41:33.514154+0000","last_undegraded":"2024-05-21T13:41:33.514154+0000","last_fullsized":"2024-05-21T13:41:33.514154+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'306","last_scrub_stamp":"2024-05-21T13:41:33.513949+0000","last_deep_scrub":"27'306","last_deep_scrub_stamp":"2024-05-21T13:41:33.513949+0000","last_clean_scrub_stamp":"2024-05-21T13:41:33.513949+0000","objects_scrubbed":0,"log_size":306,"log_dups_size":0,"ondisk_log_size":306,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:42:11.573855+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":306,"num_write_kb":835584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4,1],"acting":[0,6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"25'2","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:24.891341+0000","last_change":"2024-05-21T13:41:24.891403+0000","last_active":"2024-05-21T13:41:24.891341+0000","last_peered":"2024-05-21T13:41:24.891341+0000","last_clean":"2024-05-21T13:41:24.891341+0000","last_became_active":"2024-05-21T13:35:56.770566+0000","last_became_peered":"2024-05-21T13:35:56.770566+0000","last_unstale":"2024-05-21T13:41:24.891341+0000","last_undegraded":"2024-05-21T13:41:24.891341+0000","last_fullsized":"2024-05-21T13:41:24.891341+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'2","last_scrub_stamp":"2024-05-21T13:41:24.891160+0000","last_deep_scrub":"25'2","last_deep_scrub_stamp":"2024-05-21T13:41:24.891160+0000","last_clean_scrub_stamp":"2024-05-21T13:41:24.891160+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:05:24.530831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1f","version":"27'6","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:27.924151+0000","last_change":"2024-05-21T13:41:27.924210+0000","last_active":"2024-05-21T13:41:27.924151+0000","last_peered":"2024-05-21T13:41:27.924151+0000","last_clean":"2024-05-21T13:41:27.924151+0000","last_became_active":"2024-05-21T13:35:57.780590+0000","last_became_peered":"2024-05-21T13:35:57.780590+0000","last_unstale":"2024-05-21T13:41:27.924151+0000","last_undegraded":"2024-05-21T13:41:27.924151+0000","last_fullsized":"2024-05-21T13:41:27.924151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-21T13:41:27.923980+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-21T13:41:27.923980+0000","last_clean_scrub_stamp":"2024-05-21T13:41:27.923980+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:53:17.469379+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.18","version":"27'339","reported_seq":368,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:28.578856+0000","last_change":"2024-05-21T13:41:28.578918+0000","last_active":"2024-05-21T13:41:28.578856+0000","last_peered":"2024-05-21T13:41:28.578856+0000","last_clean":"2024-05-21T13:41:28.578856+0000","last_became_active":"2024-05-21T13:36:01.851745+0000","last_became_peered":"2024-05-21T13:36:01.851745+0000","last_unstale":"2024-05-21T13:41:28.578856+0000","last_undegraded":"2024-05-21T13:41:28.578856+0000","last_fullsized":"2024-05-21T13:41:28.578856+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'339","last_scrub_stamp":"2024-05-21T13:41:28.578662+0000","last_deep_scrub":"27'339","last_deep_scrub_stamp":"2024-05-21T13:41:28.578662+0000","last_clean_scrub_stamp":"2024-05-21T13:41:28.578662+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:37:59.196317+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":339,"num_write_kb":925696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,4,6],"acting":[2,7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1d","version":"27'7","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:18.552474+0000","last_change":"2024-05-21T13:41:18.552500+0000","last_active":"2024-05-21T13:41:18.552474+0000","last_peered":"2024-05-21T13:41:18.552474+0000","last_clean":"2024-05-21T13:41:18.552474+0000","last_became_active":"2024-05-21T13:35:56.730746+0000","last_became_peered":"2024-05-21T13:35:56.730746+0000","last_unstale":"2024-05-21T13:41:18.552474+0000","last_undegraded":"2024-05-21T13:41:18.552474+0000","last_fullsized":"2024-05-21T13:41:18.552474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-05-21T13:41:18.552412+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-05-21T13:41:18.552412+0000","last_clean_scrub_stamp":"2024-05-21T13:41:18.552412+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:34:33.224857+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"27'9","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:19.558975+0000","last_change":"2024-05-21T13:41:19.559097+0000","last_active":"2024-05-21T13:41:19.558975+0000","last_peered":"2024-05-21T13:41:19.558975+0000","last_clean":"2024-05-21T13:41:19.558975+0000","last_became_active":"2024-05-21T13:35:57.770595+0000","last_became_peered":"2024-05-21T13:35:57.770595+0000","last_unstale":"2024-05-21T13:41:19.558975+0000","last_undegraded":"2024-05-21T13:41:19.558975+0000","last_fullsized":"2024-05-21T13:41:19.558975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-05-21T13:41:19.558765+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-05-21T13:41:19.558765+0000","last_clean_scrub_stamp":"2024-05-21T13:41:19.558765+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:09:31.112330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"27'273","reported_seq":302,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:27.574407+0000","last_change":"2024-05-21T13:41:27.574477+0000","last_active":"2024-05-21T13:41:27.574407+0000","last_peered":"2024-05-21T13:41:27.574407+0000","last_clean":"2024-05-21T13:41:27.574407+0000","last_became_active":"2024-05-21T13:36:01.848996+0000","last_became_peered":"2024-05-21T13:36:01.848996+0000","last_unstale":"2024-05-21T13:41:27.574407+0000","last_undegraded":"2024-05-21T13:41:27.574407+0000","last_fullsized":"2024-05-21T13:41:27.574407+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'273","last_scrub_stamp":"2024-05-21T13:41:27.574227+0000","last_deep_scrub":"27'273","last_deep_scrub_stamp":"2024-05-21T13:41:27.574227+0000","last_clean_scrub_stamp":"2024-05-21T13:41:27.574227+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:56:01.431575+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,3,6],"acting":[2,5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1c","version":"27'3","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:20.609201+0000","last_change":"2024-05-21T13:41:20.609269+0000","last_active":"2024-05-21T13:41:20.609201+0000","last_peered":"2024-05-21T13:41:20.609201+0000","last_clean":"2024-05-21T13:41:20.609201+0000","last_became_active":"2024-05-21T13:35:56.731150+0000","last_became_peered":"2024-05-21T13:35:56.731150+0000","last_unstale":"2024-05-21T13:41:20.609201+0000","last_undegraded":"2024-05-21T13:41:20.609201+0000","last_fullsized":"2024-05-21T13:41:20.609201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-05-21T13:41:20.609030+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-05-21T13:41:20.609030+0000","last_clean_scrub_stamp":"2024-05-21T13:41:20.609030+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:26:24.329746+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"27'15","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:37.486577+0000","last_change":"2024-05-21T13:41:37.486637+0000","last_active":"2024-05-21T13:41:37.486577+0000","last_peered":"2024-05-21T13:41:37.486577+0000","last_clean":"2024-05-21T13:41:37.486577+0000","last_became_active":"2024-05-21T13:35:57.799043+0000","last_became_peered":"2024-05-21T13:35:57.799043+0000","last_unstale":"2024-05-21T13:41:37.486577+0000","last_undegraded":"2024-05-21T13:41:37.486577+0000","last_fullsized":"2024-05-21T13:41:37.486577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2024-05-21T13:41:37.486378+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2024-05-21T13:41:37.486378+0000","last_clean_scrub_stamp":"2024-05-21T13:41:37.486378+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:31:36.317755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"27'252","reported_seq":281,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:29.616197+0000","last_change":"2024-05-21T13:41:29.616274+0000","last_active":"2024-05-21T13:41:29.616197+0000","last_peered":"2024-05-21T13:41:29.616197+0000","last_clean":"2024-05-21T13:41:29.616197+0000","last_became_active":"2024-05-21T13:36:01.851913+0000","last_became_peered":"2024-05-21T13:36:01.851913+0000","last_unstale":"2024-05-21T13:41:29.616197+0000","last_undegraded":"2024-05-21T13:41:29.616197+0000","last_fullsized":"2024-05-21T13:41:29.616197+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'252","last_scrub_stamp":"2024-05-21T13:41:29.616017+0000","last_deep_scrub":"27'252","last_deep_scrub_stamp":"2024-05-21T13:41:29.616017+0000","last_clean_scrub_stamp":"2024-05-21T13:41:29.616017+0000","objects_scrubbed":0,"log_size":252,"log_dups_size":0,"ondisk_log_size":252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:05:45.291541+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":252,"num_write_kb":688128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,5,7],"acting":[2,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"27'5","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:21.544881+0000","last_change":"2024-05-21T13:41:21.544939+0000","last_active":"2024-05-21T13:41:21.544881+0000","last_peered":"2024-05-21T13:41:21.544881+0000","last_clean":"2024-05-21T13:41:21.544881+0000","last_became_active":"2024-05-21T13:35:57.795638+0000","last_became_peered":"2024-05-21T13:35:57.795638+0000","last_unstale":"2024-05-21T13:41:21.544881+0000","last_undegraded":"2024-05-21T13:41:21.544881+0000","last_fullsized":"2024-05-21T13:41:21.544881+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-05-21T13:41:21.544701+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-05-21T13:41:21.544701+0000","last_clean_scrub_stamp":"2024-05-21T13:41:21.544701+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:04:51.516014+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"27'7","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:29.574589+0000","last_change":"2024-05-21T13:41:29.574662+0000","last_active":"2024-05-21T13:41:29.574589+0000","last_peered":"2024-05-21T13:41:29.574589+0000","last_clean":"2024-05-21T13:41:29.574589+0000","last_became_active":"2024-05-21T13:35:56.747635+0000","last_became_peered":"2024-05-21T13:35:56.747635+0000","last_unstale":"2024-05-21T13:41:29.574589+0000","last_undegraded":"2024-05-21T13:41:29.574589+0000","last_fullsized":"2024-05-21T13:41:29.574589+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-05-21T13:41:29.574416+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-05-21T13:41:29.574416+0000","last_clean_scrub_stamp":"2024-05-21T13:41:29.574416+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:03:58.441948+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"27'309","reported_seq":338,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:42.497900+0000","last_change":"2024-05-21T13:41:42.497964+0000","last_active":"2024-05-21T13:41:42.497900+0000","last_peered":"2024-05-21T13:41:42.497900+0000","last_clean":"2024-05-21T13:41:42.497900+0000","last_became_active":"2024-05-21T13:36:01.861520+0000","last_became_peered":"2024-05-21T13:36:01.861520+0000","last_unstale":"2024-05-21T13:41:42.497900+0000","last_undegraded":"2024-05-21T13:41:42.497900+0000","last_fullsized":"2024-05-21T13:41:42.497900+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'309","last_scrub_stamp":"2024-05-21T13:41:42.497709+0000","last_deep_scrub":"27'309","last_deep_scrub_stamp":"2024-05-21T13:41:42.497709+0000","last_clean_scrub_stamp":"2024-05-21T13:41:42.497709+0000","objects_scrubbed":0,"log_size":309,"log_dups_size":0,"ondisk_log_size":309,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:16:45.345824+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":309,"num_write_kb":843776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,5],"acting":[3,1,7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.b","version":"27'8","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:23.788591+0000","last_change":"2024-05-21T13:41:23.788656+0000","last_active":"2024-05-21T13:41:23.788591+0000","last_peered":"2024-05-21T13:41:23.788591+0000","last_clean":"2024-05-21T13:41:23.788591+0000","last_became_active":"2024-05-21T13:35:57.786126+0000","last_became_peered":"2024-05-21T13:35:57.786126+0000","last_unstale":"2024-05-21T13:41:23.788591+0000","last_undegraded":"2024-05-21T13:41:23.788591+0000","last_fullsized":"2024-05-21T13:41:23.788591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-21T13:41:23.788412+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-21T13:41:23.788412+0000","last_clean_scrub_stamp":"2024-05-21T13:41:23.788412+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:03:44.708204+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.a","version":"27'3","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:20.844402+0000","last_change":"2024-05-21T13:41:20.844518+0000","last_active":"2024-05-21T13:41:20.844402+0000","last_peered":"2024-05-21T13:41:20.844402+0000","last_clean":"2024-05-21T13:41:20.844402+0000","last_became_active":"2024-05-21T13:35:56.764551+0000","last_became_peered":"2024-05-21T13:35:56.764551+0000","last_unstale":"2024-05-21T13:41:20.844402+0000","last_undegraded":"2024-05-21T13:41:20.844402+0000","last_fullsized":"2024-05-21T13:41:20.844402+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-05-21T13:41:20.844121+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-05-21T13:41:20.844121+0000","last_clean_scrub_stamp":"2024-05-21T13:41:20.844121+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:18:08.574389+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.c","version":"27'291","reported_seq":320,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:32.527963+0000","last_change":"2024-05-21T13:41:32.528082+0000","last_active":"2024-05-21T13:41:32.527963+0000","last_peered":"2024-05-21T13:41:32.527963+0000","last_clean":"2024-05-21T13:41:32.527963+0000","last_became_active":"2024-05-21T13:36:01.853975+0000","last_became_peered":"2024-05-21T13:36:01.853975+0000","last_unstale":"2024-05-21T13:41:32.527963+0000","last_undegraded":"2024-05-21T13:41:32.527963+0000","last_fullsized":"2024-05-21T13:41:32.527963+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'291","last_scrub_stamp":"2024-05-21T13:41:32.527752+0000","last_deep_scrub":"27'291","last_deep_scrub_stamp":"2024-05-21T13:41:32.527752+0000","last_clean_scrub_stamp":"2024-05-21T13:41:32.527752+0000","objects_scrubbed":0,"log_size":291,"log_dups_size":0,"ondisk_log_size":291,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:18:29.421742+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":291,"num_write_kb":794624,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,6,1],"acting":[0,4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"27'9","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:23.742569+0000","last_change":"2024-05-21T13:41:23.742632+0000","last_active":"2024-05-21T13:41:23.742569+0000","last_peered":"2024-05-21T13:41:23.742569+0000","last_clean":"2024-05-21T13:41:23.742569+0000","last_became_active":"2024-05-21T13:35:57.761739+0000","last_became_peered":"2024-05-21T13:35:57.761739+0000","last_unstale":"2024-05-21T13:41:23.742569+0000","last_undegraded":"2024-05-21T13:41:23.742569+0000","last_fullsized":"2024-05-21T13:41:23.742569+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-05-21T13:41:23.742405+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-05-21T13:41:23.742405+0000","last_clean_scrub_stamp":"2024-05-21T13:41:23.742405+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:08:06.216018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"27'5","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:18.746029+0000","last_change":"2024-05-21T13:41:18.746095+0000","last_active":"2024-05-21T13:41:18.746029+0000","last_peered":"2024-05-21T13:41:18.746029+0000","last_clean":"2024-05-21T13:41:18.746029+0000","last_became_active":"2024-05-21T13:35:56.733249+0000","last_became_peered":"2024-05-21T13:35:56.733249+0000","last_unstale":"2024-05-21T13:41:18.746029+0000","last_undegraded":"2024-05-21T13:41:18.746029+0000","last_fullsized":"2024-05-21T13:41:18.746029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-05-21T13:41:18.745865+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-05-21T13:41:18.745865+0000","last_clean_scrub_stamp":"2024-05-21T13:41:18.745865+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:20:17.861741+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"27'267","reported_seq":296,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:25.798369+0000","last_change":"2024-05-21T13:41:25.798481+0000","last_active":"2024-05-21T13:41:25.798369+0000","last_peered":"2024-05-21T13:41:25.798369+0000","last_clean":"2024-05-21T13:41:25.798369+0000","last_became_active":"2024-05-21T13:36:01.867701+0000","last_became_peered":"2024-05-21T13:36:01.867701+0000","last_unstale":"2024-05-21T13:41:25.798369+0000","last_undegraded":"2024-05-21T13:41:25.798369+0000","last_fullsized":"2024-05-21T13:41:25.798369+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'267","last_scrub_stamp":"2024-05-21T13:41:25.798088+0000","last_deep_scrub":"27'267","last_deep_scrub_stamp":"2024-05-21T13:41:25.798088+0000","last_clean_scrub_stamp":"2024-05-21T13:41:25.798088+0000","objects_scrubbed":0,"log_size":267,"log_dups_size":0,"ondisk_log_size":267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:51:23.705597+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":267,"num_write_kb":729088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2,3],"acting":[7,4,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"27'2","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:20.503491+0000","last_change":"2024-05-21T13:41:20.503552+0000","last_active":"2024-05-21T13:41:20.503491+0000","last_peered":"2024-05-21T13:41:20.503491+0000","last_clean":"2024-05-21T13:41:20.503491+0000","last_became_active":"2024-05-21T13:35:57.789213+0000","last_became_peered":"2024-05-21T13:35:57.789213+0000","last_unstale":"2024-05-21T13:41:20.503491+0000","last_undegraded":"2024-05-21T13:41:20.503491+0000","last_fullsized":"2024-05-21T13:41:20.503491+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-21T13:41:20.503312+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-21T13:41:20.503312+0000","last_clean_scrub_stamp":"2024-05-21T13:41:20.503312+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:56:40.705560+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.8","version":"27'3","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:22.593062+0000","last_change":"2024-05-21T13:41:22.593135+0000","last_active":"2024-05-21T13:41:22.593062+0000","last_peered":"2024-05-21T13:41:22.593062+0000","last_clean":"2024-05-21T13:41:22.593062+0000","last_became_active":"2024-05-21T13:35:56.746534+0000","last_became_peered":"2024-05-21T13:35:56.746534+0000","last_unstale":"2024-05-21T13:41:22.593062+0000","last_undegraded":"2024-05-21T13:41:22.593062+0000","last_fullsized":"2024-05-21T13:41:22.593062+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-05-21T13:41:22.592894+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-05-21T13:41:22.592894+0000","last_clean_scrub_stamp":"2024-05-21T13:41:22.592894+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:23:11.862335+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"27'288","reported_seq":317,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:26.586701+0000","last_change":"2024-05-21T13:41:26.586767+0000","last_active":"2024-05-21T13:41:26.586701+0000","last_peered":"2024-05-21T13:41:26.586701+0000","last_clean":"2024-05-21T13:41:26.586701+0000","last_became_active":"2024-05-21T13:36:01.841216+0000","last_became_peered":"2024-05-21T13:36:01.841216+0000","last_unstale":"2024-05-21T13:41:26.586701+0000","last_undegraded":"2024-05-21T13:41:26.586701+0000","last_fullsized":"2024-05-21T13:41:26.586701+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'288","last_scrub_stamp":"2024-05-21T13:41:26.586502+0000","last_deep_scrub":"27'288","last_deep_scrub_stamp":"2024-05-21T13:41:26.586502+0000","last_clean_scrub_stamp":"2024-05-21T13:41:26.586502+0000","objects_scrubbed":0,"log_size":288,"log_dups_size":0,"ondisk_log_size":288,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:50:44.427142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":288,"num_write_kb":786432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,7],"acting":[2,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"27'7","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:25.737666+0000","last_change":"2024-05-21T13:41:25.737732+0000","last_active":"2024-05-21T13:41:25.737666+0000","last_peered":"2024-05-21T13:41:25.737666+0000","last_clean":"2024-05-21T13:41:25.737666+0000","last_became_active":"2024-05-21T13:35:57.764017+0000","last_became_peered":"2024-05-21T13:35:57.764017+0000","last_unstale":"2024-05-21T13:41:25.737666+0000","last_undegraded":"2024-05-21T13:41:25.737666+0000","last_fullsized":"2024-05-21T13:41:25.737666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-05-21T13:41:25.737489+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-05-21T13:41:25.737489+0000","last_clean_scrub_stamp":"2024-05-21T13:41:25.737489+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:56:51.866661+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"27'7","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:33.517246+0000","last_change":"2024-05-21T13:41:33.517315+0000","last_active":"2024-05-21T13:41:33.517246+0000","last_peered":"2024-05-21T13:41:33.517246+0000","last_clean":"2024-05-21T13:41:33.517246+0000","last_became_active":"2024-05-21T13:35:56.751883+0000","last_became_peered":"2024-05-21T13:35:56.751883+0000","last_unstale":"2024-05-21T13:41:33.517246+0000","last_undegraded":"2024-05-21T13:41:33.517246+0000","last_fullsized":"2024-05-21T13:41:33.517246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-05-21T13:41:33.517080+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-05-21T13:41:33.517080+0000","last_clean_scrub_stamp":"2024-05-21T13:41:33.517080+0000","objects_scrubbed":2,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T13:45:48.671440+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"27'249","reported_seq":278,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:25.564412+0000","last_change":"2024-05-21T13:41:25.564475+0000","last_active":"2024-05-21T13:41:25.564412+0000","last_peered":"2024-05-21T13:41:25.564412+0000","last_clean":"2024-05-21T13:41:25.564412+0000","last_became_active":"2024-05-21T13:36:01.831609+0000","last_became_peered":"2024-05-21T13:36:01.831609+0000","last_unstale":"2024-05-21T13:41:25.564412+0000","last_undegraded":"2024-05-21T13:41:25.564412+0000","last_fullsized":"2024-05-21T13:41:25.564412+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'249","last_scrub_stamp":"2024-05-21T13:41:25.564206+0000","last_deep_scrub":"27'249","last_deep_scrub_stamp":"2024-05-21T13:41:25.564206+0000","last_clean_scrub_stamp":"2024-05-21T13:41:25.564206+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:40:25.414919+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":249,"num_write_kb":679936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3,1],"acting":[2,6,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"27'5","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:27.710256+0000","last_change":"2024-05-21T13:41:27.710319+0000","last_active":"2024-05-21T13:41:27.710256+0000","last_peered":"2024-05-21T13:41:27.710256+0000","last_clean":"2024-05-21T13:41:27.710256+0000","last_became_active":"2024-05-21T13:35:57.783150+0000","last_became_peered":"2024-05-21T13:35:57.783150+0000","last_unstale":"2024-05-21T13:41:27.710256+0000","last_undegraded":"2024-05-21T13:41:27.710256+0000","last_fullsized":"2024-05-21T13:41:27.710256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-05-21T13:41:27.710084+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-05-21T13:41:27.710084+0000","last_clean_scrub_stamp":"2024-05-21T13:41:27.710084+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:01:59.363343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"27'23","reported_seq":60,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:20.731984+0000","last_change":"2024-05-21T13:41:20.732102+0000","last_active":"2024-05-21T13:41:20.731984+0000","last_peered":"2024-05-21T13:41:20.731984+0000","last_clean":"2024-05-21T13:41:20.731984+0000","last_became_active":"2024-05-21T13:35:56.744218+0000","last_became_peered":"2024-05-21T13:35:56.744218+0000","last_unstale":"2024-05-21T13:41:20.731984+0000","last_undegraded":"2024-05-21T13:41:20.731984+0000","last_fullsized":"2024-05-21T13:41:20.731984+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'23","last_scrub_stamp":"2024-05-21T13:41:20.731763+0000","last_deep_scrub":"27'23","last_deep_scrub_stamp":"2024-05-21T13:41:20.731763+0000","last_clean_scrub_stamp":"2024-05-21T13:41:20.731763+0000","objects_scrubbed":2,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:07:46.373267+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":42,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"27'264","reported_seq":293,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:30.673066+0000","last_change":"2024-05-21T13:41:30.673140+0000","last_active":"2024-05-21T13:41:30.673066+0000","last_peered":"2024-05-21T13:41:30.673066+0000","last_clean":"2024-05-21T13:41:30.673066+0000","last_became_active":"2024-05-21T13:36:01.837401+0000","last_became_peered":"2024-05-21T13:36:01.837401+0000","last_unstale":"2024-05-21T13:41:30.673066+0000","last_undegraded":"2024-05-21T13:41:30.673066+0000","last_fullsized":"2024-05-21T13:41:30.673066+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'264","last_scrub_stamp":"2024-05-21T13:41:30.672817+0000","last_deep_scrub":"27'264","last_deep_scrub_stamp":"2024-05-21T13:41:30.672817+0000","last_clean_scrub_stamp":"2024-05-21T13:41:30.672817+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:43:54.376810+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":720896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,6,3],"acting":[4,1,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.4","version":"27'9","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:24.816934+0000","last_change":"2024-05-21T13:41:24.816992+0000","last_active":"2024-05-21T13:41:24.816934+0000","last_peered":"2024-05-21T13:41:24.816934+0000","last_clean":"2024-05-21T13:41:24.816934+0000","last_became_active":"2024-05-21T13:35:57.784664+0000","last_became_peered":"2024-05-21T13:35:57.784664+0000","last_unstale":"2024-05-21T13:41:24.816934+0000","last_undegraded":"2024-05-21T13:41:24.816934+0000","last_fullsized":"2024-05-21T13:41:24.816934+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-05-21T13:41:24.816767+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-05-21T13:41:24.816767+0000","last_clean_scrub_stamp":"2024-05-21T13:41:24.816767+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:54:06.253493+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"27'2","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:27.625040+0000","last_change":"2024-05-21T13:41:27.625109+0000","last_active":"2024-05-21T13:41:27.625040+0000","last_peered":"2024-05-21T13:41:27.625040+0000","last_clean":"2024-05-21T13:41:27.625040+0000","last_became_active":"2024-05-21T13:35:56.740846+0000","last_became_peered":"2024-05-21T13:35:56.740846+0000","last_unstale":"2024-05-21T13:41:27.625040+0000","last_undegraded":"2024-05-21T13:41:27.625040+0000","last_fullsized":"2024-05-21T13:41:27.625040+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-21T13:41:27.624850+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-21T13:41:27.624850+0000","last_clean_scrub_stamp":"2024-05-21T13:41:27.624850+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:18:01.374661+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3","version":"27'249","reported_seq":278,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:30.767147+0000","last_change":"2024-05-21T13:41:30.767208+0000","last_active":"2024-05-21T13:41:30.767147+0000","last_peered":"2024-05-21T13:41:30.767147+0000","last_clean":"2024-05-21T13:41:30.767147+0000","last_became_active":"2024-05-21T13:36:01.872085+0000","last_became_peered":"2024-05-21T13:36:01.872085+0000","last_unstale":"2024-05-21T13:41:30.767147+0000","last_undegraded":"2024-05-21T13:41:30.767147+0000","last_fullsized":"2024-05-21T13:41:30.767147+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'249","last_scrub_stamp":"2024-05-21T13:41:30.766975+0000","last_deep_scrub":"27'249","last_deep_scrub_stamp":"2024-05-21T13:41:30.766975+0000","last_clean_scrub_stamp":"2024-05-21T13:41:30.766975+0000","objects_scrubbed":0,"log_size":249,"log_dups_size":0,"ondisk_log_size":249,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:07:20.839016+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":249,"num_write_kb":679936,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2,7],"acting":[6,0,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"27'5","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:21.611629+0000","last_change":"2024-05-21T13:41:21.611687+0000","last_active":"2024-05-21T13:41:21.611629+0000","last_peered":"2024-05-21T13:41:21.611629+0000","last_clean":"2024-05-21T13:41:21.611629+0000","last_became_active":"2024-05-21T13:35:57.782517+0000","last_became_peered":"2024-05-21T13:35:57.782517+0000","last_unstale":"2024-05-21T13:41:21.611629+0000","last_undegraded":"2024-05-21T13:41:21.611629+0000","last_fullsized":"2024-05-21T13:41:21.611629+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-05-21T13:41:21.611457+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-05-21T13:41:21.611457+0000","last_clean_scrub_stamp":"2024-05-21T13:41:21.611457+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:54:02.735762+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:21.895038+0000","last_change":"2024-05-21T13:41:21.895093+0000","last_active":"2024-05-21T13:41:21.895038+0000","last_peered":"2024-05-21T13:41:21.895038+0000","last_clean":"2024-05-21T13:41:21.895038+0000","last_became_active":"2024-05-21T13:35:56.764987+0000","last_became_peered":"2024-05-21T13:35:56.764987+0000","last_unstale":"2024-05-21T13:41:21.895038+0000","last_undegraded":"2024-05-21T13:41:21.895038+0000","last_fullsized":"2024-05-21T13:41:21.895038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-21T13:41:21.894834+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-21T13:41:21.894834+0000","last_clean_scrub_stamp":"2024-05-21T13:41:21.894834+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:54:37.619072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"27'273","reported_seq":302,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:29.784127+0000","last_change":"2024-05-21T13:41:29.784188+0000","last_active":"2024-05-21T13:41:29.784127+0000","last_peered":"2024-05-21T13:41:29.784127+0000","last_clean":"2024-05-21T13:41:29.784127+0000","last_became_active":"2024-05-21T13:36:01.870831+0000","last_became_peered":"2024-05-21T13:36:01.870831+0000","last_unstale":"2024-05-21T13:41:29.784127+0000","last_undegraded":"2024-05-21T13:41:29.784127+0000","last_fullsized":"2024-05-21T13:41:29.784127+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'273","last_scrub_stamp":"2024-05-21T13:41:29.783948+0000","last_deep_scrub":"27'273","last_deep_scrub_stamp":"2024-05-21T13:41:29.783948+0000","last_clean_scrub_stamp":"2024-05-21T13:41:29.783948+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:01:41.972359+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,5,7],"acting":[6,3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3","version":"27'7","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:16.500325+0000","last_change":"2024-05-21T13:41:16.500380+0000","last_active":"2024-05-21T13:41:16.500325+0000","last_peered":"2024-05-21T13:41:16.500325+0000","last_clean":"2024-05-21T13:41:16.500325+0000","last_became_active":"2024-05-21T13:35:57.780521+0000","last_became_peered":"2024-05-21T13:35:57.780521+0000","last_unstale":"2024-05-21T13:41:16.500325+0000","last_undegraded":"2024-05-21T13:41:16.500325+0000","last_fullsized":"2024-05-21T13:41:16.500325+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-05-21T13:41:16.500162+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-05-21T13:41:16.500162+0000","last_clean_scrub_stamp":"2024-05-21T13:41:16.500162+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:23:59.572265+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"25'1","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:31.528997+0000","last_change":"2024-05-21T13:41:31.529056+0000","last_active":"2024-05-21T13:41:31.528997+0000","last_peered":"2024-05-21T13:41:31.528997+0000","last_clean":"2024-05-21T13:41:31.528997+0000","last_became_active":"2024-05-21T13:35:56.750006+0000","last_became_peered":"2024-05-21T13:35:56.750006+0000","last_unstale":"2024-05-21T13:41:31.528997+0000","last_undegraded":"2024-05-21T13:41:31.528997+0000","last_fullsized":"2024-05-21T13:41:31.528997+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2024-05-21T13:41:31.528808+0000","last_deep_scrub":"25'1","last_deep_scrub_stamp":"2024-05-21T13:41:31.528808+0000","last_clean_scrub_stamp":"2024-05-21T13:41:31.528808+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:21:09.844460+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"27'264","reported_seq":293,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:31.760159+0000","last_change":"2024-05-21T13:41:31.760225+0000","last_active":"2024-05-21T13:41:31.760159+0000","last_peered":"2024-05-21T13:41:31.760159+0000","last_clean":"2024-05-21T13:41:31.760159+0000","last_became_active":"2024-05-21T13:36:01.872363+0000","last_became_peered":"2024-05-21T13:36:01.872363+0000","last_unstale":"2024-05-21T13:41:31.760159+0000","last_undegraded":"2024-05-21T13:41:31.760159+0000","last_fullsized":"2024-05-21T13:41:31.760159+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'264","last_scrub_stamp":"2024-05-21T13:41:31.759973+0000","last_deep_scrub":"27'264","last_deep_scrub_stamp":"2024-05-21T13:41:31.759973+0000","last_clean_scrub_stamp":"2024-05-21T13:41:31.759973+0000","objects_scrubbed":0,"log_size":264,"log_dups_size":0,"ondisk_log_size":264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:08:27.285093+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":264,"num_write_kb":720896,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0,3],"acting":[6,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"27'8","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:26.943599+0000","last_change":"2024-05-21T13:41:26.943662+0000","last_active":"2024-05-21T13:41:26.943599+0000","last_peered":"2024-05-21T13:41:26.943599+0000","last_clean":"2024-05-21T13:41:26.943599+0000","last_became_active":"2024-05-21T13:35:57.780313+0000","last_became_peered":"2024-05-21T13:35:57.780313+0000","last_unstale":"2024-05-21T13:41:26.943599+0000","last_undegraded":"2024-05-21T13:41:26.943599+0000","last_fullsized":"2024-05-21T13:41:26.943599+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-21T13:41:26.943390+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-21T13:41:26.943390+0000","last_clean_scrub_stamp":"2024-05-21T13:41:26.943390+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:21:21.535402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"27'11","reported_seq":52,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:20.812086+0000","last_change":"2024-05-21T13:41:20.812173+0000","last_active":"2024-05-21T13:41:20.812086+0000","last_peered":"2024-05-21T13:41:20.812086+0000","last_clean":"2024-05-21T13:41:20.812086+0000","last_became_active":"2024-05-21T13:35:56.770465+0000","last_became_peered":"2024-05-21T13:35:56.770465+0000","last_unstale":"2024-05-21T13:41:20.812086+0000","last_undegraded":"2024-05-21T13:41:20.812086+0000","last_fullsized":"2024-05-21T13:41:20.812086+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'11","last_scrub_stamp":"2024-05-21T13:41:20.811896+0000","last_deep_scrub":"27'11","last_deep_scrub_stamp":"2024-05-21T13:41:20.811896+0000","last_clean_scrub_stamp":"2024-05-21T13:41:20.811896+0000","objects_scrubbed":3,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:48:37.354019+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":619,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.7","version":"27'270","reported_seq":299,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:28.768968+0000","last_change":"2024-05-21T13:41:28.769039+0000","last_active":"2024-05-21T13:41:28.768968+0000","last_peered":"2024-05-21T13:41:28.768968+0000","last_clean":"2024-05-21T13:41:28.768968+0000","last_became_active":"2024-05-21T13:36:01.870678+0000","last_became_peered":"2024-05-21T13:36:01.870678+0000","last_unstale":"2024-05-21T13:41:28.768968+0000","last_undegraded":"2024-05-21T13:41:28.768968+0000","last_fullsized":"2024-05-21T13:41:28.768968+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'270","last_scrub_stamp":"2024-05-21T13:41:28.768768+0000","last_deep_scrub":"27'270","last_deep_scrub_stamp":"2024-05-21T13:41:28.768768+0000","last_clean_scrub_stamp":"2024-05-21T13:41:28.768768+0000","objects_scrubbed":0,"log_size":270,"log_dups_size":0,"ondisk_log_size":270,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:53:54.860452+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":270,"num_write_kb":737280,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,7],"acting":[6,0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"27'5","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:22.883963+0000","last_change":"2024-05-21T13:41:22.884028+0000","last_active":"2024-05-21T13:41:22.883963+0000","last_peered":"2024-05-21T13:41:22.883963+0000","last_clean":"2024-05-21T13:41:22.883963+0000","last_became_active":"2024-05-21T13:35:57.781299+0000","last_became_peered":"2024-05-21T13:35:57.781299+0000","last_unstale":"2024-05-21T13:41:22.883963+0000","last_undegraded":"2024-05-21T13:41:22.883963+0000","last_fullsized":"2024-05-21T13:41:22.883963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-05-21T13:41:22.883770+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-05-21T13:41:22.883770+0000","last_clean_scrub_stamp":"2024-05-21T13:41:22.883770+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:52:42.893989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"27'4","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:26.614165+0000","last_change":"2024-05-21T13:41:26.614228+0000","last_active":"2024-05-21T13:41:26.614165+0000","last_peered":"2024-05-21T13:41:26.614165+0000","last_clean":"2024-05-21T13:41:26.614165+0000","last_became_active":"2024-05-21T13:35:56.767788+0000","last_became_peered":"2024-05-21T13:35:56.767788+0000","last_unstale":"2024-05-21T13:41:26.614165+0000","last_undegraded":"2024-05-21T13:41:26.614165+0000","last_fullsized":"2024-05-21T13:41:26.614165+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-21T13:41:26.613996+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-21T13:41:26.613996+0000","last_clean_scrub_stamp":"2024-05-21T13:41:26.613996+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:41:42.484994+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.6","version":"27'339","reported_seq":368,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:37.001106+0000","last_change":"2024-05-21T13:41:37.001171+0000","last_active":"2024-05-21T13:41:37.001106+0000","last_peered":"2024-05-21T13:41:37.001106+0000","last_clean":"2024-05-21T13:41:37.001106+0000","last_became_active":"2024-05-21T13:36:01.859141+0000","last_became_peered":"2024-05-21T13:36:01.859141+0000","last_unstale":"2024-05-21T13:41:37.001106+0000","last_undegraded":"2024-05-21T13:41:37.001106+0000","last_fullsized":"2024-05-21T13:41:37.001106+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'339","last_scrub_stamp":"2024-05-21T13:41:37.000920+0000","last_deep_scrub":"27'339","last_deep_scrub_stamp":"2024-05-21T13:41:37.000920+0000","last_clean_scrub_stamp":"2024-05-21T13:41:37.000920+0000","objects_scrubbed":0,"log_size":339,"log_dups_size":0,"ondisk_log_size":339,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:17:58.597758+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":339,"num_write_kb":925696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6,1],"acting":[5,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"27'8","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:26.743732+0000","last_change":"2024-05-21T13:41:26.743790+0000","last_active":"2024-05-21T13:41:26.743732+0000","last_peered":"2024-05-21T13:41:26.743732+0000","last_clean":"2024-05-21T13:41:26.743732+0000","last_became_active":"2024-05-21T13:35:57.774322+0000","last_became_peered":"2024-05-21T13:35:57.774322+0000","last_unstale":"2024-05-21T13:41:26.743732+0000","last_undegraded":"2024-05-21T13:41:26.743732+0000","last_fullsized":"2024-05-21T13:41:26.743732+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-21T13:41:26.743549+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-21T13:41:26.743549+0000","last_clean_scrub_stamp":"2024-05-21T13:41:26.743549+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:39:07.145642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.3","version":"27'6","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:30.541102+0000","last_change":"2024-05-21T13:41:30.541187+0000","last_active":"2024-05-21T13:41:30.541102+0000","last_peered":"2024-05-21T13:41:30.541102+0000","last_clean":"2024-05-21T13:41:30.541102+0000","last_became_active":"2024-05-21T13:35:56.747823+0000","last_became_peered":"2024-05-21T13:35:56.747823+0000","last_unstale":"2024-05-21T13:41:30.541102+0000","last_undegraded":"2024-05-21T13:41:30.541102+0000","last_fullsized":"2024-05-21T13:41:30.541102+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-21T13:41:30.540916+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-21T13:41:30.540916+0000","last_clean_scrub_stamp":"2024-05-21T13:41:30.540916+0000","objects_scrubbed":3,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:38:23.439604+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"27'74","reported_seq":135,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:16.572694+0000","last_change":"2024-05-21T13:41:16.572694+0000","last_active":"2024-05-21T13:41:16.572694+0000","last_peered":"2024-05-21T13:41:16.572694+0000","last_clean":"2024-05-21T13:41:16.572694+0000","last_became_active":"2024-05-21T13:35:45.680732+0000","last_became_peered":"2024-05-21T13:35:45.680732+0000","last_unstale":"2024-05-21T13:41:16.572694+0000","last_undegraded":"2024-05-21T13:41:16.572694+0000","last_fullsized":"2024-05-21T13:41:16.572694+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'74","last_scrub_stamp":"2024-05-21T13:41:16.572444+0000","last_deep_scrub":"27'74","last_deep_scrub_stamp":"2024-05-21T13:41:16.572444+0000","last_clean_scrub_stamp":"2024-05-21T13:41:16.572444+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T13:48:55.245032+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"27'276","reported_seq":305,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:39.499145+0000","last_change":"2024-05-21T13:41:39.499169+0000","last_active":"2024-05-21T13:41:39.499145+0000","last_peered":"2024-05-21T13:41:39.499145+0000","last_clean":"2024-05-21T13:41:39.499145+0000","last_became_active":"2024-05-21T13:36:01.828957+0000","last_became_peered":"2024-05-21T13:36:01.828957+0000","last_unstale":"2024-05-21T13:41:39.499145+0000","last_undegraded":"2024-05-21T13:41:39.499145+0000","last_fullsized":"2024-05-21T13:41:39.499145+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'276","last_scrub_stamp":"2024-05-21T13:41:39.499070+0000","last_deep_scrub":"27'276","last_deep_scrub_stamp":"2024-05-21T13:41:39.499070+0000","last_clean_scrub_stamp":"2024-05-21T13:41:39.499070+0000","objects_scrubbed":0,"log_size":276,"log_dups_size":0,"ondisk_log_size":276,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:56:40.150616+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":276,"num_write_kb":753664,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.d","version":"27'7","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:19.461359+0000","last_change":"2024-05-21T13:41:19.461416+0000","last_active":"2024-05-21T13:41:19.461359+0000","last_peered":"2024-05-21T13:41:19.461359+0000","last_clean":"2024-05-21T13:41:19.461359+0000","last_became_active":"2024-05-21T13:35:57.796050+0000","last_became_peered":"2024-05-21T13:35:57.796050+0000","last_unstale":"2024-05-21T13:41:19.461359+0000","last_undegraded":"2024-05-21T13:41:19.461359+0000","last_fullsized":"2024-05-21T13:41:19.461359+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-05-21T13:41:19.461188+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-05-21T13:41:19.461188+0000","last_clean_scrub_stamp":"2024-05-21T13:41:19.461188+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:58:27.743750+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"27'5","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:19.812608+0000","last_change":"2024-05-21T13:41:19.812724+0000","last_active":"2024-05-21T13:41:19.812608+0000","last_peered":"2024-05-21T13:41:19.812608+0000","last_clean":"2024-05-21T13:41:19.812608+0000","last_became_active":"2024-05-21T13:35:56.748604+0000","last_became_peered":"2024-05-21T13:35:56.748604+0000","last_unstale":"2024-05-21T13:41:19.812608+0000","last_undegraded":"2024-05-21T13:41:19.812608+0000","last_fullsized":"2024-05-21T13:41:19.812608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-05-21T13:41:19.812330+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-05-21T13:41:19.812330+0000","last_clean_scrub_stamp":"2024-05-21T13:41:19.812330+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:51:58.626541+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"27'280","reported_seq":309,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:24.551291+0000","last_change":"2024-05-21T13:41:24.551421+0000","last_active":"2024-05-21T13:41:24.551291+0000","last_peered":"2024-05-21T13:41:24.551291+0000","last_clean":"2024-05-21T13:41:24.551291+0000","last_became_active":"2024-05-21T13:36:01.824653+0000","last_became_peered":"2024-05-21T13:36:01.824653+0000","last_unstale":"2024-05-21T13:41:24.551291+0000","last_undegraded":"2024-05-21T13:41:24.551291+0000","last_fullsized":"2024-05-21T13:41:24.551291+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'280","last_scrub_stamp":"2024-05-21T13:41:24.551076+0000","last_deep_scrub":"27'280","last_deep_scrub_stamp":"2024-05-21T13:41:24.551076+0000","last_clean_scrub_stamp":"2024-05-21T13:41:24.551076+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:23:35.599181+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":280,"num_write_kb":761856,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7,4],"acting":[2,3,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"27'6","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:26.546646+0000","last_change":"2024-05-21T13:41:26.546805+0000","last_active":"2024-05-21T13:41:26.546646+0000","last_peered":"2024-05-21T13:41:26.546646+0000","last_clean":"2024-05-21T13:41:26.546646+0000","last_became_active":"2024-05-21T13:35:57.771695+0000","last_became_peered":"2024-05-21T13:35:57.771695+0000","last_unstale":"2024-05-21T13:41:26.546646+0000","last_undegraded":"2024-05-21T13:41:26.546646+0000","last_fullsized":"2024-05-21T13:41:26.546646+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-21T13:41:26.546432+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-21T13:41:26.546432+0000","last_clean_scrub_stamp":"2024-05-21T13:41:26.546432+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:59:41.501788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.d","version":"27'2","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:22.853236+0000","last_change":"2024-05-21T13:41:22.853324+0000","last_active":"2024-05-21T13:41:22.853236+0000","last_peered":"2024-05-21T13:41:22.853236+0000","last_clean":"2024-05-21T13:41:22.853236+0000","last_became_active":"2024-05-21T13:35:56.767053+0000","last_became_peered":"2024-05-21T13:35:56.767053+0000","last_unstale":"2024-05-21T13:41:22.853236+0000","last_undegraded":"2024-05-21T13:41:22.853236+0000","last_fullsized":"2024-05-21T13:41:22.853236+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-21T13:41:22.853060+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-21T13:41:22.853060+0000","last_clean_scrub_stamp":"2024-05-21T13:41:22.853060+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:58:34.468299+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"27'261","reported_seq":290,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:34.022244+0000","last_change":"2024-05-21T13:41:34.022309+0000","last_active":"2024-05-21T13:41:34.022244+0000","last_peered":"2024-05-21T13:41:34.022244+0000","last_clean":"2024-05-21T13:41:34.022244+0000","last_became_active":"2024-05-21T13:36:01.832972+0000","last_became_peered":"2024-05-21T13:36:01.832972+0000","last_unstale":"2024-05-21T13:41:34.022244+0000","last_undegraded":"2024-05-21T13:41:34.022244+0000","last_fullsized":"2024-05-21T13:41:34.022244+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'261","last_scrub_stamp":"2024-05-21T13:41:34.022053+0000","last_deep_scrub":"27'261","last_deep_scrub_stamp":"2024-05-21T13:41:34.022053+0000","last_clean_scrub_stamp":"2024-05-21T13:41:34.022053+0000","objects_scrubbed":0,"log_size":261,"log_dups_size":0,"ondisk_log_size":261,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:57:42.236208+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":261,"num_write_kb":712704,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1,3],"acting":[5,4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"27'9","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:24.572519+0000","last_change":"2024-05-21T13:41:24.572576+0000","last_active":"2024-05-21T13:41:24.572519+0000","last_peered":"2024-05-21T13:41:24.572519+0000","last_clean":"2024-05-21T13:41:24.572519+0000","last_became_active":"2024-05-21T13:35:57.765756+0000","last_became_peered":"2024-05-21T13:35:57.765756+0000","last_unstale":"2024-05-21T13:41:24.572519+0000","last_undegraded":"2024-05-21T13:41:24.572519+0000","last_fullsized":"2024-05-21T13:41:24.572519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-05-21T13:41:24.572359+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-05-21T13:41:24.572359+0000","last_clean_scrub_stamp":"2024-05-21T13:41:24.572359+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:22:57.326653+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"27'3","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:22.700860+0000","last_change":"2024-05-21T13:41:22.700934+0000","last_active":"2024-05-21T13:41:22.700860+0000","last_peered":"2024-05-21T13:41:22.700860+0000","last_clean":"2024-05-21T13:41:22.700860+0000","last_became_active":"2024-05-21T13:35:56.769767+0000","last_became_peered":"2024-05-21T13:35:56.769767+0000","last_unstale":"2024-05-21T13:41:22.700860+0000","last_undegraded":"2024-05-21T13:41:22.700860+0000","last_fullsized":"2024-05-21T13:41:22.700860+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-05-21T13:41:22.700668+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-05-21T13:41:22.700668+0000","last_clean_scrub_stamp":"2024-05-21T13:41:22.700668+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:24:21.267653+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.8","version":"27'318","reported_seq":347,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:38.519294+0000","last_change":"2024-05-21T13:41:38.519361+0000","last_active":"2024-05-21T13:41:38.519294+0000","last_peered":"2024-05-21T13:41:38.519294+0000","last_clean":"2024-05-21T13:41:38.519294+0000","last_became_active":"2024-05-21T13:36:01.826686+0000","last_became_peered":"2024-05-21T13:36:01.826686+0000","last_unstale":"2024-05-21T13:41:38.519294+0000","last_undegraded":"2024-05-21T13:41:38.519294+0000","last_fullsized":"2024-05-21T13:41:38.519294+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'318","last_scrub_stamp":"2024-05-21T13:41:38.519103+0000","last_deep_scrub":"27'318","last_deep_scrub_stamp":"2024-05-21T13:41:38.519103+0000","last_clean_scrub_stamp":"2024-05-21T13:41:38.519103+0000","objects_scrubbed":0,"log_size":318,"log_dups_size":0,"ondisk_log_size":318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:04:57.070284+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":318,"num_write_kb":868352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"27'5","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:19.643131+0000","last_change":"2024-05-21T13:41:19.643256+0000","last_active":"2024-05-21T13:41:19.643131+0000","last_peered":"2024-05-21T13:41:19.643131+0000","last_clean":"2024-05-21T13:41:19.643131+0000","last_became_active":"2024-05-21T13:35:57.781111+0000","last_became_peered":"2024-05-21T13:35:57.781111+0000","last_unstale":"2024-05-21T13:41:19.643131+0000","last_undegraded":"2024-05-21T13:41:19.643131+0000","last_fullsized":"2024-05-21T13:41:19.643131+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-05-21T13:41:19.642928+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-05-21T13:41:19.642928+0000","last_clean_scrub_stamp":"2024-05-21T13:41:19.642928+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:01:31.321416+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.f","version":"27'4","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:23.608852+0000","last_change":"2024-05-21T13:41:23.608917+0000","last_active":"2024-05-21T13:41:23.608852+0000","last_peered":"2024-05-21T13:41:23.608852+0000","last_clean":"2024-05-21T13:41:23.608852+0000","last_became_active":"2024-05-21T13:35:56.755158+0000","last_became_peered":"2024-05-21T13:35:56.755158+0000","last_unstale":"2024-05-21T13:41:23.608852+0000","last_undegraded":"2024-05-21T13:41:23.608852+0000","last_fullsized":"2024-05-21T13:41:23.608852+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-21T13:41:23.608674+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-21T13:41:23.608674+0000","last_clean_scrub_stamp":"2024-05-21T13:41:23.608674+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:29:59.895796+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"27'258","reported_seq":287,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:23.599001+0000","last_change":"2024-05-21T13:41:23.599120+0000","last_active":"2024-05-21T13:41:23.599001+0000","last_peered":"2024-05-21T13:41:23.599001+0000","last_clean":"2024-05-21T13:41:23.599001+0000","last_became_active":"2024-05-21T13:36:01.826374+0000","last_became_peered":"2024-05-21T13:36:01.826374+0000","last_unstale":"2024-05-21T13:41:23.599001+0000","last_undegraded":"2024-05-21T13:41:23.599001+0000","last_fullsized":"2024-05-21T13:41:23.599001+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'258","last_scrub_stamp":"2024-05-21T13:41:23.598765+0000","last_deep_scrub":"27'258","last_deep_scrub_stamp":"2024-05-21T13:41:23.598765+0000","last_clean_scrub_stamp":"2024-05-21T13:41:23.598765+0000","objects_scrubbed":0,"log_size":258,"log_dups_size":0,"ondisk_log_size":258,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:34:33.896882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":258,"num_write_kb":704512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,2],"acting":[1,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.11","version":"27'6","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:24.624918+0000","last_change":"2024-05-21T13:41:24.625007+0000","last_active":"2024-05-21T13:41:24.624918+0000","last_peered":"2024-05-21T13:41:24.624918+0000","last_clean":"2024-05-21T13:41:24.624918+0000","last_became_active":"2024-05-21T13:35:57.787544+0000","last_became_peered":"2024-05-21T13:35:57.787544+0000","last_unstale":"2024-05-21T13:41:24.624918+0000","last_undegraded":"2024-05-21T13:41:24.624918+0000","last_fullsized":"2024-05-21T13:41:24.624918+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-21T13:41:24.624727+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-21T13:41:24.624727+0000","last_clean_scrub_stamp":"2024-05-21T13:41:24.624727+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:34:25.994023+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.10","version":"27'24","reported_seq":61,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:21.727952+0000","last_change":"2024-05-21T13:41:21.727998+0000","last_active":"2024-05-21T13:41:21.727952+0000","last_peered":"2024-05-21T13:41:21.727952+0000","last_clean":"2024-05-21T13:41:21.727952+0000","last_became_active":"2024-05-21T13:35:56.752342+0000","last_became_peered":"2024-05-21T13:35:56.752342+0000","last_unstale":"2024-05-21T13:41:21.727952+0000","last_undegraded":"2024-05-21T13:41:21.727952+0000","last_fullsized":"2024-05-21T13:41:21.727952+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'24","last_scrub_stamp":"2024-05-21T13:41:21.727867+0000","last_deep_scrub":"27'24","last_deep_scrub_stamp":"2024-05-21T13:41:21.727867+0000","last_clean_scrub_stamp":"2024-05-21T13:41:21.727867+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:53:07.219186+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.16","version":"27'360","reported_seq":389,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:36.016401+0000","last_change":"2024-05-21T13:41:36.016540+0000","last_active":"2024-05-21T13:41:36.016401+0000","last_peered":"2024-05-21T13:41:36.016401+0000","last_clean":"2024-05-21T13:41:36.016401+0000","last_became_active":"2024-05-21T13:36:01.857707+0000","last_became_peered":"2024-05-21T13:36:01.857707+0000","last_unstale":"2024-05-21T13:41:36.016401+0000","last_undegraded":"2024-05-21T13:41:36.016401+0000","last_fullsized":"2024-05-21T13:41:36.016401+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'360","last_scrub_stamp":"2024-05-21T13:41:36.016153+0000","last_deep_scrub":"27'360","last_deep_scrub_stamp":"2024-05-21T13:41:36.016153+0000","last_clean_scrub_stamp":"2024-05-21T13:41:36.016153+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:39:59.054161+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":360,"num_write_kb":983040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1,6],"acting":[5,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"27'6","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:20.562874+0000","last_change":"2024-05-21T13:41:20.562938+0000","last_active":"2024-05-21T13:41:20.562874+0000","last_peered":"2024-05-21T13:41:20.562874+0000","last_clean":"2024-05-21T13:41:20.562874+0000","last_became_active":"2024-05-21T13:35:57.782330+0000","last_became_peered":"2024-05-21T13:35:57.782330+0000","last_unstale":"2024-05-21T13:41:20.562874+0000","last_undegraded":"2024-05-21T13:41:20.562874+0000","last_fullsized":"2024-05-21T13:41:20.562874+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-21T13:41:20.562656+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-21T13:41:20.562656+0000","last_clean_scrub_stamp":"2024-05-21T13:41:20.562656+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:29:18.178059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.11","version":"27'5","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:21.580067+0000","last_change":"2024-05-21T13:41:21.580140+0000","last_active":"2024-05-21T13:41:21.580067+0000","last_peered":"2024-05-21T13:41:21.580067+0000","last_clean":"2024-05-21T13:41:21.580067+0000","last_became_active":"2024-05-21T13:35:56.745202+0000","last_became_peered":"2024-05-21T13:35:56.745202+0000","last_unstale":"2024-05-21T13:41:21.580067+0000","last_undegraded":"2024-05-21T13:41:21.580067+0000","last_fullsized":"2024-05-21T13:41:21.580067+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-05-21T13:41:21.579880+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-05-21T13:41:21.579880+0000","last_clean_scrub_stamp":"2024-05-21T13:41:21.579880+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:13:16.241276+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"27'273","reported_seq":302,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:35.054344+0000","last_change":"2024-05-21T13:41:35.054423+0000","last_active":"2024-05-21T13:41:35.054344+0000","last_peered":"2024-05-21T13:41:35.054344+0000","last_clean":"2024-05-21T13:41:35.054344+0000","last_became_active":"2024-05-21T13:36:01.857716+0000","last_became_peered":"2024-05-21T13:36:01.857716+0000","last_unstale":"2024-05-21T13:41:35.054344+0000","last_undegraded":"2024-05-21T13:41:35.054344+0000","last_fullsized":"2024-05-21T13:41:35.054344+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'273","last_scrub_stamp":"2024-05-21T13:41:35.054133+0000","last_deep_scrub":"27'273","last_deep_scrub_stamp":"2024-05-21T13:41:35.054133+0000","last_clean_scrub_stamp":"2024-05-21T13:41:35.054133+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:05:53.525831+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6,4],"acting":[5,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"27'15","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:36.506744+0000","last_change":"2024-05-21T13:41:36.506804+0000","last_active":"2024-05-21T13:41:36.506744+0000","last_peered":"2024-05-21T13:41:36.506744+0000","last_clean":"2024-05-21T13:41:36.506744+0000","last_became_active":"2024-05-21T13:35:57.799225+0000","last_became_peered":"2024-05-21T13:35:57.799225+0000","last_unstale":"2024-05-21T13:41:36.506744+0000","last_undegraded":"2024-05-21T13:41:36.506744+0000","last_fullsized":"2024-05-21T13:41:36.506744+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2024-05-21T13:41:36.506545+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2024-05-21T13:41:36.506545+0000","last_clean_scrub_stamp":"2024-05-21T13:41:36.506545+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:19:05.428032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.12","version":"27'4","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:28.580187+0000","last_change":"2024-05-21T13:41:28.580256+0000","last_active":"2024-05-21T13:41:28.580187+0000","last_peered":"2024-05-21T13:41:28.580187+0000","last_clean":"2024-05-21T13:41:28.580187+0000","last_became_active":"2024-05-21T13:35:56.742296+0000","last_became_peered":"2024-05-21T13:35:56.742296+0000","last_unstale":"2024-05-21T13:41:28.580187+0000","last_undegraded":"2024-05-21T13:41:28.580187+0000","last_fullsized":"2024-05-21T13:41:28.580187+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-21T13:41:28.580015+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-21T13:41:28.580015+0000","last_clean_scrub_stamp":"2024-05-21T13:41:28.580015+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:28:54.152803+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"27'273","reported_seq":302,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:32.745997+0000","last_change":"2024-05-21T13:41:32.746059+0000","last_active":"2024-05-21T13:41:32.745997+0000","last_peered":"2024-05-21T13:41:32.745997+0000","last_clean":"2024-05-21T13:41:32.745997+0000","last_became_active":"2024-05-21T13:36:01.872320+0000","last_became_peered":"2024-05-21T13:36:01.872320+0000","last_unstale":"2024-05-21T13:41:32.745997+0000","last_undegraded":"2024-05-21T13:41:32.745997+0000","last_fullsized":"2024-05-21T13:41:32.745997+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'273","last_scrub_stamp":"2024-05-21T13:41:32.745819+0000","last_deep_scrub":"27'273","last_deep_scrub_stamp":"2024-05-21T13:41:32.745819+0000","last_clean_scrub_stamp":"2024-05-21T13:41:32.745819+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:13:23.814137+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0,7],"acting":[6,4,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.12","version":"27'10","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:27.804499+0000","last_change":"2024-05-21T13:41:27.804557+0000","last_active":"2024-05-21T13:41:27.804499+0000","last_peered":"2024-05-21T13:41:27.804499+0000","last_clean":"2024-05-21T13:41:27.804499+0000","last_became_active":"2024-05-21T13:35:57.802433+0000","last_became_peered":"2024-05-21T13:35:57.802433+0000","last_unstale":"2024-05-21T13:41:27.804499+0000","last_undegraded":"2024-05-21T13:41:27.804499+0000","last_fullsized":"2024-05-21T13:41:27.804499+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-05-21T13:41:27.804326+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-05-21T13:41:27.804326+0000","last_clean_scrub_stamp":"2024-05-21T13:41:27.804326+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:11:31.962586+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"27'10","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:18.825729+0000","last_change":"2024-05-21T13:41:18.825802+0000","last_active":"2024-05-21T13:41:18.825729+0000","last_peered":"2024-05-21T13:41:18.825729+0000","last_clean":"2024-05-21T13:41:18.825729+0000","last_became_active":"2024-05-21T13:35:56.753319+0000","last_became_peered":"2024-05-21T13:35:56.753319+0000","last_unstale":"2024-05-21T13:41:18.825729+0000","last_undegraded":"2024-05-21T13:41:18.825729+0000","last_fullsized":"2024-05-21T13:41:18.825729+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-05-21T13:41:18.825556+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-05-21T13:41:18.825556+0000","last_clean_scrub_stamp":"2024-05-21T13:41:18.825556+0000","objects_scrubbed":4,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:01:21.302956+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.15","version":"27'327","reported_seq":356,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:40.493511+0000","last_change":"2024-05-21T13:41:40.493580+0000","last_active":"2024-05-21T13:41:40.493511+0000","last_peered":"2024-05-21T13:41:40.493511+0000","last_clean":"2024-05-21T13:41:40.493511+0000","last_became_active":"2024-05-21T13:36:01.835450+0000","last_became_peered":"2024-05-21T13:36:01.835450+0000","last_unstale":"2024-05-21T13:41:40.493511+0000","last_undegraded":"2024-05-21T13:41:40.493511+0000","last_fullsized":"2024-05-21T13:41:40.493511+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'327","last_scrub_stamp":"2024-05-21T13:41:40.493325+0000","last_deep_scrub":"27'327","last_deep_scrub_stamp":"2024-05-21T13:41:40.493325+0000","last_clean_scrub_stamp":"2024-05-21T13:41:40.493325+0000","objects_scrubbed":0,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:36:59.088610+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":327,"num_write_kb":892928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5,6],"acting":[3,0,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"27'6","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:27.509483+0000","last_change":"2024-05-21T13:41:27.509545+0000","last_active":"2024-05-21T13:41:27.509483+0000","last_peered":"2024-05-21T13:41:27.509483+0000","last_clean":"2024-05-21T13:41:27.509483+0000","last_became_active":"2024-05-21T13:35:57.786401+0000","last_became_peered":"2024-05-21T13:35:57.786401+0000","last_unstale":"2024-05-21T13:41:27.509483+0000","last_undegraded":"2024-05-21T13:41:27.509483+0000","last_fullsized":"2024-05-21T13:41:27.509483+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-21T13:41:27.509298+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-21T13:41:27.509298+0000","last_clean_scrub_stamp":"2024-05-21T13:41:27.509298+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:58:50.520787+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.14","version":"27'103","reported_seq":140,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:16.724866+0000","last_change":"2024-05-21T13:41:16.724931+0000","last_active":"2024-05-21T13:41:16.724866+0000","last_peered":"2024-05-21T13:41:16.724866+0000","last_clean":"2024-05-21T13:41:16.724866+0000","last_became_active":"2024-05-21T13:35:56.750831+0000","last_became_peered":"2024-05-21T13:35:56.750831+0000","last_unstale":"2024-05-21T13:41:16.724866+0000","last_undegraded":"2024-05-21T13:41:16.724866+0000","last_fullsized":"2024-05-21T13:41:16.724866+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'103","last_scrub_stamp":"2024-05-21T13:41:16.724742+0000","last_deep_scrub":"27'103","last_deep_scrub_stamp":"2024-05-21T13:41:16.724742+0000","last_clean_scrub_stamp":"2024-05-21T13:41:16.724742+0000","objects_scrubbed":5,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:18:47.432591+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":209875,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":100,"num_write_kb":248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.12","version":"27'289","reported_seq":318,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:28.747025+0000","last_change":"2024-05-21T13:41:28.747089+0000","last_active":"2024-05-21T13:41:28.747025+0000","last_peered":"2024-05-21T13:41:28.747025+0000","last_clean":"2024-05-21T13:41:28.747025+0000","last_became_active":"2024-05-21T13:36:01.831476+0000","last_became_peered":"2024-05-21T13:36:01.831476+0000","last_unstale":"2024-05-21T13:41:28.747025+0000","last_undegraded":"2024-05-21T13:41:28.747025+0000","last_fullsized":"2024-05-21T13:41:28.747025+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'289","last_scrub_stamp":"2024-05-21T13:41:28.746820+0000","last_deep_scrub":"27'289","last_deep_scrub_stamp":"2024-05-21T13:41:28.746820+0000","last_clean_scrub_stamp":"2024-05-21T13:41:28.746820+0000","objects_scrubbed":0,"log_size":289,"log_dups_size":0,"ondisk_log_size":289,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:17:47.177363+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":288,"num_write_kb":786432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,5,0],"acting":[4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"27'11","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:22.586238+0000","last_change":"2024-05-21T13:41:22.586301+0000","last_active":"2024-05-21T13:41:22.586238+0000","last_peered":"2024-05-21T13:41:22.586238+0000","last_clean":"2024-05-21T13:41:22.586238+0000","last_became_active":"2024-05-21T13:35:57.787785+0000","last_became_peered":"2024-05-21T13:35:57.787785+0000","last_unstale":"2024-05-21T13:41:22.586238+0000","last_undegraded":"2024-05-21T13:41:22.586238+0000","last_fullsized":"2024-05-21T13:41:22.586238+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'11","last_scrub_stamp":"2024-05-21T13:41:22.586052+0000","last_deep_scrub":"27'11","last_deep_scrub_stamp":"2024-05-21T13:41:22.586052+0000","last_clean_scrub_stamp":"2024-05-21T13:41:22.586052+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:56:53.588119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.15","version":"27'12","reported_seq":49,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:19.821151+0000","last_change":"2024-05-21T13:41:19.821223+0000","last_active":"2024-05-21T13:41:19.821151+0000","last_peered":"2024-05-21T13:41:19.821151+0000","last_clean":"2024-05-21T13:41:19.821151+0000","last_became_active":"2024-05-21T13:35:56.759728+0000","last_became_peered":"2024-05-21T13:35:56.759728+0000","last_unstale":"2024-05-21T13:41:19.821151+0000","last_undegraded":"2024-05-21T13:41:19.821151+0000","last_fullsized":"2024-05-21T13:41:19.821151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'12","last_scrub_stamp":"2024-05-21T13:41:19.820982+0000","last_deep_scrub":"27'12","last_deep_scrub_stamp":"2024-05-21T13:41:19.820982+0000","last_clean_scrub_stamp":"2024-05-21T13:41:19.820982+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:28:39.145141+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.13","version":"27'297","reported_seq":326,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:30.566720+0000","last_change":"2024-05-21T13:41:30.566787+0000","last_active":"2024-05-21T13:41:30.566720+0000","last_peered":"2024-05-21T13:41:30.566720+0000","last_clean":"2024-05-21T13:41:30.566720+0000","last_became_active":"2024-05-21T13:36:01.861172+0000","last_became_peered":"2024-05-21T13:36:01.861172+0000","last_unstale":"2024-05-21T13:41:30.566720+0000","last_undegraded":"2024-05-21T13:41:30.566720+0000","last_fullsized":"2024-05-21T13:41:30.566720+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'297","last_scrub_stamp":"2024-05-21T13:41:30.566517+0000","last_deep_scrub":"27'297","last_deep_scrub_stamp":"2024-05-21T13:41:30.566517+0000","last_clean_scrub_stamp":"2024-05-21T13:41:30.566517+0000","objects_scrubbed":0,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:28:19.610249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":297,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,7],"acting":[2,3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.17","version":"27'9","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:32.976891+0000","last_change":"2024-05-21T13:41:32.976950+0000","last_active":"2024-05-21T13:41:32.976891+0000","last_peered":"2024-05-21T13:41:32.976891+0000","last_clean":"2024-05-21T13:41:32.976891+0000","last_became_active":"2024-05-21T13:35:57.804139+0000","last_became_peered":"2024-05-21T13:35:57.804139+0000","last_unstale":"2024-05-21T13:41:32.976891+0000","last_undegraded":"2024-05-21T13:41:32.976891+0000","last_fullsized":"2024-05-21T13:41:32.976891+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-05-21T13:41:32.976718+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-05-21T13:41:32.976718+0000","last_clean_scrub_stamp":"2024-05-21T13:41:32.976718+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:00:24.779936+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"27'3","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:19.589755+0000","last_change":"2024-05-21T13:41:19.589833+0000","last_active":"2024-05-21T13:41:19.589755+0000","last_peered":"2024-05-21T13:41:19.589755+0000","last_clean":"2024-05-21T13:41:19.589755+0000","last_became_active":"2024-05-21T13:35:56.732488+0000","last_became_peered":"2024-05-21T13:35:56.732488+0000","last_unstale":"2024-05-21T13:41:19.589755+0000","last_undegraded":"2024-05-21T13:41:19.589755+0000","last_fullsized":"2024-05-21T13:41:19.589755+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-05-21T13:41:19.589546+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-05-21T13:41:19.589546+0000","last_clean_scrub_stamp":"2024-05-21T13:41:19.589546+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:32:35.644245+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"27'297","reported_seq":326,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:26.822514+0000","last_change":"2024-05-21T13:41:26.822576+0000","last_active":"2024-05-21T13:41:26.822514+0000","last_peered":"2024-05-21T13:41:26.822514+0000","last_clean":"2024-05-21T13:41:26.822514+0000","last_became_active":"2024-05-21T13:36:01.864254+0000","last_became_peered":"2024-05-21T13:36:01.864254+0000","last_unstale":"2024-05-21T13:41:26.822514+0000","last_undegraded":"2024-05-21T13:41:26.822514+0000","last_fullsized":"2024-05-21T13:41:26.822514+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'297","last_scrub_stamp":"2024-05-21T13:41:26.822339+0000","last_deep_scrub":"27'297","last_deep_scrub_stamp":"2024-05-21T13:41:26.822339+0000","last_clean_scrub_stamp":"2024-05-21T13:41:26.822339+0000","objects_scrubbed":0,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:37:47.236373+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":297,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,3,2],"acting":[7,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.16","version":"27'10","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:22.581198+0000","last_change":"2024-05-21T13:41:22.581255+0000","last_active":"2024-05-21T13:41:22.581198+0000","last_peered":"2024-05-21T13:41:22.581198+0000","last_clean":"2024-05-21T13:41:22.581198+0000","last_became_active":"2024-05-21T13:35:57.787963+0000","last_became_peered":"2024-05-21T13:35:57.787963+0000","last_unstale":"2024-05-21T13:41:22.581198+0000","last_undegraded":"2024-05-21T13:41:22.581198+0000","last_fullsized":"2024-05-21T13:41:22.581198+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-05-21T13:41:22.581027+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-05-21T13:41:22.581027+0000","last_clean_scrub_stamp":"2024-05-21T13:41:22.581027+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:47:18.778141+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.17","version":"27'6","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:17.528348+0000","last_change":"2024-05-21T13:41:17.528374+0000","last_active":"2024-05-21T13:41:17.528348+0000","last_peered":"2024-05-21T13:41:17.528348+0000","last_clean":"2024-05-21T13:41:17.528348+0000","last_became_active":"2024-05-21T13:35:56.748049+0000","last_became_peered":"2024-05-21T13:35:56.748049+0000","last_unstale":"2024-05-21T13:41:17.528348+0000","last_undegraded":"2024-05-21T13:41:17.528348+0000","last_fullsized":"2024-05-21T13:41:17.528348+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-21T13:41:17.528281+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-21T13:41:17.528281+0000","last_clean_scrub_stamp":"2024-05-21T13:41:17.528281+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:23:26.743768+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"27'327","reported_seq":356,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:32.671675+0000","last_change":"2024-05-21T13:41:32.671741+0000","last_active":"2024-05-21T13:41:32.671675+0000","last_peered":"2024-05-21T13:41:32.671675+0000","last_clean":"2024-05-21T13:41:32.671675+0000","last_became_active":"2024-05-21T13:36:01.855417+0000","last_became_peered":"2024-05-21T13:36:01.855417+0000","last_unstale":"2024-05-21T13:41:32.671675+0000","last_undegraded":"2024-05-21T13:41:32.671675+0000","last_fullsized":"2024-05-21T13:41:32.671675+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'327","last_scrub_stamp":"2024-05-21T13:41:32.671497+0000","last_deep_scrub":"27'327","last_deep_scrub_stamp":"2024-05-21T13:41:32.671497+0000","last_clean_scrub_stamp":"2024-05-21T13:41:32.671497+0000","objects_scrubbed":0,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:29:27.422410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":327,"num_write_kb":892928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3,7],"acting":[4,0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1e","version":"27'273","reported_seq":302,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:29.714145+0000","last_change":"2024-05-21T13:41:29.714209+0000","last_active":"2024-05-21T13:41:29.714145+0000","last_peered":"2024-05-21T13:41:29.714145+0000","last_clean":"2024-05-21T13:41:29.714145+0000","last_became_active":"2024-05-21T13:36:01.837777+0000","last_became_peered":"2024-05-21T13:36:01.837777+0000","last_unstale":"2024-05-21T13:41:29.714145+0000","last_undegraded":"2024-05-21T13:41:29.714145+0000","last_fullsized":"2024-05-21T13:41:29.714145+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'273","last_scrub_stamp":"2024-05-21T13:41:29.713969+0000","last_deep_scrub":"27'273","last_deep_scrub_stamp":"2024-05-21T13:41:29.713969+0000","last_clean_scrub_stamp":"2024-05-21T13:41:29.713969+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:26:54.144477+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":273,"num_write_kb":745472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,5,3],"acting":[4,1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"27'11","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:24.755770+0000","last_change":"2024-05-21T13:41:24.755845+0000","last_active":"2024-05-21T13:41:24.755770+0000","last_peered":"2024-05-21T13:41:24.755770+0000","last_clean":"2024-05-21T13:41:24.755770+0000","last_became_active":"2024-05-21T13:35:57.762071+0000","last_became_peered":"2024-05-21T13:35:57.762071+0000","last_unstale":"2024-05-21T13:41:24.755770+0000","last_undegraded":"2024-05-21T13:41:24.755770+0000","last_fullsized":"2024-05-21T13:41:24.755770+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'11","last_scrub_stamp":"2024-05-21T13:41:24.755581+0000","last_deep_scrub":"27'11","last_deep_scrub_stamp":"2024-05-21T13:41:24.755581+0000","last_clean_scrub_stamp":"2024-05-21T13:41:24.755581+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:00:19.747625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.18","version":"25'1","reported_seq":37,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:32.496921+0000","last_change":"2024-05-21T13:41:32.497056+0000","last_active":"2024-05-21T13:41:32.496921+0000","last_peered":"2024-05-21T13:41:32.496921+0000","last_clean":"2024-05-21T13:41:32.496921+0000","last_became_active":"2024-05-21T13:35:56.751201+0000","last_became_peered":"2024-05-21T13:35:56.751201+0000","last_unstale":"2024-05-21T13:41:32.496921+0000","last_undegraded":"2024-05-21T13:41:32.496921+0000","last_fullsized":"2024-05-21T13:41:32.496921+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"25'1","last_scrub_stamp":"2024-05-21T13:41:32.496675+0000","last_deep_scrub":"25'1","last_deep_scrub_stamp":"2024-05-21T13:41:32.496675+0000","last_clean_scrub_stamp":"2024-05-21T13:41:32.496675+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:22:39.182625+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"27'267","reported_seq":296,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:41.467434+0000","last_change":"2024-05-21T13:41:41.467497+0000","last_active":"2024-05-21T13:41:41.467434+0000","last_peered":"2024-05-21T13:41:41.467434+0000","last_clean":"2024-05-21T13:41:41.467434+0000","last_became_active":"2024-05-21T13:36:01.836194+0000","last_became_peered":"2024-05-21T13:36:01.836194+0000","last_unstale":"2024-05-21T13:41:41.467434+0000","last_undegraded":"2024-05-21T13:41:41.467434+0000","last_fullsized":"2024-05-21T13:41:41.467434+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'267","last_scrub_stamp":"2024-05-21T13:41:41.467248+0000","last_deep_scrub":"27'267","last_deep_scrub_stamp":"2024-05-21T13:41:41.467248+0000","last_clean_scrub_stamp":"2024-05-21T13:41:41.467248+0000","objects_scrubbed":0,"log_size":267,"log_dups_size":0,"ondisk_log_size":267,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:37:15.635109+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":267,"num_write_kb":729088,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1],"acting":[3,2,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"27'8","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:31.971186+0000","last_change":"2024-05-21T13:41:31.971251+0000","last_active":"2024-05-21T13:41:31.971186+0000","last_peered":"2024-05-21T13:41:31.971186+0000","last_clean":"2024-05-21T13:41:31.971186+0000","last_became_active":"2024-05-21T13:35:57.786307+0000","last_became_peered":"2024-05-21T13:35:57.786307+0000","last_unstale":"2024-05-21T13:41:31.971186+0000","last_undegraded":"2024-05-21T13:41:31.971186+0000","last_fullsized":"2024-05-21T13:41:31.971186+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-21T13:41:31.971005+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-21T13:41:31.971005+0000","last_clean_scrub_stamp":"2024-05-21T13:41:31.971005+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:05:31.840234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.19","version":"27'3","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:18.824970+0000","last_change":"2024-05-21T13:41:18.825038+0000","last_active":"2024-05-21T13:41:18.824970+0000","last_peered":"2024-05-21T13:41:18.824970+0000","last_clean":"2024-05-21T13:41:18.824970+0000","last_became_active":"2024-05-21T13:35:56.745884+0000","last_became_peered":"2024-05-21T13:35:56.745884+0000","last_unstale":"2024-05-21T13:41:18.824970+0000","last_undegraded":"2024-05-21T13:41:18.824970+0000","last_fullsized":"2024-05-21T13:41:18.824970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'3","last_scrub_stamp":"2024-05-21T13:41:18.824811+0000","last_deep_scrub":"27'3","last_deep_scrub_stamp":"2024-05-21T13:41:18.824811+0000","last_clean_scrub_stamp":"2024-05-21T13:41:18.824811+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:06:01.517837+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"27'4","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:34.467396+0000","last_change":"2024-05-21T13:41:34.467460+0000","last_active":"2024-05-21T13:41:34.467396+0000","last_peered":"2024-05-21T13:41:34.467396+0000","last_clean":"2024-05-21T13:41:34.467396+0000","last_became_active":"2024-05-21T13:35:56.753499+0000","last_became_peered":"2024-05-21T13:35:56.753499+0000","last_unstale":"2024-05-21T13:41:34.467396+0000","last_undegraded":"2024-05-21T13:41:34.467396+0000","last_fullsized":"2024-05-21T13:41:34.467396+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-21T13:41:34.467230+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-21T13:41:34.467230+0000","last_clean_scrub_stamp":"2024-05-21T13:41:34.467230+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:09:46.555569+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"27'8","reported_seq":48,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:33.666211+0000","last_change":"2024-05-21T13:41:33.666272+0000","last_active":"2024-05-21T13:41:33.666211+0000","last_peered":"2024-05-21T13:41:33.666211+0000","last_clean":"2024-05-21T13:41:33.666211+0000","last_became_active":"2024-05-21T13:36:39.802110+0000","last_became_peered":"2024-05-21T13:36:39.802110+0000","last_unstale":"2024-05-21T13:41:33.666211+0000","last_undegraded":"2024-05-21T13:41:33.666211+0000","last_fullsized":"2024-05-21T13:41:33.666211+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-21T13:41:33.666040+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-21T13:41:33.666040+0000","last_clean_scrub_stamp":"2024-05-21T13:41:33.666040+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:35:54.695748+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1c","version":"27'297","reported_seq":326,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:31.716726+0000","last_change":"2024-05-21T13:41:31.716797+0000","last_active":"2024-05-21T13:41:31.716726+0000","last_peered":"2024-05-21T13:41:31.716726+0000","last_clean":"2024-05-21T13:41:31.716726+0000","last_became_active":"2024-05-21T13:36:01.842792+0000","last_became_peered":"2024-05-21T13:36:01.842792+0000","last_unstale":"2024-05-21T13:41:31.716726+0000","last_undegraded":"2024-05-21T13:41:31.716726+0000","last_fullsized":"2024-05-21T13:41:31.716726+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'297","last_scrub_stamp":"2024-05-21T13:41:31.716520+0000","last_deep_scrub":"27'297","last_deep_scrub_stamp":"2024-05-21T13:41:31.716520+0000","last_clean_scrub_stamp":"2024-05-21T13:41:31.716520+0000","objects_scrubbed":0,"log_size":297,"log_dups_size":0,"ondisk_log_size":297,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:03:19.554032+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":297,"num_write_kb":811008,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,7],"acting":[4,6,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"27'8","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:23.870260+0000","last_change":"2024-05-21T13:41:23.870325+0000","last_active":"2024-05-21T13:41:23.870260+0000","last_peered":"2024-05-21T13:41:23.870260+0000","last_clean":"2024-05-21T13:41:23.870260+0000","last_became_active":"2024-05-21T13:35:56.766873+0000","last_became_peered":"2024-05-21T13:35:56.766873+0000","last_unstale":"2024-05-21T13:41:23.870260+0000","last_undegraded":"2024-05-21T13:41:23.870260+0000","last_fullsized":"2024-05-21T13:41:23.870260+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-21T13:41:23.870087+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-21T13:41:23.870087+0000","last_clean_scrub_stamp":"2024-05-21T13:41:23.870087+0000","objects_scrubbed":2,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:44:53.961087+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1204,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"27'7","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:21.548601+0000","last_change":"2024-05-21T13:41:21.548665+0000","last_active":"2024-05-21T13:41:21.548601+0000","last_peered":"2024-05-21T13:41:21.548601+0000","last_clean":"2024-05-21T13:41:21.548601+0000","last_became_active":"2024-05-21T13:35:57.787255+0000","last_became_peered":"2024-05-21T13:35:57.787255+0000","last_unstale":"2024-05-21T13:41:21.548601+0000","last_undegraded":"2024-05-21T13:41:21.548601+0000","last_fullsized":"2024-05-21T13:41:21.548601+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-05-21T13:41:21.548424+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-05-21T13:41:21.548424+0000","last_clean_scrub_stamp":"2024-05-21T13:41:21.548424+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:52:10.906473+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"27'312","reported_seq":341,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:24.781189+0000","last_change":"2024-05-21T13:41:24.781309+0000","last_active":"2024-05-21T13:41:24.781189+0000","last_peered":"2024-05-21T13:41:24.781189+0000","last_clean":"2024-05-21T13:41:24.781189+0000","last_became_active":"2024-05-21T13:36:01.867522+0000","last_became_peered":"2024-05-21T13:36:01.867522+0000","last_unstale":"2024-05-21T13:41:24.781189+0000","last_undegraded":"2024-05-21T13:41:24.781189+0000","last_fullsized":"2024-05-21T13:41:24.781189+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'312","last_scrub_stamp":"2024-05-21T13:41:24.780942+0000","last_deep_scrub":"27'312","last_deep_scrub_stamp":"2024-05-21T13:41:24.780942+0000","last_clean_scrub_stamp":"2024-05-21T13:41:24.780942+0000","objects_scrubbed":0,"log_size":312,"log_dups_size":0,"ondisk_log_size":312,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:24:25.852913+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":312,"num_write_kb":851968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,1,0],"acting":[7,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"27'9","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:20.645057+0000","last_change":"2024-05-21T13:41:20.645176+0000","last_active":"2024-05-21T13:41:20.645057+0000","last_peered":"2024-05-21T13:41:20.645057+0000","last_clean":"2024-05-21T13:41:20.645057+0000","last_became_active":"2024-05-21T13:35:57.782233+0000","last_became_peered":"2024-05-21T13:35:57.782233+0000","last_unstale":"2024-05-21T13:41:20.645057+0000","last_undegraded":"2024-05-21T13:41:20.645057+0000","last_fullsized":"2024-05-21T13:41:20.645057+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-05-21T13:41:20.644840+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-05-21T13:41:20.644840+0000","last_clean_scrub_stamp":"2024-05-21T13:41:20.644840+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:06:51.552866+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"27'12","reported_seq":47,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:21.843551+0000","last_change":"2024-05-21T13:41:21.843609+0000","last_active":"2024-05-21T13:41:21.843551+0000","last_peered":"2024-05-21T13:41:21.843551+0000","last_clean":"2024-05-21T13:41:21.843551+0000","last_became_active":"2024-05-21T13:35:57.769785+0000","last_became_peered":"2024-05-21T13:35:57.769785+0000","last_unstale":"2024-05-21T13:41:21.843551+0000","last_undegraded":"2024-05-21T13:41:21.843551+0000","last_fullsized":"2024-05-21T13:41:21.843551+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'12","last_scrub_stamp":"2024-05-21T13:41:21.843385+0000","last_deep_scrub":"27'12","last_deep_scrub_stamp":"2024-05-21T13:41:21.843385+0000","last_clean_scrub_stamp":"2024-05-21T13:41:21.843385+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:18:21.380351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.22","version":"27'8","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:25.657986+0000","last_change":"2024-05-21T13:41:25.658047+0000","last_active":"2024-05-21T13:41:25.657986+0000","last_peered":"2024-05-21T13:41:25.657986+0000","last_clean":"2024-05-21T13:41:25.657986+0000","last_became_active":"2024-05-21T13:35:57.796495+0000","last_became_peered":"2024-05-21T13:35:57.796495+0000","last_unstale":"2024-05-21T13:41:25.657986+0000","last_undegraded":"2024-05-21T13:41:25.657986+0000","last_fullsized":"2024-05-21T13:41:25.657986+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-21T13:41:25.657816+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-21T13:41:25.657816+0000","last_clean_scrub_stamp":"2024-05-21T13:41:25.657816+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:06:39.514502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"27'7","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:20.882525+0000","last_change":"2024-05-21T13:41:20.882589+0000","last_active":"2024-05-21T13:41:20.882525+0000","last_peered":"2024-05-21T13:41:20.882525+0000","last_clean":"2024-05-21T13:41:20.882525+0000","last_became_active":"2024-05-21T13:35:57.783968+0000","last_became_peered":"2024-05-21T13:35:57.783968+0000","last_unstale":"2024-05-21T13:41:20.882525+0000","last_undegraded":"2024-05-21T13:41:20.882525+0000","last_fullsized":"2024-05-21T13:41:20.882525+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-05-21T13:41:20.882357+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-05-21T13:41:20.882357+0000","last_clean_scrub_stamp":"2024-05-21T13:41:20.882357+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:10:21.235554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"27'4","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:26.790860+0000","last_change":"2024-05-21T13:41:26.790921+0000","last_active":"2024-05-21T13:41:26.790860+0000","last_peered":"2024-05-21T13:41:26.790860+0000","last_clean":"2024-05-21T13:41:26.790860+0000","last_became_active":"2024-05-21T13:35:57.794885+0000","last_became_peered":"2024-05-21T13:35:57.794885+0000","last_unstale":"2024-05-21T13:41:26.790860+0000","last_undegraded":"2024-05-21T13:41:26.790860+0000","last_fullsized":"2024-05-21T13:41:26.790860+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-21T13:41:26.790691+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-21T13:41:26.790691+0000","last_clean_scrub_stamp":"2024-05-21T13:41:26.790691+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:56:59.609576+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"27'6","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:21.861939+0000","last_change":"2024-05-21T13:41:21.861997+0000","last_active":"2024-05-21T13:41:21.861939+0000","last_peered":"2024-05-21T13:41:21.861939+0000","last_clean":"2024-05-21T13:41:21.861939+0000","last_became_active":"2024-05-21T13:35:57.778171+0000","last_became_peered":"2024-05-21T13:35:57.778171+0000","last_unstale":"2024-05-21T13:41:21.861939+0000","last_undegraded":"2024-05-21T13:41:21.861939+0000","last_fullsized":"2024-05-21T13:41:21.861939+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-21T13:41:21.861766+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-21T13:41:21.861766+0000","last_clean_scrub_stamp":"2024-05-21T13:41:21.861766+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:59:31.342570+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"27'15","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:23.550449+0000","last_change":"2024-05-21T13:41:23.550509+0000","last_active":"2024-05-21T13:41:23.550449+0000","last_peered":"2024-05-21T13:41:23.550449+0000","last_clean":"2024-05-21T13:41:23.550449+0000","last_became_active":"2024-05-21T13:35:57.790971+0000","last_became_peered":"2024-05-21T13:35:57.790971+0000","last_unstale":"2024-05-21T13:41:23.550449+0000","last_undegraded":"2024-05-21T13:41:23.550449+0000","last_fullsized":"2024-05-21T13:41:23.550449+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'15","last_scrub_stamp":"2024-05-21T13:41:23.550270+0000","last_deep_scrub":"27'15","last_deep_scrub_stamp":"2024-05-21T13:41:23.550270+0000","last_clean_scrub_stamp":"2024-05-21T13:41:23.550270+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T17:28:39.274264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"27'2","reported_seq":36,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:18.903684+0000","last_change":"2024-05-21T13:41:18.903745+0000","last_active":"2024-05-21T13:41:18.903684+0000","last_peered":"2024-05-21T13:41:18.903684+0000","last_clean":"2024-05-21T13:41:18.903684+0000","last_became_active":"2024-05-21T13:35:57.781533+0000","last_became_peered":"2024-05-21T13:35:57.781533+0000","last_unstale":"2024-05-21T13:41:18.903684+0000","last_undegraded":"2024-05-21T13:41:18.903684+0000","last_fullsized":"2024-05-21T13:41:18.903684+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'2","last_scrub_stamp":"2024-05-21T13:41:18.903495+0000","last_deep_scrub":"27'2","last_deep_scrub_stamp":"2024-05-21T13:41:18.903495+0000","last_clean_scrub_stamp":"2024-05-21T13:41:18.903495+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:26:11.651388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.28","version":"27'6","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:23.632341+0000","last_change":"2024-05-21T13:41:23.632401+0000","last_active":"2024-05-21T13:41:23.632341+0000","last_peered":"2024-05-21T13:41:23.632341+0000","last_clean":"2024-05-21T13:41:23.632341+0000","last_became_active":"2024-05-21T13:35:57.797044+0000","last_became_peered":"2024-05-21T13:35:57.797044+0000","last_unstale":"2024-05-21T13:41:23.632341+0000","last_undegraded":"2024-05-21T13:41:23.632341+0000","last_fullsized":"2024-05-21T13:41:23.632341+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-21T13:41:23.632167+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-21T13:41:23.632167+0000","last_clean_scrub_stamp":"2024-05-21T13:41:23.632167+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:49:46.790341+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"27'8","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:29.953896+0000","last_change":"2024-05-21T13:41:29.953966+0000","last_active":"2024-05-21T13:41:29.953896+0000","last_peered":"2024-05-21T13:41:29.953896+0000","last_clean":"2024-05-21T13:41:29.953896+0000","last_became_active":"2024-05-21T13:35:57.789474+0000","last_became_peered":"2024-05-21T13:35:57.789474+0000","last_unstale":"2024-05-21T13:41:29.953896+0000","last_undegraded":"2024-05-21T13:41:29.953896+0000","last_fullsized":"2024-05-21T13:41:29.953896+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-21T13:41:29.953680+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-21T13:41:29.953680+0000","last_clean_scrub_stamp":"2024-05-21T13:41:29.953680+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:49:30.790938+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"27'10","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:18.508464+0000","last_change":"2024-05-21T13:41:18.508532+0000","last_active":"2024-05-21T13:41:18.508464+0000","last_peered":"2024-05-21T13:41:18.508464+0000","last_clean":"2024-05-21T13:41:18.508464+0000","last_became_active":"2024-05-21T13:35:57.755889+0000","last_became_peered":"2024-05-21T13:35:57.755889+0000","last_unstale":"2024-05-21T13:41:18.508464+0000","last_undegraded":"2024-05-21T13:41:18.508464+0000","last_fullsized":"2024-05-21T13:41:18.508464+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-05-21T13:41:18.508354+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-05-21T13:41:18.508354+0000","last_clean_scrub_stamp":"2024-05-21T13:41:18.508354+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:27:33.246162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"27'11","reported_seq":46,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:17.717050+0000","last_change":"2024-05-21T13:41:17.717113+0000","last_active":"2024-05-21T13:41:17.717050+0000","last_peered":"2024-05-21T13:41:17.717050+0000","last_clean":"2024-05-21T13:41:17.717050+0000","last_became_active":"2024-05-21T13:35:57.774386+0000","last_became_peered":"2024-05-21T13:35:57.774386+0000","last_unstale":"2024-05-21T13:41:17.717050+0000","last_undegraded":"2024-05-21T13:41:17.717050+0000","last_fullsized":"2024-05-21T13:41:17.717050+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'11","last_scrub_stamp":"2024-05-21T13:41:17.716879+0000","last_deep_scrub":"27'11","last_deep_scrub_stamp":"2024-05-21T13:41:17.716879+0000","last_clean_scrub_stamp":"2024-05-21T13:41:17.716879+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:34:15.346123+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2c","version":"27'8","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:25.548260+0000","last_change":"2024-05-21T13:41:25.548323+0000","last_active":"2024-05-21T13:41:25.548260+0000","last_peered":"2024-05-21T13:41:25.548260+0000","last_clean":"2024-05-21T13:41:25.548260+0000","last_became_active":"2024-05-21T13:35:57.769149+0000","last_became_peered":"2024-05-21T13:35:57.769149+0000","last_unstale":"2024-05-21T13:41:25.548260+0000","last_undegraded":"2024-05-21T13:41:25.548260+0000","last_fullsized":"2024-05-21T13:41:25.548260+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-21T13:41:25.548045+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-21T13:41:25.548045+0000","last_clean_scrub_stamp":"2024-05-21T13:41:25.548045+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:26:42.943590+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"27'7","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:17.544048+0000","last_change":"2024-05-21T13:41:17.544103+0000","last_active":"2024-05-21T13:41:17.544048+0000","last_peered":"2024-05-21T13:41:17.544048+0000","last_clean":"2024-05-21T13:41:17.544048+0000","last_became_active":"2024-05-21T13:35:57.795799+0000","last_became_peered":"2024-05-21T13:35:57.795799+0000","last_unstale":"2024-05-21T13:41:17.544048+0000","last_undegraded":"2024-05-21T13:41:17.544048+0000","last_fullsized":"2024-05-21T13:41:17.544048+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-05-21T13:41:17.543930+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-05-21T13:41:17.543930+0000","last_clean_scrub_stamp":"2024-05-21T13:41:17.543930+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:41:34.259266+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"27'10","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:22.797277+0000","last_change":"2024-05-21T13:41:22.797334+0000","last_active":"2024-05-21T13:41:22.797277+0000","last_peered":"2024-05-21T13:41:22.797277+0000","last_clean":"2024-05-21T13:41:22.797277+0000","last_became_active":"2024-05-21T13:35:57.775573+0000","last_became_peered":"2024-05-21T13:35:57.775573+0000","last_unstale":"2024-05-21T13:41:22.797277+0000","last_undegraded":"2024-05-21T13:41:22.797277+0000","last_fullsized":"2024-05-21T13:41:22.797277+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-05-21T13:41:22.797113+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-05-21T13:41:22.797113+0000","last_clean_scrub_stamp":"2024-05-21T13:41:22.797113+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T20:00:08.767138+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"27'8","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:35.510975+0000","last_change":"2024-05-21T13:41:35.511038+0000","last_active":"2024-05-21T13:41:35.510975+0000","last_peered":"2024-05-21T13:41:35.510975+0000","last_clean":"2024-05-21T13:41:35.510975+0000","last_became_active":"2024-05-21T13:35:57.799313+0000","last_became_peered":"2024-05-21T13:35:57.799313+0000","last_unstale":"2024-05-21T13:41:35.510975+0000","last_undegraded":"2024-05-21T13:41:35.510975+0000","last_fullsized":"2024-05-21T13:41:35.510975+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-21T13:41:35.510788+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-21T13:41:35.510788+0000","last_clean_scrub_stamp":"2024-05-21T13:41:35.510788+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T19:55:01.906223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"27'9","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:18.506055+0000","last_change":"2024-05-21T13:41:18.506076+0000","last_active":"2024-05-21T13:41:18.506055+0000","last_peered":"2024-05-21T13:41:18.506055+0000","last_clean":"2024-05-21T13:41:18.506055+0000","last_became_active":"2024-05-21T13:35:57.787735+0000","last_became_peered":"2024-05-21T13:35:57.787735+0000","last_unstale":"2024-05-21T13:41:18.506055+0000","last_undegraded":"2024-05-21T13:41:18.506055+0000","last_fullsized":"2024-05-21T13:41:18.506055+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-05-21T13:41:18.505984+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-05-21T13:41:18.505984+0000","last_clean_scrub_stamp":"2024-05-21T13:41:18.505984+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:18:38.904067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.31","version":"27'7","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:19.856000+0000","last_change":"2024-05-21T13:41:19.856060+0000","last_active":"2024-05-21T13:41:19.856000+0000","last_peered":"2024-05-21T13:41:19.856000+0000","last_clean":"2024-05-21T13:41:19.856000+0000","last_became_active":"2024-05-21T13:35:57.786403+0000","last_became_peered":"2024-05-21T13:35:57.786403+0000","last_unstale":"2024-05-21T13:41:19.856000+0000","last_undegraded":"2024-05-21T13:41:19.856000+0000","last_fullsized":"2024-05-21T13:41:19.856000+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-05-21T13:41:19.855823+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-05-21T13:41:19.855823+0000","last_clean_scrub_stamp":"2024-05-21T13:41:19.855823+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:44:49.291164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.32","version":"27'8","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:23.846775+0000","last_change":"2024-05-21T13:41:23.846836+0000","last_active":"2024-05-21T13:41:23.846775+0000","last_peered":"2024-05-21T13:41:23.846775+0000","last_clean":"2024-05-21T13:41:23.846775+0000","last_became_active":"2024-05-21T13:35:57.783060+0000","last_became_peered":"2024-05-21T13:35:57.783060+0000","last_unstale":"2024-05-21T13:41:23.846775+0000","last_undegraded":"2024-05-21T13:41:23.846775+0000","last_fullsized":"2024-05-21T13:41:23.846775+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-21T13:41:23.846594+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-21T13:41:23.846594+0000","last_clean_scrub_stamp":"2024-05-21T13:41:23.846594+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:22:01.719599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.33","version":"27'10","reported_seq":44,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:25.790785+0000","last_change":"2024-05-21T13:41:25.790898+0000","last_active":"2024-05-21T13:41:25.790785+0000","last_peered":"2024-05-21T13:41:25.790785+0000","last_clean":"2024-05-21T13:41:25.790785+0000","last_became_active":"2024-05-21T13:35:57.787508+0000","last_became_peered":"2024-05-21T13:35:57.787508+0000","last_unstale":"2024-05-21T13:41:25.790785+0000","last_undegraded":"2024-05-21T13:41:25.790785+0000","last_fullsized":"2024-05-21T13:41:25.790785+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'10","last_scrub_stamp":"2024-05-21T13:41:25.790520+0000","last_deep_scrub":"27'10","last_deep_scrub_stamp":"2024-05-21T13:41:25.790520+0000","last_clean_scrub_stamp":"2024-05-21T13:41:25.790520+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T18:18:09.987430+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"27'7","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:28.537725+0000","last_change":"2024-05-21T13:41:28.537873+0000","last_active":"2024-05-21T13:41:28.537725+0000","last_peered":"2024-05-21T13:41:28.537725+0000","last_clean":"2024-05-21T13:41:28.537725+0000","last_became_active":"2024-05-21T13:35:57.786292+0000","last_became_peered":"2024-05-21T13:35:57.786292+0000","last_unstale":"2024-05-21T13:41:28.537725+0000","last_undegraded":"2024-05-21T13:41:28.537725+0000","last_fullsized":"2024-05-21T13:41:28.537725+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-05-21T13:41:28.537501+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-05-21T13:41:28.537501+0000","last_clean_scrub_stamp":"2024-05-21T13:41:28.537501+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:18:26.588695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.35","version":"27'6","reported_seq":40,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:30.592388+0000","last_change":"2024-05-21T13:41:30.592452+0000","last_active":"2024-05-21T13:41:30.592388+0000","last_peered":"2024-05-21T13:41:30.592388+0000","last_clean":"2024-05-21T13:41:30.592388+0000","last_became_active":"2024-05-21T13:35:57.800858+0000","last_became_peered":"2024-05-21T13:35:57.800858+0000","last_unstale":"2024-05-21T13:41:30.592388+0000","last_undegraded":"2024-05-21T13:41:30.592388+0000","last_fullsized":"2024-05-21T13:41:30.592388+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-21T13:41:30.592210+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-21T13:41:30.592210+0000","last_clean_scrub_stamp":"2024-05-21T13:41:30.592210+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:57:42.313631+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"27'16","reported_seq":50,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:17.531736+0000","last_change":"2024-05-21T13:41:17.531763+0000","last_active":"2024-05-21T13:41:17.531736+0000","last_peered":"2024-05-21T13:41:17.531736+0000","last_clean":"2024-05-21T13:41:17.531736+0000","last_became_active":"2024-05-21T13:35:57.777962+0000","last_became_peered":"2024-05-21T13:35:57.777962+0000","last_unstale":"2024-05-21T13:41:17.531736+0000","last_undegraded":"2024-05-21T13:41:17.531736+0000","last_fullsized":"2024-05-21T13:41:17.531736+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'16","last_scrub_stamp":"2024-05-21T13:41:17.531662+0000","last_deep_scrub":"27'16","last_deep_scrub_stamp":"2024-05-21T13:41:17.531662+0000","last_clean_scrub_stamp":"2024-05-21T13:41:17.531662+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T14:46:19.125770+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.37","version":"27'11","reported_seq":45,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:22.567889+0000","last_change":"2024-05-21T13:41:22.568021+0000","last_active":"2024-05-21T13:41:22.567889+0000","last_peered":"2024-05-21T13:41:22.567889+0000","last_clean":"2024-05-21T13:41:22.567889+0000","last_became_active":"2024-05-21T13:35:57.797793+0000","last_became_peered":"2024-05-21T13:35:57.797793+0000","last_unstale":"2024-05-21T13:41:22.567889+0000","last_undegraded":"2024-05-21T13:41:22.567889+0000","last_fullsized":"2024-05-21T13:41:22.567889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'11","last_scrub_stamp":"2024-05-21T13:41:22.567679+0000","last_deep_scrub":"27'11","last_deep_scrub_stamp":"2024-05-21T13:41:22.567679+0000","last_clean_scrub_stamp":"2024-05-21T13:41:22.567679+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T16:30:01.741483+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"27'9","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:28.934474+0000","last_change":"2024-05-21T13:41:28.934540+0000","last_active":"2024-05-21T13:41:28.934474+0000","last_peered":"2024-05-21T13:41:28.934474+0000","last_clean":"2024-05-21T13:41:28.934474+0000","last_became_active":"2024-05-21T13:35:57.782058+0000","last_became_peered":"2024-05-21T13:35:57.782058+0000","last_unstale":"2024-05-21T13:41:28.934474+0000","last_undegraded":"2024-05-21T13:41:28.934474+0000","last_fullsized":"2024-05-21T13:41:28.934474+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'9","last_scrub_stamp":"2024-05-21T13:41:28.934299+0000","last_deep_scrub":"27'9","last_deep_scrub_stamp":"2024-05-21T13:41:28.934299+0000","last_clean_scrub_stamp":"2024-05-21T13:41:28.934299+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T00:58:06.516166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"27'5","reported_seq":39,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:15.455032+0000","last_change":"2024-05-21T13:41:15.455065+0000","last_active":"2024-05-21T13:41:15.455032+0000","last_peered":"2024-05-21T13:41:15.455032+0000","last_clean":"2024-05-21T13:41:15.455032+0000","last_became_active":"2024-05-21T13:35:57.779168+0000","last_became_peered":"2024-05-21T13:35:57.779168+0000","last_unstale":"2024-05-21T13:41:15.455032+0000","last_undegraded":"2024-05-21T13:41:15.455032+0000","last_fullsized":"2024-05-21T13:41:15.455032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'5","last_scrub_stamp":"2024-05-21T13:41:15.454935+0000","last_deep_scrub":"27'5","last_deep_scrub_stamp":"2024-05-21T13:41:15.454935+0000","last_clean_scrub_stamp":"2024-05-21T13:41:15.454935+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:10:30.165895+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"27'6","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:18.681774+0000","last_change":"2024-05-21T13:41:18.681890+0000","last_active":"2024-05-21T13:41:18.681774+0000","last_peered":"2024-05-21T13:41:18.681774+0000","last_clean":"2024-05-21T13:41:18.681774+0000","last_became_active":"2024-05-21T13:35:57.772268+0000","last_became_peered":"2024-05-21T13:35:57.772268+0000","last_unstale":"2024-05-21T13:41:18.681774+0000","last_undegraded":"2024-05-21T13:41:18.681774+0000","last_fullsized":"2024-05-21T13:41:18.681774+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'6","last_scrub_stamp":"2024-05-21T13:41:18.681569+0000","last_deep_scrub":"27'6","last_deep_scrub_stamp":"2024-05-21T13:41:18.681569+0000","last_clean_scrub_stamp":"2024-05-21T13:41:18.681569+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T15:53:40.763037+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3b","version":"27'4","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:29.554454+0000","last_change":"2024-05-21T13:41:29.554514+0000","last_active":"2024-05-21T13:41:29.554454+0000","last_peered":"2024-05-21T13:41:29.554454+0000","last_clean":"2024-05-21T13:41:29.554454+0000","last_became_active":"2024-05-21T13:35:57.788689+0000","last_became_peered":"2024-05-21T13:35:57.788689+0000","last_unstale":"2024-05-21T13:41:29.554454+0000","last_undegraded":"2024-05-21T13:41:29.554454+0000","last_fullsized":"2024-05-21T13:41:29.554454+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-21T13:41:29.554275+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-21T13:41:29.554275+0000","last_clean_scrub_stamp":"2024-05-21T13:41:29.554275+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T22:16:33.218753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"27'8","reported_seq":43,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:17.677305+0000","last_change":"2024-05-21T13:41:17.677329+0000","last_active":"2024-05-21T13:41:17.677305+0000","last_peered":"2024-05-21T13:41:17.677305+0000","last_clean":"2024-05-21T13:41:17.677305+0000","last_became_active":"2024-05-21T13:35:57.772160+0000","last_became_peered":"2024-05-21T13:35:57.772160+0000","last_unstale":"2024-05-21T13:41:17.677305+0000","last_undegraded":"2024-05-21T13:41:17.677305+0000","last_fullsized":"2024-05-21T13:41:17.677305+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-21T13:41:17.677230+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-21T13:41:17.677230+0000","last_clean_scrub_stamp":"2024-05-21T13:41:17.677230+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:47:59.673206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3d","version":"27'7","reported_seq":41,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:17.908253+0000","last_change":"2024-05-21T13:41:17.908316+0000","last_active":"2024-05-21T13:41:17.908253+0000","last_peered":"2024-05-21T13:41:17.908253+0000","last_clean":"2024-05-21T13:41:17.908253+0000","last_became_active":"2024-05-21T13:35:57.784741+0000","last_became_peered":"2024-05-21T13:35:57.784741+0000","last_unstale":"2024-05-21T13:41:17.908253+0000","last_undegraded":"2024-05-21T13:41:17.908253+0000","last_fullsized":"2024-05-21T13:41:17.908253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'7","last_scrub_stamp":"2024-05-21T13:41:17.908066+0000","last_deep_scrub":"27'7","last_deep_scrub_stamp":"2024-05-21T13:41:17.908066+0000","last_clean_scrub_stamp":"2024-05-21T13:41:17.908066+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T23:22:07.867092+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"27'4","reported_seq":38,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:30.952280+0000","last_change":"2024-05-21T13:41:30.952404+0000","last_active":"2024-05-21T13:41:30.952280+0000","last_peered":"2024-05-21T13:41:30.952280+0000","last_clean":"2024-05-21T13:41:30.952280+0000","last_became_active":"2024-05-21T13:35:57.786629+0000","last_became_peered":"2024-05-21T13:35:57.786629+0000","last_unstale":"2024-05-21T13:41:30.952280+0000","last_undegraded":"2024-05-21T13:41:30.952280+0000","last_fullsized":"2024-05-21T13:41:30.952280+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'4","last_scrub_stamp":"2024-05-21T13:41:30.952072+0000","last_deep_scrub":"27'4","last_deep_scrub_stamp":"2024-05-21T13:41:30.952072+0000","last_clean_scrub_stamp":"2024-05-21T13:41:30.952072+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-23T01:23:44.848821+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3f","version":"27'8","reported_seq":42,"reported_epoch":27,"state":"active+clean","last_fresh":"2024-05-21T13:41:31.561029+0000","last_change":"2024-05-21T13:41:31.561158+0000","last_active":"2024-05-21T13:41:31.561029+0000","last_peered":"2024-05-21T13:41:31.561029+0000","last_clean":"2024-05-21T13:41:31.561029+0000","last_became_active":"2024-05-21T13:35:57.802925+0000","last_became_peered":"2024-05-21T13:35:57.802925+0000","last_unstale":"2024-05-21T13:41:31.561029+0000","last_undegraded":"2024-05-21T13:41:31.561029+0000","last_fullsized":"2024-05-21T13:41:31.561029+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"27'8","last_scrub_stamp":"2024-05-21T13:41:31.560829+0000","last_deep_scrub":"27'8","last_deep_scrub_stamp":"2024-05-21T13:41:31.560829+0000","last_clean_scrub_stamp":"2024-05-21T13:41:31.560829+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-05-22T21:36:45.106646+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9217,"num_write_kb":25165824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":9218,"ondisk_log_size":9218,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":503,"ondisk_log_size":503,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":214596,"num_objects":61,"num_object_clones":0,"num_object_copies":122,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":271,"num_write_kb":306,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15000,"num_omap_keys":30,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":589824,"data_stored":429192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":294,"ondisk_log_size":294,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":1180736,"data_compressed":66916,"data_compressed_allocated":90112,"data_compressed_original":1146880,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509518,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49528,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94322312,"statfs":{"total":96636764160,"available":96586047488,"internally_reserved":0,"allocated":311296,"data_stored":116594,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":50395594},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509518,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":49512,"kb_used_data":288,"kb_used_omap":1,"kb_used_meta":49214,"kb_avail":94322328,"statfs":{"total":96636764160,"available":96586063872,"internally_reserved":0,"allocated":294912,"data_stored":116943,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":50395590},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509517,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":53676,"kb_used_data":292,"kb_used_omap":1,"kb_used_meta":53374,"kb_avail":94318164,"statfs":{"total":96636764160,"available":96581799936,"internally_reserved":0,"allocated":299008,"data_stored":116383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":54655431},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509518,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27512,"kb_used_data":496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344328,"statfs":{"total":96636764160,"available":96608591872,"internally_reserved":0,"allocated":507904,"data_stored":325066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509518,"num_pgs":40,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":57892,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":57534,"kb_avail":94313948,"statfs":{"total":96636764160,"available":96577482752,"internally_reserved":0,"allocated":356352,"data_stored":705685,"data_compressed":33458,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":58915269},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509517,"num_pgs":45,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39792,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94332048,"statfs":{"total":96636764160,"available":96596017152,"internally_reserved":0,"allocated":303104,"data_stored":116473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542220,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45428,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326412,"statfs":{"total":96636764160,"available":96590245888,"internally_reserved":0,"allocated":372736,"data_stored":707440,"data_compressed":33458,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574925,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45588,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":45054,"kb_avail":94326252,"statfs":{"total":96636764160,"available":96590082048,"internally_reserved":0,"allocated":536576,"data_stored":326600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":46135749},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33458,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":590368,"data_compressed":33458,"data_compressed_allocated":45056,"data_compressed_original":573440,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":225280,"data_stored":209909,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":253952,"data_stored":211443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-21T13:41:59.907 DEBUG:teuthology.orchestra.run.smithi022:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-05-21T13:42:00.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.093+0000 7fef50845640 1 Processor -- start 2024-05-21T13:42:00.069 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.093+0000 7fef50845640 1 -- start start 2024-05-21T13:42:00.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.093+0000 7fef50845640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fef4c070040 0x7fef4c0c47f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:42:00.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.093+0000 7fef50845640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef4c073030 0x7fef4c152580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:42:00.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.093+0000 7fef50845640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef4c0c4d30 con 0x7fef4c070420 2024-05-21T13:42:00.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.093+0000 7fef50845640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7fef4c074930 con 0x7fef4c070040 2024-05-21T13:42:00.070 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.093+0000 7fef50845640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7fef4c072890 con 0x7fef4c073030 2024-05-21T13:42:00.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.093+0000 7fef4a59c640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7fef4c070040 0x7fef4c0c47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:42:00.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.093+0000 7fef49d9b640 1 --1- >> v1:172.21.15.115:6789/0 conn(0x7fef4c070420 0x7fef4c15bcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.115:6789/0 says I am v1:172.21.15.22:43576/0 (socket says 172.21.15.22:43576) 2024-05-21T13:42:00.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.093+0000 7fef49d9b640 1 -- 172.21.15.22:0/303872193 learned_addr learned my addr 172.21.15.22:0/303872193 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-21T13:42:00.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.093+0000 7fef4ad9d640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef4c073030 0x7fef4c152580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:42:00.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.093+0000 7fef4959a640 1 -- 172.21.15.22:0/303872193 <== mon.1 v1:172.21.15.115:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2498653886 0 0) 0x7fef4c0c4d30 con 0x7fef4c070420 2024-05-21T13:42:00.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.093+0000 7fef4959a640 1 -- 172.21.15.22:0/303872193 --> v1:172.21.15.115:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fef34003530 con 0x7fef4c070420 2024-05-21T13:42:00.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.093+0000 7fef4ad9d640 1 -- 172.21.15.22:0/303872193 >> v2:172.21.15.115:3300/0 conn(0x7fef4c070040 msgr2=0x7fef4c0c47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:42:00.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.093+0000 7fef4ad9d640 1 --2- 172.21.15.22:0/303872193 >> v2:172.21.15.115:3300/0 conn(0x7fef4c070040 0x7fef4c0c47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:42:00.071 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.093+0000 7fef4ad9d640 1 -- 172.21.15.22:0/303872193 >> v1:172.21.15.115:6789/0 conn(0x7fef4c070420 legacy=0x7fef4c15bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:42:00.072 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.093+0000 7fef4ad9d640 1 -- 172.21.15.22:0/303872193 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef4c072dc0 con 0x7fef4c073030 2024-05-21T13:42:00.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.097+0000 7fef4ad9d640 1 --2- 172.21.15.22:0/303872193 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef4c073030 0x7fef4c152580 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fef44009d90 tx=0x7fef4401f150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70bdd4c1bac24d9 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:42:00.073 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.097+0000 7fef4959a640 1 -- 172.21.15.22:0/303872193 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef440b4070 con 0x7fef4c073030 2024-05-21T13:42:00.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.097+0000 7fef4959a640 1 -- 172.21.15.22:0/303872193 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef440af600 con 0x7fef4c073030 2024-05-21T13:42:00.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.097+0000 7fef4959a640 1 -- 172.21.15.22:0/303872193 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef440af9b0 con 0x7fef4c073030 2024-05-21T13:42:00.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.097+0000 7fef50845640 1 -- 172.21.15.22:0/303872193 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef4c073030 msgr2=0x7fef4c152580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:42:00.074 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.097+0000 7fef50845640 1 --2- 172.21.15.22:0/303872193 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef4c073030 0x7fef4c152580 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fef44009d90 tx=0x7fef4401f150 comp rx=0 tx=0).stop 2024-05-21T13:42:00.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.097+0000 7fef50845640 1 -- 172.21.15.22:0/303872193 shutdown_connections 2024-05-21T13:42:00.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.097+0000 7fef50845640 1 --2- 172.21.15.22:0/303872193 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef4c073030 0x7fef4c152580 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:42:00.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.097+0000 7fef50845640 1 --2- 172.21.15.22:0/303872193 >> v2:172.21.15.115:3300/0 conn(0x7fef4c070040 0x7fef4c0c47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:42:00.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.097+0000 7fef50845640 1 -- 172.21.15.22:0/303872193 >> 172.21.15.22:0/303872193 conn(0x7fef4c06cc50 msgr2=0x7fef4c0cd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:42:00.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.097+0000 7fef50845640 1 -- 172.21.15.22:0/303872193 shutdown_connections 2024-05-21T13:42:00.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.097+0000 7fef50845640 1 -- 172.21.15.22:0/303872193 wait complete. 2024-05-21T13:42:00.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.097+0000 7fef50845640 1 Processor -- start 2024-05-21T13:42:00.075 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.097+0000 7fef50845640 1 -- start start 2024-05-21T13:42:00.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.101+0000 7fef50845640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef4c070040 0x7fef4c0c8080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:42:00.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.101+0000 7fef50845640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef4c070420 0x7fef4c153060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:42:00.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.101+0000 7fef50845640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fef4c073030 0x7fef4c1f5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:42:00.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.101+0000 7fef50845640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7fef4c073b70 con 0x7fef4c073030 2024-05-21T13:42:00.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.101+0000 7fef50845640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7fef4c0744a0 con 0x7fef4c070420 2024-05-21T13:42:00.076 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.101+0000 7fef50845640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7fef4c073e50 con 0x7fef4c070040 2024-05-21T13:42:00.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.101+0000 7fef4ad9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fef4c073030 0x7fef4c1f5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:42:00.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.101+0000 7fef4ad9d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fef4c073030 0x7fef4c1f5440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34178/0 (socket says 172.21.15.22:34178) 2024-05-21T13:42:00.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.101+0000 7fef4ad9d640 1 -- 172.21.15.22:0/3740536622 learned_addr learned my addr 172.21.15.22:0/3740536622 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:42:00.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.101+0000 7fef4a59c640 1 --2- 172.21.15.22:0/3740536622 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef4c070040 0x7fef4c0c8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:42:00.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.101+0000 7fef49d9b640 1 --2- 172.21.15.22:0/3740536622 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef4c070420 0x7fef4c153060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:42:00.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.101+0000 7fef4ad9d640 1 -- 172.21.15.22:0/3740536622 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef4c070040 msgr2=0x7fef4c0c8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:42:00.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.101+0000 7fef4ad9d640 1 --2- 172.21.15.22:0/3740536622 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef4c070040 0x7fef4c0c8080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:42:00.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.101+0000 7fef4ad9d640 1 -- 172.21.15.22:0/3740536622 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef4c070420 msgr2=0x7fef4c153060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:42:00.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.101+0000 7fef4ad9d640 1 --2- 172.21.15.22:0/3740536622 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef4c070420 0x7fef4c153060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:42:00.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.101+0000 7fef4ad9d640 1 -- 172.21.15.22:0/3740536622 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef4c155140 con 0x7fef4c073030 2024-05-21T13:42:00.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.101+0000 7fef4ad9d640 1 --2- 172.21.15.22:0/3740536622 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fef4c073030 0x7fef4c1f5440 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fef440b2040 tx=0x7fef4401bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:42:00.078 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.101+0000 7fef3affd640 1 -- 172.21.15.22:0/3740536622 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef440b4040 con 0x7fef4c073030 2024-05-21T13:42:00.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.101+0000 7fef3affd640 1 -- 172.21.15.22:0/3740536622 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef440af400 con 0x7fef4c073030 2024-05-21T13:42:00.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.101+0000 7fef50845640 1 -- 172.21.15.22:0/3740536622 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef4c155420 con 0x7fef4c073030 2024-05-21T13:42:00.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.101+0000 7fef3affd640 1 -- 172.21.15.22:0/3740536622 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef440af9b0 con 0x7fef4c073030 2024-05-21T13:42:00.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.101+0000 7fef50845640 1 -- 172.21.15.22:0/3740536622 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef4c1559e0 con 0x7fef4c073030 2024-05-21T13:42:00.079 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.101+0000 7fef50845640 1 -- 172.21.15.22:0/3740536622 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef4c077bb0 con 0x7fef4c073030 2024-05-21T13:42:00.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.101+0000 7fef3affd640 1 -- 172.21.15.22:0/3740536622 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7fef440c1020 con 0x7fef4c073030 2024-05-21T13:42:00.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.101+0000 7fef3affd640 1 --2- 172.21.15.22:0/3740536622 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fef2c06f400 0x7fef2c0718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:42:00.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.101+0000 7fef3affd640 1 -- 172.21.15.22:0/3740536622 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7fef4412d060 con 0x7fef4c073030 2024-05-21T13:42:00.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.101+0000 7fef4a59c640 1 --2- 172.21.15.22:0/3740536622 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fef2c06f400 0x7fef2c0718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:42:00.080 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.105+0000 7fef4a59c640 1 --2- 172.21.15.22:0/3740536622 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fef2c06f400 0x7fef2c0718c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fef3c009af0 tx=0x7fef3c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:42:00.083 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.105+0000 7fef3affd640 1 -- 172.21.15.22:0/3740536622 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7fef44018cb0 con 0x7fef4c073030 2024-05-21T13:42:00.250 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.273+0000 7fef50845640 1 -- 172.21.15.22:0/3740536622 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7fef4c14ccc0 con 0x7fef4c073030 2024-05-21T13:42:00.255 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.277+0000 7fef3affd640 1 -- 172.21.15.22:0/3740536622 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) ==== 123+0+0 (secure 0 0 0) 0x7fef440f9be0 con 0x7fef4c073030 2024-05-21T13:42:00.257 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.281+0000 7fef3affd640 1 -- 172.21.15.22:0/3740536622 <== mon.0 v2:172.21.15.22:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fef440f8ff0 con 0x7fef4c073030 2024-05-21T13:42:00.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.281+0000 7fef50845640 1 -- 172.21.15.22:0/3740536622 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fef2c06f400 msgr2=0x7fef2c0718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:42:00.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.281+0000 7fef50845640 1 --2- 172.21.15.22:0/3740536622 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fef2c06f400 0x7fef2c0718c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fef3c009af0 tx=0x7fef3c008040 comp rx=0 tx=0).stop 2024-05-21T13:42:00.259 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.281+0000 7fef50845640 1 -- 172.21.15.22:0/3740536622 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fef4c073030 msgr2=0x7fef4c1f5440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:42:00.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.281+0000 7fef50845640 1 --2- 172.21.15.22:0/3740536622 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fef4c073030 0x7fef4c1f5440 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fef440b2040 tx=0x7fef4401bef0 comp rx=0 tx=0).stop 2024-05-21T13:42:00.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.281+0000 7fef50845640 1 -- 172.21.15.22:0/3740536622 shutdown_connections 2024-05-21T13:42:00.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.281+0000 7fef50845640 1 --2- 172.21.15.22:0/3740536622 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7fef2c06f400 0x7fef2c0718c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:42:00.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.281+0000 7fef50845640 1 --2- 172.21.15.22:0/3740536622 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7fef4c073030 0x7fef4c1f5440 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:42:00.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.281+0000 7fef50845640 1 --2- 172.21.15.22:0/3740536622 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7fef4c070420 0x7fef4c153060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:42:00.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.281+0000 7fef50845640 1 --2- 172.21.15.22:0/3740536622 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7fef4c070040 0x7fef4c0c8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:42:00.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.281+0000 7fef50845640 1 -- 172.21.15.22:0/3740536622 >> 172.21.15.22:0/3740536622 conn(0x7fef4c06cc50 msgr2=0x7fef4c06e5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:42:00.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.281+0000 7fef50845640 1 -- 172.21.15.22:0/3740536622 shutdown_connections 2024-05-21T13:42:00.260 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.281+0000 7fef50845640 1 -- 172.21.15.22:0/3740536622 wait complete. 2024-05-21T13:42:00.278 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-05-21T13:42:00.278 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-21T13:42:00.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.425+0000 7f2bbfe05640 1 Processor -- start 2024-05-21T13:42:00.403 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.425+0000 7f2bbfe05640 1 -- start start 2024-05-21T13:42:00.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.429+0000 7f2bbfe05640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2bb8152cc0 0x7f2bb80c4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:42:00.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.429+0000 7f2bbfe05640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f2bb80c9e30 0x7f2bb80ca2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:42:00.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.429+0000 7f2bbfe05640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2bb81530a0 con 0x7f2bb80c66b0 2024-05-21T13:42:00.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.429+0000 7f2bbfe05640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f2bb81592b0 con 0x7f2bb80c9e30 2024-05-21T13:42:00.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.429+0000 7f2bbfe05640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f2bb8074840 con 0x7f2bb8152cc0 2024-05-21T13:42:00.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.429+0000 7f2bbe3a2640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f2bb80c9e30 0x7f2bb80ca2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:42:00.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.429+0000 7f2bbd3a0640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f2bb80c66b0 0x7f2bb80c7df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:57778/0 (socket says 172.21.15.22:57778) 2024-05-21T13:42:00.405 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.429+0000 7f2bbd3a0640 1 -- 172.21.15.22:0/1671920455 learned_addr learned my addr 172.21.15.22:0/1671920455 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-21T13:42:00.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.429+0000 7f2bbdba1640 1 --2- 172.21.15.22:0/1671920455 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2bb8152cc0 0x7f2bb80c4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:42:00.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.429+0000 7f2bbe3a2640 1 -- 172.21.15.22:0/1671920455 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2bb8152cc0 msgr2=0x7f2bb80c4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:42:00.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.429+0000 7f2bbe3a2640 1 --2- 172.21.15.22:0/1671920455 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2bb8152cc0 0x7f2bb80c4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:42:00.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.429+0000 7f2bbe3a2640 1 -- 172.21.15.22:0/1671920455 >> v1:172.21.15.22:6789/0 conn(0x7f2bb80c66b0 legacy=0x7f2bb80c7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:42:00.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.429+0000 7f2bbe3a2640 1 -- 172.21.15.22:0/1671920455 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bb81589a0 con 0x7f2bb80c9e30 2024-05-21T13:42:00.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.429+0000 7f2bbcb9f640 1 -- 172.21.15.22:0/1671920455 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1655914697 0 0) 0x7f2bb81530a0 con 0x7f2bb80c66b0 2024-05-21T13:42:00.406 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.429+0000 7f2bbdba1640 1 --2- 172.21.15.22:0/1671920455 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2bb8152cc0 0x7f2bb80c4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:42:00.407 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.429+0000 7f2bbe3a2640 1 --2- 172.21.15.22:0/1671920455 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2bb80c9e30 0x7f2bb80ca2c0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f2bb00097c0 tx=0x7f2bb001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30dcb7eb91eb61fe server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:42:00.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.429+0000 7f2bbcb9f640 1 -- 172.21.15.22:0/1671920455 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bb00b0070 con 0x7f2bb80c9e30 2024-05-21T13:42:00.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.433+0000 7f2bbcb9f640 1 -- 172.21.15.22:0/1671920455 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f2bb00ab600 con 0x7f2bb80c9e30 2024-05-21T13:42:00.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.433+0000 7f2bbcb9f640 1 -- 172.21.15.22:0/1671920455 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bb00ab9f0 con 0x7f2bb80c9e30 2024-05-21T13:42:00.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.433+0000 7f2bbfe05640 1 -- 172.21.15.22:0/1671920455 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2bb80c9e30 msgr2=0x7f2bb80ca2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:42:00.408 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.433+0000 7f2bbfe05640 1 --2- 172.21.15.22:0/1671920455 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2bb80c9e30 0x7f2bb80ca2c0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f2bb00097c0 tx=0x7f2bb001c4a0 comp rx=0 tx=0).stop 2024-05-21T13:42:00.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.433+0000 7f2bbfe05640 1 -- 172.21.15.22:0/1671920455 shutdown_connections 2024-05-21T13:42:00.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.433+0000 7f2bbfe05640 1 --2- 172.21.15.22:0/1671920455 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2bb80c9e30 0x7f2bb80ca2c0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:42:00.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.433+0000 7f2bbfe05640 1 --2- 172.21.15.22:0/1671920455 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2bb8152cc0 0x7f2bb80c4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:42:00.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.433+0000 7f2bbfe05640 1 -- 172.21.15.22:0/1671920455 >> 172.21.15.22:0/1671920455 conn(0x7f2bb806ea10 msgr2=0x7f2bb806ff50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:42:00.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.433+0000 7f2bbfe05640 1 -- 172.21.15.22:0/1671920455 shutdown_connections 2024-05-21T13:42:00.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.433+0000 7f2bbfe05640 1 -- 172.21.15.22:0/1671920455 wait complete. 2024-05-21T13:42:00.409 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.433+0000 7f2bbfe05640 1 Processor -- start 2024-05-21T13:42:00.410 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.433+0000 7f2bbfe05640 1 -- start start 2024-05-21T13:42:00.411 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.433+0000 7f2bbfe05640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2bb80c66b0 0x7f2bb80c6d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:42:00.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.433+0000 7f2bbfe05640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2bb80c9e30 0x7f2bb81f2260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:42:00.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.433+0000 7f2bbfe05640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2bb8152cc0 0x7f2bb8145cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:42:00.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.433+0000 7f2bbfe05640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f2bb80c8500 con 0x7f2bb8152cc0 2024-05-21T13:42:00.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.433+0000 7f2bbfe05640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f2bb8158f40 con 0x7f2bb80c9e30 2024-05-21T13:42:00.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.433+0000 7f2bbfe05640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f2bb8159720 con 0x7f2bb80c66b0 2024-05-21T13:42:00.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.433+0000 7f2bbe3a2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2bb8152cc0 0x7f2bb8145cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:42:00.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.433+0000 7f2bbe3a2640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2bb8152cc0 0x7f2bb8145cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34192/0 (socket says 172.21.15.22:34192) 2024-05-21T13:42:00.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.433+0000 7f2bbe3a2640 1 -- 172.21.15.22:0/3282833205 learned_addr learned my addr 172.21.15.22:0/3282833205 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:42:00.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.433+0000 7f2bbdba1640 1 --2- 172.21.15.22:0/3282833205 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2bb80c66b0 0x7f2bb80c6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:42:00.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.433+0000 7f2bbd3a0640 1 --2- 172.21.15.22:0/3282833205 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2bb80c9e30 0x7f2bb81f2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:42:00.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.433+0000 7f2bbe3a2640 1 -- 172.21.15.22:0/3282833205 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2bb80c66b0 msgr2=0x7f2bb80c6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:42:00.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.433+0000 7f2bbe3a2640 1 --2- 172.21.15.22:0/3282833205 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2bb80c66b0 0x7f2bb80c6d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:42:00.412 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.433+0000 7f2bbe3a2640 1 -- 172.21.15.22:0/3282833205 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2bb80c9e30 msgr2=0x7f2bb81f2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:42:00.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.433+0000 7f2bbe3a2640 1 --2- 172.21.15.22:0/3282833205 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2bb80c9e30 0x7f2bb81f2260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:42:00.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.433+0000 7f2bbe3a2640 1 -- 172.21.15.22:0/3282833205 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bb815c440 con 0x7f2bb8152cc0 2024-05-21T13:42:00.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.433+0000 7f2bbe3a2640 1 --2- 172.21.15.22:0/3282833205 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2bb8152cc0 0x7f2bb8145cb0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f2bb00097c0 tx=0x7f2bb001ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:42:00.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.433+0000 7f2bae7fc640 1 -- 172.21.15.22:0/3282833205 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bb00bc070 con 0x7f2bb8152cc0 2024-05-21T13:42:00.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.433+0000 7f2bae7fc640 1 -- 172.21.15.22:0/3282833205 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f2bb00b1040 con 0x7f2bb8152cc0 2024-05-21T13:42:00.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.433+0000 7f2bbfe05640 1 -- 172.21.15.22:0/3282833205 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bb815be80 con 0x7f2bb8152cc0 2024-05-21T13:42:00.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.433+0000 7f2bae7fc640 1 -- 172.21.15.22:0/3282833205 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bb00b0050 con 0x7f2bb8152cc0 2024-05-21T13:42:00.413 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.433+0000 7f2bbfe05640 1 -- 172.21.15.22:0/3282833205 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bb8148850 con 0x7f2bb8152cc0 2024-05-21T13:42:00.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.437+0000 7f2bbfe05640 1 -- 172.21.15.22:0/3282833205 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bb8077bb0 con 0x7f2bb8152cc0 2024-05-21T13:42:00.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.437+0000 7f2bae7fc640 1 -- 172.21.15.22:0/3282833205 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f2bb00bf070 con 0x7f2bb8152cc0 2024-05-21T13:42:00.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.437+0000 7f2bae7fc640 1 --2- 172.21.15.22:0/3282833205 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f2b9c06f430 0x7f2b9c0718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:42:00.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.437+0000 7f2bae7fc640 1 -- 172.21.15.22:0/3282833205 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f2bb0129280 con 0x7f2bb8152cc0 2024-05-21T13:42:00.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.437+0000 7f2bbdba1640 1 --2- 172.21.15.22:0/3282833205 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f2b9c06f430 0x7f2b9c0718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:42:00.414 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.437+0000 7f2bbdba1640 1 --2- 172.21.15.22:0/3282833205 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f2b9c06f430 0x7f2b9c0718f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2bb40075b0 tx=0x7f2bb4007540 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:42:00.418 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.441+0000 7f2bae7fc640 1 -- 172.21.15.22:0/3282833205 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f2bb0016090 con 0x7f2bb8152cc0 2024-05-21T13:42:00.619 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.641+0000 7f2bbfe05640 1 -- 172.21.15.22:0/3282833205 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2bb8070150 con 0x7f2bb8152cc0 2024-05-21T13:42:00.621 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.645+0000 7f2bae7fc640 1 -- 172.21.15.22:0/3282833205 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6875 (secure 0 0 0) 0x7f2bb00fce20 con 0x7f2bb8152cc0 2024-05-21T13:42:00.621 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-21T13:42:00.621 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4224,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/355756580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":355756580},{"type":"v1","addr":"172.21.15.22:6833","nonce":355756580}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4230,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3277017116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":3277017116},{"type":"v1","addr":"172.21.15.22:6835","nonce":3277017116}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4233,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3840772609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3840772609},{"type":"v1","addr":"172.21.15.22:6837","nonce":3840772609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-21T13:35:57.106892+0000","modified":"2024-05-21T13:36:32.396351+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4300,"mds_1":4294,"mds_2":4248},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4248":{"gid":4248,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":12,"addr":"172.21.15.115:6837/2009761279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":2009761279},{"type":"v1","addr":"172.21.15.115:6837","nonce":2009761279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4294":{"gid":4294,"name":"b","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.115:6835/3894678097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3894678097},{"type":"v1","addr":"172.21.15.115:6835","nonce":3894678097}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4300":{"gid":4300,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.115:6839/1525097577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6838","nonce":1525097577},{"type":"v1","addr":"172.21.15.115:6839","nonce":1525097577}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4300,"qdb_cluster":[4248,4300,4294]},"id":1}]} 2024-05-21T13:42:00.621 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 14 2024-05-21T13:42:00.623 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.645+0000 7f2bbfe05640 1 -- 172.21.15.22:0/3282833205 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f2b9c06f430 msgr2=0x7f2b9c0718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:42:00.624 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.645+0000 7f2bbfe05640 1 --2- 172.21.15.22:0/3282833205 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f2b9c06f430 0x7f2b9c0718f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2bb40075b0 tx=0x7f2bb4007540 comp rx=0 tx=0).stop 2024-05-21T13:42:00.624 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.645+0000 7f2bbfe05640 1 -- 172.21.15.22:0/3282833205 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2bb8152cc0 msgr2=0x7f2bb8145cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:42:00.624 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.645+0000 7f2bbfe05640 1 --2- 172.21.15.22:0/3282833205 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2bb8152cc0 0x7f2bb8145cb0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f2bb00097c0 tx=0x7f2bb001ace0 comp rx=0 tx=0).stop 2024-05-21T13:42:00.624 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.645+0000 7f2bbfe05640 1 -- 172.21.15.22:0/3282833205 shutdown_connections 2024-05-21T13:42:00.624 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.645+0000 7f2bbfe05640 1 --2- 172.21.15.22:0/3282833205 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f2b9c06f430 0x7f2b9c0718f0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:42:00.624 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.645+0000 7f2bbfe05640 1 --2- 172.21.15.22:0/3282833205 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2bb8152cc0 0x7f2bb8145cb0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:42:00.624 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.645+0000 7f2bbfe05640 1 --2- 172.21.15.22:0/3282833205 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2bb80c9e30 0x7f2bb81f2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:42:00.624 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.645+0000 7f2bbfe05640 1 --2- 172.21.15.22:0/3282833205 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2bb80c66b0 0x7f2bb80c6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:42:00.624 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.645+0000 7f2bbfe05640 1 -- 172.21.15.22:0/3282833205 >> 172.21.15.22:0/3282833205 conn(0x7f2bb806ea10 msgr2=0x7f2bb8152300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:42:00.625 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.645+0000 7f2bbfe05640 1 -- 172.21.15.22:0/3282833205 shutdown_connections 2024-05-21T13:42:00.625 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.645+0000 7f2bbfe05640 1 -- 172.21.15.22:0/3282833205 wait complete. 2024-05-21T13:42:00.641 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-05-21T13:42:00.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.793+0000 7ff8f3f3d640 1 Processor -- start 2024-05-21T13:42:00.768 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.793+0000 7ff8f3f3d640 1 -- start start 2024-05-21T13:42:00.769 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.793+0000 7ff8f3f3d640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff8ec0ccd00 0x7ff8ec0cd190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:42:00.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.793+0000 7ff8f3f3d640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8ec0cc6c0 con 0x7ff8ec0cbf80 2024-05-21T13:42:00.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.793+0000 7ff8f3f3d640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8ec15bc30 con 0x7ff8ec152680 2024-05-21T13:42:00.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.793+0000 7ff8f3f3d640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7ff8ec15c9f0 con 0x7ff8ec0ccd00 2024-05-21T13:42:00.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.793+0000 7ff8f14d8640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7ff8ec0cbf80 0x7ff8ec0c6d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:57794/0 (socket says 172.21.15.22:57794) 2024-05-21T13:42:00.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.793+0000 7ff8f14d8640 1 -- 172.21.15.22:0/866869042 learned_addr learned my addr 172.21.15.22:0/866869042 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-21T13:42:00.770 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.793+0000 7ff8f24da640 1 --2- 172.21.15.22:0/866869042 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff8ec0ccd00 0x7ff8ec0cd190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:42:00.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.793+0000 7ff8f0cd7640 1 -- 172.21.15.22:0/866869042 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 845585041 0 0) 0x7ff8ec0cc6c0 con 0x7ff8ec0cbf80 2024-05-21T13:42:00.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.793+0000 7ff8f0cd7640 1 -- 172.21.15.22:0/866869042 --> v1:172.21.15.22:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff8d8003530 con 0x7ff8ec0cbf80 2024-05-21T13:42:00.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.793+0000 7ff8f24da640 1 -- 172.21.15.22:0/866869042 >> v1:172.21.15.115:6789/0 conn(0x7ff8ec152680 legacy=0x7ff8ec0c6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:42:00.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.793+0000 7ff8f24da640 1 -- 172.21.15.22:0/866869042 >> v1:172.21.15.22:6789/0 conn(0x7ff8ec0cbf80 legacy=0x7ff8ec0c6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:42:00.771 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.793+0000 7ff8f24da640 1 -- 172.21.15.22:0/866869042 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8ec15bf10 con 0x7ff8ec0ccd00 2024-05-21T13:42:00.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.797+0000 7ff8f24da640 1 --2- 172.21.15.22:0/866869042 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff8ec0ccd00 0x7ff8ec0cd190 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff8e4009dc0 tx=0x7ff8e401f170 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f26785d30b91252 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:42:00.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.797+0000 7ff8f0cd7640 1 -- 172.21.15.22:0/866869042 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8e40b4070 con 0x7ff8ec0ccd00 2024-05-21T13:42:00.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.797+0000 7ff8f0cd7640 1 -- 172.21.15.22:0/866869042 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7ff8e40af600 con 0x7ff8ec0ccd00 2024-05-21T13:42:00.773 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.797+0000 7ff8f0cd7640 1 -- 172.21.15.22:0/866869042 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8e40af9b0 con 0x7ff8ec0ccd00 2024-05-21T13:42:00.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.797+0000 7ff8f3f3d640 1 -- 172.21.15.22:0/866869042 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff8ec0ccd00 msgr2=0x7ff8ec0cd190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:42:00.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.797+0000 7ff8f3f3d640 1 --2- 172.21.15.22:0/866869042 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff8ec0ccd00 0x7ff8ec0cd190 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ff8e4009dc0 tx=0x7ff8e401f170 comp rx=0 tx=0).stop 2024-05-21T13:42:00.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.797+0000 7ff8f3f3d640 1 -- 172.21.15.22:0/866869042 shutdown_connections 2024-05-21T13:42:00.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.797+0000 7ff8f3f3d640 1 --2- 172.21.15.22:0/866869042 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff8ec0ccd00 0x7ff8ec0cd190 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:42:00.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.797+0000 7ff8f3f3d640 1 -- 172.21.15.22:0/866869042 >> 172.21.15.22:0/866869042 conn(0x7ff8ec06f3b0 msgr2=0x7ff8ec06d430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:42:00.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.797+0000 7ff8f3f3d640 1 -- 172.21.15.22:0/866869042 shutdown_connections 2024-05-21T13:42:00.774 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.797+0000 7ff8f3f3d640 1 -- 172.21.15.22:0/866869042 wait complete. 2024-05-21T13:42:00.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.797+0000 7ff8f3f3d640 1 Processor -- start 2024-05-21T13:42:00.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.797+0000 7ff8f3f3d640 1 -- start start 2024-05-21T13:42:00.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.797+0000 7ff8f3f3d640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff8ec0cbf80 0x7ff8ec0c9010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:42:00.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.797+0000 7ff8f3f3d640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff8ec0ccd00 0x7ff8ec0b6db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:42:00.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.797+0000 7ff8f3f3d640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff8ec152680 0x7ff8ec14cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:42:00.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.797+0000 7ff8f3f3d640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7ff8ec0b43e0 con 0x7ff8ec0ccd00 2024-05-21T13:42:00.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.797+0000 7ff8f3f3d640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7ff8ec15c4d0 con 0x7ff8ec0cbf80 2024-05-21T13:42:00.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.797+0000 7ff8f3f3d640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7ff8ec0cc3a0 con 0x7ff8ec152680 2024-05-21T13:42:00.777 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.797+0000 7ff8f14d8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff8ec0ccd00 0x7ff8ec0b6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:42:00.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.797+0000 7ff8f14d8640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff8ec0ccd00 0x7ff8ec0b6db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34208/0 (socket says 172.21.15.22:34208) 2024-05-21T13:42:00.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.797+0000 7ff8f14d8640 1 -- 172.21.15.22:0/527706250 learned_addr learned my addr 172.21.15.22:0/527706250 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:42:00.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.797+0000 7ff8f1cd9640 1 --2- 172.21.15.22:0/527706250 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff8ec0cbf80 0x7ff8ec0c9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:42:00.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.797+0000 7ff8f24da640 1 --2- 172.21.15.22:0/527706250 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff8ec152680 0x7ff8ec14cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:42:00.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.801+0000 7ff8f14d8640 1 -- 172.21.15.22:0/527706250 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff8ec152680 msgr2=0x7ff8ec14cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:42:00.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.801+0000 7ff8f14d8640 1 --2- 172.21.15.22:0/527706250 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff8ec152680 0x7ff8ec14cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:42:00.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.801+0000 7ff8f14d8640 1 -- 172.21.15.22:0/527706250 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff8ec0cbf80 msgr2=0x7ff8ec0c9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:42:00.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.801+0000 7ff8f14d8640 1 --2- 172.21.15.22:0/527706250 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff8ec0cbf80 0x7ff8ec0c9010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:42:00.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.801+0000 7ff8f14d8640 1 -- 172.21.15.22:0/527706250 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8ec1e5890 con 0x7ff8ec0ccd00 2024-05-21T13:42:00.778 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.801+0000 7ff8f14d8640 1 --2- 172.21.15.22:0/527706250 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff8ec0ccd00 0x7ff8ec0b6db0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc00c410 tx=0x7ff8dc00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:42:00.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.801+0000 7ff8e27fc640 1 -- 172.21.15.22:0/527706250 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8dc017070 con 0x7ff8ec0ccd00 2024-05-21T13:42:00.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.801+0000 7ff8e27fc640 1 -- 172.21.15.22:0/527706250 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7ff8dc005d10 con 0x7ff8ec0ccd00 2024-05-21T13:42:00.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.801+0000 7ff8f3f3d640 1 -- 172.21.15.22:0/527706250 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8ec1e5b70 con 0x7ff8ec0ccd00 2024-05-21T13:42:00.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.801+0000 7ff8e27fc640 1 -- 172.21.15.22:0/527706250 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8dc007330 con 0x7ff8ec0ccd00 2024-05-21T13:42:00.779 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.801+0000 7ff8f3f3d640 1 -- 172.21.15.22:0/527706250 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8ec1e6130 con 0x7ff8ec0ccd00 2024-05-21T13:42:00.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.801+0000 7ff8f3f3d640 1 -- 172.21.15.22:0/527706250 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8ec077bb0 con 0x7ff8ec0ccd00 2024-05-21T13:42:00.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.801+0000 7ff8e27fc640 1 -- 172.21.15.22:0/527706250 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7ff8dc01a070 con 0x7ff8ec0ccd00 2024-05-21T13:42:00.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.801+0000 7ff8e27fc640 1 --2- 172.21.15.22:0/527706250 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7ff8d006f400 0x7ff8d00718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:42:00.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.801+0000 7ff8e27fc640 1 -- 172.21.15.22:0/527706250 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7ff8dc08eac0 con 0x7ff8ec0ccd00 2024-05-21T13:42:00.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.801+0000 7ff8f1cd9640 1 --2- 172.21.15.22:0/527706250 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7ff8d006f400 0x7ff8d00718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:42:00.780 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.801+0000 7ff8f1cd9640 1 --2- 172.21.15.22:0/527706250 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7ff8d006f400 0x7ff8d00718c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff8e8000f70 tx=0x7ff8e8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:42:00.783 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:00.805+0000 7ff8e27fc640 1 -- 172.21.15.22:0/527706250 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7ff8dc05b640 con 0x7ff8ec0ccd00 2024-05-21T13:42:00.821 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-21T13:42:00.823 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-21T13:42:00.983 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.005+0000 7ff8f3f3d640 1 -- 172.21.15.22:0/527706250 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff8ec0ccae0 con 0x7ff8ec0ccd00 2024-05-21T13:42:00.985 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.009+0000 7ff8e27fc640 1 -- 172.21.15.22:0/527706250 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+6875 (secure 0 0 0) 0x7ff8dc05af40 con 0x7ff8ec0ccd00 2024-05-21T13:42:00.985 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-21T13:42:00.985 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4224,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6833/355756580","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6832","nonce":355756580},{"type":"v1","addr":"172.21.15.22:6833","nonce":355756580}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4230,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6835/3277017116","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6834","nonce":3277017116},{"type":"v1","addr":"172.21.15.22:6835","nonce":3277017116}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4233,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.22:6837/3840772609","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6836","nonce":3840772609},{"type":"v1","addr":"172.21.15.22:6837","nonce":3840772609}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-05-21T13:35:57.106892+0000","modified":"2024-05-21T13:36:32.396351+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":4300,"mds_1":4294,"mds_2":4248},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4248":{"gid":4248,"name":"d","rank":2,"incarnation":13,"state":"up:active","state_seq":12,"addr":"172.21.15.115:6837/2009761279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6836","nonce":2009761279},{"type":"v1","addr":"172.21.15.115:6837","nonce":2009761279}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4294":{"gid":4294,"name":"b","rank":1,"incarnation":9,"state":"up:active","state_seq":10,"addr":"172.21.15.115:6835/3894678097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6834","nonce":3894678097},{"type":"v1","addr":"172.21.15.115:6835","nonce":3894678097}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4300":{"gid":4300,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.115:6839/1525097577","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6838","nonce":1525097577},{"type":"v1","addr":"172.21.15.115:6839","nonce":1525097577}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4300,"qdb_cluster":[4248,4300,4294]},"id":1}]} 2024-05-21T13:42:00.985 INFO:teuthology.orchestra.run.smithi022.stderr:dumped fsmap epoch 14 2024-05-21T13:42:00.988 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.009+0000 7ff8f3f3d640 1 -- 172.21.15.22:0/527706250 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7ff8d006f400 msgr2=0x7ff8d00718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:42:00.988 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.009+0000 7ff8f3f3d640 1 --2- 172.21.15.22:0/527706250 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7ff8d006f400 0x7ff8d00718c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff8e8000f70 tx=0x7ff8e8009040 comp rx=0 tx=0).stop 2024-05-21T13:42:00.988 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.009+0000 7ff8f3f3d640 1 -- 172.21.15.22:0/527706250 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff8ec0ccd00 msgr2=0x7ff8ec0b6db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:42:00.988 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.009+0000 7ff8f3f3d640 1 --2- 172.21.15.22:0/527706250 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff8ec0ccd00 0x7ff8ec0b6db0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc00c410 tx=0x7ff8dc00c8d0 comp rx=0 tx=0).stop 2024-05-21T13:42:00.988 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.009+0000 7ff8f3f3d640 1 -- 172.21.15.22:0/527706250 shutdown_connections 2024-05-21T13:42:00.988 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.009+0000 7ff8f3f3d640 1 --2- 172.21.15.22:0/527706250 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7ff8d006f400 0x7ff8d00718c0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:42:00.988 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.009+0000 7ff8f3f3d640 1 --2- 172.21.15.22:0/527706250 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7ff8ec152680 0x7ff8ec14cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:42:00.988 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.009+0000 7ff8f3f3d640 1 --2- 172.21.15.22:0/527706250 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7ff8ec0ccd00 0x7ff8ec0b6db0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:42:00.988 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.009+0000 7ff8f3f3d640 1 --2- 172.21.15.22:0/527706250 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7ff8ec0cbf80 0x7ff8ec0c9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:42:00.988 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.009+0000 7ff8f3f3d640 1 -- 172.21.15.22:0/527706250 >> 172.21.15.22:0/527706250 conn(0x7ff8ec06f3b0 msgr2=0x7ff8ec0b61e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:42:00.988 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.009+0000 7ff8f3f3d640 1 -- 172.21.15.22:0/527706250 shutdown_connections 2024-05-21T13:42:00.989 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.009+0000 7ff8f3f3d640 1 -- 172.21.15.22:0/527706250 wait complete. 2024-05-21T13:42:01.005 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-05-21T13:42:01.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.157+0000 7f1efe744640 1 Processor -- start 2024-05-21T13:42:01.132 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.157+0000 7f1efe744640 1 -- start start 2024-05-21T13:42:01.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.157+0000 7f1efe744640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1ef80c9e30 0x7f1ef80ca280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:42:01.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.157+0000 7f1efe744640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ef81530a0 con 0x7f1ef80c4bf0 2024-05-21T13:42:01.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.157+0000 7f1efe744640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1ef80c5060 con 0x7f1ef8152cc0 2024-05-21T13:42:01.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.157+0000 7f1efe744640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f1ef81592b0 con 0x7f1ef80c9e30 2024-05-21T13:42:01.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.157+0000 7f1efcce1640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1ef80c9e30 0x7f1ef80ca280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:42:01.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.157+0000 7f1eeffff640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f1ef80c4bf0 0x7f1ef80c7df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:57796/0 (socket says 172.21.15.22:57796) 2024-05-21T13:42:01.134 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.157+0000 7f1eeffff640 1 -- 172.21.15.22:0/3180094254 learned_addr learned my addr 172.21.15.22:0/3180094254 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-21T13:42:01.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.157+0000 7f1efcce1640 1 -- 172.21.15.22:0/3180094254 >> v1:172.21.15.115:6789/0 conn(0x7f1ef8152cc0 legacy=0x7f1ef80c66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:42:01.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.157+0000 7f1ef77fe640 1 -- 172.21.15.22:0/3180094254 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2073909171 0 0) 0x7f1ef81530a0 con 0x7f1ef80c4bf0 2024-05-21T13:42:01.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.157+0000 7f1efcce1640 1 -- 172.21.15.22:0/3180094254 >> v1:172.21.15.22:6789/0 conn(0x7f1ef80c4bf0 legacy=0x7f1ef80c7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:42:01.135 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.157+0000 7f1efcce1640 1 -- 172.21.15.22:0/3180094254 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ef81589a0 con 0x7f1ef80c9e30 2024-05-21T13:42:01.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.161+0000 7f1efcce1640 1 --2- 172.21.15.22:0/3180094254 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ef80c9e30 0x7f1ef80ca280 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f1ef8159430 tx=0x7f1ef001c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a1d183dafd17ad5 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:42:01.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.161+0000 7f1ef77fe640 1 -- 172.21.15.22:0/3180094254 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ef00b2070 con 0x7f1ef80c9e30 2024-05-21T13:42:01.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.161+0000 7f1ef77fe640 1 -- 172.21.15.22:0/3180094254 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f1ef00a5810 con 0x7f1ef80c9e30 2024-05-21T13:42:01.136 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.161+0000 7f1ef77fe640 1 -- 172.21.15.22:0/3180094254 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ef00a5c00 con 0x7f1ef80c9e30 2024-05-21T13:42:01.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.161+0000 7f1efe744640 1 -- 172.21.15.22:0/3180094254 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ef80c9e30 msgr2=0x7f1ef80ca280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:42:01.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.161+0000 7f1efe744640 1 --2- 172.21.15.22:0/3180094254 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ef80c9e30 0x7f1ef80ca280 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f1ef8159430 tx=0x7f1ef001c950 comp rx=0 tx=0).stop 2024-05-21T13:42:01.137 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.161+0000 7f1efe744640 1 -- 172.21.15.22:0/3180094254 shutdown_connections 2024-05-21T13:42:01.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.161+0000 7f1efe744640 1 --2- 172.21.15.22:0/3180094254 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ef80c9e30 0x7f1ef80ca280 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:42:01.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.161+0000 7f1efe744640 1 -- 172.21.15.22:0/3180094254 >> 172.21.15.22:0/3180094254 conn(0x7f1ef806ea10 msgr2=0x7f1ef806ff50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:42:01.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.161+0000 7f1efe744640 1 -- 172.21.15.22:0/3180094254 shutdown_connections 2024-05-21T13:42:01.138 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.161+0000 7f1efe744640 1 -- 172.21.15.22:0/3180094254 wait complete. 2024-05-21T13:42:01.140 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.161+0000 7f1efe744640 1 Processor -- start 2024-05-21T13:42:01.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.161+0000 7f1efe744640 1 -- start start 2024-05-21T13:42:01.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.161+0000 7f1efe744640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ef80c4bf0 0x7f1ef8153290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:42:01.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.161+0000 7f1efe744640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1ef80c9e30 0x7f1ef815b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:42:01.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.161+0000 7f1efe744640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ef8152cc0 0x7f1ef8149110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:42:01.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.161+0000 7f1efe744640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f1ef80c8500 con 0x7f1ef80c4bf0 2024-05-21T13:42:01.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.161+0000 7f1efe744640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f1ef8158f40 con 0x7f1ef8152cc0 2024-05-21T13:42:01.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.161+0000 7f1efe744640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f1ef8159720 con 0x7f1ef80c9e30 2024-05-21T13:42:01.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.161+0000 7f1ef7fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ef80c4bf0 0x7f1ef8153290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:42:01.141 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.161+0000 7f1ef7fff640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ef80c4bf0 0x7f1ef8153290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34236/0 (socket says 172.21.15.22:34236) 2024-05-21T13:42:01.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.161+0000 7f1ef7fff640 1 -- 172.21.15.22:0/246974747 learned_addr learned my addr 172.21.15.22:0/246974747 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:42:01.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.161+0000 7f1eeffff640 1 --2- 172.21.15.22:0/246974747 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1ef80c9e30 0x7f1ef815b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:42:01.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.161+0000 7f1efcce1640 1 --2- 172.21.15.22:0/246974747 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ef8152cc0 0x7f1ef8149110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:42:01.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.161+0000 7f1ef7fff640 1 -- 172.21.15.22:0/246974747 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1ef80c9e30 msgr2=0x7f1ef815b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:42:01.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.161+0000 7f1ef7fff640 1 --2- 172.21.15.22:0/246974747 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1ef80c9e30 0x7f1ef815b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:42:01.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.161+0000 7f1ef7fff640 1 -- 172.21.15.22:0/246974747 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ef8152cc0 msgr2=0x7f1ef8149110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:42:01.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.161+0000 7f1ef7fff640 1 --2- 172.21.15.22:0/246974747 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ef8152cc0 0x7f1ef8149110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:42:01.142 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.161+0000 7f1ef7fff640 1 -- 172.21.15.22:0/246974747 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ef81537d0 con 0x7f1ef80c4bf0 2024-05-21T13:42:01.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.161+0000 7f1eeffff640 1 --2- 172.21.15.22:0/246974747 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1ef80c9e30 0x7f1ef815b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:42:01.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.161+0000 7f1efcce1640 1 --2- 172.21.15.22:0/246974747 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ef8152cc0 0x7f1ef8149110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:42:01.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.161+0000 7f1ef7fff640 1 --2- 172.21.15.22:0/246974747 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ef80c4bf0 0x7f1ef8153290 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f1ee800c4e0 tx=0x7f1ee800c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:42:01.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.161+0000 7f1ef57fa640 1 -- 172.21.15.22:0/246974747 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee80052d0 con 0x7f1ef80c4bf0 2024-05-21T13:42:01.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.161+0000 7f1ef57fa640 1 -- 172.21.15.22:0/246974747 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f1ee8005470 con 0x7f1ef80c4bf0 2024-05-21T13:42:01.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.161+0000 7f1efe744640 1 -- 172.21.15.22:0/246974747 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ef814b9b0 con 0x7f1ef80c4bf0 2024-05-21T13:42:01.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.161+0000 7f1ef57fa640 1 -- 172.21.15.22:0/246974747 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ee8012870 con 0x7f1ef80c4bf0 2024-05-21T13:42:01.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.165+0000 7f1efe744640 1 -- 172.21.15.22:0/246974747 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ef81f5e20 con 0x7f1ef80c4bf0 2024-05-21T13:42:01.143 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.165+0000 7f1efe744640 1 -- 172.21.15.22:0/246974747 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ef8077bb0 con 0x7f1ef80c4bf0 2024-05-21T13:42:01.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.165+0000 7f1ef57fa640 1 -- 172.21.15.22:0/246974747 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f1ee8012a10 con 0x7f1ef80c4bf0 2024-05-21T13:42:01.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.165+0000 7f1ef57fa640 1 --2- 172.21.15.22:0/246974747 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f1ed806f400 0x7f1ed80718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:42:01.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.165+0000 7f1ef57fa640 1 -- 172.21.15.22:0/246974747 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f1ee808f2f0 con 0x7f1ef80c4bf0 2024-05-21T13:42:01.144 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.165+0000 7f1eeffff640 1 --2- 172.21.15.22:0/246974747 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f1ed806f400 0x7f1ed80718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:42:01.145 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.165+0000 7f1eeffff640 1 --2- 172.21.15.22:0/246974747 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f1ed806f400 0x7f1ed80718c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1ef8069c10 tx=0x7f1ee0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:42:01.146 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.169+0000 7f1ef57fa640 1 -- 172.21.15.22:0/246974747 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f1ee805be70 con 0x7f1ef80c4bf0 2024-05-21T13:42:01.313 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.337+0000 7f1efe744640 1 -- 172.21.15.22:0/246974747 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1ef8072510 con 0x7f1ef80c4bf0 2024-05-21T13:42:01.315 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.337+0000 7f1ef57fa640 1 -- 172.21.15.22:0/246974747 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) ==== 74+0+18554 (secure 0 0 0) 0x7f1ee805b770 con 0x7f1ef80c4bf0 2024-05-21T13:42:01.315 INFO:teuthology.orchestra.run.smithi022.stdout: 2024-05-21T13:42:01.315 INFO:teuthology.orchestra.run.smithi022.stdout:{"epoch":27,"fsid":"f2c96204-e240-4e7f-8a76-927b4f80f534","created":"2024-05-21T13:35:33.827005+0000","modified":"2024-05-21T13:36:39.578654+0000","last_up_change":"2024-05-21T13:35:44.542324+0000","last_in_change":"2024-05-21T13:35:36.061492+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-21T13:35:44.536105+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-05-21T13:35:54.972996+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-05-21T13:35:56.065755+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-05-21T13:35:59.791448+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"09157d4a-9443-4e10-bbb3-cf8ed7c42cb9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6800","nonce":222752954},{"type":"v1","addr":"172.21.15.22:6801","nonce":222752954}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6802","nonce":222752954},{"type":"v1","addr":"172.21.15.22:6803","nonce":222752954}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6806","nonce":222752954},{"type":"v1","addr":"172.21.15.22:6807","nonce":222752954}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6804","nonce":222752954},{"type":"v1","addr":"172.21.15.22:6805","nonce":222752954}]},"public_addr":"172.21.15.22:6801/222752954","cluster_addr":"172.21.15.22:6803/222752954","heartbeat_back_addr":"172.21.15.22:6807/222752954","heartbeat_front_addr":"172.21.15.22:6805/222752954","state":["exists","up"]},{"osd":1,"uuid":"2a6a87c0-01ad-4a98-a538-c0a8e865b05d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6808","nonce":685426272},{"type":"v1","addr":"172.21.15.22:6809","nonce":685426272}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6810","nonce":685426272},{"type":"v1","addr":"172.21.15.22:6811","nonce":685426272}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6814","nonce":685426272},{"type":"v1","addr":"172.21.15.22:6815","nonce":685426272}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6812","nonce":685426272},{"type":"v1","addr":"172.21.15.22:6813","nonce":685426272}]},"public_addr":"172.21.15.22:6809/685426272","cluster_addr":"172.21.15.22:6811/685426272","heartbeat_back_addr":"172.21.15.22:6815/685426272","heartbeat_front_addr":"172.21.15.22:6813/685426272","state":["exists","up"]},{"osd":2,"uuid":"4c18f931-40a4-46ac-a752-0d1be35b01a5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6816","nonce":2092224336},{"type":"v1","addr":"172.21.15.22:6817","nonce":2092224336}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6818","nonce":2092224336},{"type":"v1","addr":"172.21.15.22:6819","nonce":2092224336}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6822","nonce":2092224336},{"type":"v1","addr":"172.21.15.22:6823","nonce":2092224336}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6820","nonce":2092224336},{"type":"v1","addr":"172.21.15.22:6821","nonce":2092224336}]},"public_addr":"172.21.15.22:6817/2092224336","cluster_addr":"172.21.15.22:6819/2092224336","heartbeat_back_addr":"172.21.15.22:6823/2092224336","heartbeat_front_addr":"172.21.15.22:6821/2092224336","state":["exists","up"]},{"osd":3,"uuid":"d57ee7fd-b73e-41ec-8e3b-e62fb8898128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6824","nonce":1232311110},{"type":"v1","addr":"172.21.15.22:6825","nonce":1232311110}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6826","nonce":1232311110},{"type":"v1","addr":"172.21.15.22:6827","nonce":1232311110}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6830","nonce":1232311110},{"type":"v1","addr":"172.21.15.22:6831","nonce":1232311110}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.22:6828","nonce":1232311110},{"type":"v1","addr":"172.21.15.22:6829","nonce":1232311110}]},"public_addr":"172.21.15.22:6825/1232311110","cluster_addr":"172.21.15.22:6827/1232311110","heartbeat_back_addr":"172.21.15.22:6831/1232311110","heartbeat_front_addr":"172.21.15.22:6829/1232311110","state":["exists","up"]},{"osd":4,"uuid":"43c6494f-352b-42a7-b6a9-fe7e3573fab9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6800","nonce":832695158},{"type":"v1","addr":"172.21.15.115:6801","nonce":832695158}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6802","nonce":832695158},{"type":"v1","addr":"172.21.15.115:6803","nonce":832695158}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6806","nonce":832695158},{"type":"v1","addr":"172.21.15.115:6807","nonce":832695158}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6804","nonce":832695158},{"type":"v1","addr":"172.21.15.115:6805","nonce":832695158}]},"public_addr":"172.21.15.115:6801/832695158","cluster_addr":"172.21.15.115:6803/832695158","heartbeat_back_addr":"172.21.15.115:6807/832695158","heartbeat_front_addr":"172.21.15.115:6805/832695158","state":["exists","up"]},{"osd":5,"uuid":"25fc861c-593d-4d49-942a-c75c19f25994","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6812","nonce":1504764223},{"type":"v1","addr":"172.21.15.115:6815","nonce":1504764223}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6819","nonce":1504764223},{"type":"v1","addr":"172.21.15.115:6823","nonce":1504764223}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6828","nonce":1504764223},{"type":"v1","addr":"172.21.15.115:6830","nonce":1504764223}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6825","nonce":1504764223},{"type":"v1","addr":"172.21.15.115:6827","nonce":1504764223}]},"public_addr":"172.21.15.115:6815/1504764223","cluster_addr":"172.21.15.115:6823/1504764223","heartbeat_back_addr":"172.21.15.115:6830/1504764223","heartbeat_front_addr":"172.21.15.115:6827/1504764223","state":["exists","up"]},{"osd":6,"uuid":"2e7fb0b8-1162-497f-bffc-e2c02b9b9ef4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6808","nonce":959292720},{"type":"v1","addr":"172.21.15.115:6809","nonce":959292720}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6810","nonce":959292720},{"type":"v1","addr":"172.21.15.115:6813","nonce":959292720}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6820","nonce":959292720},{"type":"v1","addr":"172.21.15.115:6822","nonce":959292720}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6816","nonce":959292720},{"type":"v1","addr":"172.21.15.115:6818","nonce":959292720}]},"public_addr":"172.21.15.115:6809/959292720","cluster_addr":"172.21.15.115:6813/959292720","heartbeat_back_addr":"172.21.15.115:6822/959292720","heartbeat_front_addr":"172.21.15.115:6818/959292720","state":["exists","up"]},{"osd":7,"uuid":"a97df0dc-e370-45ce-8742-25ae31e2212e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6811","nonce":20268513},{"type":"v1","addr":"172.21.15.115:6814","nonce":20268513}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6817","nonce":20268513},{"type":"v1","addr":"172.21.15.115:6821","nonce":20268513}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6829","nonce":20268513},{"type":"v1","addr":"172.21.15.115:6831","nonce":20268513}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.115:6824","nonce":20268513},{"type":"v1","addr":"172.21.15.115:6826","nonce":20268513}]},"public_addr":"172.21.15.115:6814/20268513","cluster_addr":"172.21.15.115:6821/20268513","heartbeat_back_addr":"172.21.15.115:6831/20268513","heartbeat_front_addr":"172.21.15.115:6826/20268513","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.692890+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.545577+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.712724+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.681944+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.492954+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.553222+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.597022+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-05-21T13:35:41.601698+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.1b","mappings":[{"from":0,"to":7}]},{"pgid":"4.19","mappings":[{"from":7,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-21T13:42:01.317 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.341+0000 7f1efe744640 1 -- 172.21.15.22:0/246974747 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f1ed806f400 msgr2=0x7f1ed80718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:42:01.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.341+0000 7f1efe744640 1 --2- 172.21.15.22:0/246974747 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f1ed806f400 0x7f1ed80718c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1ef8069c10 tx=0x7f1ee0009040 comp rx=0 tx=0).stop 2024-05-21T13:42:01.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.341+0000 7f1efe744640 1 -- 172.21.15.22:0/246974747 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ef80c4bf0 msgr2=0x7f1ef8153290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:42:01.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.341+0000 7f1efe744640 1 --2- 172.21.15.22:0/246974747 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ef80c4bf0 0x7f1ef8153290 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f1ee800c4e0 tx=0x7f1ee800c9a0 comp rx=0 tx=0).stop 2024-05-21T13:42:01.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.341+0000 7f1efe744640 1 -- 172.21.15.22:0/246974747 shutdown_connections 2024-05-21T13:42:01.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.341+0000 7f1efe744640 1 --2- 172.21.15.22:0/246974747 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f1ed806f400 0x7f1ed80718c0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:42:01.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.341+0000 7f1efe744640 1 --2- 172.21.15.22:0/246974747 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f1ef8152cc0 0x7f1ef8149110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:42:01.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.341+0000 7f1efe744640 1 --2- 172.21.15.22:0/246974747 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1ef80c9e30 0x7f1ef815b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:42:01.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.341+0000 7f1efe744640 1 --2- 172.21.15.22:0/246974747 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1ef80c4bf0 0x7f1ef8153290 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:42:01.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.341+0000 7f1efe744640 1 -- 172.21.15.22:0/246974747 >> 172.21.15.22:0/246974747 conn(0x7f1ef806ea10 msgr2=0x7f1ef80c8e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:42:01.318 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.341+0000 7f1efe744640 1 -- 172.21.15.22:0/246974747 shutdown_connections 2024-05-21T13:42:01.319 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.341+0000 7f1efe744640 1 -- 172.21.15.22:0/246974747 wait complete. 2024-05-21T13:42:01.336 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-05-21T13:42:01.460 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.485+0000 7f7780a37640 1 Processor -- start 2024-05-21T13:42:01.461 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.485+0000 7f7780a37640 1 -- start start 2024-05-21T13:42:01.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.485+0000 7f7780a37640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f777c0c47f0 0x7f777c15d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:42:01.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.485+0000 7f7780a37640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f777c15d650 0x7f777c06df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:42:01.462 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.485+0000 7f7780a37640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f777c159b20 con 0x7f777c153b20 2024-05-21T13:42:01.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.485+0000 7f7780a37640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f777c0c9a60 con 0x7f777c15d650 2024-05-21T13:42:01.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.485+0000 7f7780a37640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f777c159da0 con 0x7f777c0c47f0 2024-05-21T13:42:01.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.485+0000 7f777ad9d640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f777c15d650 0x7f777c06df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:42:01.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.485+0000 7f777ad9d640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f777c15d650 0x7f777c06df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34244/0 (socket says 172.21.15.22:34244) 2024-05-21T13:42:01.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.485+0000 7f777ad9d640 1 -- 172.21.15.22:0/1664020600 learned_addr learned my addr 172.21.15.22:0/1664020600 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:42:01.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.485+0000 7f777a59c640 1 --1- 172.21.15.22:0/1664020600 >> v1:172.21.15.22:6789/0 conn(0x7f777c153b20 0x7f777c0c9020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:57810/0 (socket says 172.21.15.22:57810) 2024-05-21T13:42:01.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.485+0000 7f7779d9b640 1 --2- 172.21.15.22:0/1664020600 >> v2:172.21.15.115:3300/0 conn(0x7f777c0c47f0 0x7f777c15d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:42:01.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.485+0000 7f777ad9d640 1 -- 172.21.15.22:0/1664020600 >> v2:172.21.15.115:3300/0 conn(0x7f777c0c47f0 msgr2=0x7f777c15d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:42:01.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.485+0000 7f777ad9d640 1 --2- 172.21.15.22:0/1664020600 >> v2:172.21.15.115:3300/0 conn(0x7f777c0c47f0 0x7f777c15d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:42:01.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.485+0000 7f777ad9d640 1 -- 172.21.15.22:0/1664020600 >> v1:172.21.15.22:6789/0 conn(0x7f777c153b20 legacy=0x7f777c0c9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:42:01.463 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.485+0000 7f777ad9d640 1 -- 172.21.15.22:0/1664020600 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f777c15a080 con 0x7f777c15d650 2024-05-21T13:42:01.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.485+0000 7f777959a640 1 -- 172.21.15.22:0/1664020600 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1003498995 0 0) 0x7f776c001120 con 0x7f777c153b20 2024-05-21T13:42:01.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.489+0000 7f777ad9d640 1 --2- 172.21.15.22:0/1664020600 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f777c15d650 0x7f777c06df50 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f777c0748a0 tx=0x7f777401f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c989e89bd408c01 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:42:01.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.489+0000 7f777959a640 1 -- 172.21.15.22:0/1664020600 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77740b4070 con 0x7f777c15d650 2024-05-21T13:42:01.464 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.489+0000 7f777959a640 1 -- 172.21.15.22:0/1664020600 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f77740af400 con 0x7f777c15d650 2024-05-21T13:42:01.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.489+0000 7f777959a640 1 -- 172.21.15.22:0/1664020600 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77740af7f0 con 0x7f777c15d650 2024-05-21T13:42:01.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.489+0000 7f7780a37640 1 -- 172.21.15.22:0/1664020600 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f777c15d650 msgr2=0x7f777c06df50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:42:01.465 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.489+0000 7f7780a37640 1 --2- 172.21.15.22:0/1664020600 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f777c15d650 0x7f777c06df50 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f777c0748a0 tx=0x7f777401f1e0 comp rx=0 tx=0).stop 2024-05-21T13:42:01.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.489+0000 7f7780a37640 1 -- 172.21.15.22:0/1664020600 shutdown_connections 2024-05-21T13:42:01.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.489+0000 7f7780a37640 1 --2- 172.21.15.22:0/1664020600 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f777c15d650 0x7f777c06df50 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:42:01.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.489+0000 7f7780a37640 1 --2- 172.21.15.22:0/1664020600 >> v2:172.21.15.115:3300/0 conn(0x7f777c0c47f0 0x7f777c15d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:42:01.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.489+0000 7f7780a37640 1 -- 172.21.15.22:0/1664020600 >> 172.21.15.22:0/1664020600 conn(0x7f777c06ce70 msgr2=0x7f777c0cd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:42:01.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.489+0000 7f7780a37640 1 -- 172.21.15.22:0/1664020600 shutdown_connections 2024-05-21T13:42:01.466 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.489+0000 7f7780a37640 1 -- 172.21.15.22:0/1664020600 wait complete. 2024-05-21T13:42:01.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.489+0000 7f7780a37640 1 Processor -- start 2024-05-21T13:42:01.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.489+0000 7f7780a37640 1 -- start start 2024-05-21T13:42:01.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.489+0000 7f7780a37640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f777c0c47f0 0x7f777c0cb0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:42:01.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.489+0000 7f7780a37640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f777c153b20 0x7f777c0ccd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:42:01.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.489+0000 7f7780a37640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f777c15d650 0x7f777c15ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:42:01.468 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.489+0000 7f7780a37640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f777c0c9730 con 0x7f777c0c47f0 2024-05-21T13:42:01.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.489+0000 7f7780a37640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f777c15a640 con 0x7f777c153b20 2024-05-21T13:42:01.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.489+0000 7f7780a37640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f777c153f00 con 0x7f777c15d650 2024-05-21T13:42:01.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.489+0000 7f777a59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f777c0c47f0 0x7f777c0cb0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:42:01.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.489+0000 7f777a59c640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f777c0c47f0 0x7f777c0cb0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34250/0 (socket says 172.21.15.22:34250) 2024-05-21T13:42:01.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.489+0000 7f777a59c640 1 -- 172.21.15.22:0/3717869506 learned_addr learned my addr 172.21.15.22:0/3717869506 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:42:01.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.489+0000 7f7779d9b640 1 --2- 172.21.15.22:0/3717869506 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f777c153b20 0x7f777c0ccd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:42:01.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.489+0000 7f777ad9d640 1 --2- 172.21.15.22:0/3717869506 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f777c15d650 0x7f777c15ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:42:01.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.489+0000 7f777a59c640 1 -- 172.21.15.22:0/3717869506 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f777c15d650 msgr2=0x7f777c15ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:42:01.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.489+0000 7f777a59c640 1 --2- 172.21.15.22:0/3717869506 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f777c15d650 0x7f777c15ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:42:01.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.489+0000 7f777a59c640 1 -- 172.21.15.22:0/3717869506 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f777c153b20 msgr2=0x7f777c0ccd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:42:01.469 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.489+0000 7f777a59c640 1 --2- 172.21.15.22:0/3717869506 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f777c153b20 0x7f777c0ccd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:42:01.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.489+0000 7f777a59c640 1 -- 172.21.15.22:0/3717869506 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f777c15ace0 con 0x7f777c0c47f0 2024-05-21T13:42:01.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.493+0000 7f777a59c640 1 --2- 172.21.15.22:0/3717869506 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f777c0c47f0 0x7f777c0cb0f0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f776c00c730 tx=0x7f776c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:42:01.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.493+0000 7f776affd640 1 -- 172.21.15.22:0/3717869506 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f776c018070 con 0x7f777c0c47f0 2024-05-21T13:42:01.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.493+0000 7f776affd640 1 -- 172.21.15.22:0/3717869506 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f776c0070d0 con 0x7f777c0c47f0 2024-05-21T13:42:01.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.493+0000 7f7780a37640 1 -- 172.21.15.22:0/3717869506 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f777c15c480 con 0x7f777c0c47f0 2024-05-21T13:42:01.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.493+0000 7f776affd640 1 -- 172.21.15.22:0/3717869506 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f776c0074e0 con 0x7f777c0c47f0 2024-05-21T13:42:01.470 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.493+0000 7f7780a37640 1 -- 172.21.15.22:0/3717869506 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f777c15af80 con 0x7f777c0c47f0 2024-05-21T13:42:01.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.493+0000 7f7780a37640 1 -- 172.21.15.22:0/3717869506 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f777c077bb0 con 0x7f777c0c47f0 2024-05-21T13:42:01.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.493+0000 7f776affd640 1 -- 172.21.15.22:0/3717869506 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f776c01b070 con 0x7f777c0c47f0 2024-05-21T13:42:01.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.493+0000 7f776affd640 1 --2- 172.21.15.22:0/3717869506 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f775c06f400 0x7f775c0718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:42:01.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.493+0000 7f776affd640 1 -- 172.21.15.22:0/3717869506 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 6590+0+0 (secure 0 0 0) 0x7f776c08eda0 con 0x7f777c0c47f0 2024-05-21T13:42:01.471 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.493+0000 7f7779d9b640 1 --2- 172.21.15.22:0/3717869506 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f775c06f400 0x7f775c0718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:42:01.472 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.497+0000 7f7779d9b640 1 --2- 172.21.15.22:0/3717869506 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f775c06f400 0x7f775c0718c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f777c1e56c0 tx=0x7f7770008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:42:01.474 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.497+0000 7f776affd640 1 -- 172.21.15.22:0/3717869506 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f777c159b20 con 0x7f777c0c47f0 2024-05-21T13:42:01.673 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.697+0000 7f7780a37640 1 -- 172.21.15.22:0/3717869506 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f777c0c0f70 con 0x7f777c0c47f0 2024-05-21T13:42:01.676 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.701+0000 7f776affd640 1 -- 172.21.15.22:0/3717869506 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v15) ==== 161+0+0 (secure 0 0 0) 0x7f776c05b900 con 0x7f777c0c47f0 2024-05-21T13:42:01.676 INFO:teuthology.orchestra.run.smithi022.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-05-21T13:42:01.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.701+0000 7f7780a37640 1 -- 172.21.15.22:0/3717869506 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f775c06f400 msgr2=0x7f775c0718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:42:01.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.701+0000 7f7780a37640 1 --2- 172.21.15.22:0/3717869506 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f775c06f400 0x7f775c0718c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f777c1e56c0 tx=0x7f7770008040 comp rx=0 tx=0).stop 2024-05-21T13:42:01.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.705+0000 7f7780a37640 1 -- 172.21.15.22:0/3717869506 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f777c0c47f0 msgr2=0x7f777c0cb0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:42:01.680 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.705+0000 7f7780a37640 1 --2- 172.21.15.22:0/3717869506 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f777c0c47f0 0x7f777c0cb0f0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f776c00c730 tx=0x7f776c00cbf0 comp rx=0 tx=0).stop 2024-05-21T13:42:01.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.705+0000 7f7780a37640 1 -- 172.21.15.22:0/3717869506 shutdown_connections 2024-05-21T13:42:01.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.705+0000 7f7780a37640 1 --2- 172.21.15.22:0/3717869506 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f775c06f400 0x7f775c0718c0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:42:01.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.705+0000 7f7780a37640 1 --2- 172.21.15.22:0/3717869506 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f777c15d650 0x7f777c15ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:42:01.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.705+0000 7f7780a37640 1 --2- 172.21.15.22:0/3717869506 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f777c153b20 0x7f777c0ccd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:42:01.681 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.705+0000 7f7780a37640 1 --2- 172.21.15.22:0/3717869506 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f777c0c47f0 0x7f777c0cb0f0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:42:01.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.705+0000 7f7780a37640 1 -- 172.21.15.22:0/3717869506 >> 172.21.15.22:0/3717869506 conn(0x7f777c06ce70 msgr2=0x7f777c06df50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:42:01.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.705+0000 7f7780a37640 1 -- 172.21.15.22:0/3717869506 shutdown_connections 2024-05-21T13:42:01.682 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.705+0000 7f7780a37640 1 -- 172.21.15.22:0/3717869506 wait complete. 2024-05-21T13:42:01.697 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-05-21T13:42:01.753 INFO:tasks.ceph.mds.f.smithi115.stdout:starting mds.f at 2024-05-21T13:42:01.754 INFO:tasks.ceph.mds.b.smithi115.stdout:starting mds.b at 2024-05-21T13:42:01.758 INFO:tasks.ceph.mds.d.smithi115.stdout:starting mds.d at 2024-05-21T13:42:01.810 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.833+0000 7f141716e640 1 Processor -- start 2024-05-21T13:42:01.811 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.833+0000 7f141716e640 1 -- start start 2024-05-21T13:42:01.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.833+0000 7f141716e640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1410153c00 0x7f14100ca190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:42:01.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.833+0000 7f141716e640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f14100ccdd0 0x7f14100710b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:42:01.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.833+0000 7f141716e640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1410153fe0 con 0x7f14100715f0 2024-05-21T13:42:01.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.833+0000 7f141716e640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f14100caf10 con 0x7f1410153c00 2024-05-21T13:42:01.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.833+0000 7f141716e640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f1410070c20 con 0x7f14100ccdd0 2024-05-21T13:42:01.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.833+0000 7f1414f0a640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1410153c00 0x7f14100ca190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:42:01.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.833+0000 7f1414f0a640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f1410153c00 0x7f14100ca190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34262/0 (socket says 172.21.15.22:34262) 2024-05-21T13:42:01.812 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.833+0000 7f1414f0a640 1 -- 172.21.15.22:0/3479677911 learned_addr learned my addr 172.21.15.22:0/3479677911 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:42:01.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.837+0000 7f140ffff640 1 --2- 172.21.15.22:0/3479677911 >> v2:172.21.15.115:3300/0 conn(0x7f14100ccdd0 0x7f14100710b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:42:01.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.837+0000 7f1414f0a640 1 -- 172.21.15.22:0/3479677911 >> v2:172.21.15.115:3300/0 conn(0x7f14100ccdd0 msgr2=0x7f14100710b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:42:01.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.837+0000 7f1414f0a640 1 --2- 172.21.15.22:0/3479677911 >> v2:172.21.15.115:3300/0 conn(0x7f14100ccdd0 0x7f14100710b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:42:01.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.837+0000 7f1414f0a640 1 -- 172.21.15.22:0/3479677911 >> v1:172.21.15.115:6789/0 conn(0x7f14100715f0 legacy=0x7f14100cbff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:42:01.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.837+0000 7f1414f0a640 1 -- 172.21.15.22:0/3479677911 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14100ca990 con 0x7f1410153c00 2024-05-21T13:42:01.813 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.837+0000 7f140ffff640 1 --2- 172.21.15.22:0/3479677911 >> v2:172.21.15.115:3300/0 conn(0x7f14100ccdd0 0x7f14100710b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T13:42:01.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.837+0000 7f1414f0a640 1 --2- 172.21.15.22:0/3479677911 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1410153c00 0x7f14100ca190 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f14100cb090 tx=0x7f140001f1d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c10a901834cd4570 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:42:01.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.837+0000 7f140f7fe640 1 -- 172.21.15.22:0/3479677911 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14000b4070 con 0x7f1410153c00 2024-05-21T13:42:01.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.837+0000 7f140f7fe640 1 -- 172.21.15.22:0/3479677911 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f14000af400 con 0x7f1410153c00 2024-05-21T13:42:01.814 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.837+0000 7f140f7fe640 1 -- 172.21.15.22:0/3479677911 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14000af7f0 con 0x7f1410153c00 2024-05-21T13:42:01.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.837+0000 7f141716e640 1 -- 172.21.15.22:0/3479677911 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1410153c00 msgr2=0x7f14100ca190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:42:01.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.837+0000 7f141716e640 1 --2- 172.21.15.22:0/3479677911 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1410153c00 0x7f14100ca190 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f14100cb090 tx=0x7f140001f1d0 comp rx=0 tx=0).stop 2024-05-21T13:42:01.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.837+0000 7f141716e640 1 -- 172.21.15.22:0/3479677911 shutdown_connections 2024-05-21T13:42:01.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.837+0000 7f141716e640 1 --2- 172.21.15.22:0/3479677911 >> v2:172.21.15.115:3300/0 conn(0x7f14100ccdd0 0x7f14100710b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:42:01.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.837+0000 7f141716e640 1 --2- 172.21.15.22:0/3479677911 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f1410153c00 0x7f14100ca190 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:42:01.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.837+0000 7f141716e640 1 -- 172.21.15.22:0/3479677911 >> 172.21.15.22:0/3479677911 conn(0x7f14100722b0 msgr2=0x7f14100726c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:42:01.815 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.837+0000 7f141716e640 1 -- 172.21.15.22:0/3479677911 shutdown_connections 2024-05-21T13:42:01.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.837+0000 7f141716e640 1 -- 172.21.15.22:0/3479677911 wait complete. 2024-05-21T13:42:01.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.841+0000 7f141716e640 1 Processor -- start 2024-05-21T13:42:01.816 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.841+0000 7f141716e640 1 -- start start 2024-05-21T13:42:01.817 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.841+0000 7f141716e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f14100715f0 0x7f1410147560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:42:01.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.841+0000 7f141716e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14100ccdd0 0x7f141006d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:42:01.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.841+0000 7f141716e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1410153c00 0x7f141006db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:42:01.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.841+0000 7f141716e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f141015a480 con 0x7f14100715f0 2024-05-21T13:42:01.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.841+0000 7f141716e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f14100cac30 con 0x7f14100ccdd0 2024-05-21T13:42:01.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.841+0000 7f141716e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f141015a760 con 0x7f1410153c00 2024-05-21T13:42:01.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.841+0000 7f1414f0a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f14100715f0 0x7f1410147560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:42:01.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.841+0000 7f1414f0a640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f14100715f0 0x7f1410147560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34266/0 (socket says 172.21.15.22:34266) 2024-05-21T13:42:01.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.841+0000 7f1414f0a640 1 -- 172.21.15.22:0/18965061 learned_addr learned my addr 172.21.15.22:0/18965061 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:42:01.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.841+0000 7f141570b640 1 --2- 172.21.15.22:0/18965061 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1410153c00 0x7f141006db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:42:01.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.841+0000 7f1414f0a640 1 -- 172.21.15.22:0/18965061 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1410153c00 msgr2=0x7f141006db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:42:01.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.841+0000 7f140ffff640 1 --2- 172.21.15.22:0/18965061 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14100ccdd0 0x7f141006d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:42:01.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.841+0000 7f1414f0a640 1 --2- 172.21.15.22:0/18965061 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1410153c00 0x7f141006db40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:42:01.818 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.841+0000 7f1414f0a640 1 -- 172.21.15.22:0/18965061 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14100ccdd0 msgr2=0x7f141006d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:42:01.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.841+0000 7f1414f0a640 1 --2- 172.21.15.22:0/18965061 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14100ccdd0 0x7f141006d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:42:01.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.841+0000 7f1414f0a640 1 -- 172.21.15.22:0/18965061 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14101f16f0 con 0x7f14100715f0 2024-05-21T13:42:01.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.841+0000 7f141570b640 1 --2- 172.21.15.22:0/18965061 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1410153c00 0x7f141006db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:42:01.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.841+0000 7f140ffff640 1 --2- 172.21.15.22:0/18965061 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14100ccdd0 0x7f141006d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:42:01.819 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.841+0000 7f1414f0a640 1 --2- 172.21.15.22:0/18965061 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f14100715f0 0x7f1410147560 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f14000b2040 tx=0x7f140001bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:42:01.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.841+0000 7f140d7fa640 1 -- 172.21.15.22:0/18965061 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14000c0070 con 0x7f14100715f0 2024-05-21T13:42:01.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.841+0000 7f140d7fa640 1 -- 172.21.15.22:0/18965061 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f14000afe50 con 0x7f14100715f0 2024-05-21T13:42:01.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.841+0000 7f141716e640 1 -- 172.21.15.22:0/18965061 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14100b2150 con 0x7f14100715f0 2024-05-21T13:42:01.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.841+0000 7f140d7fa640 1 -- 172.21.15.22:0/18965061 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14000b4040 con 0x7f14100715f0 2024-05-21T13:42:01.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.841+0000 7f141716e640 1 -- 172.21.15.22:0/18965061 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14101f1c50 con 0x7f14100715f0 2024-05-21T13:42:01.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.841+0000 7f141716e640 1 -- 172.21.15.22:0/18965061 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14100697d0 con 0x7f14100715f0 2024-05-21T13:42:01.820 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.845+0000 7f140d7fa640 1 -- 172.21.15.22:0/18965061 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f14000c3070 con 0x7f14100715f0 2024-05-21T13:42:01.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.845+0000 7f140d7fa640 1 --2- 172.21.15.22:0/18965061 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f13f006f430 0x7f13f00718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:42:01.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.845+0000 7f140d7fa640 1 -- 172.21.15.22:0/18965061 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6848+0+0 (secure 0 0 0) 0x7f140012d0d0 con 0x7f14100715f0 2024-05-21T13:42:01.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.845+0000 7f140ffff640 1 --2- 172.21.15.22:0/18965061 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f13f006f430 0x7f13f00718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:42:01.821 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.845+0000 7f140ffff640 1 --2- 172.21.15.22:0/18965061 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f13f006f430 0x7f13f00718f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f14101ef320 tx=0x7f13f8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:42:01.825 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:01.849+0000 7f140d7fa640 1 -- 172.21.15.22:0/18965061 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f14101f16f0 con 0x7f14100715f0 2024-05-21T13:42:02.026 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:02.049+0000 7f141716e640 1 -- 172.21.15.22:0/18965061 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f14100ca770 con 0x7f14100715f0 2024-05-21T13:42:02.709 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:02.733+0000 7f140d7fa640 1 -- 172.21.15.22:0/18965061 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v16) ==== 104+0+0 (secure 0 0 0) 0x7f1400018d30 con 0x7f14100715f0 2024-05-21T13:42:02.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:02.737+0000 7f141716e640 1 -- 172.21.15.22:0/18965061 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f13f006f430 msgr2=0x7f13f00718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:42:02.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:02.737+0000 7f141716e640 1 --2- 172.21.15.22:0/18965061 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f13f006f430 0x7f13f00718f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f14101ef320 tx=0x7f13f8008040 comp rx=0 tx=0).stop 2024-05-21T13:42:02.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:02.737+0000 7f141716e640 1 -- 172.21.15.22:0/18965061 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f14100715f0 msgr2=0x7f1410147560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:42:02.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:02.737+0000 7f141716e640 1 --2- 172.21.15.22:0/18965061 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f14100715f0 0x7f1410147560 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f14000b2040 tx=0x7f140001bf70 comp rx=0 tx=0).stop 2024-05-21T13:42:02.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:02.737+0000 7f141716e640 1 -- 172.21.15.22:0/18965061 shutdown_connections 2024-05-21T13:42:02.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:02.737+0000 7f141716e640 1 --2- 172.21.15.22:0/18965061 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f13f006f430 0x7f13f00718f0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:42:02.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:02.737+0000 7f141716e640 1 --2- 172.21.15.22:0/18965061 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f1410153c00 0x7f141006db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:42:02.713 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:02.737+0000 7f141716e640 1 --2- 172.21.15.22:0/18965061 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f14100ccdd0 0x7f141006d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:42:02.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:02.737+0000 7f141716e640 1 --2- 172.21.15.22:0/18965061 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f14100715f0 0x7f1410147560 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:42:02.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:02.737+0000 7f141716e640 1 -- 172.21.15.22:0/18965061 >> 172.21.15.22:0/18965061 conn(0x7f14100722b0 msgr2=0x7f1410158d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:42:02.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:02.737+0000 7f141716e640 1 -- 172.21.15.22:0/18965061 shutdown_connections 2024-05-21T13:42:02.714 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:02.737+0000 7f141716e640 1 -- 172.21.15.22:0/18965061 wait complete. 2024-05-21T13:42:02.733 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-05-21T13:42:02.867 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:02.889+0000 7f5e5384e640 1 Processor -- start 2024-05-21T13:42:02.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:02.889+0000 7f5e5384e640 1 -- start start 2024-05-21T13:42:02.868 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:02.893+0000 7f5e5384e640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f5e4c0cc570 0x7f5e4c153820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:42:02.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:02.893+0000 7f5e5384e640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e4c0c49c0 con 0x7f5e4c0cc190 2024-05-21T13:42:02.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:02.893+0000 7f5e5384e640 1 -- --> v1:172.21.15.115:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5e4c0cb1e0 con 0x7f5e4c071870 2024-05-21T13:42:02.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:02.893+0000 7f5e5384e640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f5e4c0cb4c0 con 0x7f5e4c0cc570 2024-05-21T13:42:02.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:02.893+0000 7f5e50de9640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f5e4c0cc570 0x7f5e4c153820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:42:02.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:02.893+0000 7f5e515ea640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f5e4c0cc190 0x7f5e4c0c9ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:57820/0 (socket says 172.21.15.22:57820) 2024-05-21T13:42:02.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:02.893+0000 7f5e515ea640 1 -- 172.21.15.22:0/1392110833 learned_addr learned my addr 172.21.15.22:0/1392110833 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-21T13:42:02.869 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:02.893+0000 7f5e50de9640 1 -- 172.21.15.22:0/1392110833 >> v1:172.21.15.115:6789/0 conn(0x7f5e4c071870 legacy=0x7f5e4c15d2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:42:02.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:02.893+0000 7f5e43fff640 1 -- 172.21.15.22:0/1392110833 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2940099852 0 0) 0x7f5e4c0c49c0 con 0x7f5e4c0cc190 2024-05-21T13:42:02.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:02.893+0000 7f5e50de9640 1 -- 172.21.15.22:0/1392110833 >> v1:172.21.15.22:6789/0 conn(0x7f5e4c0cc190 legacy=0x7f5e4c0c9ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:42:02.870 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:02.893+0000 7f5e50de9640 1 -- 172.21.15.22:0/1392110833 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e4c0cb7a0 con 0x7f5e4c0cc570 2024-05-21T13:42:02.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:02.897+0000 7f5e50de9640 1 --2- 172.21.15.22:0/1392110833 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5e4c0cc570 0x7f5e4c153820 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c0097c0 tx=0x7f5e3c01ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fc96f9e245a7cb4 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:42:02.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:02.897+0000 7f5e43fff640 1 -- 172.21.15.22:0/1392110833 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c0b5070 con 0x7f5e4c0cc570 2024-05-21T13:42:02.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:02.897+0000 7f5e43fff640 1 -- 172.21.15.22:0/1392110833 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f5e3c0a8990 con 0x7f5e4c0cc570 2024-05-21T13:42:02.872 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:02.897+0000 7f5e43fff640 1 -- 172.21.15.22:0/1392110833 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c0a8d80 con 0x7f5e4c0cc570 2024-05-21T13:42:02.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:02.897+0000 7f5e5384e640 1 -- 172.21.15.22:0/1392110833 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5e4c0cc570 msgr2=0x7f5e4c153820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:42:02.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:02.897+0000 7f5e5384e640 1 --2- 172.21.15.22:0/1392110833 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5e4c0cc570 0x7f5e4c153820 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c0097c0 tx=0x7f5e3c01ec90 comp rx=0 tx=0).stop 2024-05-21T13:42:02.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:02.897+0000 7f5e5384e640 1 -- 172.21.15.22:0/1392110833 shutdown_connections 2024-05-21T13:42:02.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:02.897+0000 7f5e5384e640 1 --2- 172.21.15.22:0/1392110833 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5e4c0cc570 0x7f5e4c153820 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:42:02.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:02.897+0000 7f5e5384e640 1 -- 172.21.15.22:0/1392110833 >> 172.21.15.22:0/1392110833 conn(0x7f5e4c072240 msgr2=0x7f5e4c072650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:42:02.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:02.897+0000 7f5e5384e640 1 -- 172.21.15.22:0/1392110833 shutdown_connections 2024-05-21T13:42:02.873 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:02.897+0000 7f5e5384e640 1 -- 172.21.15.22:0/1392110833 wait complete. 2024-05-21T13:42:02.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:02.897+0000 7f5e5384e640 1 Processor -- start 2024-05-21T13:42:02.874 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:02.897+0000 7f5e5384e640 1 -- start start 2024-05-21T13:42:02.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:02.897+0000 7f5e5384e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e4c071870 0x7f5e4c1e64b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:42:02.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:02.897+0000 7f5e5384e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5e4c0cc190 0x7f5e4c1f2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:42:02.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:02.897+0000 7f5e5384e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5e4c0cc570 0x7f5e4c1f3310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:42:02.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:02.897+0000 7f5e5384e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f5e4c15db80 con 0x7f5e4c0cc190 2024-05-21T13:42:02.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:02.897+0000 7f5e5384e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f5e4c15da00 con 0x7f5e4c071870 2024-05-21T13:42:02.876 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:02.897+0000 7f5e5384e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f5e4c145e10 con 0x7f5e4c0cc570 2024-05-21T13:42:02.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:02.897+0000 7f5e50de9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5e4c0cc190 0x7f5e4c1f2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:42:02.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:02.897+0000 7f5e50de9640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5e4c0cc190 0x7f5e4c1f2dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34274/0 (socket says 172.21.15.22:34274) 2024-05-21T13:42:02.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:02.897+0000 7f5e50de9640 1 -- 172.21.15.22:0/2648588503 learned_addr learned my addr 172.21.15.22:0/2648588503 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:42:02.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:02.897+0000 7f5e515ea640 1 --2- 172.21.15.22:0/2648588503 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e4c071870 0x7f5e4c1e64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:42:02.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:02.897+0000 7f5e51deb640 1 --2- 172.21.15.22:0/2648588503 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5e4c0cc570 0x7f5e4c1f3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:42:02.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:02.897+0000 7f5e50de9640 1 -- 172.21.15.22:0/2648588503 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5e4c0cc570 msgr2=0x7f5e4c1f3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:42:02.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:02.897+0000 7f5e50de9640 1 --2- 172.21.15.22:0/2648588503 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5e4c0cc570 0x7f5e4c1f3310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:42:02.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:02.897+0000 7f5e50de9640 1 -- 172.21.15.22:0/2648588503 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e4c071870 msgr2=0x7f5e4c1e64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:42:02.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:02.897+0000 7f5e50de9640 1 --2- 172.21.15.22:0/2648588503 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e4c071870 0x7f5e4c1e64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:42:02.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:02.897+0000 7f5e50de9640 1 -- 172.21.15.22:0/2648588503 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e4c149570 con 0x7f5e4c0cc190 2024-05-21T13:42:02.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:02.897+0000 7f5e515ea640 1 --2- 172.21.15.22:0/2648588503 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e4c071870 0x7f5e4c1e64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:42:02.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:02.897+0000 7f5e51deb640 1 --2- 172.21.15.22:0/2648588503 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5e4c0cc570 0x7f5e4c1f3310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-05-21T13:42:02.877 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:02.897+0000 7f5e50de9640 1 --2- 172.21.15.22:0/2648588503 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5e4c0cc190 0x7f5e4c1f2dd0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c0097c0 tx=0x7f5e3c01ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:42:02.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:02.901+0000 7f5e41ffb640 1 -- 172.21.15.22:0/2648588503 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c0c0070 con 0x7f5e4c0cc190 2024-05-21T13:42:02.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:02.901+0000 7f5e41ffb640 1 -- 172.21.15.22:0/2648588503 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f5e3c004230 con 0x7f5e4c0cc190 2024-05-21T13:42:02.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:02.901+0000 7f5e5384e640 1 -- 172.21.15.22:0/2648588503 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e4c149850 con 0x7f5e4c0cc190 2024-05-21T13:42:02.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:02.901+0000 7f5e41ffb640 1 -- 172.21.15.22:0/2648588503 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c0b5040 con 0x7f5e4c0cc190 2024-05-21T13:42:02.878 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:02.901+0000 7f5e5384e640 1 -- 172.21.15.22:0/2648588503 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e4c149e10 con 0x7f5e4c0cc190 2024-05-21T13:42:02.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:02.901+0000 7f5e5384e640 1 -- 172.21.15.22:0/2648588503 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e4c0697d0 con 0x7f5e4c0cc190 2024-05-21T13:42:02.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:02.901+0000 7f5e41ffb640 1 -- 172.21.15.22:0/2648588503 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f5e3c0c3070 con 0x7f5e4c0cc190 2024-05-21T13:42:02.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:02.901+0000 7f5e41ffb640 1 --2- 172.21.15.22:0/2648588503 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f5e3006f400 0x7f5e300718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:42:02.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:02.901+0000 7f5e41ffb640 1 -- 172.21.15.22:0/2648588503 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6848+0+0 (secure 0 0 0) 0x7f5e3c12c270 con 0x7f5e4c0cc190 2024-05-21T13:42:02.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:02.901+0000 7f5e515ea640 1 --2- 172.21.15.22:0/2648588503 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f5e3006f400 0x7f5e300718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:42:02.879 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:02.901+0000 7f5e515ea640 1 --2- 172.21.15.22:0/2648588503 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f5e3006f400 0x7f5e300718c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5e48000f70 tx=0x7f5e48009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:42:02.882 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:02.905+0000 7f5e41ffb640 1 -- 172.21.15.22:0/2648588503 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f5e3c0187f0 con 0x7f5e4c0cc190 2024-05-21T13:42:03.050 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:03.073+0000 7f5e5384e640 1 -- 172.21.15.22:0/2648588503 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f5e4c153e80 con 0x7f5e4c0cc190 2024-05-21T13:42:03.721 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:03.745+0000 7f5e41ffb640 1 -- 172.21.15.22:0/2648588503 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v29) ==== 181+0+0 (secure 0 0 0) 0x7f5e3c0f8c70 con 0x7f5e4c0cc190 2024-05-21T13:42:03.721 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_metadata' removed 2024-05-21T13:42:03.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:03.749+0000 7f5e5384e640 1 -- 172.21.15.22:0/2648588503 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f5e3006f400 msgr2=0x7f5e300718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:42:03.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:03.749+0000 7f5e5384e640 1 --2- 172.21.15.22:0/2648588503 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f5e3006f400 0x7f5e300718c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5e48000f70 tx=0x7f5e48009040 comp rx=0 tx=0).stop 2024-05-21T13:42:03.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:03.749+0000 7f5e5384e640 1 -- 172.21.15.22:0/2648588503 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5e4c0cc190 msgr2=0x7f5e4c1f2dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:42:03.726 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:03.749+0000 7f5e5384e640 1 --2- 172.21.15.22:0/2648588503 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5e4c0cc190 0x7f5e4c1f2dd0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c0097c0 tx=0x7f5e3c01ba30 comp rx=0 tx=0).stop 2024-05-21T13:42:03.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:03.749+0000 7f5e5384e640 1 -- 172.21.15.22:0/2648588503 shutdown_connections 2024-05-21T13:42:03.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:03.749+0000 7f5e5384e640 1 --2- 172.21.15.22:0/2648588503 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f5e3006f400 0x7f5e300718c0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:42:03.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:03.749+0000 7f5e5384e640 1 --2- 172.21.15.22:0/2648588503 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5e4c0cc570 0x7f5e4c1f3310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:42:03.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:03.749+0000 7f5e5384e640 1 --2- 172.21.15.22:0/2648588503 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f5e4c0cc190 0x7f5e4c1f2dd0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:42:03.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:03.749+0000 7f5e5384e640 1 --2- 172.21.15.22:0/2648588503 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5e4c071870 0x7f5e4c1e64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:42:03.727 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:03.749+0000 7f5e5384e640 1 -- 172.21.15.22:0/2648588503 >> 172.21.15.22:0/2648588503 conn(0x7f5e4c072240 msgr2=0x7f5e4c14eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:42:03.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:03.749+0000 7f5e5384e640 1 -- 172.21.15.22:0/2648588503 shutdown_connections 2024-05-21T13:42:03.728 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:03.749+0000 7f5e5384e640 1 -- 172.21.15.22:0/2648588503 wait complete. 2024-05-21T13:42:03.751 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-05-21T13:42:03.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:03.905+0000 7f2006ba7640 1 Processor -- start 2024-05-21T13:42:03.883 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:03.905+0000 7f2006ba7640 1 -- start start 2024-05-21T13:42:03.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:03.909+0000 7f2006ba7640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f2000070040 0x7f20000c47f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:42:03.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:03.909+0000 7f2006ba7640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f2000070420 0x7f200015bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:42:03.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:03.909+0000 7f2006ba7640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2000073030 0x7f2000152580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:42:03.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:03.909+0000 7f2006ba7640 1 -- --> v2:172.21.15.22:3300/0 -- mon_getmap magic: 0 -- 0x7f2000074930 con 0x7f2000070420 2024-05-21T13:42:03.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:03.909+0000 7f2006ba7640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f2000072890 con 0x7f2000070040 2024-05-21T13:42:03.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:03.909+0000 7f2006ba7640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f20000744a0 con 0x7f2000073030 2024-05-21T13:42:03.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:03.909+0000 7f1ff7fff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f2000070420 0x7f200015bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:42:03.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:03.909+0000 7f1ff7fff640 1 --2- >> v2:172.21.15.22:3300/0 conn(0x7f2000070420 0x7f200015bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34286/0 (socket says 172.21.15.22:34286) 2024-05-21T13:42:03.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:03.909+0000 7f1ff7fff640 1 -- 172.21.15.22:0/419952465 learned_addr learned my addr 172.21.15.22:0/419952465 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:42:03.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:03.909+0000 7f2004943640 1 --2- 172.21.15.22:0/419952465 >> v2:172.21.15.115:3300/0 conn(0x7f2000070040 0x7f20000c47f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:42:03.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:03.909+0000 7f2005144640 1 --2- 172.21.15.22:0/419952465 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2000073030 0x7f2000152580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:42:03.885 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:03.909+0000 7f1ff7fff640 1 -- 172.21.15.22:0/419952465 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2000073030 msgr2=0x7f2000152580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:42:03.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:03.909+0000 7f1ff7fff640 1 --2- 172.21.15.22:0/419952465 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2000073030 0x7f2000152580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:42:03.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:03.909+0000 7f1ff7fff640 1 -- 172.21.15.22:0/419952465 >> v2:172.21.15.115:3300/0 conn(0x7f2000070040 msgr2=0x7f20000c47f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:42:03.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:03.909+0000 7f1ff7fff640 1 --2- 172.21.15.22:0/419952465 >> v2:172.21.15.115:3300/0 conn(0x7f2000070040 0x7f20000c47f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:42:03.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:03.909+0000 7f1ff7fff640 1 -- 172.21.15.22:0/419952465 --> v2:172.21.15.22:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20000c4d30 con 0x7f2000070420 2024-05-21T13:42:03.886 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:03.909+0000 7f2004943640 1 --2- 172.21.15.22:0/419952465 >> v2:172.21.15.115:3300/0 conn(0x7f2000070040 0x7f20000c47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T13:42:03.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:03.909+0000 7f1ff7fff640 1 --2- 172.21.15.22:0/419952465 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2000070420 0x7f200015bcb0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f20000cdb50 tx=0x7f1ff001ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e8c6d84b0a5259f server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:42:03.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:03.913+0000 7f1ff77fe640 1 -- 172.21.15.22:0/419952465 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ff00b5070 con 0x7f2000070420 2024-05-21T13:42:03.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:03.913+0000 7f1ff77fe640 1 -- 172.21.15.22:0/419952465 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f1ff00a89d0 con 0x7f2000070420 2024-05-21T13:42:03.888 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:03.913+0000 7f1ff77fe640 1 -- 172.21.15.22:0/419952465 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ff00a8dc0 con 0x7f2000070420 2024-05-21T13:42:03.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:03.913+0000 7f2006ba7640 1 -- 172.21.15.22:0/419952465 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2000070420 msgr2=0x7f200015bcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:42:03.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:03.913+0000 7f2006ba7640 1 --2- 172.21.15.22:0/419952465 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2000070420 0x7f200015bcb0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f20000cdb50 tx=0x7f1ff001ed10 comp rx=0 tx=0).stop 2024-05-21T13:42:03.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:03.913+0000 7f2006ba7640 1 -- 172.21.15.22:0/419952465 shutdown_connections 2024-05-21T13:42:03.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:03.913+0000 7f2006ba7640 1 --2- 172.21.15.22:0/419952465 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2000073030 0x7f2000152580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:42:03.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:03.913+0000 7f2006ba7640 1 --2- 172.21.15.22:0/419952465 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2000070420 0x7f200015bcb0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:42:03.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:03.913+0000 7f2006ba7640 1 --2- 172.21.15.22:0/419952465 >> v2:172.21.15.115:3300/0 conn(0x7f2000070040 0x7f20000c47f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:42:03.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:03.913+0000 7f2006ba7640 1 -- 172.21.15.22:0/419952465 >> 172.21.15.22:0/419952465 conn(0x7f200006cc50 msgr2=0x7f20000cd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:42:03.889 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:03.913+0000 7f2006ba7640 1 -- 172.21.15.22:0/419952465 shutdown_connections 2024-05-21T13:42:03.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:03.913+0000 7f2006ba7640 1 -- 172.21.15.22:0/419952465 wait complete. 2024-05-21T13:42:03.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:03.913+0000 7f2006ba7640 1 Processor -- start 2024-05-21T13:42:03.890 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:03.913+0000 7f2006ba7640 1 -- start start 2024-05-21T13:42:03.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:03.913+0000 7f2006ba7640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2000070040 0x7f200015bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:42:03.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:03.913+0000 7f2006ba7640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2000070420 0x7f200014cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:42:03.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:03.913+0000 7f2006ba7640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2000073030 0x7f200014d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:42:03.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:03.913+0000 7f2006ba7640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f2000073b70 con 0x7f2000073030 2024-05-21T13:42:03.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:03.913+0000 7f2006ba7640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f2000072ae0 con 0x7f2000070040 2024-05-21T13:42:03.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:03.913+0000 7f2006ba7640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f2000073e50 con 0x7f2000070420 2024-05-21T13:42:03.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:03.913+0000 7f2005144640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2000073030 0x7f200014d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:42:03.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:03.913+0000 7f2005144640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2000073030 0x7f200014d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34302/0 (socket says 172.21.15.22:34302) 2024-05-21T13:42:03.892 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:03.913+0000 7f2005144640 1 -- 172.21.15.22:0/668436233 learned_addr learned my addr 172.21.15.22:0/668436233 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:42:03.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:03.913+0000 7f2004943640 1 --2- 172.21.15.22:0/668436233 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2000070040 0x7f200015bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:42:03.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:03.913+0000 7f1ff7fff640 1 --2- 172.21.15.22:0/668436233 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2000070420 0x7f200014cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:42:03.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:03.913+0000 7f2005144640 1 -- 172.21.15.22:0/668436233 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2000070420 msgr2=0x7f200014cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:42:03.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:03.913+0000 7f2005144640 1 --2- 172.21.15.22:0/668436233 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2000070420 0x7f200014cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:42:03.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:03.913+0000 7f2005144640 1 -- 172.21.15.22:0/668436233 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2000070040 msgr2=0x7f200015bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:42:03.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:03.913+0000 7f2005144640 1 --2- 172.21.15.22:0/668436233 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2000070040 0x7f200015bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:42:03.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:03.913+0000 7f2005144640 1 -- 172.21.15.22:0/668436233 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2000156ae0 con 0x7f2000073030 2024-05-21T13:42:03.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:03.913+0000 7f2004943640 1 --2- 172.21.15.22:0/668436233 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2000070040 0x7f200015bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-05-21T13:42:03.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:03.913+0000 7f2005144640 1 --2- 172.21.15.22:0/668436233 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2000073030 0x7f200014d180 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f1ff8006e90 tx=0x7f1ff800d9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:42:03.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:03.913+0000 7f1ff57fa640 1 -- 172.21.15.22:0/668436233 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ff80125f0 con 0x7f2000073030 2024-05-21T13:42:03.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:03.913+0000 7f1ff57fa640 1 -- 172.21.15.22:0/668436233 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f1ff8019070 con 0x7f2000073030 2024-05-21T13:42:03.893 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:03.913+0000 7f2006ba7640 1 -- 172.21.15.22:0/668436233 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20000ccbb0 con 0x7f2000073030 2024-05-21T13:42:03.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:03.917+0000 7f1ff57fa640 1 -- 172.21.15.22:0/668436233 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ff80129f0 con 0x7f2000073030 2024-05-21T13:42:03.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:03.917+0000 7f2006ba7640 1 -- 172.21.15.22:0/668436233 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f200014f5a0 con 0x7f2000073030 2024-05-21T13:42:03.894 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:03.917+0000 7f2006ba7640 1 -- 172.21.15.22:0/668436233 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20000766d0 con 0x7f2000073030 2024-05-21T13:42:03.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:03.917+0000 7f1ff57fa640 1 -- 172.21.15.22:0/668436233 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f1ff8012b90 con 0x7f2000073030 2024-05-21T13:42:03.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:03.917+0000 7f1ff57fa640 1 --2- 172.21.15.22:0/668436233 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f1fec06f430 0x7f1fec0718f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:42:03.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:03.917+0000 7f1ff57fa640 1 -- 172.21.15.22:0/668436233 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6410+0+0 (secure 0 0 0) 0x7f1ff808f900 con 0x7f2000073030 2024-05-21T13:42:03.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:03.917+0000 7f2004943640 1 --2- 172.21.15.22:0/668436233 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f1fec06f430 0x7f1fec0718f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:42:03.895 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:03.917+0000 7f2004943640 1 --2- 172.21.15.22:0/668436233 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f1fec06f430 0x7f1fec0718f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc009b40 tx=0x7f1ffc0039a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:42:03.898 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:03.921+0000 7f1ff57fa640 1 -- 172.21.15.22:0/668436233 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f1ff805c490 con 0x7f2000073030 2024-05-21T13:42:04.061 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:04.085+0000 7f2006ba7640 1 -- 172.21.15.22:0/668436233 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f2000149b80 con 0x7f2000073030 2024-05-21T13:42:04.734 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:04.753+0000 7f1ff57fa640 1 -- 172.21.15.22:0/668436233 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v30) ==== 169+0+0 (secure 0 0 0) 0x7f1ff805bd90 con 0x7f2000073030 2024-05-21T13:42:04.734 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_data' removed 2024-05-21T13:42:04.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:04.761+0000 7f2006ba7640 1 -- 172.21.15.22:0/668436233 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f1fec06f430 msgr2=0x7f1fec0718f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:42:04.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:04.761+0000 7f2006ba7640 1 --2- 172.21.15.22:0/668436233 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f1fec06f430 0x7f1fec0718f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc009b40 tx=0x7f1ffc0039a0 comp rx=0 tx=0).stop 2024-05-21T13:42:04.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:04.761+0000 7f2006ba7640 1 -- 172.21.15.22:0/668436233 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2000073030 msgr2=0x7f200014d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:42:04.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:04.761+0000 7f2006ba7640 1 --2- 172.21.15.22:0/668436233 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2000073030 0x7f200014d180 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f1ff8006e90 tx=0x7f1ff800d9e0 comp rx=0 tx=0).stop 2024-05-21T13:42:04.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:04.761+0000 7f2006ba7640 1 -- 172.21.15.22:0/668436233 shutdown_connections 2024-05-21T13:42:04.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:04.761+0000 7f2006ba7640 1 --2- 172.21.15.22:0/668436233 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f1fec06f430 0x7f1fec0718f0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:42:04.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:04.761+0000 7f2006ba7640 1 --2- 172.21.15.22:0/668436233 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f2000073030 0x7f200014d180 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:42:04.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:04.761+0000 7f2006ba7640 1 --2- 172.21.15.22:0/668436233 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f2000070420 0x7f200014cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:42:04.740 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:04.761+0000 7f2006ba7640 1 --2- 172.21.15.22:0/668436233 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f2000070040 0x7f200015bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:42:04.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:04.761+0000 7f2006ba7640 1 -- 172.21.15.22:0/668436233 >> 172.21.15.22:0/668436233 conn(0x7f200006cc50 msgr2=0x7f20000c8550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:42:04.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:04.765+0000 7f2006ba7640 1 -- 172.21.15.22:0/668436233 shutdown_connections 2024-05-21T13:42:04.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:04.765+0000 7f2006ba7640 1 -- 172.21.15.22:0/668436233 wait complete. 2024-05-21T13:42:04.766 DEBUG:teuthology.orchestra.run.smithi022:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-05-21T13:42:04.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:04.925+0000 7f556b48e640 1 Processor -- start 2024-05-21T13:42:04.903 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:04.925+0000 7f556b48e640 1 -- start start 2024-05-21T13:42:04.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:04.925+0000 7f556b48e640 1 --2- >> v2:172.21.15.115:3300/0 conn(0x7f5564159ee0 0x7f556406fde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:42:04.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:04.925+0000 7f556b48e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5564070320 0x7f55640c7d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:42:04.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:04.925+0000 7f556b48e640 1 -- --> v1:172.21.15.22:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5564160270 con 0x7f556415a2c0 2024-05-21T13:42:04.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:04.925+0000 7f556b48e640 1 -- --> v2:172.21.15.115:3300/0 -- mon_getmap magic: 0 -- 0x7f5564160df0 con 0x7f5564159ee0 2024-05-21T13:42:04.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:04.925+0000 7f556b48e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f5564160550 con 0x7f5564070320 2024-05-21T13:42:04.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:04.925+0000 7f5568a29640 1 --1- >> v1:172.21.15.22:6789/0 conn(0x7f556415a2c0 0x7f5564163a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.22:6789/0 says I am v1:172.21.15.22:57822/0 (socket says 172.21.15.22:57822) 2024-05-21T13:42:04.904 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:04.925+0000 7f5568a29640 1 -- 172.21.15.22:0/3048993317 learned_addr learned my addr 172.21.15.22:0/3048993317 (peer_addr_for_me v1:172.21.15.22:0/0) 2024-05-21T13:42:04.905 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:04.929+0000 7f5569a2b640 1 --2- 172.21.15.22:0/3048993317 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5564070320 0x7f55640c7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:42:04.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:04.937+0000 7f5569a2b640 1 -- 172.21.15.22:0/3048993317 >> v2:172.21.15.115:3300/0 conn(0x7f5564159ee0 msgr2=0x7f556406fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-05-21T13:42:04.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:04.937+0000 7f5569a2b640 1 --2- 172.21.15.22:0/3048993317 >> v2:172.21.15.115:3300/0 conn(0x7f5564159ee0 0x7f556406fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:42:04.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:04.937+0000 7f5569a2b640 1 -- 172.21.15.22:0/3048993317 >> v1:172.21.15.22:6789/0 conn(0x7f556415a2c0 legacy=0x7f5564163a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:42:04.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:04.937+0000 7f5569a2b640 1 -- 172.21.15.22:0/3048993317 --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5564160830 con 0x7f5564070320 2024-05-21T13:42:04.913 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:04.933+0000 7f555bfff640 1 -- 172.21.15.22:0/3048993317 <== mon.0 v1:172.21.15.22:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3721367085 0 0) 0x7f5564160270 con 0x7f556415a2c0 2024-05-21T13:42:04.918 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:04.941+0000 7f5569a2b640 1 --2- 172.21.15.22:0/3048993317 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5564070320 0x7f55640c7d60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f555c009d90 tx=0x7f555c01c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a66c3b437da4c69 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:42:04.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:04.941+0000 7f555bfff640 1 -- 172.21.15.22:0/3048993317 <== mon.2 v2:172.21.15.115:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f555c0b2070 con 0x7f5564070320 2024-05-21T13:42:04.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:04.941+0000 7f555bfff640 1 -- 172.21.15.22:0/3048993317 <== mon.2 v2:172.21.15.115:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f555c0a5a00 con 0x7f5564070320 2024-05-21T13:42:04.919 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:04.941+0000 7f555bfff640 1 -- 172.21.15.22:0/3048993317 <== mon.2 v2:172.21.15.115:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f555c0a5df0 con 0x7f5564070320 2024-05-21T13:42:04.920 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:04.945+0000 7f556b48e640 1 -- 172.21.15.22:0/3048993317 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5564070320 msgr2=0x7f55640c7d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:42:04.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:04.945+0000 7f556b48e640 1 --2- 172.21.15.22:0/3048993317 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5564070320 0x7f55640c7d60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f555c009d90 tx=0x7f555c01c940 comp rx=0 tx=0).stop 2024-05-21T13:42:04.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:04.945+0000 7f556b48e640 1 -- 172.21.15.22:0/3048993317 shutdown_connections 2024-05-21T13:42:04.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:04.945+0000 7f556b48e640 1 --2- 172.21.15.22:0/3048993317 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5564070320 0x7f55640c7d60 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:42:04.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:04.945+0000 7f556b48e640 1 --2- 172.21.15.22:0/3048993317 >> v2:172.21.15.115:3300/0 conn(0x7f5564159ee0 0x7f556406fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:42:04.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:04.945+0000 7f556b48e640 1 -- 172.21.15.22:0/3048993317 >> 172.21.15.22:0/3048993317 conn(0x7f556406cc50 msgr2=0x7f55640cd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:42:04.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:04.945+0000 7f556b48e640 1 -- 172.21.15.22:0/3048993317 shutdown_connections 2024-05-21T13:42:04.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:04.945+0000 7f556b48e640 1 -- 172.21.15.22:0/3048993317 wait complete. 2024-05-21T13:42:04.921 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:04.945+0000 7f556b48e640 1 Processor -- start 2024-05-21T13:42:04.922 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:04.945+0000 7f556b48e640 1 -- start start 2024-05-21T13:42:04.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:04.945+0000 7f556b48e640 1 --2- >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5564070320 0x7f5564159080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:42:04.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:04.945+0000 7f556b48e640 1 --2- >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5564159ee0 0x7f556415d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:42:04.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:04.945+0000 7f556b48e640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f556415a2c0 0x7f556415c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:42:04.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:04.945+0000 7f556b48e640 1 -- --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_getmap magic: 0 -- 0x7f55641642d0 con 0x7f556415a2c0 2024-05-21T13:42:04.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:04.945+0000 7f556b48e640 1 -- --> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] -- mon_getmap magic: 0 -- 0x7f5564164150 con 0x7f5564070320 2024-05-21T13:42:04.923 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:04.945+0000 7f556b48e640 1 -- --> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] -- mon_getmap magic: 0 -- 0x7f556415fe00 con 0x7f5564159ee0 2024-05-21T13:42:04.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:04.945+0000 7f5569a2b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f556415a2c0 0x7f556415c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:42:04.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:04.945+0000 7f5569a2b640 1 --2- >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f556415a2c0 0x7f556415c200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.22:3300/0 says I am v2:172.21.15.22:34316/0 (socket says 172.21.15.22:34316) 2024-05-21T13:42:04.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:04.945+0000 7f5569a2b640 1 -- 172.21.15.22:0/3473437774 learned_addr learned my addr 172.21.15.22:0/3473437774 (peer_addr_for_me v2:172.21.15.22:0/0) 2024-05-21T13:42:04.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:04.945+0000 7f5569a2b640 1 -- 172.21.15.22:0/3473437774 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5564159ee0 msgr2=0x7f556415d0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:42:04.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:04.945+0000 7f5569a2b640 1 --2- 172.21.15.22:0/3473437774 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5564159ee0 0x7f556415d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:42:04.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:04.945+0000 7f5569a2b640 1 -- 172.21.15.22:0/3473437774 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5564070320 msgr2=0x7f5564159080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:42:04.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:04.945+0000 7f5569a2b640 1 --2- 172.21.15.22:0/3473437774 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5564070320 0x7f5564159080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:42:04.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:04.945+0000 7f5569a2b640 1 -- 172.21.15.22:0/3473437774 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5564149a30 con 0x7f556415a2c0 2024-05-21T13:42:04.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:04.945+0000 7f5569a2b640 1 --2- 172.21.15.22:0/3473437774 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f556415a2c0 0x7f556415c200 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f555c009d90 tx=0x7f555c0196e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:42:04.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:04.945+0000 7f5559ffb640 1 -- 172.21.15.22:0/3473437774 <== mon.0 v2:172.21.15.22:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f555c0b2050 con 0x7f556415a2c0 2024-05-21T13:42:04.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:04.945+0000 7f5559ffb640 1 -- 172.21.15.22:0/3473437774 <== mon.0 v2:172.21.15.22:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f555c0b3040 con 0x7f556415a2c0 2024-05-21T13:42:04.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:04.945+0000 7f556b48e640 1 -- 172.21.15.22:0/3473437774 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55641596c0 con 0x7f556415a2c0 2024-05-21T13:42:04.924 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:04.945+0000 7f5559ffb640 1 -- 172.21.15.22:0/3473437774 <== mon.0 v2:172.21.15.22:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f555c0adb70 con 0x7f556415a2c0 2024-05-21T13:42:04.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:04.945+0000 7f556b48e640 1 -- 172.21.15.22:0/3473437774 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5564154170 con 0x7f556415a2c0 2024-05-21T13:42:04.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:04.949+0000 7f556b48e640 1 -- 172.21.15.22:0/3473437774 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55640766d0 con 0x7f556415a2c0 2024-05-21T13:42:04.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:04.949+0000 7f5559ffb640 1 -- 172.21.15.22:0/3473437774 <== mon.0 v2:172.21.15.22:3300/0 4 ==== mgrmap(e 5) ==== 93207+0+0 (secure 0 0 0) 0x7f555c0c0020 con 0x7f556415a2c0 2024-05-21T13:42:04.925 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:04.949+0000 7f5559ffb640 1 --2- 172.21.15.22:0/3473437774 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f554806f400 0x7f55480718c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-05-21T13:42:04.926 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:04.949+0000 7f5559ffb640 1 -- 172.21.15.22:0/3473437774 <== mon.0 v2:172.21.15.22:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 5967+0+0 (secure 0 0 0) 0x7f555c12a000 con 0x7f556415a2c0 2024-05-21T13:42:04.927 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:04.949+0000 7f556922a640 1 --2- 172.21.15.22:0/3473437774 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f554806f400 0x7f55480718c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-05-21T13:42:04.929 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:04.953+0000 7f556922a640 1 --2- 172.21.15.22:0/3473437774 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f554806f400 0x7f55480718c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5560009730 tx=0x7f5560006ca0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-05-21T13:42:04.930 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:04.953+0000 7f5559ffb640 1 -- 172.21.15.22:0/3473437774 <== mon.0 v2:172.21.15.22:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+180029 (secure 0 0 0) 0x7f555c0c7020 con 0x7f556415a2c0 2024-05-21T13:42:05.095 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:05.117+0000 7f556b48e640 1 -- 172.21.15.22:0/3473437774 --> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f5564077bb0 con 0x7f556415a2c0 2024-05-21T13:42:05.741 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:05.765+0000 7f5559ffb640 1 -- 172.21.15.22:0/3473437774 <== mon.0 v2:172.21.15.22:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v31) ==== 178+0+0 (secure 0 0 0) 0x7f555c016580 con 0x7f556415a2c0 2024-05-21T13:42:05.741 INFO:teuthology.orchestra.run.smithi022.stderr:pool 'cephfs_data_ec' removed 2024-05-21T13:42:05.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:05.769+0000 7f556b48e640 1 -- 172.21.15.22:0/3473437774 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f554806f400 msgr2=0x7f55480718c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:42:05.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:05.769+0000 7f556b48e640 1 --2- 172.21.15.22:0/3473437774 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f554806f400 0x7f55480718c0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5560009730 tx=0x7f5560006ca0 comp rx=0 tx=0).stop 2024-05-21T13:42:05.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:05.769+0000 7f556b48e640 1 -- 172.21.15.22:0/3473437774 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f556415a2c0 msgr2=0x7f556415c200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-05-21T13:42:05.745 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:05.769+0000 7f556b48e640 1 --2- 172.21.15.22:0/3473437774 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f556415a2c0 0x7f556415c200 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f555c009d90 tx=0x7f555c0196e0 comp rx=0 tx=0).stop 2024-05-21T13:42:05.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:05.769+0000 7f556b48e640 1 -- 172.21.15.22:0/3473437774 shutdown_connections 2024-05-21T13:42:05.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:05.769+0000 7f556b48e640 1 --2- 172.21.15.22:0/3473437774 >> [v2:172.21.15.115:6832/184591771,v1:172.21.15.115:6833/184591771] conn(0x7f554806f400 0x7f55480718c0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:42:05.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:05.769+0000 7f556b48e640 1 --2- 172.21.15.22:0/3473437774 >> [v2:172.21.15.22:3300/0,v1:172.21.15.22:6789/0] conn(0x7f556415a2c0 0x7f556415c200 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:42:05.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:05.769+0000 7f556b48e640 1 --2- 172.21.15.22:0/3473437774 >> [v2:172.21.15.115:3301/0,v1:172.21.15.115:6790/0] conn(0x7f5564159ee0 0x7f556415d0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:42:05.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:05.769+0000 7f556b48e640 1 --2- 172.21.15.22:0/3473437774 >> [v2:172.21.15.115:3300/0,v1:172.21.15.115:6789/0] conn(0x7f5564070320 0x7f5564159080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-05-21T13:42:05.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:05.769+0000 7f556b48e640 1 -- 172.21.15.22:0/3473437774 >> 172.21.15.22:0/3473437774 conn(0x7f556406cc50 msgr2=0x7f5564072f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-05-21T13:42:05.746 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:05.769+0000 7f556b48e640 1 -- 172.21.15.22:0/3473437774 shutdown_connections 2024-05-21T13:42:05.747 INFO:teuthology.orchestra.run.smithi022.stderr:2024-05-21T13:42:05.769+0000 7f556b48e640 1 -- 172.21.15.22:0/3473437774 wait complete. 2024-05-21T13:42:05.774 INFO:teuthology.misc:Shutting down mds daemons... 2024-05-21T13:42:05.775 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-05-21T13:42:05.775 INFO:teuthology.orchestra.run:waiting for 300 2024-05-21T13:42:05.787 INFO:tasks.ceph.mds.a:Stopped 2024-05-21T13:42:05.787 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-05-21T13:42:05.788 INFO:teuthology.orchestra.run:waiting for 300 2024-05-21T13:42:05.845 INFO:tasks.ceph.mds.c:Stopped 2024-05-21T13:42:05.845 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2024-05-21T13:42:05.845 INFO:teuthology.orchestra.run:waiting for 300 2024-05-21T13:42:05.901 INFO:tasks.ceph.mds.e:Stopped 2024-05-21T13:42:05.901 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-05-21T13:42:05.901 INFO:teuthology.orchestra.run:waiting for 300 2024-05-21T13:42:05.914 INFO:tasks.ceph.mds.b:Stopped 2024-05-21T13:42:05.914 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-05-21T13:42:05.914 INFO:teuthology.orchestra.run:waiting for 300 2024-05-21T13:42:05.973 INFO:tasks.ceph.mds.d:Stopped 2024-05-21T13:42:05.973 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2024-05-21T13:42:05.973 INFO:teuthology.orchestra.run:waiting for 300 2024-05-21T13:42:06.028 INFO:tasks.ceph.mds.f:Stopped 2024-05-21T13:42:06.028 INFO:teuthology.misc:Shutting down osd daemons... 2024-05-21T13:42:06.028 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-05-21T13:42:06.028 INFO:teuthology.orchestra.run:waiting for 300 2024-05-21T13:42:06.098 INFO:tasks.ceph.osd.0:Stopped 2024-05-21T13:42:06.099 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-05-21T13:42:06.099 INFO:teuthology.orchestra.run:waiting for 300 2024-05-21T13:42:12.144 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-05-21T13:42:12.200 INFO:tasks.ceph.osd.1:Stopped 2024-05-21T13:42:12.201 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-05-21T13:42:12.201 INFO:teuthology.orchestra.run:waiting for 300 2024-05-21T13:42:12.265 INFO:tasks.ceph.osd.2:Stopped 2024-05-21T13:42:12.266 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-05-21T13:42:12.266 INFO:teuthology.orchestra.run:waiting for 300 2024-05-21T13:42:12.363 INFO:tasks.ceph.osd.3:Stopped 2024-05-21T13:42:12.363 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-05-21T13:42:12.363 INFO:teuthology.orchestra.run:waiting for 300 2024-05-21T13:42:12.437 INFO:tasks.ceph.osd.4:Stopped 2024-05-21T13:42:12.438 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-05-21T13:42:12.438 INFO:teuthology.orchestra.run:waiting for 300 2024-05-21T13:42:17.851 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-05-21T13:42:17.851 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-05-21T13:42:18.540 INFO:tasks.ceph.osd.5:Stopped 2024-05-21T13:42:18.540 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-05-21T13:42:18.540 INFO:teuthology.orchestra.run:waiting for 300 2024-05-21T13:42:18.606 INFO:tasks.ceph.osd.6:Stopped 2024-05-21T13:42:18.606 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-05-21T13:42:18.606 INFO:teuthology.orchestra.run:waiting for 300 2024-05-21T13:42:18.697 INFO:tasks.ceph.osd.7:Stopped 2024-05-21T13:42:18.697 INFO:teuthology.misc:Shutting down mgr daemons... 2024-05-21T13:42:18.697 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-05-21T13:42:18.697 INFO:teuthology.orchestra.run:waiting for 300 2024-05-21T13:42:18.725 INFO:tasks.ceph.mgr.y:Stopped 2024-05-21T13:42:18.725 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-05-21T13:42:18.726 INFO:teuthology.orchestra.run:waiting for 300 2024-05-21T13:42:18.755 INFO:tasks.ceph.mgr.x:Stopped 2024-05-21T13:42:18.755 INFO:teuthology.misc:Shutting down mon daemons... 2024-05-21T13:42:18.755 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-05-21T13:42:18.755 INFO:teuthology.orchestra.run:waiting for 300 2024-05-21T13:42:18.793 INFO:tasks.ceph.mon.a:Stopped 2024-05-21T13:42:18.793 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-05-21T13:42:18.793 INFO:teuthology.orchestra.run:waiting for 300 2024-05-21T13:42:18.817 INFO:tasks.ceph.mon.b:Stopped 2024-05-21T13:42:18.818 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-05-21T13:42:18.818 INFO:teuthology.orchestra.run:waiting for 300 2024-05-21T13:42:18.877 INFO:tasks.ceph.mon.c:Stopped 2024-05-21T13:42:18.877 INFO:tasks.ceph:Checking cluster log for badness... 2024-05-21T13:42:18.878 DEBUG:teuthology.orchestra.run.smithi022:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | head -n 1 2024-05-21T13:42:18.905 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi022.front.sepia.ceph.com 2024-05-21T13:42:18.905 DEBUG:teuthology.orchestra.run.smithi022:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-05-21T13:42:19.271 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi022.front.sepia.ceph.com 2024-05-21T13:42:19.272 DEBUG:teuthology.orchestra.run.smithi022:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-05-21T13:42:19.477 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi022.front.sepia.ceph.com 2024-05-21T13:42:19.477 DEBUG:teuthology.orchestra.run.smithi022:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-05-21T13:42:19.652 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi022.front.sepia.ceph.com 2024-05-21T13:42:19.652 DEBUG:teuthology.orchestra.run.smithi022:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-05-21T13:42:19.845 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi115.front.sepia.ceph.com 2024-05-21T13:42:19.845 DEBUG:teuthology.orchestra.run.smithi115:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-05-21T13:42:20.144 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi115.front.sepia.ceph.com 2024-05-21T13:42:20.144 DEBUG:teuthology.orchestra.run.smithi115:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-05-21T13:42:20.337 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi115.front.sepia.ceph.com 2024-05-21T13:42:20.337 DEBUG:teuthology.orchestra.run.smithi115:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-05-21T13:42:20.504 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi115.front.sepia.ceph.com 2024-05-21T13:42:20.504 DEBUG:teuthology.orchestra.run.smithi115:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-05-21T13:42:20.679 INFO:tasks.ceph:Archiving mon data... 2024-05-21T13:42:20.680 DEBUG:teuthology.misc:Transferring archived files from smithi022:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/leonidus-2024-05-21_13:01:15-fs-wip-lusov-quiesce-overdrive-export-distro-default-smithi/7718504/data/mon.a.tgz 2024-05-21T13:42:20.680 DEBUG:teuthology.orchestra.run.smithi022:> mktemp 2024-05-21T13:42:20.690 INFO:teuthology.orchestra.run.smithi022.stdout:/tmp/tmp.dN6itgb0wv 2024-05-21T13:42:20.691 DEBUG:teuthology.orchestra.run.smithi022:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.dN6itgb0wv 2024-05-21T13:42:20.820 DEBUG:teuthology.orchestra.run.smithi022:> sudo chmod 0666 /tmp/tmp.dN6itgb0wv 2024-05-21T13:42:20.881 DEBUG:teuthology.orchestra.remote:smithi022:/tmp/tmp.dN6itgb0wv is 354KB 2024-05-21T13:42:20.946 DEBUG:teuthology.orchestra.run.smithi022:> rm -fr /tmp/tmp.dN6itgb0wv 2024-05-21T13:42:20.951 DEBUG:teuthology.misc:Transferring archived files from smithi115:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/leonidus-2024-05-21_13:01:15-fs-wip-lusov-quiesce-overdrive-export-distro-default-smithi/7718504/data/mon.b.tgz 2024-05-21T13:42:20.951 DEBUG:teuthology.orchestra.run.smithi115:> mktemp 2024-05-21T13:42:20.957 INFO:teuthology.orchestra.run.smithi115.stdout:/tmp/tmp.QITDk2PLoH 2024-05-21T13:42:20.957 DEBUG:teuthology.orchestra.run.smithi115:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.QITDk2PLoH 2024-05-21T13:42:21.111 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 0666 /tmp/tmp.QITDk2PLoH 2024-05-21T13:42:21.171 DEBUG:teuthology.orchestra.remote:smithi115:/tmp/tmp.QITDk2PLoH is 466KB 2024-05-21T13:42:21.238 DEBUG:teuthology.orchestra.run.smithi115:> rm -fr /tmp/tmp.QITDk2PLoH 2024-05-21T13:42:21.243 DEBUG:teuthology.misc:Transferring archived files from smithi115:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/leonidus-2024-05-21_13:01:15-fs-wip-lusov-quiesce-overdrive-export-distro-default-smithi/7718504/data/mon.c.tgz 2024-05-21T13:42:21.243 DEBUG:teuthology.orchestra.run.smithi115:> mktemp 2024-05-21T13:42:21.288 INFO:teuthology.orchestra.run.smithi115.stdout:/tmp/tmp.NF6HmpfFpW 2024-05-21T13:42:21.288 DEBUG:teuthology.orchestra.run.smithi115:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.NF6HmpfFpW 2024-05-21T13:42:21.444 DEBUG:teuthology.orchestra.run.smithi115:> sudo chmod 0666 /tmp/tmp.NF6HmpfFpW 2024-05-21T13:42:21.508 DEBUG:teuthology.orchestra.remote:smithi115:/tmp/tmp.NF6HmpfFpW is 466KB 2024-05-21T13:42:21.570 DEBUG:teuthology.orchestra.run.smithi115:> rm -fr /tmp/tmp.NF6HmpfFpW 2024-05-21T13:42:21.575 INFO:tasks.ceph:Cleaning ceph cluster... 2024-05-21T13:42:21.575 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-21T13:42:21.578 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-05-21T13:42:21.636 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-21T13:42:21.672 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-05-21T13:42:21.672 INFO:tasks.ceph:Archiving crash dumps... 2024-05-21T13:42:21.674 DEBUG:teuthology.misc:Transferring archived files from smithi022:/var/lib/ceph/crash to /home/teuthworker/archive/leonidus-2024-05-21_13:01:15-fs-wip-lusov-quiesce-overdrive-export-distro-default-smithi/7718504/remote/smithi022/crash 2024-05-21T13:42:21.675 DEBUG:teuthology.orchestra.run.smithi022:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-21T13:42:21.693 DEBUG:teuthology.misc:Transferring archived files from smithi115:/var/lib/ceph/crash to /home/teuthworker/archive/leonidus-2024-05-21_13:01:15-fs-wip-lusov-quiesce-overdrive-export-distro-default-smithi/7718504/remote/smithi115/crash 2024-05-21T13:42:21.694 DEBUG:teuthology.orchestra.run.smithi115:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-05-21T13:42:21.728 INFO:tasks.ceph:Shutting down logrotate 2024-05-21T13:42:21.728 DEBUG:teuthology.orchestra.run.smithi022:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-21T13:42:21.741 DEBUG:teuthology.orchestra.run.smithi115:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-05-21T13:42:21.815 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-21T13:42:21.829 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-05-21T13:42:21.871 INFO:tasks.ceph:Compressing logs... 2024-05-21T13:42:21.871 DEBUG:teuthology.orchestra.run.smithi022:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-21T13:42:21.873 DEBUG:teuthology.orchestra.run.smithi115:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-21T13:42:21.897 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34256.log 2024-05-21T13:42:21.898 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32128.log 2024-05-21T13:42:21.899 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.34256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35144.log 2024-05-21T13:42:21.901 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32024.log 2024-05-21T13:42:21.901 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.32128.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.34256.log.gz 2024-05-21T13:42:21.901 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.35144.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32751.log 2024-05-21T13:42:21.901 INFO:teuthology.orchestra.run.smithi022.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.35144.log.gz 2024-05-21T13:42:21.901 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.32024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35641.log 2024-05-21T13:42:21.901 INFO:teuthology.orchestra.run.smithi022.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.32128.log.gz 2024-05-21T13:42:21.901 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.32751.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-05-21T13:42:21.901 INFO:teuthology.orchestra.run.smithi022.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.32024.log.gz 2024-05-21T13:42:21.902 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.35641.log: gzip -5 --verbose -- 88.0% /var/log/ceph/ceph-client.admin.35615.log -- replaced with /var/log/ceph/ceph-client.admin.32751.log.gz 2024-05-21T13:42:21.902 INFO:teuthology.orchestra.run.smithi022.stderr: 2024-05-21T13:42:21.902 INFO:teuthology.orchestra.run.smithi022.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35641.log.gz 2024-05-21T13:42:21.903 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31333.log 2024-05-21T13:42:21.904 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.35615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31627.log 2024-05-21T13:42:21.904 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.31333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33198.log 2024-05-21T13:42:21.904 INFO:teuthology.orchestra.run.smithi022.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35615.log.gz 2024-05-21T13:42:21.904 INFO:teuthology.orchestra.run.smithi022.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.31333.log.gz 2024-05-21T13:42:21.904 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.31627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34480.log 2024-05-21T13:42:21.904 INFO:teuthology.orchestra.run.smithi022.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.31627.log.gz 2024-05-21T13:42:21.904 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-05-21T13:42:21.904 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.33198.log: /var/log/ceph/ceph-client.admin.34480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32959.log 2024-05-21T13:42:21.904 INFO:teuthology.orchestra.run.smithi022.stderr: 89.2% 88.4% -- replaced with /var/log/ceph/ceph-client.admin.33198.log.gz 2024-05-21T13:42:21.904 INFO:teuthology.orchestra.run.smithi022.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34480.log.gz 2024-05-21T13:42:21.906 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35040.log 2024-05-21T13:42:21.906 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.32959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35196.log 2024-05-21T13:42:21.906 INFO:teuthology.orchestra.run.smithi022.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32959.log.gz 2024-05-21T13:42:21.906 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.35040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35538.log 2024-05-21T13:42:21.906 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.35196.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35040.log.gz 2024-05-21T13:42:21.906 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33771.log 2024-05-21T13:42:21.906 INFO:teuthology.orchestra.run.smithi022.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35196.log.gz 2024-05-21T13:42:21.906 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27531.log 2024-05-21T13:42:21.907 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.35538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32962.log 2024-05-21T13:42:21.908 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.33771.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35538.log.gz 2024-05-21T13:42:21.908 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.27531.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35747.log 2024-05-21T13:42:21.908 INFO:teuthology.orchestra.run.smithi022.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33771.log.gz 2024-05-21T13:42:21.908 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.32962.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.27531.log.gz 2024-05-21T13:42:21.908 INFO:teuthology.orchestra.run.smithi022.stderr: 93.9%gzip -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-05-21T13:42:21.908 INFO:teuthology.orchestra.run.smithi022.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.34172.log 2024-05-21T13:42:21.908 INFO:teuthology.orchestra.run.smithi022.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.32962.log.gz 2024-05-21T13:42:21.908 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.35747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32335.log 2024-05-21T13:42:21.909 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.34172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35248.log 2024-05-21T13:42:21.910 INFO:teuthology.orchestra.run.smithi022.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35747.log.gz 2024-05-21T13:42:21.910 INFO:teuthology.orchestra.run.smithi022.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34172.log.gz 2024-05-21T13:42:21.910 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.32335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34561.log 2024-05-21T13:42:21.910 INFO:teuthology.orchestra.run.smithi022.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32335.log.gz 2024-05-21T13:42:21.910 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.35248.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34946.log 2024-05-21T13:42:21.910 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.34561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32545.log 2024-05-21T13:42:21.910 INFO:teuthology.orchestra.run.smithi022.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.35248.log.gz 2024-05-21T13:42:21.910 INFO:teuthology.orchestra.run.smithi022.stderr: 88.2%/var/log/ceph/ceph-client.admin.34946.log: -- replaced with /var/log/ceph/ceph-client.admin.34561.log.gz 2024-05-21T13:42:21.910 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31601.log 2024-05-21T13:42:21.910 INFO:teuthology.orchestra.run.smithi022.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34946.log.gz 2024-05-21T13:42:21.912 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-05-21T13:42:21.912 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.32545.log: /var/log/ceph/ceph-client.admin.31601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31359.log 2024-05-21T13:42:21.912 INFO:teuthology.orchestra.run.smithi022.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.32545.log.gz 2024-05-21T13:42:21.912 INFO:teuthology.orchestra.run.smithi022.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.31601.log.gz 2024-05-21T13:42:21.913 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35669.log 2024-05-21T13:42:21.913 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34919.log 2024-05-21T13:42:21.913 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.31359.log: /var/log/ceph/ceph-client.admin.35669.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.31359.log.gz 2024-05-21T13:42:21.913 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35430.log 2024-05-21T13:42:21.913 INFO:teuthology.orchestra.run.smithi022.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.35669.log.gz 2024-05-21T13:42:21.913 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34746.log 2024-05-21T13:42:21.913 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.34919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35589.log 2024-05-21T13:42:21.915 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.35430.log: /var/log/ceph/ceph-client.admin.34746.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34919.log.gz 2024-05-21T13:42:21.915 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-05-21T13:42:21.916 INFO:teuthology.orchestra.run.smithi022.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.35430.log.gz 2024-05-21T13:42:21.916 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.35589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32960.log 2024-05-21T13:42:21.916 INFO:teuthology.orchestra.run.smithi022.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.34746.log.gz 2024-05-21T13:42:21.916 INFO:teuthology.orchestra.run.smithi022.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35589.log.gz 2024-05-21T13:42:21.916 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31857.log 2024-05-21T13:42:21.916 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.32960.log: 88.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.32960.log.gz 2024-05-21T13:42:21.916 INFO:teuthology.orchestra.run.smithi022.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.31653.log 2024-05-21T13:42:21.916 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33250.log 2024-05-21T13:42:21.916 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.31857.log: /var/log/ceph/ceph-client.admin.31653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35695.log 2024-05-21T13:42:21.916 INFO:teuthology.orchestra.run.smithi022.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.31653.log.gz 2024-05-21T13:42:21.916 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.33250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31497.log 2024-05-21T13:42:21.920 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.35695.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.33250.log.gz 2024-05-21T13:42:21.920 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35799.log 2024-05-21T13:42:21.921 INFO:teuthology.orchestra.run.smithi022.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35695.log.gz 2024-05-21T13:42:21.921 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32338.log 2024-05-21T13:42:21.921 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.31497.log: gzip -5 --verbose/var/log/ceph/ceph-client.admin.35799.log: -- /var/log/ceph/ceph-client.admin.33667.log 2024-05-21T13:42:21.921 INFO:teuthology.orchestra.run.smithi022.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.31497.log.gz 2024-05-21T13:42:21.921 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.32338.log: 87.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31972.log 2024-05-21T13:42:21.921 INFO:teuthology.orchestra.run.smithi022.stderr: -- replaced with /var/log/ceph/ceph-client.admin.35799.log.gz 2024-05-21T13:42:21.921 INFO:teuthology.orchestra.run.smithi022.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.32338.log.gz 2024-05-21T13:42:21.921 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.33667.log: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.31857.log.gz 2024-05-21T13:42:21.921 INFO:teuthology.orchestra.run.smithi022.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.33667.log.gz 2024-05-21T13:42:21.921 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33378.log 2024-05-21T13:42:21.921 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.31972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35118.log 2024-05-21T13:42:21.921 INFO:teuthology.orchestra.run.smithi022.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.31972.log.gz 2024-05-21T13:42:21.921 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31575.log 2024-05-21T13:42:21.921 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.33378.log: /var/log/ceph/ceph-client.admin.35118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33863.log 2024-05-21T13:42:21.922 INFO:teuthology.orchestra.run.smithi022.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35118.log.gz 2024-05-21T13:42:21.922 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.31575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32542.log 2024-05-21T13:42:21.922 INFO:teuthology.orchestra.run.smithi022.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.31575.log.gz 2024-05-21T13:42:21.922 INFO:teuthology.orchestra.run.smithi022.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.33378.log.gz 2024-05-21T13:42:21.922 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33302.log 2024-05-21T13:42:21.924 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.33863.log: /var/log/ceph/ceph-client.admin.32542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32102.log 2024-05-21T13:42:21.924 INFO:teuthology.orchestra.run.smithi022.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.32542.log.gz 2024-05-21T13:42:21.925 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34665.log 2024-05-21T13:42:21.925 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.33302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35773.log 2024-05-21T13:42:21.925 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.32102.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.33863.log.gz 2024-05-21T13:42:21.925 INFO:teuthology.orchestra.run.smithi022.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.33302.log.gz 2024-05-21T13:42:21.925 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.34665.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.32102.log.gz 2024-05-21T13:42:21.925 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35352.log 2024-05-21T13:42:21.925 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.35773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35014.log 2024-05-21T13:42:21.925 INFO:teuthology.orchestra.run.smithi022.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.34665.log.gz 2024-05-21T13:42:21.925 INFO:teuthology.orchestra.run.smithi022.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.35773.log.gz 2024-05-21T13:42:21.925 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31467.log 2024-05-21T13:42:21.926 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.35352.log: /var/log/ceph/ceph-client.admin.35014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33797.log 2024-05-21T13:42:21.926 INFO:teuthology.orchestra.run.smithi022.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35014.log.gz 2024-05-21T13:42:21.926 INFO:teuthology.orchestra.run.smithi022.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35352.log.gz 2024-05-21T13:42:21.926 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.31467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33276.log 2024-05-21T13:42:21.926 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.33797.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.31467.log.gz 2024-05-21T13:42:21.926 INFO:teuthology.orchestra.run.smithi022.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.33797.log.gz 2024-05-21T13:42:21.926 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35274.log 2024-05-21T13:42:21.929 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31549.log 2024-05-21T13:42:21.929 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.33276.log: /var/log/ceph/ceph-client.admin.35274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33172.log 2024-05-21T13:42:21.929 INFO:teuthology.orchestra.run.smithi022.stderr: 88.1% 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35274.log.gz 2024-05-21T13:42:21.930 INFO:teuthology.orchestra.run.smithi022.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33276.log.gz 2024-05-21T13:42:21.930 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34988.log 2024-05-21T13:42:21.930 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.31549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32743.log 2024-05-21T13:42:21.930 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.33172.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.31549.log.gz 2024-05-21T13:42:21.930 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.34988.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-05-21T13:42:21.930 INFO:teuthology.orchestra.run.smithi022.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33172.log.gz 2024-05-21T13:42:21.930 INFO:teuthology.orchestra.run.smithi022.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34988.log.gz 2024-05-21T13:42:21.930 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.32743.log: /var/log/ceph/ceph-client.admin.34719.log 2024-05-21T13:42:21.930 INFO:teuthology.orchestra.run.smithi022.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32743.log.gz 2024-05-21T13:42:21.930 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27640.log 2024-05-21T13:42:21.930 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32284.log 2024-05-21T13:42:21.930 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.34719.log: /var/log/ceph/ceph-client.admin.27640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32957.log 2024-05-21T13:42:21.930 INFO:teuthology.orchestra.run.smithi022.stderr: 87.8% 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34719.log.gz 2024-05-21T13:42:21.930 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.32284.log: -- replaced with /var/log/ceph/ceph-client.admin.27640.log.gz 2024-05-21T13:42:21.931 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34283.log 2024-05-21T13:42:21.931 INFO:teuthology.orchestra.run.smithi022.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.32284.log.gz 2024-05-21T13:42:21.931 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.32957.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32750.log 2024-05-21T13:42:21.931 INFO:teuthology.orchestra.run.smithi022.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.32957.log.gz 2024-05-21T13:42:21.931 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32726.log 2024-05-21T13:42:21.933 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.34283.log: /var/log/ceph/ceph-client.admin.32750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32936.log 2024-05-21T13:42:21.933 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.32726.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32750.log.gz 2024-05-21T13:42:21.934 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32258.log 2024-05-21T13:42:21.934 INFO:teuthology.orchestra.run.smithi022.stderr: 90.6% -- replaced with /var/log/ceph/ceph-client.admin.34283.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33828.log 2024-05-21T13:42:21.934 INFO:teuthology.orchestra.run.smithi022.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.32726.log.gz 2024-05-21T13:42:21.934 INFO:teuthology.orchestra.run.smithi022.stderr: 2024-05-21T13:42:21.934 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.32936.log: /var/log/ceph/ceph-client.admin.32258.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.32936.log.gz 2024-05-21T13:42:21.934 INFO:teuthology.orchestra.run.smithi022.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.32258.log.gz 2024-05-21T13:42:21.934 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35721.log 2024-05-21T13:42:21.934 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.33828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31220.log 2024-05-21T13:42:21.934 INFO:teuthology.orchestra.run.smithi022.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33828.log.gz 2024-05-21T13:42:21.934 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33913.log 2024-05-21T13:42:21.934 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.35721.log: /var/log/ceph/ceph-client.admin.31220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.33615.log 2024-05-21T13:42:21.934 INFO:teuthology.orchestra.run.smithi022.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35721.log.gz 89.7%/var/log/ceph/ceph-client.admin.33913.log: -- replaced with /var/log/ceph/ceph-client.admin.31220.log.gz 2024-05-21T13:42:21.934 INFO:teuthology.orchestra.run.smithi022.stderr: 2024-05-21T13:42:21.934 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31307.log 2024-05-21T13:42:21.943 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27790.log 2024-05-21T13:42:21.943 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-05-21T13:42:21.943 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-05-21T13:42:21.943 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.27790.log: /var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27838.log 2024-05-21T13:42:21.943 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-05-21T13:42:21.943 INFO:teuthology.orchestra.run.smithi115.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.27790.log.gz 2024-05-21T13:42:21.943 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.27838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27910.log 2024-05-21T13:42:21.943 INFO:teuthology.orchestra.run.smithi115.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.27838.log.gz 2024-05-21T13:42:21.943 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-05-21T13:42:21.944 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.27910.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.f.log 2024-05-21T13:42:21.944 INFO:teuthology.orchestra.run.smithi115.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.27910.log.gz 2024-05-21T13:42:21.944 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-21T13:42:21.944 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27934.log 2024-05-21T13:42:21.944 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-mds.f.log: /var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-05-21T13:42:21.944 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.27934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27862.log 2024-05-21T13:42:21.944 INFO:teuthology.orchestra.run.smithi115.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.27934.log.gz 2024-05-21T13:42:21.944 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-21T13:42:21.944 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.27862.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.27862.log.gz 2024-05-21T13:42:21.944 INFO:teuthology.orchestra.run.smithi115.stderr: 92.3% -- replaced with /var/log/ceph/ceph.log.gz 2024-05-21T13:42:21.944 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-05-21T13:42:21.944 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-05-21T13:42:21.946 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-05-21T13:42:21.946 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.0.33615.log: /var/log/ceph/ceph-client.admin.31307.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.33913.log.gz 2024-05-21T13:42:21.946 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34840.log 2024-05-21T13:42:21.946 INFO:teuthology.orchestra.run.smithi022.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.31307.log.gz/var/log/ceph/ceph-osd.1.log: 2024-05-21T13:42:21.946 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34588.log 2024-05-21T13:42:21.946 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.34840.log: 89.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32535.log 2024-05-21T13:42:21.946 INFO:teuthology.orchestra.run.smithi022.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34840.log.gz 2024-05-21T13:42:21.946 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.34588.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.22722.log 2024-05-21T13:42:21.946 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.32535.log: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.34588.log.gz 2024-05-21T13:42:21.947 INFO:teuthology.orchestra.run.smithi022.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.32535.log.gz 2024-05-21T13:42:21.947 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32332.log 2024-05-21T13:42:21.947 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph.tmp-client.admin.22722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34095.log 2024-05-21T13:42:21.947 INFO:teuthology.orchestra.run.smithi022.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.22722.log.gz 2024-05-21T13:42:21.947 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.32332.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.32332.log.gz 2024-05-21T13:42:21.947 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35482.log 2024-05-21T13:42:21.947 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.34095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31729.log 2024-05-21T13:42:21.947 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.35482.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34095.log.gz 2024-05-21T13:42:21.947 INFO:teuthology.orchestra.run.smithi022.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35482.log.gz 2024-05-21T13:42:21.947 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32206.log 2024-05-21T13:42:21.947 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.31729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33328.log 2024-05-21T13:42:21.947 INFO:teuthology.orchestra.run.smithi022.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.31729.log.gz 2024-05-21T13:42:21.947 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.32206.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32206.log.gz 2024-05-21T13:42:21.948 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35456.log 2024-05-21T13:42:21.948 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.33328.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-05-21T13:42:21.948 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.35456.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35456.log.gz 2024-05-21T13:42:21.948 INFO:teuthology.orchestra.run.smithi022.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.33328.log.gz 2024-05-21T13:42:21.948 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32528.log 2024-05-21T13:42:21.948 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31441.log 2024-05-21T13:42:21.948 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.32528.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.32528.log.gz 2024-05-21T13:42:21.950 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-mds.d.log: 93.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-21T13:42:21.950 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-05-21T13:42:21.952 INFO:teuthology.orchestra.run.smithi022.stderr: 86.2% -- replaced with /var/log/ceph/ceph.log.gz 2024-05-21T13:42:21.952 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35326.log 2024-05-21T13:42:21.952 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.31441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33428.log 2024-05-21T13:42:21.952 INFO:teuthology.orchestra.run.smithi022.stderr: 88.3%/var/log/ceph/ceph-client.admin.35326.log: -- replaced with /var/log/ceph/ceph-client.admin.31441.log.gz 2024-05-21T13:42:21.952 INFO:teuthology.orchestra.run.smithi022.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.35326.log.gz 2024-05-21T13:42:21.952 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32336.log 2024-05-21T13:42:21.952 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.33428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31387.log 2024-05-21T13:42:21.952 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.32336.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32336.log.gz 2024-05-21T13:42:21.952 INFO:teuthology.orchestra.run.smithi022.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.33428.log.gz 2024-05-21T13:42:21.952 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35378.log 2024-05-21T13:42:21.953 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.31387.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33719.log 2024-05-21T13:42:21.953 INFO:teuthology.orchestra.run.smithi022.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.31387.log.gz 2024-05-21T13:42:21.953 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.35378.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35378.log.gz 2024-05-21T13:42:21.953 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32076.log 2024-05-21T13:42:21.953 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.33719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32232.log 2024-05-21T13:42:21.954 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-05-21T13:42:21.956 INFO:teuthology.orchestra.run.smithi022.stderr: 89.0%/var/log/ceph/ceph-client.admin.32076.log: -- replaced with /var/log/ceph/ceph-client.admin.33719.log.gz 2024-05-21T13:42:21.956 INFO:teuthology.orchestra.run.smithi022.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.32076.log.gz 2024-05-21T13:42:21.956 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31128.log 2024-05-21T13:42:21.956 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.32232.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31942.log 2024-05-21T13:42:21.956 INFO:teuthology.orchestra.run.smithi022.stderr: 88.5%/var/log/ceph/ceph-client.admin.31128.log: -- replaced with /var/log/ceph/ceph-client.admin.32232.log.gz 2024-05-21T13:42:21.956 INFO:teuthology.orchestra.run.smithi022.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.31128.log.gz 2024-05-21T13:42:21.956 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35066.log 2024-05-21T13:42:21.956 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.31942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34199.log 2024-05-21T13:42:21.956 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.35066.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.31942.log.gz 2024-05-21T13:42:21.956 INFO:teuthology.orchestra.run.smithi022.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35066.log.gz 2024-05-21T13:42:21.957 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31915.log 2024-05-21T13:42:21.957 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.34199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31184.log 2024-05-21T13:42:21.958 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.31915.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.31915.log.gz 2024-05-21T13:42:21.958 INFO:teuthology.orchestra.run.smithi022.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.34199.log.gz 2024-05-21T13:42:21.958 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31998.log 2024-05-21T13:42:21.959 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34638.log 2024-05-21T13:42:21.959 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.31184.log: /var/log/ceph/ceph-client.admin.31998.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.31184.log.gz 2024-05-21T13:42:21.959 INFO:teuthology.orchestra.run.smithi022.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.31998.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27750.log 2024-05-21T13:42:21.960 INFO:teuthology.orchestra.run.smithi022.stderr: 2024-05-21T13:42:21.960 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.34638.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.34638.log.gz 2024-05-21T13:42:21.961 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33489.log 2024-05-21T13:42:21.961 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.27750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32544.log 2024-05-21T13:42:21.961 INFO:teuthology.orchestra.run.smithi022.stderr: 89.1%/var/log/ceph/ceph-client.admin.33489.log: -- replaced with /var/log/ceph/ceph-client.admin.27750.log.gz 2024-05-21T13:42:21.961 INFO:teuthology.orchestra.run.smithi022.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.33489.log.gz 2024-05-21T13:42:21.962 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32326.log 2024-05-21T13:42:21.962 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.32544.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-05-21T13:42:21.963 INFO:teuthology.orchestra.run.smithi022.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.32544.log.gz 2024-05-21T13:42:21.963 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.32326.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.32326.log.gz 2024-05-21T13:42:21.963 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-05-21T13:42:21.964 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31523.log 2024-05-21T13:42:21.965 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-mds.c.log: 89.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-05-21T13:42:21.965 INFO:teuthology.orchestra.run.smithi022.stderr: 93.4% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-05-21T13:42:21.966 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-05-21T13:42:21.967 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.31523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33745.log 2024-05-21T13:42:21.967 INFO:teuthology.orchestra.run.smithi022.stderr: 89.3%/var/log/ceph/ceph-mds.a.log: -- replaced with /var/log/ceph/ceph-client.admin.31523.log.gz 2024-05-21T13:42:21.968 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33693.log 2024-05-21T13:42:21.969 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.33745.log: 93.5% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-05-21T13:42:21.969 INFO:teuthology.orchestra.run.smithi022.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.33745.log.gz 2024-05-21T13:42:21.969 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33224.log 2024-05-21T13:42:21.970 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.33693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35404.log 2024-05-21T13:42:21.970 INFO:teuthology.orchestra.run.smithi022.stderr: 88.4%/var/log/ceph/ceph-client.admin.33224.log: -- replaced with /var/log/ceph/ceph-client.admin.33693.log.gz 2024-05-21T13:42:21.970 INFO:teuthology.orchestra.run.smithi022.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.33224.log.gz 2024-05-21T13:42:21.970 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31679.log 2024-05-21T13:42:21.971 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.35404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34867.log 2024-05-21T13:42:21.971 INFO:teuthology.orchestra.run.smithi022.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35404.log.gz 2024-05-21T13:42:21.972 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.31679.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.31679.log.gz 2024-05-21T13:42:21.972 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32546.log 2024-05-21T13:42:21.973 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.34867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34508.log 2024-05-21T13:42:21.973 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.32546.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.32546.log.gz 2024-05-21T13:42:21.974 INFO:teuthology.orchestra.run.smithi022.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.34867.log.gz 2024-05-21T13:42:21.974 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32749.log 2024-05-21T13:42:21.975 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.34508.log: 90.5% -- replaced with /var/log/ceph/ceph-client.admin.34508.log.gz 2024-05-21T13:42:21.975 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34045.log 2024-05-21T13:42:21.976 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27886.log 2024-05-21T13:42:21.976 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.32749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32050.log 2024-05-21T13:42:21.976 INFO:teuthology.orchestra.run.smithi022.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.32749.log.gz 2024-05-21T13:42:21.977 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.34045.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.34045.log.gz 2024-05-21T13:42:21.977 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32154.log 2024-05-21T13:42:21.978 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.32050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32753.log 2024-05-21T13:42:21.978 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.32154.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.32050.log.gz 2024-05-21T13:42:21.978 INFO:teuthology.orchestra.run.smithi022.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32154.log.gz 2024-05-21T13:42:21.979 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32180.log 2024-05-21T13:42:21.980 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.32753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32331.log 2024-05-21T13:42:21.980 INFO:teuthology.orchestra.run.smithi022.stderr: 88.8%/var/log/ceph/ceph-client.admin.32180.log: -- replaced with /var/log/ceph/ceph-client.admin.32753.log.gz 2024-05-21T13:42:21.980 INFO:teuthology.orchestra.run.smithi022.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.32180.log.gz 2024-05-21T13:42:21.982 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-osd.4.log: 92.6% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-05-21T13:42:21.982 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27814.log 2024-05-21T13:42:21.982 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.27886.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.27886.log.gz 2024-05-21T13:42:21.982 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35222.log 2024-05-21T13:42:21.982 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.32331.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32541.log 2024-05-21T13:42:21.982 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.35222.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.32331.log.gz 2024-05-21T13:42:21.982 INFO:teuthology.orchestra.run.smithi022.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35222.log.gz 2024-05-21T13:42:21.982 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32752.log 2024-05-21T13:42:21.984 INFO:teuthology.orchestra.run.smithi115.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27766.log 2024-05-21T13:42:21.984 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.27814.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.27814.log.gz 2024-05-21T13:42:21.985 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.32541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35508.log 2024-05-21T13:42:21.985 INFO:teuthology.orchestra.run.smithi022.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.32541.log.gz 2024-05-21T13:42:21.985 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.32752.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32752.log.gz 2024-05-21T13:42:21.985 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32940.log 2024-05-21T13:42:21.985 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.35508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32754.log 2024-05-21T13:42:21.985 INFO:teuthology.orchestra.run.smithi022.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35508.log.gz 2024-05-21T13:42:21.986 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.32940.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32940.log.gz 2024-05-21T13:42:21.986 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34018.log 2024-05-21T13:42:21.986 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.32754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33146.log 2024-05-21T13:42:21.987 INFO:teuthology.orchestra.run.smithi115.stderr:/var/log/ceph/ceph-client.admin.27766.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.27766.log.gz 2024-05-21T13:42:21.988 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.34018.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.32754.log.gz 2024-05-21T13:42:21.988 INFO:teuthology.orchestra.run.smithi022.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34018.log.gz 2024-05-21T13:42:21.988 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34122.log 2024-05-21T13:42:21.988 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.33146.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.e.log 2024-05-21T13:42:21.988 INFO:teuthology.orchestra.run.smithi022.stderr: 89.1%/var/log/ceph/ceph-client.admin.34122.log: -- replaced with /var/log/ceph/ceph-client.admin.33146.log.gz 2024-05-21T13:42:21.988 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32318.log 2024-05-21T13:42:21.988 INFO:teuthology.orchestra.run.smithi022.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.34122.log.gz 2024-05-21T13:42:21.989 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-mds.e.log: 93.5% -- replaced with /var/log/ceph/ceph-mds.e.log.gz 2024-05-21T13:42:21.989 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35170.log 2024-05-21T13:42:21.990 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.32318.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31415.log 2024-05-21T13:42:21.991 INFO:teuthology.orchestra.run.smithi022.stderr: 87.8%/var/log/ceph/ceph-client.admin.35170.log: -- replaced with /var/log/ceph/ceph-client.admin.32318.log.gz 2024-05-21T13:42:21.991 INFO:teuthology.orchestra.run.smithi022.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35170.log.gz 2024-05-21T13:42:21.992 INFO:teuthology.orchestra.run.smithi115.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-05-21T13:42:21.992 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32963.log 2024-05-21T13:42:21.993 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.31415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33963.log 2024-05-21T13:42:21.993 INFO:teuthology.orchestra.run.smithi022.stderr: 89.0%/var/log/ceph/ceph-client.admin.32963.log: -- replaced with /var/log/ceph/ceph-client.admin.31415.log.gz 2024-05-21T13:42:21.993 INFO:teuthology.orchestra.run.smithi022.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.32963.log.gz 2024-05-21T13:42:21.993 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32337.log 2024-05-21T13:42:21.993 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.33963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32539.log 2024-05-21T13:42:21.994 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.32337.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.32337.log.gz 2024-05-21T13:42:21.994 INFO:teuthology.orchestra.run.smithi022.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.33963.log.gz 2024-05-21T13:42:21.994 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35565.log 2024-05-21T13:42:21.994 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32964.log 2024-05-21T13:42:21.995 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.32539.log: /var/log/ceph/ceph-client.admin.35565.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.32539.log.gz 2024-05-21T13:42:21.996 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35300.log 2024-05-21T13:42:21.996 INFO:teuthology.orchestra.run.smithi022.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.35565.log.gz 2024-05-21T13:42:21.996 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.32964.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32964.log.gz 2024-05-21T13:42:21.996 INFO:teuthology.orchestra.run.smithi022.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35092.log 2024-05-21T13:42:21.997 INFO:teuthology.orchestra.run.smithi022.stderr:/var/log/ceph/ceph-client.admin.35300.log: /var/log/ceph/ceph-client.admin.35092.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35300.log.gz 2024-05-21T13:42:21.997 INFO:teuthology.orchestra.run.smithi022.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35092.log.gz 2024-05-21T13:42:22.020 INFO:teuthology.orchestra.run.smithi115.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-05-21T13:42:22.117 INFO:teuthology.orchestra.run.smithi115.stderr: 92.2% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-05-21T13:42:22.133 INFO:teuthology.orchestra.run.smithi115.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-05-21T13:42:22.146 INFO:teuthology.orchestra.run.smithi115.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mds.f.log.gz 2024-05-21T13:42:22.340 INFO:teuthology.orchestra.run.smithi022.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-05-21T13:42:22.852 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-05-21T13:42:26.954 INFO:teuthology.orchestra.run.smithi022.stderr: 92.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-05-21T13:42:28.514 INFO:teuthology.orchestra.run.smithi115.stderr: 92.9% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-05-21T13:42:28.576 INFO:teuthology.orchestra.run.smithi115.stderr: 92.9% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-05-21T13:42:29.190 INFO:teuthology.orchestra.run.smithi115.stderr: 92.9% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-05-21T13:42:29.326 INFO:teuthology.orchestra.run.smithi115.stderr: 92.9% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-05-21T13:42:29.327 INFO:teuthology.orchestra.run.smithi115.stderr: 2024-05-21T13:42:29.327 INFO:teuthology.orchestra.run.smithi115.stderr:real 0m7.410s 2024-05-21T13:42:29.327 INFO:teuthology.orchestra.run.smithi115.stderr:user 0m27.621s 2024-05-21T13:42:29.327 INFO:teuthology.orchestra.run.smithi115.stderr:sys 0m0.910s 2024-05-21T13:42:29.648 INFO:teuthology.orchestra.run.smithi022.stderr: 92.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-05-21T13:42:30.090 INFO:teuthology.orchestra.run.smithi022.stderr: 92.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-05-21T13:42:30.153 INFO:teuthology.orchestra.run.smithi022.stderr: 92.9% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-05-21T13:42:31.460 INFO:teuthology.orchestra.run.smithi022.stderr: 96.9% -- replaced with /var/log/ceph/ceph-client.0.33615.log.gz 2024-05-21T13:42:31.461 INFO:teuthology.orchestra.run.smithi022.stderr: 2024-05-21T13:42:31.462 INFO:teuthology.orchestra.run.smithi022.stderr:real 0m9.586s 2024-05-21T13:42:31.462 INFO:teuthology.orchestra.run.smithi022.stderr:user 0m38.017s 2024-05-21T13:42:31.462 INFO:teuthology.orchestra.run.smithi022.stderr:sys 0m1.341s 2024-05-21T13:42:31.463 INFO:tasks.ceph:Archiving logs... 2024-05-21T13:42:31.463 DEBUG:teuthology.misc:Transferring archived files from smithi022:/var/log/ceph to /home/teuthworker/archive/leonidus-2024-05-21_13:01:15-fs-wip-lusov-quiesce-overdrive-export-distro-default-smithi/7718504/remote/smithi022/log 2024-05-21T13:42:31.464 DEBUG:teuthology.orchestra.run.smithi022:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-21T13:42:35.746 DEBUG:teuthology.misc:Transferring archived files from smithi115:/var/log/ceph to /home/teuthworker/archive/leonidus-2024-05-21_13:01:15-fs-wip-lusov-quiesce-overdrive-export-distro-default-smithi/7718504/remote/smithi115/log 2024-05-21T13:42:35.747 DEBUG:teuthology.orchestra.run.smithi115:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-21T13:42:39.439 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-05-21T13:42:39.449 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-05-21T13:42:39.450 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-21T13:42:39.452 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-05-21T13:42:39.524 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-21T13:42:39.533 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-21T13:42:39.534 DEBUG:teuthology.orchestra.run.smithi022:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-21T13:42:39.536 DEBUG:teuthology.orchestra.run.smithi115:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-21T13:42:39.546 INFO:teuthology.orchestra.run.smithi022.stdout: remote refid st t when poll reach delay offset jitter 2024-05-21T13:42:39.546 INFO:teuthology.orchestra.run.smithi022.stdout:============================================================================== 2024-05-21T13:42:39.546 INFO:teuthology.orchestra.run.smithi022.stdout:+hv01.front.sepi 67.205.162.81 3 u 25 64 377 0.115 -5.314 1.314 2024-05-21T13:42:39.546 INFO:teuthology.orchestra.run.smithi022.stdout:+hv02.front.sepi 63.231.80.2 3 u 30 64 377 0.074 +0.846 1.225 2024-05-21T13:42:39.546 INFO:teuthology.orchestra.run.smithi022.stdout:*hv03.front.sepi 74.6.168.72 3 u 34 64 377 0.061 +0.380 0.730 2024-05-21T13:42:39.546 INFO:teuthology.orchestra.run.smithi022.stdout: hv04.front.sepi .INIT. 16 u - 128 0 0.000 +0.000 0.000 2024-05-21T13:42:39.548 INFO:teuthology.orchestra.run.smithi115.stdout: remote refid st t when poll reach delay offset jitter 2024-05-21T13:42:39.548 INFO:teuthology.orchestra.run.smithi115.stdout:============================================================================== 2024-05-21T13:42:39.548 INFO:teuthology.orchestra.run.smithi115.stdout:+hv01.front.sepi 67.205.162.81 3 u 27 64 377 0.081 -6.054 1.379 2024-05-21T13:42:39.548 INFO:teuthology.orchestra.run.smithi115.stdout:+hv02.front.sepi 63.231.80.2 3 u 33 64 377 0.076 +0.112 1.316 2024-05-21T13:42:39.548 INFO:teuthology.orchestra.run.smithi115.stdout:*hv03.front.sepi 74.6.168.72 3 u 34 64 377 0.104 +0.062 1.240 2024-05-21T13:42:39.548 INFO:teuthology.orchestra.run.smithi115.stdout: hv04.front.sepi .INIT. 16 u - 128 0 0.000 +0.000 0.000 2024-05-21T13:42:39.549 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-21T13:42:39.558 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-21T13:42:39.559 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-21T13:42:39.568 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-21T13:42:39.576 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-21T13:42:39.585 INFO:teuthology.task.internal:Duration was 1059.166261 seconds 2024-05-21T13:42:39.586 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-21T13:42:39.595 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-21T13:42:39.595 DEBUG:teuthology.orchestra.run.smithi022:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-21T13:42:39.597 DEBUG:teuthology.orchestra.run.smithi115:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-21T13:42:39.635 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-21T13:42:39.635 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi022.front.sepia.ceph.com 2024-05-21T13:42:39.635 DEBUG:teuthology.orchestra.run.smithi022:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-21T13:42:39.685 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi115.front.sepia.ceph.com 2024-05-21T13:42:39.685 DEBUG:teuthology.orchestra.run.smithi115:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-21T13:42:39.695 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-21T13:42:39.695 DEBUG:teuthology.orchestra.run.smithi022:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-21T13:42:39.729 DEBUG:teuthology.orchestra.run.smithi115:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-21T13:42:39.764 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-21T13:42:39.765 DEBUG:teuthology.orchestra.run.smithi022:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-21T13:42:39.801 DEBUG:teuthology.orchestra.run.smithi115:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-21T13:42:39.864 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-21T13:42:39.875 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-21T13:42:39.875 DEBUG:teuthology.orchestra.run.smithi022:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-21T13:42:39.887 DEBUG:teuthology.orchestra.run.smithi115:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-21T13:42:39.898 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-21T13:42:39.908 DEBUG:teuthology.orchestra.run.smithi022:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-21T13:42:39.933 DEBUG:teuthology.orchestra.run.smithi115:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-21T13:42:39.940 INFO:teuthology.orchestra.run.smithi022.stdout:kernel.core_pattern = core 2024-05-21T13:42:39.954 INFO:teuthology.orchestra.run.smithi115.stdout:kernel.core_pattern = core 2024-05-21T13:42:40.051 DEBUG:teuthology.orchestra.run.smithi022:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-21T13:42:40.056 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-21T13:42:40.057 DEBUG:teuthology.orchestra.run.smithi115:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-21T13:42:40.096 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-21T13:42:40.096 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-21T13:42:40.106 INFO:teuthology.task.internal:Transferring archived files... 2024-05-21T13:42:40.107 DEBUG:teuthology.misc:Transferring archived files from smithi022:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/leonidus-2024-05-21_13:01:15-fs-wip-lusov-quiesce-overdrive-export-distro-default-smithi/7718504/remote/smithi022 2024-05-21T13:42:40.108 DEBUG:teuthology.orchestra.run.smithi022:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-21T13:42:40.130 DEBUG:teuthology.misc:Transferring archived files from smithi115:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/leonidus-2024-05-21_13:01:15-fs-wip-lusov-quiesce-overdrive-export-distro-default-smithi/7718504/remote/smithi115 2024-05-21T13:42:40.130 DEBUG:teuthology.orchestra.run.smithi115:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-21T13:42:40.160 INFO:teuthology.task.internal:Removing archive directory... 2024-05-21T13:42:40.160 DEBUG:teuthology.orchestra.run.smithi022:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-21T13:42:40.173 DEBUG:teuthology.orchestra.run.smithi115:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-21T13:42:40.204 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-21T13:42:40.215 INFO:teuthology.task.internal:Not uploading archives. 2024-05-21T13:42:40.215 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-21T13:42:40.225 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-21T13:42:40.225 DEBUG:teuthology.orchestra.run.smithi022:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-21T13:42:40.227 DEBUG:teuthology.orchestra.run.smithi115:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-21T13:42:40.231 INFO:teuthology.orchestra.run.smithi022.stdout: 658642 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 21 13:42 /home/ubuntu/cephtest 2024-05-21T13:42:40.252 INFO:teuthology.orchestra.run.smithi115.stdout: 655429 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 21 13:42 /home/ubuntu/cephtest 2024-05-21T13:42:40.254 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-21T13:42:40.264 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-21T13:42:40.301 INFO:teuthology.run:Summary data: description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-comp-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/3 tasks/{1-thrash/with-quiesce 2-workunit/suites/iozone}} duration: 1059.166260957718 flavor: default owner: scheduled_leonidus@teuthology success: true 2024-05-21T13:42:40.301 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-21T13:42:40.379 INFO:teuthology.run:pass